flint edge
I was searching for the good cheap miniPC setup to be used for running local LLMs with eGPUs.
- I've chosen this setup : https://pcpartpicker.com/b/nCFgXL
- When choosing this setup, my priorities were: silence of the PC overall , while being miniPC sizing; powerfull enough for running LLM via the eGPU; possibility to connect fast NVMe Gen5 storage (used for LLM data read/write); relatively cheap.
- What I also like from ASRock MOBOs is BIOS, which provides the good fan curve CPU fans configuration, which is not the case for minisforum (Just before this setup I've tried MS-A1, and the level of noise from the default fan was breaker for me, as well as no good fan tuning available in that BIOS. I've seen there were some 3D printed projects to add aftermarker CPU fan to MS-A1, but that is a lot of extra work to do).
- Configured the main CPU Fan to be at 30% Fan Duty for 55-70 degree, then 45% for 70-85 and max at 90 degrees.
- As the result: it idles at 52-57 degrees, while CPU fan is 900-1000 RPM (my room temp is 23-25 celsius). These RPMs (1000-1200 at max) are perfect for me personally, in terms of noise level for this kind of CPU + cooler.
- Given the default x600/USB4 does not have Oculink, and given it has two M.2 NVMe slots: top PCIe Gen 5 and bottom PCIe Gen 4 (Not counting wifi-specific M.2 slot, as that was a bit slow), I decided to connect the Oculink right into it, and use the top M.2 for the fast NVMe, which would be used for the LLMs.
- To achieve that task, given the fact there was no extra cutouts, I've modded the stock frame and the case to accomodate the Oculink adapter.
- Overall, I'm satisfied with the level of silence and performance of this miniPC. For me it's better setup than MS-A1, which I've been considering just before this setup, but returned.
junior phoenix