New at-home AI server!

[subtle grove]

Built my first PC in like 9 years. My how things have changed. Took me like a week due to limited Dad hours. Also took a lot of YouTube watching and reading, but it was able to post on the first try!

Dual 4090s so I can run larger AI models, or multiple smaller ones through ollama. Planning to integrate it with home assistant, but right now just playing around with AI and stable diffusion to start.

I based it off of Network Chucks “run AI at home” build, but swapped some things after some research. Didn’t like how he had the rad for one of the cards at the bottom - so instead went air cooled for the CPU and put one rad on the side, and one up top.

The Lian Li Evo XL is an amazing piece of engineering. Amazing and fun to work with, kinda sad to see it finished. I may rip all the cables out and redo them just for fun.

The colors, duke! The colors!

https://pcpartpicker.com/list/QPNNfy

And here is the video inspiration.

https://youtu.be/Wjrdr0NU4Sk?feature=shared

I did get Nix up and running, and ollama as a service, but didn’t see it using both graphics cards. Thought something was off so I installed PopOS. Then I realized that I was only pulling down the 8gb models, so it never exceeded the 24 VRAM to spill into the second card. 🤦‍♂️ May jump back into Nix in a week or two, for now I’m just happy I get to play around with it and feel it out.

[warm slate]

You must have a lot of LLM needs to build a machine like that 😲