#Comprehensive guide to hardware for AI

1 messages · Page 1 of 1 (latest)

light burrow
#

I'm trying to explore what hardware combinations make up for the best performance of various AI models but so far I didn't manage to find a proper and comprehensive guide on that.

glass socket
light burrow
# glass socket list the things you want to do

right now I want to assemble a pc optimized for Deepseek and kimi as much as possible but my higher goal is general understanding of what hardware combinations for each price range would work for which of the most popular models and why

glass socket
#

kimi q4 requires 600GB VRAM

#

kimi k2 instruct gguf that is

light burrow
# glass socket kimi q4 requires 600GB VRAM

yeah but I mean sure there must be some resources comparing let's say the performance and price of particular RAM or unified memory builds vs full VRAM ones or examining the influence of offloading

glass socket
#

so if you got $150K you can run Q4 quant

light burrow
#

I ain't got no 150k for sure, I'm looking for researching budget builds like sysram based or mixed