GPU rec? | Linus Tech Tips | Page 1

amber citrus Sep 29, 2025, 6:00 PM

#

Hey freaks

I need a GPU for inference/fine-tuning and general NN training. Looking at the nvidia pro/tesla models. Budget is under 3k USD. Current choice is L4/A40. What are we thinking and are there any better picks?

gritty shuttle Sep 29, 2025, 6:38 PM

#

Your priority vram?

amber citrus Sep 29, 2025, 6:38 PM

#

My priority is overall performance and vram

gritty shuttle Sep 29, 2025, 6:38 PM

#

Well an a40 is above your budget isn’t it?

#

Wait both will be

amber citrus Sep 29, 2025, 6:39 PM

#

It can be arranged lol

#

My current pick is L4

gritty shuttle Sep 29, 2025, 6:40 PM

#

Otherwise realistically under 3k you’re buying 2x ada 4000s?

#

I’m not great with this stuff but from what I know you don’t have much choice when it comes to bang for buck

amber citrus Sep 29, 2025, 6:41 PM

#

Well
Money can be arranged

gritty shuttle Sep 29, 2025, 6:42 PM

#

If that’s the case you’re good on your own buddy

#

You know what you need and want

amber citrus Sep 29, 2025, 6:43 PM

#

I have 0 idea about modern GPUs

amber citrus Sep 29, 2025, 6:43 PM

#

gritty shuttle Otherwise realistically under 3k you’re buying 2x ada 4000s?

4000 have video outputs and dual gpu configuration gets increasingly too expensive for server setup

#

Hey, I appreciate the input!

#

I’ve checked the 4000 honestly not a bad choice

#

Double 4000s would go past L4 in both memory and performance

#

Any other options?

gritty shuttle Sep 29, 2025, 6:53 PM

#

None I know of in that price bracket that would do what you want it to with no issues

#GPU rec?