Model initialization failed: CUDA driver initialization failed, you might not have a CUDA gpu. | Runpod | Page 1

restive flint Aug 20, 2025, 12:01 PM

#

Getting this error few times while loading a model that runs on gpu/torch, then the model proceeds to get loaded on CPU.
Even tho most of the times the model loads and runs fine on GPU.

frigid novaBOT Aug 20, 2025, 12:01 PM

#

To help others find answers, you can mark your question as solved via Right click solution message -> Apps -> ✅ Mark Solution

frozen domeBOT Aug 21, 2025, 9:23 AM

#

restive flint Getting this error few times while loading a model that runs on gpu/torch, then ...

@restive flint

Escalated To Zendesk

The thread has been escalated to Zendesk!

oblique onyx Aug 21, 2025, 9:24 AM

#

try to give support the worker id / endpoint id

restive flint Aug 21, 2025, 10:42 AM

#

okkay will do

#Model initialization failed: CUDA driver initialization failed, you might not have a CUDA gpu.