rich nest
"2024-03-12T08:39:43.053682465Z /usr/bin/python3: Error while finding module specification for 'vllm.entrypoints.openai.api_server' (ModuleNotFoundError: No module named 'vllm')"
i always run this in A6000, but it is getting error, why this is happening??
polar agateBOT
main bloom
Impossible to say since you don't mention a template or anything.
rich nest
it's my custom template, which i'm using same for months
system logs
container logs:-
@main bloom please help me out, i have a demo.
n i'm using pod
main bloom
Looks like a problem with the docker image.
rich nest
but the same is working from last month
in between i got the same error, but trying after sometime, it was working fine.
main bloom
You shouldn't use latest tag, you should contact the devs of the Docker image, its not a RunPod issue and nothing RunPod can do about it. Or alternatively, build your own Docker image so that you are not at the mercy of someone else.
rich nest
ok let me try once
Now i tried again on new pod on the A 6000 GPU, it is working fine , So how can you say that this is the problem in docker image, may be problem is in the gpu,
flat flax
It's happening cause that docker image uses /workspace as work dir
rich nest
ok, so what should i use?
rich nest
it is in my workspace
flat flax
aka change /workspace to something else
example /workspace2 and in startup command change download dir to /workspace2
rich nest
okay got it, will try the same.
Thank you for your time
