Any plans to update the vllm image worker? I would like to test Phi 3 and Llama 3.1, currently both are unsupported with the current image. (serverless)
upper mirage
Any plans to update the vllm image worker? I would like to test Phi 3 and Llama 3.1, currently both are unsupported with the current image. (serverless)
zenith obsidian
Gemma2 also doesn't seem to be supported
jagged sinew
Target: these weeks, some runpod staff said.. but he can't guarantee when exactly