west garnet
I might be missing something obvious, but: in the new RunPod Pods > Deploy UI, after selecting a GPU config, how do I pick a template other than the default?
RunPod Pytorch 2.2.10
runpod/pytorch:2.2.0-py3.10-cuda12.1.1-devel-ubuntu22.04
There used to be a way to search for other provided templates, but I can't figure out how to do that in the new UI.
Thanks!
Huh… so, I'd selected H100 80GB SXM5 as the GPU config when I posted the message above. I just spotted that if I select (say) L40 or A40 instead, I see a "change template" option that isn't visible with the H100 config. Are alternate templates not available for H100 GPUs now?
real sand
I believe its because torch is compiled specifically for H100.
west garnet
Ah, I see. Thank you!
unique flare
Not that I'm an expert, but I think its an error. I used to be able to run other templates on the H100. And then for a chunk of today no non-torch templates were loading at all for any GPU's. Now it looks like they have fixed it for most, just not the H100 yet [unless this is now a deliberate change]
static verge
you should be able to change templates on h100s now
unique flare
Ideal. Thanks 🙂
vivid fable
Hi, it seems that i have a problem with the templates too.
Whenever i pick a template, let's say Koboldccp official, all arguments inside are completely blank, which defeats the purpose of a template.
Is there anything i could to to fix it? New ui seems to have broken it.
real sand
Hi, it seems that i have a problem with the templates too.
Whenever i pick a tem...
Ask @bitter mica if he knows about this.
bitter mica
I have heard of this yes
vivid fable
Ask <@128643751689060352> if he knows about this.
I've already talked with him
bitter mica
But its a runpod bug, I don't know whats causing it
vivid fable
i will just go around and run pytorch instead and apply the notebook
bitter mica
It happens before my template is even running
real sand
Probably similar issue to volume disk setting getting lost
vivid fable
New ui requires us to pick a GPU and THEN pick the template, so the link wtih official kobold ccp is non-functional, but there's an additional bug that makes all values in the config blank
real sand
Koboldcpp has no volume disk so thats normal
yeah but other templates had issues with it being lost, so I think the issue may be related
bitter mica
New ui requires us to pick a GPU and THEN pick the template, so the link wtih of...
If I do it on my end I can pick the GPU and the Koboldcpp template will be prefilled with the correct values
Thats why its hard for me to know how to help others with it being blank
static verge
Hi, it seems that i have a problem with the templates too.
Whenever i pick a tem...
a fix for this issue was deployed earlier, are you still seeing it now?
real sand
Looks like its working for me:
vivid fable
if i could stream it it would be easy for you to see, but the moment i pick a template, and attempt to change the values, everything is blank
static verge
New ui requires us to pick a GPU and THEN pick the template, so the link wtih of...
there was a hotfix for the former issue as well
static verge
if i could stream it it would be easy for you to see, but the moment i pick a te...
when was the last time you attempted this?
vivid fable
5 minutes ago, and now i feel like a moron because it just got fixed
you guys are the best
static verge
no worries, the feedback is helpful
vivid fable
Praise the Omnissaiah. 🙌