#Trouble with Pod HTTP Service Port

8 messages · Page 1 of 1 (latest)

night hornet
#

First time user of runpod.io.

Went through the steps of creating a Pod, used TheBloke Local LLMs One-Click UI

When I click on "Connect" I am not able to connect to the HTTP Service Port. It reads "Not Ready".

How do I solve this issue? Thanks!

slate stumpBOT
#

To help others find answers, you can mark your question as solved via Right click solution message -> Apps -> ✅ Mark Solution

scarlet mortar
#

Try other templates or ui's

night hornet
#

What TheBloke Local LLMs would be supported? Is their a list somewhere?

left pawn
#

None, he doesn't maintain it anymore so they are all broken

#

You can try this one instead

night hornet
#

OK, I will give this Template a try.

Most of the videos / tutorials i've watched have shown loading a model through the Interface.

Is their any good beginner tutorial you would recommend for loading models / parameters using the recommended template?

Thanks,