Web terminal keeps closing connection for no reason | Runpod | Page 1

sterile violet Apr 10, 2024, 10:18 PM

#

I have an on demand GPU pod deployed and I'm running a shell script that's training a model through the web terminal. Systematically, every roughly 1h40m, the web terminal dies with the message "Connection closed", for seemingly no reason. This is very frustrating as I'm paying for on-demand specifically because I want to be able to leave it training for a long period unattended. What can be done to fix this?

austere crowBOT Apr 10, 2024, 10:18 PM

#

To help others find answers, you can mark your question as solved via Right click solution message -> Apps -> ✅ Mark Solution

minor dragon Apr 10, 2024, 10:22 PM

#

Check your container logs, is the pod constantly restarting?

sterile violet Apr 10, 2024, 10:33 PM

#

Doesn't seem like it

dusk lotus Apr 10, 2024, 10:40 PM

#

pro tip do not use web terminal

sterile violet Apr 10, 2024, 10:42 PM

#

dusk lotus pro tip do not use web terminal

What is the better solution?

dusk lotus Apr 10, 2024, 10:56 PM

#

Ssh proxy, true ssh or use terminal in Jupiter

sterile violet Apr 10, 2024, 10:57 PM

#

Right, I saw a several people reporting issues with SSH connections crapping out so I wanted to try another way

#

also jupyter notebook ran out of memory

dusk lotus Apr 10, 2024, 10:59 PM

#

Pro tip if you want more stable ssh session use tmux so even if ssh disconnect it will keep things running

sterile violet Apr 10, 2024, 11:00 PM

#

thanks for that

#

do you work for runpod?

sterile violet Apr 10, 2024, 11:09 PM

#

dusk lotus Pro tip if you want more stable ssh session use tmux so even if ssh disconnect i...

Also to make sure I understand correctly, I tmux on my computer or once I'm connected to the pod? Because when I'm connected with ssh I get "bash: tmux: command not found"

#Web terminal keeps closing connection for no reason