#RunPod File Uploader

71 messages · Page 1 of 1 (latest)

outer ivy
#

RunPod File Uploader is a cutting-edge web interface that simplifies the process of uploading files to RunPod pods. Leveraging the power of tusd for reliable file transfers, it supports multi-file uploads, as well as pause and resume capabilities, ensuring a robust and user-friendly file management experience.

Demo video: https://peer.madiator.cloud/videos/embed/20267134-6738-4c06-81d7-dc44e26857d3

Repo Link: https://github.com/kodxana/RunPod-FilleUploader

Note: Expose port 2999 HTTP to get it to work.

ui.png
outer ivy
#

@nocturne flame fell free to test it out

nocturne flame
# outer ivy <@235238279908163585> fell free to test it out

I think this is super cool. Just tested it out. I think the other thing if it was me would be to combine it with the OhMyRunpod repository, so that I can get an SSH password setup. Then maybe a tab I can click on a file, and it gives me the SCP command to download ~ but that is just a future feature request xD / my brain haha.

#

Or maybe using croc lol to have a button, start croc transfer~! lol

#

But either way ❤️ I love it. Im definitely adding this to my stuff in the future cause it makes that part of file uploading so much easier

vast glen
#

Just used it. Seems to be working. 10gb worth of files will take 15+ min to upload though. Maybe that is because of the time of day.

outer ivy
#

Or your internet speed

#

By the way you can pause resume uploads

outer ivy
#

New update is out:

image.png
indigo geyser
#

@outer ivy how do I run this? I ran the install script but when I run /usr/local/bin/runpod-uploader it listens on port 8080 and not port 2999

#

Oh never mind, I see it binds to port 8080 as well as 2999, apologies.

indigo geyser
#

By the way @outer ivy , there is a typo in your repo name. Fille has 2 x l.

outer ivy
#

@indigo geyser np
are you trying to integrate it into template or just testing?

#

btw runpod-uploader is installing as system app so you can call it without full path

indigo geyser
outer ivy
indigo geyser
outer ivy
#

My script is fixing names of uploaded files after upload is finished as normal they saved as bas64 hash and info file.

indigo geyser
#

Oh thats pretty cool

outer ivy
#

My fav thing is that you can close page come 30 min later drop same files and it will resume

#

If I get to know what plan is used on cloudflare I can also up chunk size limit as for now it's set to 50MB

indigo geyser
#

I think 50MB is fine for people with spotty internet

outer ivy
#

Also upload speed should be fine though not expect speeds like croc or sftp
Btw any request whats to integrate?

indigo geyser
#

I don't know of anything to integrate, maybe other people who develop templates like @copper tiger may have some requests.

outer ivy
#

btw speed test is still clunky

#

was thinking about making rsync wrapper

indigo geyser
#

rsync from pod to pod, or local machine to pod, or both?

outer ivy
#

could be both, also many people asked about timer stuff. I can make so you can deploy template on cpu pod and have it auto stop pod with id after x time

indigo geyser
#

Yeah lots of people want the ability to auto stop pods but struggle to get it working

outer ivy
#

I mean we do not have ability to fully delete pod but can be stop

indigo geyser
#

So the API key that gets created for the pod when the pod is created doesn't have permission to terminate the pod?

outer ivy
#

I mean graph api only has option to stop pod

#

Unless there is option to do it from runpodctl

indigo geyser
outer ivy
#

Then I can easly make timer for terminating pods

#

we can also use
runpodctl remove pod podid

indigo geyser
#

Oh yes good point, I am not familiar with all of the features of runpodctl, I use it mostly for transferring files

outer ivy
#

That's going to be asy to add

#

Have form to set for how long user wants to run pod then add pod id and display timer an real time

#

works with both volume and network just tested

indigo geyser
#

Thats awesome!!

outer ivy
#

Note for myself: Make GUI for cloudlfare tunneling

nocturne flame
indigo geyser
#

Yeah I also haven't tried it yet, I read the docs and just hit a mental block 🙈

outer ivy
#

Cloudflare tunnels are easy

nocturne flame
outer ivy
#

Making new Vinyl collection 🙂

indigo geyser
#

@outer ivy this should say vCPU rather than CPU, there is quite a big difference between the two. Would also be nice if you can display the RAM and VRAM and maybe even GPU type if possible.

Monosnap_Admin_Dashboard_2024-02-22_11-35-30.png
outer ivy
#

Going to fix that in next update

outer ivy
#

New update v1.2 is out:

  • Added way to set timer to stop or remove pod
outer ivy
#

@proper moss tagging you cause you asked for that kinda of thing

#

Note for now you cant cancel timer 😄

indigo geyser
#

Oh yeah it will be a useful feature to cancel it in future 👍

outer ivy
#

for now you would need to kill app

indigo geyser
#

Thats simple enough since both myself and SECourses tell people to use fuser.

outer ivy
#

fuser for what?

indigo geyser
#

fuser -k 2999/tcp to kill the app

outer ivy
#

btw my app comes with some apis

indigo geyser
#

Oh thats cool, are you gonna add docs for them?

outer ivy
indigo geyser
outer ivy
#

so in theory you can integrate it into own code

indigo geyser
#

Yeah, thanks, I don't really have much code though, its mostly just a Dockerfile that installs stuff from Github 😆

outer ivy
#

btw I do not use nginx at all and my app can route traffic

#

single port multiple apps

indigo geyser
#

I mostly just use nginx for the CloudFlare 503 errors so I can display a custom message while apps syncing, starting etc, otherwise people assume something is broken when it isn't

#

I also updated my templates so that they start ssh server, jupyter and runpod file uploader before the syncing starts so that people can access their pods while syncing is in progress and start uploading models and things via the file uploader while they wait for the syncing to complete.

outer ivy
#

I'm kinda thinking how we could optimise syncing