How to get worker to save multiple images to S3? | Runpod | Page 1

little fractal Jul 19, 2024, 3:59 PM

#

Hey all - my comfyui workflow is saving multiple images from throughout the workflow......however in the S3 upload, the worker is only saving one image - do you know how I can have it to save the multiple images into the same directory in S3?

untold summit Jul 19, 2024, 4:23 PM

#

I think you need to change the code for uploading files to s3 in the handler

#

it only uploads 1 result if im not wrong

little fractal Jul 19, 2024, 4:27 PM

#

oh I see

#

I'll dig into it - thanks!

untold summit Jul 19, 2024, 4:31 PM

#

Sure, your welcome!

narrow sky Jul 19, 2024, 5:16 PM

#

zip it then upload

little fractal Jul 20, 2024, 1:51 AM

#

Oh that’s a great suggestion - I wasn’t sure if comfyui had a zip node?

untold summit Jul 20, 2024, 3:22 AM

#

Oh wait what doesn't runpod supports multi files upload?

untold summit Jul 20, 2024, 3:22 AM

#

little fractal Hey all - my comfyui workflow is saving multiple images from throughout the work...

Btw how does your code call the upload?

little fractal Jul 20, 2024, 5:11 AM

#

I'm using the runpod-worker-comfy repo by blib-la - this is the lines of code that handles the upload:

            print(
                "runpod-worker-comfy - the image was generated and uploaded to AWS S3"
            )```

untold summit Jul 20, 2024, 5:12 AM

#

Ah le me check

little fractal Jul 20, 2024, 5:15 AM

#

FWIW, I mentioned the following in the blib-la support discord too:

I suspect the issue is in line 240 in rp_handler.py where the dict output_images is overwritten in the for statement? I unfortunately have no way to test as I can't set up the docker locally on my M1 Mac (needs a Nvidia I'm guessing?)

untold summit Jul 20, 2024, 5:18 AM

#

little fractal I'm using the runpod-worker-comfy repo by blib-la - this is the lines of code th...

doesnt have any for loops here?

#

Whats local_image_path

little fractal Jul 20, 2024, 5:21 AM

#

the path where the output images are stored in the worker's instance of ComfyUI I believe

untold summit Jul 20, 2024, 5:21 AM

#

so a directory, and it only uploads one file?

little fractal Jul 20, 2024, 5:24 AM

#

correct

untold summit Jul 20, 2024, 6:04 AM

#

ill try to check on this maybe, runpod only uploads one of the files

untold summit Jul 20, 2024, 6:45 AM

#

little fractal I'm using the runpod-worker-comfy repo by blib-la - this is the lines of code th...

yeah i think that upload function only uploads one file

narrow sky Jul 21, 2024, 6:31 PM

#

nah you can upload multi

untold summit Jul 21, 2024, 6:59 PM

#

narrow sky nah you can upload multi

Did you mean the upload functions automatically retrieves multiple images or files if the input path is a directory?

compact skiff Jul 23, 2024, 2:14 PM

#

It's not magic. It depends on how you code your serverless handler to run. If you need to upload multiple files then call rp_upload.upload_image (included in the runpod Python module) multiple times. If you don't like how rp_upload.upload_image works you can write your own upload routine.

Here is an example of uploading 2 files uses rp_upload.upload_image:

from runpod.serverless.utils import rp_upload
import runpod

def handler(job):
input = job['input']
JOB_ID = job['id']

imageOne_url = rp_upload.upload_image(JOB_ID, "./imageOne.png")
imageTwo_url = rp_upload.upload_image(JOB_ID, "./imageTwo.png")

return {'imageOne_url': imageOne_url, 'imageTwo_url': imageTwo_url}

You will have to modify this for your specific needs.

untold summit Jul 23, 2024, 2:29 PM

#

Yeah thats why im confused why madiator said this

#

#

Yeah it receives a file path in args

#

orr... you can use another utility function in the same python file as that upload_image() to upload multiple files

compact skiff Jul 23, 2024, 2:41 PM

#

untold summit Did you mean the upload functions automatically retrieves multiple images or fil...

I do not believe that rp_upload.upload_image handles multiple files with its default code. Here is code for a Multi file upload routine you could add and use to upload multiple files, with wilcard:

import glob

def uploadMulti(job_id, path_with_wildcard):
    # Get a list of all files matching the wildcard path
    file_list = glob.glob(path_with_wildcard)
    
    # Initialize an empty list to store the URLs of uploaded files
    uploaded_urls = []
    
    # Iterate through each file in the list
    for file_path in file_list:
        # Upload the file and get the URL
        file_url = rp_upload.upload_image(job_id, file_path)
        # Append the URL to the list
        uploaded_urls.append(file_url)
    
    # Return the list of URLs
    return uploaded_urls

Here is how you call such a function:

# Example usage
def handler(job):
    input = job['input']
    JOB_ID = job['id']

    path_with_wildcard = "./images/*.png"
    uploaded_urls = uploadMulti(JOB_ID, path_with_wildcard)

    return {'uploaded_urls': uploaded_urls}

untold summit Jul 23, 2024, 2:42 PM

#

compact skiff I do not believe that rp_upload.upload_image handles multiple files with its def...

ikr yeah

little fractal Jul 27, 2024, 4:11 PM

#

Thank you @compact skiff - this is super helpful. I’m actually looking to download - rather than upload - multiple images from the output folder. Basically my workflow is producing multiple images and I want to present them all to the user to choose the one they want?

untold summit Jul 27, 2024, 4:46 PM

#

little fractal Thank you <@392788612153868290> - this is super helpful. I’m actually looking to...

how do you want to download them?
Where / how maybe

#

if you want to download inside serverless, there is boto3, or you can use the rp_download from the runpod's pip package

compact skiff Jul 27, 2024, 4:48 PM

#

little fractal Thank you <@392788612153868290> - this is super helpful. I’m actually looking to...

I think what you are describing is uploading. Your workflow is likely producing image files PNG, JPG, or similar. They are stored on the worker's disk as files. For the user to get access to them you will have to upload those files somewhere that will host them on the Internet. My code above uploads them to an S3 bucket. With proper configuration of the S3 bucket it's URL will be available for anyone on the Internet to access it. Your handler needs to return those URLs to user in JSON. If you are presenting a web interface to the user then you will need to include the images in <img> tags so they can see them or use JavaScript to make it so the user downloads it.

untold summit Jul 27, 2024, 4:49 PM

#

yep correct you're, encryption

#

upload -> serverless worker to s3
download is s3 to serverless worker

compact skiff Jul 27, 2024, 4:52 PM

#

If you do actually need to dowload something into your worker you can add this function:

"""Downloads a file from a URL to a local path."""
def download_file(url, local_filename):
    try:
        print(f'[Enhancer]: Downloading {url}')
        if os.path.exists(local_filename):
            return local_filename, None
        with requests.get(url, stream=True) as r:
            r.raise_for_status()

            with open(local_filename, 'wb') as f:
                for chunk in r.iter_content(chunk_size=8192):
                    f.write(chunk)

        return local_filename, None

    except Exception as e:
        return None, e

You can call it like this:

result, error = download_file(url, local_path)

little fractal Jul 27, 2024, 6:54 PM

#

Ahh thank you both!

#

Btw from a performance point of view is it better to go via S3 or bring directly to local device? Ie export as a list of base64 strings

untold summit Jul 27, 2024, 6:57 PM

#

Try both, but if you do many images at one time I guess s3 is better

#

S3 more cleaner, depending on your provider too it can provide speed if your provider allows you to connect cdn to s3 buckets

compact skiff Jul 27, 2024, 7:11 PM

#

little fractal Btw from a performance point of view is it better to go via S3 or bring directly...

When you run a serverless worker the only thing that will be returned is JSON (text). Below is an example of a run of one of my ToonCrafter worker:

{
  "delayTime": 491,
  "executionTime": 135484,
  "id": "your-unique-id-will-be-here",
  "output": {
    "output_video_url": "https://mybucket.nyc3.digitaloceanspaces.com/ToonCrafter/2024_06_16_16.20.48.mp4"
  },
  "status": "COMPLETED"
}

You can see how I returned a s3 URL to a video file. None of the serverless disk will persist so any files not uploaded somewhere are lost.

One other option would be to convert your image to BASE64. Since BAS64 is just text you can return that in the actual JSON response. Although, there is a size limit on how much data you can include in a response. You could likely return an image encoded as BASE64 but I wouldn't suggest that route for multiple images.

But again, nothing persists after an API call to a serverless worker. You have to move the results somewhere that will persist and give a link to it in the JSON that is returned.

little fractal Jul 27, 2024, 7:12 PM

#

Thank you thank you both!!

untold summit Jul 27, 2024, 7:13 PM

#

Yep might be slower too if you return base64.. Depending on your network connection

compact skiff Jul 27, 2024, 7:18 PM

#

I've just finished building a web socket proxy... that creates a WebSocket connection between the serverless worker and the user's browser. With that you could send the results directly to the users browser. I'm not giving that code out yet though... I am considering if I want to run it as a service.

untold summit Jul 27, 2024, 7:19 PM

#

Wew how's the speed

compact skiff Jul 27, 2024, 7:27 PM

#

Hard to say.... it depends on a lot of factors. Upload/Download speed at given runpod region. Upload/Download speed of the users browser. I have done tests with streaming logs from the worker to the browser. I am currently working on code that will stream webcam video to the worker from the browser and video in the reverse. Transferring over media (images, videos) should be no problem in most scenarios.... but if a user was on a slow link it could.

#How to get worker to save multiple images to S3?