YOLO models on serverless?

[autumn stream]

if you're asking if its possible, yes

[wicked mantle]

Ah yeah, I was mostly asking for any pointers/tips on optimal setups for accomplishing it.

[autumn stream]

isnt huggingface's library okay already?, me i dont use yolo models alot so i dont optimize them

[dire heart]

I also couldn't find examples of this, I'm sure it's doable but I just don't know anything about these models

In general if it gives you some kind of API/SDK for passing an image or something it can run on Runpod.

[haughty breach]

if they have any examples for running the model, generally you can try wrapping that example in a runpod serverless handler

import runpod

# ... example imports and maybe some initialization

def handler(job):
  # ... example inference code

runpod.serverless.start({"handler": handler})