worthy rune
I've tried octoai.cloud and baseten so far.
octoai.cloud has text to image API, where one SDXL 1024x1024 30 step image costs $0.004. Using a custom checkpoint costs $0.008. If you generate 4000 images per day using base SDXL, that's $0.004 * 1000 = $16 a day.
baseten let's you deploy a comfyui workflow as an API, and the cheapest instance is T4x4x161 T4 GPU, 16 GiB VM, 4 vCPUs, 16 GiB
Costing $0.01052/min, which is $0.01052 * 60 * 24 = $15 a day.
Are there any cheaper options?
lavish prairie
If you have a desktop, consider upgrading the specs to have 16+ GB RAM memory and put in one of the following cards for your GPU (https://www.newegg.com/p/pl?N=100007709+601110192) which should give you 16GB VRAM memory for the model to run quickly. It's "cheapest" if you're using the desktop for your own stuff (browse, work, game, etc).
worthy rune
If you have a desktop, consider upgrading the specs to have 16+ GB RAM memory an...
if you're using one 16GB VRAM GPU, how many users can that handle? Can it only do one image at a time?
lavish prairie
Ah, I misunderstood. I assumed you were using this for personal use
worthy rune
Ah, I misunderstood. I assumed you were using this for personal use
Got it. It's for a discord bot
lavish prairie
I mean, it could work for a small server of friends