#APIBackends - Add backends from the paid APIs, Ideogram, OpenAI, BlackForestLabs

1 messages · Page 1 of 1 (latest)

cursive trellis
#

This is in an unreleased Alpha phase. While it is stable and working it is not in the Extension tab yet and it still has some bugs/missing features. Do NOT install this extension unless you like testing out projects in their early stages.

When I am ready for some testers and bug hunters I will let you guys know. I will provide API keys and the testing will last for as long as there are credits on the keys. If you have always wanted to try these "Premium" models but never wanted to pay for them these upcoming tests may be for you! Comment with your interest and I will send keys once I have time to sit here and fix bugs you find.

When you add the backend it registers each model and adds them to the models tab on the Generate page. I made some basic icons for the models but I could use some help creating some icons that dont look like crap.

HELP ME!?
I need better icon designs for each model. Your images could be included in this plugin!:

  • All images need to be 1:1
  • The designs per company should be cohesive and match
  • Large text with the model name is required. I want to know what model it is from the image
  • Don't break any laws, no copyrighted characters or logos, no NSFW
  • You release all rights to the images to be open sourced and used in this extension

Ideogram:
Models: (I know, they have such creative names)

  • Ideogram V1
  • Ideogram V2
  • Ideogram V3

OpenAI
Models:

  • Dall-E 2
  • Dall-E 3
  • GPT 4.5 (Or whatever the new one is called)

Black Forest Labs:
Models:

  • Flux Dev
  • Flux 1 Pro
  • Flux 1.1 Pro
  • Flux 1.1 Pro + Ultra

Here are the crappy ones I made for reference:

dalle.png dalle2.png flux-dev.png flux-pro.png flux-pro-ultra.png ideogram.png
dull anvil
#

I just so happen to be awake at 3:21 AM (my time)

#

🤔 And I'm curious about this

#

Hmm, so are icons to be made for the different models?

#

I'd guess that the icon designs should stylistically resemble the model's "identity" - or are they supposed to be similar in design?

neat scaffold
#

Really awesome, can't wait for this! Would it make any sense to do Kling?

cursive trellis
cursive trellis
cursive trellis
gusty quartz
# cursive trellis

Can I suggest an API/ prefix, eg API/BFL/flux-dev? So all the API models are in one folder together

cursive trellis
analog perch
#

I'll be your huckleberry... and bug hunter tester... 🙂

cursive trellis
dull anvil
cursive trellis
#

All good. I was so busy I would not have been able to do anything with them yet anyway.

lost shore
#

Looks like the new "image" part of the GPT4.5 is called "GPT-Image 1" now. But, isn't it all the same 4.5 model? So i'm guessing just a different endpoint?

cursive trellis
#

Yeah I have not added it yet been waiting for the API docs to update.

cursive trellis
lost shore
#

At least it's an easy addition! A controversial decision it seems like but, I think it's no biggie? They aren't jacking up the price at least

cursive trellis
gusty quartz
#

I doubt they'd paywall comfy, as
(A) mr. comfy the person would fight to the bitter end to prevent it
and (B) they all know that if they do that, everyone is going to abandon comfy and move elsewhere

#

ANd if they ever do try to paywall comfy... refer again to (B), we will all just move elsewhere

#

I'll swap the recommended backend for Swarm and make it as directly intercompatible as possible with the existing params

cursive trellis
#

Im sorry guys I have been super swamped if you want to test out the extension you can take a peek at it here:
https://github.com/HartsyAI/SwarmUI-API-Backends

Anyone who submits any of those replacement model icons I will let use some API keys to do bug hunting.

I dont have a solution for the parameter list yet. That is still a bit wonky. I will not have time to finish this for a few weeks.

GitHub
GitHub - HartsyAI/SwarmUI-API-Backends: This swarmUI extension adds...

This swarmUI extension adds a multiple backends for paid API image generation - HartsyAI/SwarmUI-API-Backends

cursive trellis
#

With the new comfy API nodes I assume I will be replacing my code with those. It covers almost all the APIs I was planning on covering.

lapis hinge
#

Btw why is it not in the extension list ?

gusty quartz
#

using comfy as a proxy for a remote API is pretty jank

#

one comfy server processes one workflow at a time

#

remote APIs vary but usually 2, 10, whatever at a time per user

#

swarm can async multiqueue just fine, comfy can't

#

even with eg stability api way back when, it was always on the todolist to ditch the stupid comfy nodes and do native impl (just didn't care cause stability api sucked and no amount of me working for the company made it worth bothering lol)

cursive trellis
lapis hinge
cursive trellis
# gusty quartz Ehhh not sure that's a good plan, unless you're just wanting to abandon maintena...

Not having to maintain it much was the benefit I was thinking of. but I also have most of the api stuff done already so it should not change much after that. Maybe add new models or a new backend.

I have not looked at this at all in weeks. The param list visual is still the biggest hurdle. Swarm does not like me removing the things it thinks all models should have.

I tried to violently remove elements manually with js but Swarm also does a great job of refreshing the params and adding them all back lol

gusty quartz
#

don't hack it, PR anything you need that's not already there

#

didn't i add an injection method in the js for you or something

#

ye hideParamCallbacks

cursive trellis
cursive trellis
#

APIBackends - Add backends from the paid APIs, Ideogram, OpenAI, BlackForestLabs

#

Added a massive amount of models and paid backends. Fal.ai is the best to test out new stuff.

Most param stuff is good but let me know if i missed something or have the wrong param on a model. there were a lot.

I would be grateful for any contributions to fix model descriptions or make metadata images for each model.