When I run the google colab I’m not sure if this is normal, but on launch at the very ends, it says unrecognized arguments— cai chat
#unrecognized arguments
sharp minnow
tired nest
Must be a very outdated colab. That argument was removed months ago.
sharp minnow
Must be a very outdated colab. That argument was removed months ago.
Do you have a link to any new ones by chance?
tired nest
Looking around, I've found 2:
- https://github.com/camenduru/text-generation-webui-colab
- This repo seems to be actively maintained and up to date. It has multiple colabs for various models.
- https://colab.research.google.com/drive/18L3akiVE8Y6KKjd8TdPlvadTsQAqXh73
- This one seems to be fairly outdated, but may still work with the latest webui as I didn't see any code that would break it. I only really glanced at the code, so I may have missed something.
sharp minnow
Looking around, I've found 2:
- https://github.com/camenduru/text-generation-web...
How do I run the first one, all the links don’t lead to colab I’m not good at this stuff at all so I might just be stupid
tired nest
In the README, there are multiple buttons titled Open in Colab. Press the one next to the model you want to use, then press the arrow button to run it or press Ctrl+Enter.
sharp minnow
Yeah I figured it out
sharp minnow
In the README, there are multiple buttons titled `Open in Colab`. Press the one ...
It’s says I used up all the cpu for colab, is this permanent or will it reset?
tired nest
No clue. I don't use Colab.
sharp minnow
Damm
tired nest
Reading their FAQ gives the impression that it will reset eventually.
sharp minnow
Reading their FAQ gives the impression that it will reset eventually.
What it seems like
Honestly I wish they’re was a way to run those locally on iPhone
tired nest
Apple is too restrictive with their devices and services for something like that.
At best, you might come across an app that allows it to an extent, but the fact that you have to download a model to run is a major sticking point with Apple who is obsessively against side-loading of any form.
sharp minnow
I heard they would add it with IOS 17
Or atleast planning to
Oh it’s EU only apparently
tired nest
Yep. EU threatened to kick them out if they didn't allow side-loading. Apple fought quite a bit and eventually relented when they realized that the EU's threats were serious.