#OSError: models/pygmalion-6b_sharded is not a local folder

1 messages · Page 1 of 1 (latest)

surreal haven
#

Hello, I am trying to run the ooga booga notebook on google collab. After clicking all 3 play buttons, I get the following error on the final button:

OSError: models/pygmalion-6b_sharded is not a local folder and is not a valid
model identifier listed on 'https://huggingface.co/models'
If this is a private repository, make sure to pass a token having permission to
this repo with use_auth_token or log in with huggingface-cli login and pass
use_auth_token=True.

Does anyone know how to solve this?

tame quarry
#

i can't solve it immediately, but i can point you in the right direction. let me look at the notebook rq

#

okay. error message indicates that it can't find the model where it expects to find the model, so it's going out to hugging face to try to download it by default. that model does not exist, at least at that path, on hugging face

http://huggingface.co/models/pygmalion-6b_sharded [404]

so it's almost certainly that the linkage between your oobabooga and your drive is busted, assuming the instructions work. 6b_sharded is something that the instructions should create in your google drive.

surreal haven
#

Since I'm running using collab, is there anything else I need to do other than the 3 play arrows that I click?

tame quarry
#

let me try it myself -- i never have

#

okay, the first part of step 3 is what's breaking for you

#

probably because it can't connect to google drive

#

what is the full output of step 3 when you play it?

surreal haven
tame quarry
#

gimme a bit of time

surreal haven
#

Thanks a lot btw <3

tame quarry
surreal haven
#

Im trying to run it on my phone now to see if i get a different result

#

I'm not sure if it has anything to do with my google drive account, but I'm using an alt that has pretty much no data on it rather than my main google account

#

ah yea, exact same error on mobile too

tame quarry
#

yeah, it won't have anything to do with your device or client

#

this query is failing:

huggingface_org, huggingface_repo, huggingface_branch, model_name = models[model]
![[ ! -f models/$model_name/config.json ]] && python download-model.py $huggingface_org/$huggingface_repo --branch $huggingface_branch

i don't see how or where it acquires the hf api key, though

surreal haven
#

possibly do I need a hugging face account? the url prompts username and password

tame quarry
#

it didn't prompt for me, which is why i'm thinking

#

is it supposed to?

#

(i do have an account)

#

let me try in a different browser without the HF API key

surreal haven
#

I've made a hugging face account, but now the url https://huggingface.co/models/pygmalion-6b_sharded/resolve/main/config.json straight up has no resources there

#

it doesnt even look like the model https://huggingface.co/models/pygmalion-6b_sharded exists

tame quarry
#

right, i mentioned that up top

#

i think the error message is lying to us about what it's trying to access

#

worked first shot with a different gmail address in a totally clean browser

surreal haven
#

lemme try that

tame quarry
#

please do -- i wish i could replicate this

surreal haven
#

F, i guess google colab hates me

#

I switched from chrome to firefox with a fresh google account and it still gives me the same error

#

I don't think we can find a fix for this anytime soon, but thanks for helping anyways, I'll probably just keep trying to run it locally

#

Just that I have a rtx 2070 with 8 gb vram and my system only has 16 gb, so running locally with kobald + tavern + pygmalion takes like 1 minute

#

I just need to find ways to optimise it so its faster

tame quarry
#

i honestly don't know how that could be blowing up. i tried to think of things like the country you may be in leading to the 401, but the notebook should be running somewhere with permission

#

i'm sorry i couldn't be more helpful on this. frustrating that you're stuck with that system for now