🔒 How to integrate a Large language model into a graphical user interface?

[forest cove]

Does anyone want to work on creating a GUI that has a Large Language Model Integrated in it, so the user can talk to the llm (like chatgpt but offline)?

I'm asking this because, I have tried many ways to integrate a LLM into a GUI, but it doesn't seem to work.
I have downloaded countless .gguf files for LLMs and I've tried using Javascript.

[amber plume]

@forest cove

Python help channel opened

Remember to:

• Ask your Python question, not if you can ask or if there's an expert who can help.
• Show a code sample as text (rather than a screenshot) and the error message, if you've got one.
• Explain what you expect to happen and what actually happens.

:warning: Do not pip install anything that isn't related to your question, especially if asked to over DMs.

Closes after a period of inactivity, or when you send !close.

[wintry hamlet]

I mean, have you looked into huggingface transformers?

[forest cove]

yes i have

[wintry hamlet]

and...?
it doesn't seem to work really doesn't tell anything about what went wrong

[forest cove]

ill send you the code

[wintry hamlet]

if that doesn't work you can look into other stuff like llamacpp

[forest cove]

yeah, i did try transformers but then i had a module problem because on my device, for some reason i can't pip install or use cmd prompt

[forest cove]

I tried downloading transformers (in the file format .whl) manually and used a program to install the module, but then when i tried importing it, It didnt work.

[wintry hamlet]

elaborate

[forest cove]

on what specifically?

[wintry hamlet]

you mean something like this?

pip : The term 'pip' is not recognized as the name of a cmdlet, function, script file, or operable program. Check the
spelling of the name, or if a path was included, verify that the path is correct and try again.

[wintry hamlet]

wdym by "I can't pip install"

show the error if there's one

[forest cove]

in my idle shell it shows:

[wintry hamlet]

you don't pip install in an IDLE shell

you run pip in a terminal, IDLE runs python (which is different)

[forest cove]

yeah but i access my terminal

cant

its like broken or somet

[wintry hamlet]

wdym by "its(the cmd) like broken"
can you not open a terminal? is there an error when you try to run pip? ...

[forest cove]

when i search "terminal" or "command prompt" and i click on it to open it, it just wont open

so im forced to manually download modules

and thats why VS code doesnt work for me

[wintry hamlet]

what about powershell?

[forest cove]

same problem

idk why

[wintry hamlet]

then really the problem is that your terminal's broken

idk how to fix that, so look it up or smthn
e.g. the first result of command prompt instantly closes on google

actually that seems like it needs a terminal to run

[forest cove]

i have tried that in the past but im not able to find a solution,

ill try again

thanks

[amber plume]

Python help channel closed

This help channel has been closed and it's no longer possible to send messages here. If your question wasn't answered, feel free to create a new post in #1035199133436354600. To maximize your chances of getting a response, check out this guide on asking good questions.