Q: ChatGPT integration in Moodle

[native ice]

hi, has anyone here already integrated chatGPT into existing projects? how do you train it specifically for a specific topic, with the fine-tuning? i'm reading the documentation, but don't quite understand how yet.

We have a project with Moodle in which we would like to integrate ChatGPT (preferably GPT4). If the learners are stuck on a question, for example, then they could ask ChatGPT and it would help.
Is it possible to integrate ChatGPT into Moodle fluently? What do you need to consider?
ChatGPT is pre-trained, but additionally we then need to train ChatGPT specifically in the subject area of the course. How would that need to be done specifically? I think we would have to train ChatGPT specifically on hundreds/thousands of texts from that topic area.

I read something from https://moodle.org/plugins/block_openai_chat. Is that usable? Is this only available in version 3.5?
Thanks a lot!

[indigo owl]

I'm not sure how moodle works, but have you tried just injecting them as part of the prompt, alongside a vector database to do QA search?

[native ice]

I am not a pro, and I am only a facilitator, not a developer in this project. Could you explain what you mean?

[indigo owl]

So unless the topic is really niche, typically you can past them as part of the prompt as "context". Here is a video about how ChromaDB, a vectordatabase, is used. https://www.youtube.com/watch?v=3yPBVii7Ct0&ab_channel=SamWitteveen

LangChain is a good prototyping library to test out your workflow, but essentially, you can put all the knowledge (or PDFs, files, etc, convert them into text) into a vector database, which typically has great query capabilities. Given a query (say question or such), vector database can retrieve relevant chunks of text, which you can then pass to OpenAI as part of context to have a context-aware question answering. Here's another article, which is what the screenshot is based on: https://www.antoinebernard.com/diy-support-chatbots-creating-your-first-ai-assistant-on-your-own-documentation/

So what's left is really how you're going to integrate knowledge. Now, how to integrate with Moodle really is more of a dev question rather than ML question, but hopefully this provides an approach to go about it

[native ice]

@indigo owl Thank you for your effort. I am studying the docs at the moment. GPT-4 is the general model as far as I know, ChatGPT is the pre-trained chatbot. Do I have to use the OpenAI API for using GPT-4 or can I use chatGPT directly? Are both pretrained?