#Architecture for the new Chat Completion (GPT3.5) API

35 messages · Page 1 of 1 (latest)

brave river
#

Let's discuss architecture patterns for building on the new ChatGPT -like API

#

Your application will essentially sit between the user and the AI (AKA assistant)

lament spoke
#

In what language?

brave river
#

regardless of the language

#

I have tried two approaches ..

#
  1. Scraping the user's input before I send it to the AI
lament spoke
#

I'm trying to get GPT3.5 to work in my TSX

brave river
#
  1. Asking the AI to run commands it needs to give a proper answer
#

Something along the lines of "you are an agent and have the following tools..."

brave river
lament spoke
#

TypeScript

velvet scaffold
brave river
velvet scaffold
#

yes that's the proper way

brave river
#

I think the layers then are:

  1. Front end - collecting usrr role inputs
  2. Application (back-end) that adds system role messages
    and looks at both user and assistant messages.... Parses them. Looks for any commands the assistant sends (maybe hides these and replaces them with the output of running the commands)
  3. OpenAI model assistant role
#

e.g. I have started the chat telling the AI that it has tools like ImageSearch[subject] when it wants to display an illustration...

#

then the application code, the "system", needs to parse these and do the job

velvet scaffold
#

Yes, that seems good

#

Have you tested how reliable it is?

brave river
#

Not fully tested yet

brave river
#

made some diagrams... it helps to clear my thinking 🙂

brave river
#

Update: we're upgrading to the new GPT4 model and have started working on browser based UI

tropic grove
# brave river

This is really well done. Is this open source? Are you working with any non profit programs to get this into the hands of teachers? Gamechanger.

brave river
# tropic grove This is really well done. Is this open source? Are you working with any non prof...

The source is available as part of the notebook. It's not fee open source software (FOSS), doesn't come with GNU License or similar.
I'm open to the idea.

No, at the moment I'm not in contact with any non-profit programs... if you can point me to some that would be great.

I hope this makes sense... I'd like this in the hands of learners rather than teachers. With that said... are teachers the way to get to the learners? 🙂

#

here is a link is you want to try it: https://www.warmersun.com/l/AILC_History

Gumroad
🧠AI Learning Companion - History - 📓 Wolfram notebook

AI Learning Companion built for high school seniors and university undergraduate students who want to learn history.Q&AAsk questions and follow-up in conversation using OpenAI ChatGPT. Pick either GPT-3.5 or GPT-4 models.The AI has some teaching tools, it can have its facts verified using the Wolfram knowledge base, do a web image search, draw m...

#

(as you can see... it's almost free software)
works locally using your own OpenAI Secret API key

tropic grove
# brave river The source is available as part of the notebook. It's not fee open source softwa...

Sure. Maybe with teachers it's about the passionate ones asking about how AI can help them teach the kids better? If so, I'd say the ones seeking it now are probably the ones you want to invest in.

Unsure. I'm interviewing MS TEALS program tomorrow to see what they are looking like next year with the teaching ecosystem. None of us are ready, but I'm interested in talking with the people that want to talk about it.

tropic grove
brave river
#

have you heard any teacher asking that question?
I haven't... sadly.
I've only heard them freaking out because assessment is f@cked.

#

There are generative AI products being built for learning. Khan demoed Khanmigo at the TED stage, Udacity built some sort of semantic search Q&A bot along their course content.
There are some smaller ones that create quizes...

tropic grove
tropic grove
brave river