lethal lance
Ghost is a ChatBot based on chatGPT that runs in your terminal and other platforms(Telegram!). The unique thing about ghost is that you can create locally stored 'neural imprints' (.ni files) which are basically chat histories that shape Ghost's behavior. And you can also load imprints created by other people into Ghost to give it different personalities or features.
nova spindle
@lethal lance eventually this will bust the token cap as it just keeps sending the entire history... needs to be pruned before 4096 tokens
lethal lance
<@478965776372465684> eventually this will bust the token cap as it just keeps s...
ya I just finished a version dealing with the cap
nova spindle
I tried swapping the models and changing the API endpoint so it can use davinci and then realized I can't just dump the entire unanswered_history at it 😂
lethal lance
ah ya, and what i did in the version im just gonna push implemented a naive token estimator, after some cap, its gonna begin deleting old histories
nova spindle
that's probably the best way to do it
I was going to take an attempt to just prune the oldest context and then realized you were likely already on it
lethal lance
😂
tulip steppe
Can you explain this a little more? How is a neural imprint file different than a text file? Is this just feeding the prompt with the chat history?
nova spindle
Can you explain this a little more? How is a neural imprint file different than ...
Yes, generate some and look in the NI file
tulip steppe
So how does it differ from txt?
lethal lance
They all just plain text files, ni just a name I gave so people can expect it’s content to be an array of chat histories
tulip steppe
Ah understood
tribal yew
make me a checkerboard in html
lethal lance
im thinking about adding more model parameters into the imprint files