Hey guys, wondering if anyone has any insight on how to solve this problem? Say I create a completion with a list of prompts. Is there a way for me to ask another question that corresponds to the same list of prompts so I don't have to re-enter the previous prompts (one of the prompts is a super long one, avg 16k tokens)? Like a follow up question once the prompts have already been sent in?
#API Follow up questions after a completion is made
gray oasis
pulsar abyss
The only way I know is that you need to combine the prompts and history into a larger prompt
If another prompt is super long you are out of luck
gray oasis
No way to access a previous completion?
Like through an ID or something so I don't have to re-use all the tokens
pulsar abyss
If you find one please ping me immediately because I would love to know 😅
One way could be to do a fine tune with previous answers, but I haven't tried that myself since I would need to do many fine tunes because I have many different contexts I want to keep