When I first call the API with a long question that has context and then enter a second question, it retains that context. What are the limits of this? Does it still remember context after I ask enough questions to exceed the 4k token length? What if I enter context in the first question that is 3k in length and follow up with another question that has context 3k in length. Can it handle both?
#ChatGPT API Memory Retention
novel solar
plush matrix
Are you talking about the website or the api? From the docs Because the models have no memory of past requests, all relevant information must be supplied via the conversation. If its the api you need to resend all relevant information everytime. For the website it drops things from the convo once it approaches the token limit