#Cache limitations for JSON Structured Output.

1 messages · Page 1 of 1 (latest)

tawny geyser
#

In reveal, it was mentioned that the schema would be cached so that subsequent searches would be faster. Does this mean a single schema will be cached, and if a new question with a different schema is asked, then it will be cached and the other forgotten? Or can multiple schemas be cached?

As an example, suppose I have a multi layered approach where I classify the input, use a prompt template for the class, and a different json structure for each template. I have 6 classes. Will all 6 get cached or one at a time?

unique atlasBOT
#

Hi @tawny geyser. I'm kapa.ai, your friendly support bot. I will try to answer your question by searching through the knowledge base. :wave:

#

Hmm, I don't know enough to give you a confident answer yet. The knowledge sources provided do not contain specific information about cache limitations for JSON Structured Output in OpenAI's systems or how many schemas can be cached at a time.

For detailed information about how OpenAI handles caching of schemas, I would recommend reaching out to OpenAI support or referring to the official OpenAI documentation.

Note: you can ask me a follow up question by @ mentioning me again :speech_balloon: