primal eagle
Hey there! I have a large JSON file (~139kb) with a bunch of data, and I'd like to be able to use a GPT model (3, 3.5, 4, don't care) to parse the data and help a user using that data (if that makes any sense).
Is it possible to do this, and if so, how?
Thanks!
stable solstice
GPT cannot parse such a large file directly. You need to use either code interpreter, or noteable plugin.
stuck kayak
You can always attach it to system, or include it as content.
{"role": "system", "content": "You are a helpful assistant. use the following information to assist answering user questions:\n" + formatted_json}```
3.5 Standard Token Limit
```4096```
From GPT:
```The number of tokens in a JSON file can vary depending on the structure and content of the file. However, as a rough estimate, you can assume that a JSON file consumes around 10 tokens per kilobyte (KB) on average.
So, for a 139 KB JSON file, the approximate number of tokens would be:
139 KB * 10 tokens/KB = 1390 tokens```