Hi I have created a program which takes C# files, from a project and summarizes all of the code into one big text file and sends it to davinci-3 to be analyzed with a set of instructions. Purpose being to be able to take students homework assignments and correct them fast and easily. Problem is the token size token size can be anywhere from a few thousands to 30.000+ tokens, how do I get around this issue in the best way? the ai will need all the files to check it.
#Getting around the 4096 token limit
copper thistle