#Trouble formatting JSONL for fine tuning

3 messages · Page 1 of 1 (latest)

mighty geode Feb 10, 2023, 1:33 AM

Hello! So I’ll admit i am very new to this world - i have never touched js and have only done some rudimentary api calls. Point is, this is likely a dumb question.

Ive tried several time to format a jsonl file for fine tuning, but the results have been bad. The calls return disjointed, repeating, and more often than not insane replies.

My jsonl is small, and I’m aware more examples are better, but I also don’t want to spend days building it incorrectly so i just start with these.. could someone point out what I might be doing wrong? Attaching shortly.

Jsonl here: https://cdn.discordapp.com/attachments/1021802551450021958/1073416577749368832/sarah-8.jsonl

More context - this is intended for a conversational discord bot focused toward a sim racing league. It wont strictly be for motorsports type stuff, mostly for entertainment.

I have a rudimentary prompt for api calls that has worked significantly better than the jsonl so far, which I can share as well if needed. That prompt includes variable that include the previous chat exchange, giving the replies direct context, and i also have trouble getting that to happen with the fine tuning implemented.