Any tips on getting gpt 3 5 to follow

[rapid shore]

I am trying with a really short system message and have most of the instructions in a user message, but it's having a hard time outputting in the format I am asking for :/

[boreal veldt]

can you send your prompt by any chance

[rapid shore]

This is the format I am trying to achieve. it works almost always with GPT-4, almost never with GPT-3.5:

# Output format

The output must contain the following sections in the listed order. Each section must start with the name of the section as an H1 heading (single "#") followed by the content. Always include all sections. The sections are:

- message: the message to the user. 
- references: a numbered list of reference links for context items used in the message.
- suggestions: a list of suggestions for what the user could ask next based on the conversation so far and the context. The suggestions should be succinct and written from the perspective of the user. Include 3 suggestions. Do not wrap suggestions in quotes.

So I basically want markdown, because I want to stream the message part to the client

Funnily enough, directly requesting "markdown" is hit or miss 😄 it's clearly finetuned for json

(including gpt-4)

[boreal veldt]

hmm when i test out that on its own it seems to seperate it into sections

one thing i would try

is denote the seperate sections using a markdown syntax

The output must contain the following sections in the listed order. Each section must start with the name of the section as an H1 heading (single "#") followed by the content. Always include all sections. The sections are:

# message: the message to the user. 
# references: a numbered list of reference links for context items used in the message.
# suggestions: a list of suggestions for what the user could ask next based on the conversation so far and the context. The suggestions should be succinct and written from the perspective of the user. Include 3 suggestions. Do not wrap suggestions in quotes.```

if that doesnt work perhaps try

The output must contain the following sections in the listed order.  Always include all sections. The sections are:
"
# message: 
{{message to the user}}
***
# references: 
{{a numbered list of reference links for context items used in the message}}
***
# suggestions: 
{{a list of suggestions for what the user could ask next based on the conversation so far and the context. The suggestions should be succinct and written from the perspective of the user. Include 3 suggestions. Do not wrap suggestions in quotes.}}
"""```

both mine and yours produced the same output for me though so it depends on your specific case i guess

@rapid shore

the problem you're having is very similar to the "[RESPONSE FORMAT]" tag i recently made in my https://discord.com/channels/974519864045756446/1117763027769503764 prompt

[rapid shore]

Thanks a lot! I'll try this 🙏