Does Mistral have a System Prompt?

[junior stirrup]

Does Mistral have a System Prompt? I couldn't find it in the documentation.
Or should I put all content into the User Prompt?
Do I need to make any special markings, for example, [System] {my system prompt} [/System]?

[north brook]

yes you can use a system prompt

[junior stirrup]

Is there a place where he has a separate System Prompt like OpenAI GPT 4 API or Llama?

[odd arch]

How can we set it up? According to this: https://github.com/vllm-project/vllm/issues/2080 there is no system prompt with mistral-instruct

[rough warren]

Not exactly, the "system prompt" is just added to the beginning of the first user message

It's a known limitation

[clever gazelle]

Hi Sophia, may you help me to match my prompt for the Mixtral 8x7B?

[proven temple]

Maybe you should split your prompt into half a dozen different prompts...

[clever gazelle]

Why?!

[proven temple]

Because I doubt it would work as it is... but if it works, keep it like that...

[clever gazelle]

Does it consume a lot of tokens?

[clever gazelle]

By adding this prompt in the section of command script. Can I prevent using a lot of tokens?

[gleaming apex]

Of course

[gleaming apex]

No, you're better off finetuning the model with a prompt of that size

[clever gazelle]

@gleaming apex how?!