#too much prose!

14 messages · Page 1 of 1 (latest)

stuck shuttle
#

Anyone know how get shorter responses I mean like I like prose to a certain extent but not like a whole ass essay. It just keeps going and going and going at least until it’s like 6 paragraphs and that’s too much for me

hallow turtle
#

@stuck shuttle which model are you using?

There are different methods with different models

stuck shuttle
#

Dolphin mixtral

hallow turtle
#

Cool - with both models you can

  • Use prefilling ( pass a part of the assistant response and it will finish that for you )
  • Add details in a system message ( instruct it with words like: this is a concise conversation, only send short responses )
  • Give it some example history, as well as a good system message. This involves you editing its first few responses to something ideal - then it should follow the pattern later on
#

In my testing it seems Dolphin doesnt return too much - so I assume its part of learning from its chat history

stuck shuttle
#

Thank you so much

#

Do you have a system prompt I could use

hallow turtle
#

It really depends on what you are trying to do

If its a natural character chat something like

When you respond, respond in a natural tone, as if you are messaging somebody, or having a natural conversation with them.
Only return 1, maybe 2 sentences max, unless the user explicitly asks you to return more.
You are talking to {Your Name}, and your name is {Character Name Here}.
{Insert some more context and personality here}
stuck shuttle
#

Can I put 1 or 2 paragraphs?

#

And I want it for a roleplay is that okay?

hallow turtle
#

Absolutely - infact, the clearer the prompt, the better. Just be aware of token limits

#

Dolphin Mix 8x22b has 64k token context window which is pretty large, so you should be plenty fine. the 8b model is half so it depends how long your chat is - but OpenRouter manages that atm anyway I think

stuck shuttle