#Very early impressions but wow, this is

1 messages · Page 1 of 1 (latest)

red helm
#

Right now it has to be baked into the prompt, i.e. "please respond in 2 sentences".

I've experienced some of the same issues though - maybe we can set a target response length field

neat robin
#

Yes, the challenge is that some answers will merit a longer response, but the default now is to give something that's overly long too often. Rather than a length it might be better to prompt about keeping answers simple and to the point. I'll have lots of fun trying things and feedback! Thank, this is extraordinary already! Great work.

worthy berry
#

Thanks! Appreciate the feedback!

Agreed that the only way right now is through prompt engineering

#

We're actively thinking about how we can take some of the difficulty out of getting the right prompt!

neat robin
#

It's probably going to vary by model too. But having a backend toggle that will autoinject some proven prompt additions into what's sent to the model would be one option.

#

The challenge is that what works in text is often too long for an audio interaction, it needs to be really tight and short by default, while LLMs are used to giving long, complex replies.