#Response blocked under 1000 token ??

1 messages · Page 1 of 1 (latest)

gleaming tusk
#

Hello guys,

I would like to generate a more longer story than what i get for the moment.

I don't know why it's block under 1000 tokens, the model I use can do something like 8192 tokens.

This is the body :

{
  "model": "gpt-4",
  "max_tokens": 8000,
  "messages": [
    {
      "role": "system",
      "content": "You are a story writer."
    },
    {
      "role": "user",
      "content": "Please write me a complete story for a child, aiming for around 4000 words. The story should be an adventure featuring diverse characters, engaging challenges, and a moral lesson at the end. I'd like the story to be rich in details and dialogues, appropriate for children."
    }
  ]
}

And the response body without the text :

{
    "id": "chatcmpl-8GlRInV7tAjFHZ1jZm3kCILIdCJPx",
    "object": "chat.completion",
    "created": 1699006296,
    "model": "gpt-4-0613",
    "choices" : ...,
    "usage": {
        "prompt_tokens": 74,
        "completion_tokens": 903,
        "total_tokens": 977
    }

Can you help me to have more longer response ?

stuck rune
#

so it has no idea if it's written 1000 words or 4000 words

#

Instead, you can ask it to generate chunks of the story separately one after the other, asking each chunk to be "very long" which will give u better and longer output

gleaming tusk
stuck rune
#

No, it doesn't know, it only has a very general and vague idea of it, it's how LLM models work

#

Like@it knows the difference between very long and short, etc but not exact word counts

gleaming tusk
#

Yes I know

#

What do you mean

#

I was not accurate in my last message

#

I will try with long chunks as you suggested

#

So i did this with the help of chatgpt :

#

{
"model": "gpt-4",
"messages": [
{
"role": "system",
"content": "You are a story writter with a lot of imagination and you dont hesitate to write a very very lot of words, around 4000 words for a story !"
},
{
"role": "user",
"content": "Create a personalized children's aventure story based on the following structure: 1. Introduction: Introduce the protagonist, whose are Jade 8 years and Sarah 5 years. 2. Conflict: Introduce a problem or challenge that the protagonist must face. 3. Rising Action: Describe the protagonist's journey to overcome the challenge, including any helpers or companions they meet along the way, as specified by the user's preferences. 4. Climax: Bring the story to a peak where the protagonist faces the central challenge, using elements provided by the user to shape the climax. 5. Falling Action: Show how the protagonist begins to resolve the problem, with outcomes influenced by choices made by the user. 6. Resolution: End with a resolution that reflects the story's theme and user's choices, providing a moral or lesson that leaves a positive impression. Please ensure the language is simple, engaging, and appropriate for children aged 5-10. The story should encourage values aligned with the theme, be inclusive and diverse, and inspire creativity. The structure should be flexible to accommodate different lengths and complexities of stories. Each part of the story must be a long paragraph !"
}
]
}

#

But same : "completion_tokens": 940,

inland steppe