STOP sequence breaks POST request | OpenAI | Page 1

frozen forge Aug 11, 2023, 2:09 AM

#

The following POST request breaks if you include the stop sequence. If you don't include it then it works just fine:

{
"model": "gpt-3.5-turbo-0613",
"messages": [{"role":"system","content":"you are an assistant, complete the chat."},{"role":"user","content":"Hey are you a robot?"}],
"max_tokens": 300,
"stop": ".",
"functions": [
  {
    "name": "being",
    "description": "Gets who or what someone is",
    "parameters": {
      "type": "object",
      "properties": {
        "source": {
          "type": "string",
          "description": "Who is asking?"
        },
        "target": {
          "type": "string",
          "description": "who is being asked?"
        }
      },
      "required": [
        "source",
        "target"
      ]
    }
  }
]
}

It seems function calling does not work with stop sequences. Anyone else agree?

sacred kite Aug 15, 2023, 1:51 PM

#

Yes. The stop sequence is used to tell the model when to stop generating new tokens. You set "." as the stop sequence, the model will of course stop generating when meeting a full stop

knotty yew Aug 15, 2023, 6:14 PM

#

stop should be an array of strings

frozen forge Aug 15, 2023, 11:36 PM

#

sacred kite Yes. The stop sequence is used to tell the model when to stop generating new tok...

The response is a 500 internal system error. It does not return a proper JSON

frozen forge Aug 15, 2023, 11:37 PM

#

knotty yew ``stop`` should be an array of strings

Stop works just fine as a single character. It works just fine if you DON'T use function calling

sacred kite Aug 16, 2023, 12:23 AM

#

frozen forge Stop works just fine as a single character. It works just fine if you DON'T use ...

Try "\n" as the stop?

#STOP sequence breaks POST request