Test example:
r = openai.ChatCompletion.create(
model="gpt-3.5-turbo",
messages=[
{"role": "user", "content": "test"},
],
max_tokens=10,
logit_bias={42: 100}
)
500 {'error': {'message': 'The server had an error processing your request. Sorry about that! You can retry your request, or contact us through our help center at help.openai.com if you keep seeing this error. (Please include the request ID a6892ec8ace8faa1ba2c7897d4ec3618 in your email.)', 'type': 'server_error', 'param': None, 'code': None}} {'Date': 'Fri, 03 Mar 2023 19:53:38 GMT', 'Content-Type': 'application/json', 'Content-Length': '366', 'Connection': 'keep-alive', 'Access-Control-Allow-Origin': '*', 'Openai-Model': 'gpt-3.5-turbo-0301', 'Openai-Organization': 'user-vf0yk2qakium1qvafiwphf91', 'Openai-Processing-Ms': '227', 'Openai-Version': '2020-10-01', 'Strict-Transport-Security': 'max-age=15724800; includeSubDomains', 'X-Request-Id': 'a6892ec8ace8faa1ba2c7897d4ec3618'}
This does not reproduce with a smaller logit bias, oddly.
r = openai.ChatCompletion.create(
model="gpt-3.5-turbo",
messages=[
{"role": "user", "content": "test"},
],
max_tokens=10,
logit_bias={42: 1}
)