#Even though it's configured to do so, custom GPT fails to use only data provided by its creator

1 messages · Page 1 of 1 (latest)

sour ocean
#

Bug Report:

Steps to reproduce:

  1. Create a new GPT and explain that the GPT is not allowed to reply to user queries using any other data than that which you've provided
  2. After the alterations have been made, ask the GPT a question on something you haven't provided any data on.

Expected result:

"Sorry, I cannot answer this questions as I haven't been trained with the right dataset relating to your query." - or something like that.

Actual result:

It starts coming up with things, hallucinating - spewing information that's simply untrue.

Additional information

Browser: Chome
OS: Windows

#

My workflow:

Me: We're going to make a GPT based on [topic]. This GPT is going to inform players about [features]. The GPT is not allowed to use any other information than the information provided by me. If it does, it'll start hallucinating. So please have it refrain from coming up with stuff itself or using information that wasn't directly shared in here.

GPT Builder: The GPT has been transformed into [name bot]. This GPT will provide information exclusively based on the data you provide, strictly avoiding the use of any other information, including its pre-existing knowledge. It's designed to assist players with [features].

The GPT is programmed to not speculate or use external information beyond what you've shared. If a query is outside the scope of your data, it will acknowledge its limitations and refrain from providing an answer.

Upon testing if this was true, the GPT failed by answering gibberish to my question instead of acknowledging its limitations and refraining from providing an answer.