#UI DIFF output malformed.

1 messages · Page 1 of 1 (latest)

misty waveBOT
#

Reported by @left haven

Bug Report: UI DIFF output malformed.
`Steps to Reproduce`

Prompt chatgpt to output a c++ code fix as diff.
I filed a bug report for claude on the same matter
https://hackerone.com/reports/3517935

`Expected Result`

code output for changes on c++ as diff

`Actual Result`

code output for changes on c++ as various stacked codebrackets and or diff malformed as html / markdown.

If the input / output exceeds a certain length e.g + 1k lines c++ ...

various llm (eg claude) and chatgpt are triggered to output malformed diff.

`Environment`

WEB UI

#
Additional Information

Please provide relevant details to help resolve the issue, such as:

  • ChatGPT Shared Link (if applicable).
  • Screenshots or videos demonstrating the problem.

-# ➜ Need to contact support? Visit the OpenAI Help Center.

left haven
#

see the failed diff output ... its obviously attempting to output diff something but is triggered to render as html / markdown and spawns a lot code brackets eg python something

#

same occurrence on claude ...
somehow, this type of prompting triggers LLM for malformed output.... theres something about [c++] input + [scale] of "input / output" that triggers this behavior.

#

this occurrence is noteworthy because:

  1. generates overhead for repeated prompting.
  2. generates bad user-experience.
  3. shows there are triggers which may be weaponized under different circumstances. weather for input or output.