Trying to make an AI writing detector tool. How could i go about creating one?
#API to detect AI work?
south nimbus
amber reef
An openAI/ gpt detector already exists. The source code is on github. https://huggingface.co/openai-detector/
edgy dust
An openAI/ gpt detector already exists. The source code is on github. https://...
That only detects GPT-2 output. Detecting GPT-3 output is far more difficult, and may be impossible to do reliably in an adversarial environment where the output may be generated from prompts specifically designed to produce a style that doesn’t match what the detector is expecting.
amber reef
That only detects GPT-2 output. Detecting GPT-3 output is far more difficult, an...
It detects the output of chatGPT at 99%
edgy dust
This thread has a good overview of the state of play: https://twitter.com/emollick/status/1604872727973830657?s=46&t=_GvBcQLAAiOpR8-8NCwd5g
Twitter
edgy dust
It detects the output of chatGPT at 99%
Where do you see that? I just pasted my last several ChatGPT completions in, and the ones that it didn’t error on due to <> characters were about 50/50 Real vs. Fake, and almost always highly overconfident (99% one way or the other).
clever shoal
Sounds like a bad loss function or training data (probably the latter) to me
south nimbus
How could I integrate this into a chrome extension?
edgy dust
How could I integrate this into a chrome extension?
I think you need a better “this” first, which is an unsolved research problem.