#AI detection tool
1 messages · Page 1 of 1 (latest)
i have never heard of any existing which don't also have tons of false positives or are easily defeated
why do you need this?
mostly because this is a universal issue
there’s a sort of arms race between llm’s and llm detection tools. hard to be certain
i like this paper for looking at detection strategies and cool alternatives: https://aclanthology.org/2021.acl-long.565/
Elizabeth Clark, Tal August, Sofia Serrano, Nikita Haduong, Suchin Gururangan, Noah A. Smith. Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers). 2021.
Without going into too much detail (I don’t want to dox myself), I work at a company that manage a database of movies, TV series (something like IMDb, but we focus on local productions). I handle the moderation of content posted by our users. We suspect that more and more content (especially movie descriptions) is being generated by AI. SEO department said that, this negatively affecting the site search engine stats. So we want to verify content for AI. I’ve tested a few available tools, but I've noticed they struggle to detect the latest LLM models.
seems relatively in line with research findings