Scivillage.com Casual Discussion Science Forum

Full Version: Why AI detectors think the US Constitution was written by AI (data analysis)
You're currently viewing a stripped down version of our content. View the full version with proper formatting.
https://arstechnica.com/information-tech...ten-by-ai/

EXCERPTS: If you feed America's most important legal document—the US Constitution—into a tool designed to detect text written by AI models like ChatGPT, it will tell you that the document was almost certainly written by AI. But unless James Madison was a time traveler, that can't be the case. Why do AI writing detection tools give false positives? We spoke to several experts—and the creator of AI writing detector GPTZero—to find out.

[...] As tempting as it is to rely on AI tools to detect AI-generated writing, evidence so far has shown that they are not reliable. Due to false positives, AI writing detectors such as GPTZero, ZeroGPT, and OpenAI's Text Classifier cannot be trusted to detect text composed by large language models (LLMs) like ChatGPT.

[...] To explain why these tools make such obvious mistakes (and otherwise often return false positives), we first need to understand how they work... (MORE - missing details)