+- Scivillage.com Casual Discussion Science Forum (https://www.scivillage.com)
+-- Forum: Science (https://www.scivillage.com/forum-61.html)
+--- Forum: Computer Sci., Programming & Intelligence (https://www.scivillage.com/forum-79.html)
+--- Thread: Article Learning from AI’s bullshit (/thread-17592.html)
Learning from AI’s bullshit - C C - Mar 15, 2025
Learning from AI’s bullshit
https://blog.apaonline.org/2025/03/13/learning-from-ais-bullshit/
EXCERPTS: Anyone who has used modern AI knows how unreliable they are. They might recommend adding glue to pizza sauce to keep the cheese from sliding off, generate Shrek when asked to recreate the Mona Lisa, or give completely wrong answers to mathematical questions.
While new models of AI are getting better at many of these tasks, research has also found AI models are increasingly more likely to willingly answer questions they get wrong.
[...] LLMs are not intelligent agents or advanced search engines. Modern LLMs just make predictions of what the next token will be, and choose one of the likelier tokens...
[...] Because these LLMs are nothing more than predicting the likely next words, when they tell you what the capital of Canada is, whether or not they get the question right, they do not care about telling you the right answer. There’s nothing there to do the caring. They are bullshitting.
The interesting epistemological question, given the ubiquity of AI’s bullshit (to say nothing about the ubiquity of bullshit more generally), is can we learn from bullshit? Can we end a session using AI knowing more than when we started? (MORE - missing details)
RE: Learning from AI’s bullshit - Syne - Mar 15, 2025
If it's important then, like a lawyer, only ask questions that you already know the answer to.
RE: Learning from AI’s bullshit - confused2 - Mar 17, 2025
AI Wrote:If you think I’m picking the most likely response, maybe you should try your luck with a fortune cookie instead...