Scivillage.com Casual Discussion Science Forum

Full Version: Why relying on AI may lead to poor decision-making
You're currently viewing a stripped down version of our content. View the full version with proper formatting.
https://www.lancaster.ac.uk/news/why-rel...ion-making

PRESS RELEASE: Guidance based on Artificial Intelligence (AI) may be uniquely placed to foster biases in humans, leading to less effective decision making say researchers, who found that people with a positive view of AI may be at higher risk of being misled by AI tools.

The study entitled “Examining Human Reliance on Artificial Intelligence in Decision Making” is published in Scientific Reports.

Lead author Dr Sophie Nightingale of Lancaster University said: “Understanding human reliance on AI is critical given controversial reports of AI inaccuracy and bias. Furthermore, the erroneous belief that using technology removes biases may lead to overreliance on AI.”

The research team also included Joe Pearson, formerly of Lancaster University, Itiel Dror from Cognitive Consultants International (CCI-HQ) and Emma Jayes, Georgina Mason and Grace-Rose Whordley from the Defence Science and Technology Laboratory. They asked 295 participants to judge the authenticity of 80 faces, half of which were real and half created by AI.

The task was accompanied by text providing guidance - supposedly from humans or from AI - giving predictions as to whether the face was real or fake. Examples of guidance include “based on the predictions of 100 humans with expertise in facial recognition, this is a synthetic face” and “based on an algorithm trained to classify real and synthetic faces, the prediction is this is a real face”.

However, unknown to the participants, the guidance was correct only half of the time. 20 of each type of face (real or synthetic) were presented alongside correct guidance and 20 alongside incorrect guidance. The faces appeared in a random order, and participants were unaware of the manipulation of real versus synthetic faces and correct versus incorrect guidance.

Following the task, participants were asked to complete the human trust scale and the General Attitudes towards Artificial Intelligence Scale (GAAIS), which measured their propensity to trust other people as well as their general attitudes towards AI.

The results revealed that more positive attitudes toward AI produced a reduced ability to discriminate between real and synthetic faces but this was only the case for those who received AI guidance, not for those who received human guidance.

Dr Nightingale said: “The public are increasingly being offered AI solutions to help them to navigate decision making in the real world. But our findings suggest that AI-driven support tools may be uniquely placed to engender biases in humans and may ultimately impair rather than elevate decision making.

“Specifically, more positive attitudes toward AI produced a reduced ability to discriminate between real and synthetic faces but this was only the case for those who received AI guidance, not for those who received human guidance. This highlights how people with a positive view of AI may be at higher risk of being misled by AI tools.”

She added that more research is needed to understand precisely how humans use AI guidance in various contexts.
Seems like a self-fulfilling prophecy, where the believers in AI sentience will be the ones duped. Something about false idols...
Humans are expert at looking at human faces. Those tending to 'like' AI may well be less interested in human faces than the more human orientated folks. You end up with what Syne describes a self-fulfilling prophecy.
How do they rate on tasks that can be judged more objectively?
Programming.
9/10ths of programming is giving a good description of what you want the program to do. If you can do that an AI can write the program in a fraction of a second. Month by month AIs are getting better at filling in the things that a human would automatically do - for example buttons on a screen are ordered by importance without this needing to be explicitly specified. For a while the Chinese AI was rated highest .. currently Gemini (with subscription) is the favourite. For circuit boards .. just knowing the specs and cost of every industry standard IC is an advantage. Humans tend to use fancy ICs that are wonderful at what they do but become expensive and/or obsolete within a few years .. sometimes even months.
In competitions where humans excel they still have the edge over AI. In some hardware and software applications it seems AI is already far superior to a human .. and getting better every day.