Research  It’s disturbingly easy to trick AI into seeing aliens

#1
C C Offline
https://www.eurekalert.org/news-releases/1135009

EXCERPT: So Adami and Gupta did an experiment where they created artificial forms of life using a computer program called Avida, and then trained an AI to detect them.

In the Avida universe, digital organisms written in computer code — essentially strings of commands — copy themselves over and over again in a virtual Petri dish inside the computer. Each time they replicate, the copying process is imperfect and their computer code changes, just like the genetic code of real organisms mutates when they reproduce.

Such forms of “digital life” have been used for several decades to study evolution, Adami explained. For the study, the researchers used Avida to generate tens of thousands of digital organisms, some of which contained the instructions needed to copy themselves and others not. They then used them to train a neural network to distinguish between the two with 99.97% accuracy.

However, when the researchers put the neural network to the test on examples it had never seen before, the results looked far less impressive.

In their experiments, the researchers started by presenting the neural network with a digital organism that the AI correctly deemed incapable of copying itself. Then by gradually swapping out one operation for another in the organism’s computer code, the researchers were able to trick the AI into misclassifying the organism as self-replicating, in as few as 150 tries.

In other words, with just a few tweaks, the team showed that it was possible to convince the AI that it was seeing signs of life where they didn’t exist.

"No matter what sequence of commands we started with, we were able to fool the AI 100% of the time," said Gupta, a PhD student in computer science and engineering at MSU. The number of sequences that could potentially trip up the network is vast. “So the likelihood of encountering such a sequence is substantial,” Adami added.

This risk of false positives raises the likelihood that space missions could be fooled into thinking they’d made a discovery by the data they gather, only to be proven wrong later.

Having trained an AI on computer-generated data, next the researchers plan to re-train the model with real-world data and see how easy it is to deceive, Gupta said. The findings underscore a known weakness in many contemporary AI models.

“AI has an Achilles heel,” said Adami, professor in MSU’s departments of microbiology and molecular genetics, and physics and astronomy. “It can see a pattern and completely misclassify it.”

Beyond the search for alien life, this weakness could also be problematic as AI continues to move into medical scanners, security cameras, self-driving cars and other devices in everyday use here on Earth... (MORE - no ads)
Reply
#2
Magical Realist Offline
Perhaps proving that what we call and define as "alive" is itself a morphemic swamp of semantic vagaries. Any LLM trained on our language would be limited by these very nebulous and inexact categorical terms. Shall we then discard the whole notion of life as a specific "in-itself" property of matter when our very definition of matter seems to necessarily exclude it? Perhaps. Perhaps life is simply situational and relational, not some ghostly essence haunting the interstices of material substances. Could we even conceive of alien entities without this assumed property called "life"? Why for instance isn't the Brownian motion of heat a form of life? Or electricity? Or the incandescent plasma of stars? Life defined then as self-organizing and self-potentializing transmogrification of matter with energy.

https://carlzimmer.com/the-meaning-of-life-437/

"As we explore the universe, Cleland thinks we should leave all of our preconceptions about what life has to be at home. “When you go into outer space, you’re going to find weird physical systems,” she says. “Some of them are going to be living, but a lot of them are going to be non-living. There are lots and lots of phenomena discovered on Mars and Titan that nobody has been able to figure out. So we’re going to be running into weird stuff period when we go to other worlds. The most important thing is to search for anomalies.”

It’s anomalies, Cleland points out, that have always pushed science forward, as scientists have recognized inconsistencies in their old ideas. They expose the flaws in old ways of thinking. They both force and allow scientists to expand the scope of their vision. If Cleland is right, scientific anomalies have the potential to truly broaden our understanding of life. In some cases, they may turn out to be little more than peculiar chemistry that has nothing to do with life. But in other cases, they may actually be “life” that defies all our expectations of what the term may comprise..."
Reply


Possibly Related Threads…
Thread Author Replies Views Last Post
  Research Seeing infrared: scientists create contact lenses that grant ‘super-vision’ C C 1 3,979 May 29, 2025 02:09 AM
Last Post: confused2
  Research Temporary tattoo printed on scalp offers easy solution for measuring brainwaves C C 0 3,668 Dec 2, 2024 06:08 PM
Last Post: C C
  New microscope sees through intact skull + Device enables "seeing" shapes minus eyes C C 0 3,737 Dec 3, 2020 09:57 PM
Last Post: C C



Users browsing this thread: 1 Guest(s)