Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5

Artificial Intelligence learns better when distracted

#1
C C Offline
https://www.rug.nl/sciencelinx/nieuws/20...ed?lang=en

RELEASE: How should you train your AI system? This question is pertinent, because many deep learning systems are still black boxes. Computer scientists from the Netherlands and Spain have now determined how a deep learning system well suited for image recognition learns to recognize its surroundings. They were able to simplify the learning process by forcing the system’s focus toward secondary characteristics.

Convolutional Neural Networks (CNNs) are a form of bio-inspired deep learning in artificial intelligence. The interaction of thousands of ‘neurons’ mimics the way our brain learns to recognize images. ‘These CNNs are successful, but we don’t fully understand how they work’, says Estefanía Talavera Martinez, lecturer and researcher at the Bernoulli Institute for Mathematics, Computer Science and Artificial Intelligence of the University of Groningen in the Netherlands.

Food. She has made use of CNNs herself to analyse images made by wearable cameras in the study of human behaviour. Among other things, Talavera Martinez has been studying our interactions with food, so she wanted the system to recognize the different settings in which people encounter food. ‘I noticed that the system made errors in the classification of some pictures and needed to know why this happened.’

By using heat maps, she analysed which parts of the images were used by the CNNs to identify the setting. ‘This led to the hypothesis that the system was not looking at enough details’, she explains. For example, if an AI system has taught itself to use mugs to identify a kitchen, it will wrongly classify living rooms, offices and other places where mugs are used. The solution that was developed by Talavera Martinez and her colleagues David Morales (Andalusian Research Institute in Data Science and Computational Intelligence, University of Granada) and Beatriz Remeseiro (Department of Computer Science, Universidad de Oviedo), both in Spain, is to distract the system from their primary targets.

Blurred. They trained CNNs using a standard image set of planes or cars and identified through heat maps which parts of the images were used for classification. Then, these parts were blurred in the image set, which was then used for a second round of training. ‘This forces the system to look elsewhere for identifiers. And by using this extra information, it becomes more fine-grained in its classification.’

The approach worked well in the standard image sets, and was also successful in the images Talavera Martinez had collected herself from the wearable cameras. ‘Our training regime gives us results similar to other approaches, but is much simpler and requires less computing time.’ Previous attempts to increase fine-grained classification included combining different sets of CNNs. The approach developed by Talavera Martinez and her colleagues is much more lightweight. ‘This study gave us a better idea of how these CNNs learn, and that has helped us to improve the training program.’

Reference: David Morales, Estefania Talavera and Beatriz Remeseiro: Playing to distraction: towards a robust training of CNN classifiers through visual explanation techniques. Neural Computing and Applications, first online 9 July 2021.
Reply


Possibly Related Threads…
Thread Author Replies Views Last Post
  Quotes about Artificial Intelligence Magical Realist 29 848 Jan 3, 2024 10:25 AM
Last Post: stryder
  Article Artificial intelligence: Four debates to expect in 2024 C C 0 49 Jan 3, 2024 02:01 AM
Last Post: C C
  Article A new approach to computation reimagines artificial intelligence C C 1 76 Apr 15, 2023 08:44 AM
Last Post: Kornee
  Article Artificial intelligence finds the first stars were not alone C C 0 49 Mar 27, 2023 07:14 PM
Last Post: C C
  The danger of advanced artificial intelligence controlling its own feedback C C 0 141 Oct 25, 2022 08:21 PM
Last Post: C C
  How artificial intelligence can explain its decisions C C 0 127 Sep 3, 2022 10:37 PM
Last Post: C C
  Will transformers take over artificial intelligence? C C 0 78 Mar 11, 2022 07:24 PM
Last Post: C C
  Consciousness in humans, animals and artificial intelligence C C 0 98 Dec 21, 2021 09:41 PM
Last Post: C C
  Artificial Intelligence that can discover hidden physical laws in various data C C 0 60 Dec 11, 2021 05:08 AM
Last Post: C C
  New report assesses progress and risks of artificial intelligence C C 0 73 Sep 17, 2021 01:58 AM
Last Post: C C



Users browsing this thread: 1 Guest(s)