Direct Human-AI Comparison in the Animal-AI Environment

Frontiers in Psychology 13 (2022)
  Copy   BIBTEX

Abstract

Artificial Intelligence is making rapid and remarkable progress in the development of more sophisticated and powerful systems. However, the acknowledgement of several problems with modern machine learning approaches has prompted a shift in AI benchmarking away from task-oriented testing towards ability-oriented testing, in which AI systems are tested on their capacity to solve certain kinds of novel problems. The Animal-AI Environment is one such benchmark which aims to apply the ability-oriented testing used in comparative psychology to AI systems. Here, we present the first direct human-AI comparison in the Animal-AI Environment, using children aged 6–10. We found that children of all ages were significantly better than a sample of 30 AIs across most of the tests we examined, as well as performing significantly better than the two top-scoring AIs, “ironbar” and “Trrrrr,” from the Animal-AI Olympics Competition 2019. While children and AIs performed similarly on basic navigational tasks, AIs performed significantly worse in more complex cognitive tests, including detour tasks, spatial elimination tasks, and object permanence tasks, indicating that AIs lack several cognitive abilities that children aged 6–10 possess. Both children and AIs performed poorly on tool-use tasks, suggesting that these tests are challenging for both biological and non-biological machines.

Other Versions

No versions found

Links

PhilArchive



    Upload a copy of this work     Papers currently archived: 97,405

External links

Setup an account with your affiliations in order to access resources via your University's proxy server

Through your library

Analytics

Added to PP
2022-05-26

Downloads
34 (#527,007)

6 months
12 (#403,831)

Historical graph of downloads
How can I increase my downloads?

Author Profiles

Matthew Crosby
Imperial College London
2 more

Citations of this work

No citations found.

Add more citations

References found in this work

Computing machinery and intelligence.Alan Turing - 1950 - Mind 59 (October):433-60.
Animal intelligence.Edward L. Thorndike - 1899 - Psych Revmonog 8 (2):207-208.
Animal Intelligence: Experimental Studies.Edward L. Thorndike - 1912 - Journal of Philosophy, Psychology and Scientific Methods 9 (7):193-194.

View all 12 references / Add more references