Direct Human-AI Comparison in the Animal-AI Environment


Artificial Intelligence is making rapid and remarkable progress in the development of more sophisticated and powerful systems. However, the acknowledgement of several problems with modern machine learning approaches has prompted a shift in AI benchmarking away from task-oriented testing towards ability-oriented testing, in which AI systems are tested on their capacity to solve certain kinds of novel problems. The Animal-AI Environment is one such benchmark which aims to apply the ability-oriented testing used in comparative psychology to AI systems. Here, we present the first direct human-AI comparison in the Animal-AI Environment, using children aged 6–10. We found that children of all ages were significantly better than a sample of 30 AIs across most of the tests we examined, as well as performing significantly better than the two top-scoring AIs, “ironbar” and “Trrrrr,” from the Animal-AI Olympics Competition 2019. While children and AIs performed similarly on basic navigational tasks, AIs performed significantly worse in more complex cognitive tests, including detour tasks, spatial elimination tasks, and object permanence tasks, indicating that AIs lack several cognitive abilities that children aged 6–10 possess. Both children and AIs performed poorly on tool-use tasks, suggesting that these tests are challenging for both biological and non-biological machines.

Download options


    Upload a copy of this work     Papers currently archived: 72,660

External links

Setup an account with your affiliations in order to access resources via your University's proxy server

Through your library


Added to PP

5 (#1,211,454)

6 months
5 (#136,433)

Historical graph of downloads
How can I increase my downloads?

Similar books and articles

An Outline of a Theory of Affordances.Anthony Chemero - 2003 - Ecological Psychology 15 (2):181-195.
Can the Treatment of Animals Be Compared to the Holocaust?David Sztybel - 2006 - Ethics and the Environment 11 (1):97-132.
Can the Treatment of Animals Be Compared to the Holocaust?David Sztybel - 2006 - Ethics and the Environment 11 (1):97-132.
Animals and Humans, Thinking and Nature.David Morris - 2005 - Phenomenology and the Cognitive Sciences 4 (1):49-72.
Animal Welfare: Ends and Means.Roger Cryan - 1997 - Dissertation, University of Florida
Humanity and Animality. A Transdisciplinary Approach.Astrid Guillaume - 2013 - Human and Social Studies 2 (3):13-32.

Author Profiles

Matthew Crosby
Imperial College London
2 more

Citations of this work

No citations found.

Add more citations