Existential risk from AI and orthogonality: Can we have it both ways?

Ratio 35 (1):25-36 (2021)
  Copy   BIBTEX

Abstract

The standard argument to the conclusion that artificial intelligence (AI) constitutes an existential risk for the human species uses two premises: (1) AI may reach superintelligent levels, at which point we humans lose control (the ‘singularity claim’); (2) Any level of intelligence can go along with any goal (the ‘orthogonality thesis’). We find that the singularity claim requires a notion of ‘general intelligence’, while the orthogonality thesis requires a notion of ‘instrumental intelligence’. If this interpretation is correct, they cannot be joined as premises and the argument for the existential risk of AI turns out invalid. If the interpretation is incorrect and both premises use the same notion of intelligence, then at least one of the premises is false and the orthogonality thesis remains itself orthogonal to the argument to existential risk from AI. In either case, the standard argument for existential risk from AI is not sound.—Having said that, there remains a risk of instrumental AI to cause very significant damage if designed or used badly, though this is not due to superintelligence or a singularity.

Similar books and articles

First-Order Theories of Orthogonality Structures.Ruaan Kellerman - 2007 - Logic Journal of the IGPL 15 (3):255-270.
Vulnerability to Natural Hazards.Mark Coeckelbergh - 2016 - In Paolo Gardoni, Colleen Murphy & Arden Rowell (eds.), Risk Analysis of Natural Hazards. Springer. pp. 27-41.
Superintelligence as a Cause or Cure for Risks of Astronomical Suffering.Kaj Sotala & Lukas Gloor - 2017 - Informatica: An International Journal of Computing and Informatics 41 (4):389-400.
Agential Risks: A Comprehensive Introduction.Phil Torres - 2016 - Journal of Evolution and Technology 26 (2):31-47.
Varieties of Risk Representations.John Kadvany - 1997 - Journal of Social Philosophy 28 (3):123-143.

Analytics

Added to PP
2021-07-17

Downloads
655 (#23,357)

6 months
211 (#10,316)

Historical graph of downloads
How can I increase my downloads?

Author Profiles

Vincent C. Müller
Universität Erlangen-Nürnberg
Michael Cannon
Eindhoven University of Technology