“Trust but Verify”: The Difficulty of Trusting Autonomous Weapons Systems

Journal of Military Ethics 17 (1):2-20 (2018)
  Copy   BIBTEX

Abstract

ABSTRACTAutonomous weapons systems pose many challenges in complex battlefield environments. Previous discussions of them have largely focused on technological or policy issues. In contrast, we focus here on the challenge of trust in an AWS. One type of human trust depends only on judgments about the predictability or reliability of the trustee, and so are suitable for all manner of artifacts. However, AWSs that are worthy of the descriptor “autonomous” will not exhibit the required strong predictability in the complex, changing contexts of war. Instead, warfighters need to develop deeper, interpersonal trust that is grounded in understanding the values, beliefs, and dispositions of the AWS. Current acquisition, training, and deployment processes preclude the development of such trust, and so there are currently no routes for a warfighter to develop trust in an AWS. We thus survey three possible changes to current practices in order to facilitate the type of deep trust that is required for appropri...

Links

PhilArchive



    Upload a copy of this work     Papers currently archived: 93,031

External links

Setup an account with your affiliations in order to access resources via your University's proxy server

Through your library

Similar books and articles

Trust and resilient autonomous driving systems.Adam Henschke - 2020 - Ethics and Information Technology 22 (1):81-92.
Robots and Respect: A Response to Robert Sparrow.Ryan Jenkins & Duncan Purves - 2016 - Ethics and International Affairs 30 (3):391-400.
Trustworthiness of autonomous systems.S. Kate Devitt - 2018 - In Hussein A. Abbass, Jason Scholz & Darryn Reid (eds.), Foundations of Trusted Autonomous Systems. Springer. pp. 161-184.
Trust, Mistrust and Distrust in Diverse Societies.James Tully - forthcoming - In Dimitr Karmis & Francois Rocher (eds.), Trust and Distrust in Political Theory and Practice: The Case of Diverse Societies. Montreal & Kingston: McGill-Queens.

Analytics

Added to PP
2018-06-15

Downloads
96 (#184,245)

6 months
16 (#171,938)

Historical graph of downloads
How can I increase my downloads?

Author Profiles

Heather Roff
University of Denver
David Danks
University of California, San Diego

References found in this work

Killer robots.Robert Sparrow - 2007 - Journal of Applied Philosophy 24 (1):62–77.
The Strategic Robot Problem: Lethal Autonomous Weapons in War.Heather M. Roff - 2014 - Journal of Military Ethics 13 (3):211-227.

Add more references