Against Interpretability: a Critical Examination of the Interpretability Problem in Machine Learning

Philosophy and Technology 33 (3):487-502 (2020)

Abstract

The usefulness of machine learning algorithms has led to their widespread adoption prior to the development of a conceptual framework for making sense of them. One common response to this situation is to say that machine learning suffers from a “black box problem.” That is, machine learning algorithms are “opaque” to human users, failing to be “interpretable” or “explicable” in terms that would render categorization procedures “understandable.” The purpose of this paper is to challenge the widespread agreement about the existence and importance of a black box problem. The first section argues that “interpretability” and cognates lack precise meanings when applied to algorithms. This makes the concepts difficult to use when trying to solve the problems that have motivated the call for interpretability. Furthermore, since there is no adequate account of the concepts themselves, it is not possible to assess whether particular technical features supply formal definitions of those concepts. The second section argues that there are ways of being a responsible user of these algorithms that do not require interpretability. In many cases in which a black box problem is cited, interpretability is a means to a further end such as justification or non-discrimination. Since addressing these problems need not involve something that looks like an “interpretation” of an algorithm, the focus on interpretability artificially constrains the solution space by characterizing one possible solution as the problem itself. Where possible, discussion should be reformulated in terms of the ends of interpretability.

Download options

PhilArchive



    Upload a copy of this work     Papers currently archived: 72,694

External links

Setup an account with your affiliations in order to access resources via your University's proxy server

Through your library

Analytics

Added to PP
2019-08-13

Downloads
177 (#68,363)

6 months
18 (#48,081)

Historical graph of downloads
How can I increase my downloads?

Similar books and articles

Explaining Explanations in AI.Brent Mittelstadt - forthcoming - FAT* 2019 Proceedings 1.
Interpretability Over Peano Arithmetic.Claes Strannegard - 1999 - Journal of Symbolic Logic 64 (4):1407-1425.
Interpretability Over Peano Arithmetic.Claes Strannegård - 1999 - Journal of Symbolic Logic 64 (4):1407-1425.
The Formalization of Interpretability.Albert Visser - 1991 - Studia Logica 50 (1):81 - 105.
Hammond.Claes Strannegard - 1999 - Journal of Symbolic Logic 64 (4):1407-1425.
Interpretability Degrees of Finitely Axiomatized Sequential Theories.Albert Visser - 2014 - Archive for Mathematical Logic 53 (1-2):23-42.
Interpolation and the Interpretability Logic of PA.Evan Goris - 2006 - Notre Dame Journal of Formal Logic 47 (2):179-195.
Interpretability In.Marta Bílková, Dick de Jongh & Joost J. Joosten - 2010 - Annals of Pure and Applied Logic 161 (2):128-138.
On Interpretability of Almost Linear Orderings.Akito Tsuboi & Kentaro Wakai - 1998 - Notre Dame Journal of Formal Logic 39 (3):325-331.