As machine learning has gradually entered into ever more sectors of public and private life, there has been a growing demand for algorithmic explainability. How can we make the predictions of complex statistical models more intelligible to end users? A subdiscipline of computer science known as interpretable machine learning (IML) has emerged to address this urgent question. Numerous influential methods have been proposed, from local linear approximations to rule lists and counterfactuals. In this article, I highlight three conceptual challenges that (...) are largely overlooked by authors in this area. I argue that the vast majority of IML algorithms are plagued by (1) ambiguity with respect to their true target; (2) a disregard for error rates and severe testing; and (3) an emphasis on product over process. Each point is developed at length, drawing on relevant debates in epistemology and philosophy of science. Examples and counterexamples from IML are considered, demonstrating how failure to acknowledge these problems can result in counterintuitive and potentially misleading explanations. Without greater care for the conceptual foundations of IML, future work in this area is doomed to repeat the same mistakes. (shrink)

In place of the traditional epistemological view of knowledge as justified true belief we argue that artificial intelligence and law needs an evidence-based epistemology according to which scientific knowledge is based on critical analysis of evidence using argumentation. This new epistemology of scientific evidence (ESE) models scientific knowledge as achieved through a process of marshaling evidence in a scientific inquiry that results in a convergence of scientific theories and research results. We show how a dialogue interface of argument from expert (...) opinion, along with its set of critical questions, provides the argumentation component of the ESE. It enables internal scientific knowledge to be translated over into a wider arena in which individual nonexpert citizens and groups can make use of it. The external component shows how evidence is presented and used in a legal procedural setting that includes fact-finding, weighing the credibility of expert witnesses, and critical questioning of arguments. The paper critically reviews the standards of admissibility of scientific evidence using the ESE. (shrink)

Manipulation of quotation, shown to be a common tactic of argumentation in this paper, is associated with fallacies like wrenching from context, hasty generalization, equivocation, accent, the straw man fallacy, and ad hominem arguments. Several examples are presented from everyday speech, legislative debates and trials. Analysis using dialog models explains the critical defects of argumentation illustrated in each of the examples. In the formal dialog system CB, a proponent and respondent take turns in making moves in an orderly goal-directed sequence (...) of argumentation in which the proponent tries to persuade the respondent to become committed to a conclusion by asking questions and offering arguments. Analyzing quotation by using the notion of commitment in dialog, it is shown (a) how an arguer’s previous assertions can be brought to light in the course of a dialog to deal with problems arising from misquotation, (b) how the profile of dialog model allows a critic to analyse the fundamental effects misquotation brings about in a dialog, and (c) how the critic can use such an analysis to correct the problem. (shrink)

This paper offers a new model of belief by embedding the Peircean account of belief into a formal dialogue system that uses argumentation schemes for practical reasoning and abductive reasoning. A belief is characterised as a stable proposition that is derived abductively by one agent in a dialogue from the commitment set (including commitments derived from actions and goals) of another agent. On the model (to give a rough summary), a belief is defined as a proposition held by an agent (...) that (1) is not easily changed (stable), (2) is a matter of degree (held more or less weakly or strongly), (3) guides the goals and actions of the agent, and (4) is habitually or tenaciously held in a manner that indicates a strong commitment to defend it. It is argued that the new model overcomes the pervasive conflict in artificial intelligence between the belief-desire-intention model of reasoning and the commitment model. (shrink)

This paper builds a dialectical system of explanation with speech act rules that define the kinds of moves allowed, like requesting and offering an explanation. Pre and post-condition rules for the speech acts determine when a particular speech act can be put forward as a move in the dialogue, and what type of move or moves must follow it. A successful explanation has been achieved when there has been a transfer of understanding from the party giving the explanation to the (...) party asking for it. The dialogue has an opening stage, an explanation stage and a closing stage. Whether a transfer of understanding has taken place is tested by a dialectical shift to an examination dialogue. (shrink)

In one of his papers, Moti Mizrahi argues that arguments from an expert opinion are weak arguments. His thesis may seem controversial due to the consensus on this topic in the field of informal logic. I argue that its controversy is framework-dependent, and if translated into a different framework, it appears to be a correct, however trivial, claim. I will use a framework based on Douglas Walton’s argumentation scheme theory and his conception of examination dialogue to demonstrate that it is (...) so. It appears that Mizrahi’s idiosyncratic framework provides an excessively restrictive conception of an argument from expert opinion than Walton’s scheme does. There is no quarrel between both frameworks, as they yield analogous, almost identical, outcomes of argument evaluation. The actual and crucial disagreement is on the topic of argument classification. Mizrahi’s conception of arguments from an expert opinion imposes exact conditions that such argument must fulfil: an expert’s opinion o truth-value must be unknown; o must be unsupported by any evidence; an expert’s peers neither accept o nor reject it. These exclude, by definition, every possible strong, in Walton’s terms, variant of such an argument. Therefore, if rephrased with the notions of the examination dialogue framework, Mizrahi’s thesis sounds as follows: weak arguments from expert opinion are weak arguments. (shrink)

The notions of types of dialogue and dialectical relevance are central themes in Walton’s work and the grounds for a dialectical approach to many fallacies. After outlining the dialogue models constituting the background of Walton’s account, this article presents the concepts of dialectical relevance and dialogue shifts in their application to biased argumentation, fallacious moves, and illicit argumentative strategies. Showing the different dialectical proposals Walton advanced in several studies on argumentation as a development of a dialogical system, it has proved (...) possible to highlight the fundamental aspects of his theory in a comprehensive model of communication and interaction. (shrink)

We shall investigate the similarities and dissimilarities between old and new dialectic. For the ‘old dialectic’, we base our survey mainly on Aristotle’s Topics and Sophistical Refutations, whereas for the ‘new dialectic’, we turn to contemporary views on dialogical interaction, such as can, for the greater part, be found in Walton’s The New Dialectic. Three issues are taken up: types of dialogue, fallacies, and strategies. Though one should not belittle the differences in scope and outlook that obtain between the old (...) and the new dialectic, the paper will show that in many respects the old dialectic foreshadows the new dialectic. (shrink)

Using the profiles of dialogue method we identify a species of ad verecundiam fallacy that works by forestalling of questioning in arguments from expert opinion. A profile of dialogue is a graph structure used to model a sequence of speech acts surrounding both the putting forward of an argument and the response to it at the next moves in a dialogue. The method is applied to a case of cross-examining a software engineer in a legal deposition in a case of (...) intellectual property litigation. (shrink)

Herein, I consider arguments resting on an appeal to a non-existent authority as a species of argument from authority, and ultimately show them to be reliant on arguments from analogy in their inferential force. Three sub-types of argument are discussed: from authorities as yet unborn, no longer living, or incapable of ever doing so. In each case it is shown that an element of arguing from analogy is required since there can be no direct evidence of any assertions of the (...) source. In conclusion, it is suggested that such steps of analogy are employed frequently in traditional arguments from authority. (shrink)

In this paper I describe the apparent differences between the views of Mizrahi and Seidel on the strength of arguments from expert opinion. I show that most of Seidel's objections rely on an understanding of the words 'expert' and 'opinion' different from those which Mizrahi employs. I also discuss certain inconsistencies found in both papers over the use of these key terms. The paper concludes by noting that Mizrahi is right to suggest that evidence shows expert predictions to be unreliable, (...) but Seidel is correct to observe that this finding should not be used to claim that expert opinion in general is not to be trusted. (shrink)

What role, if any, does dialectic play in Aristotle’s epistemology in the Topics? In this paper I argue that it does play a role, but a role that is independent of endoxa. In the first section, I sketch the case for thinking that dialectic plays a distinctively epistemological role—not just a methodological role, or a merely instrumental role in getting episteme. In the second section, I consider three ways it could play that role, on two of which endoxa play at (...) least a co-starring role. But in the third section, I argue that endoxa don’t play that co-starring role, by arguing for a deflationary account of what endoxa are. For that reason, the third view emerges as the most plausible; but the third view is, I’ll suggest, Platonic. (shrink)

Douglas Walton’s multitudinous contributions to the study of argumentation seldom, if ever, directly engage with argumentation in mathematics. Nonetheless, several of the innovations with which he is most closely associated lend themselves to improving our understanding of mathematical arguments. I concentrate on two such innovations: dialogue types (§1) and argumentation schemes (§2). I argue that both devices are much more applicable to mathematical reasoning than may be commonly supposed.

The questions concerning rationality and the ethics of verbal occurrences are at the centre of the deliberations of social communication. The antagonistic and cooperative functions of social discourses are connected with the notion of a conflict and the capability of solving it. Argumentative discourse as one of the types of social discourse is discussed within the framework of pragmatic, dialectic and rhetorical models. This paper is an attempt at critical assessment of the pragma-dialectical model of argumentation proposed by Frans H. (...) Eemeren and Rob Grootendorst. I defend the standpoint that the application of the pragma-dialectical model to the analysis of argumentation reliability in a naturally occurring discussion requires an expansion of the concepts introduced in the pragma-dialectical theory. (shrink)

I characterize the deductivist ideal of justification and, following to a great extent Toulmin’s work The Uses of Argument, I try to explain why this ideal is erroneous. Then I offer an alternative model of justification capable of making our claims to knowledge about substantial matters sound and reasonable. This model of justification will be based on a conception of justification as the result of good argumentation, and on a model of argumentation which is a pragmatic linguistic reconstruction of Toulmin’s (...) model of argument. (shrink)

In this paper, I will try to answer the question: How are we supposed to assess the expert’s opinion in an argument from the position of an outsider to the specialized field? by placing it in the larger context of the political status of epistemic authority. In order to do this I will first sketch the actual debate around the problem of expertise in a democracy and relate this to the issue of the status of science in society. Secondly, I (...) will review how Douglas Walton’s pragma-dialectical approach offers a practical procedure to assess the expert bias from a nonprofessional’s perspective. Thirdly, I will introduce the problem of group bias using insights from Bohman and Fischer and show how Walton’s solution does not address this specific type of bias. Lastly, I will try proposing a revision of Walton’s solution in order to address this problem. In order to make the explanation more easy to follow I will use a case study concerning the medical expertise in the public debate on second-hand smoke. (shrink)