This article argues that a successful answer to Hume's problem of induction can be developed from a sub-genre of philosophy of science known as formal learning theory. One of the central concepts of formal learning theory is logical reliability: roughly, a method is logically reliable when it is assured of eventually settling on the truth for every sequence of data that is possible given what we know. I show that the principle of induction (PI) is necessary and sufficient for logical (...) reliability in what I call simple enumerative induction. This answer to Hume's problem rests on interpreting PI as a normative claim justified by a non-empirical epistemic means-ends argument. In such an argument, a rule of inference is shown by mathematical or logical proof to promote a specified epistemic end. Since the proof concerning PI and logical reliability is not based on inductive reasoning, this argument avoids the circularity that Hume argued was inherent in any attempt to justify PI. (shrink)

The no-free-lunch theorems promote a skeptical conclusion that all possible machine learning algorithms equally lack justification. But how could this leave room for a learning theory, that shows that some algorithms are better than others? Drawing parallels to the philosophy of induction, we point out that the no-free-lunch results presuppose a conception of learning algorithms as purely data-driven. On this conception, every algorithm must have an inherent inductive bias, that wants justification. We argue that many standard learning algorithms should rather (...) be understood as model-dependent: in each application they also require for input a model, representing a bias. Generic algorithms themselves, they can be given a model-relative justification. (shrink)

Many epistemologists believe that the distinction between the genesis and the validity of a belief is a fundamental presupposition of adequate epistemological reflection. In this article it will be argued that the arguments for this majority conviction are not convincing. As an alternative it is suggested that the distin- ction between epistemic and non-epistemic procedures should be regarded as fundamental for epistemology.

There are two important traditions in the philosophy of induction. According to one tradition, which has dominated for the last couple of centuries, inductive arguments are warranted by rules. Bayesianism is the most popular view within this tradition. Rules of induction provide functional accounts of inductive support, but no rule is universal; hence, no rule is by itself an accurate model of inductive support. According to another tradition, inductive arguments are not warranted by rules but by matters of fact. Norton’s (...) material theory of induction (MTI) is an influential view within this tradition. Norton’s MTI fails to provide an account of inductive support, but it provides a good account of inductive warrant that can help us define the domain of validity of each rule of induction. Despite their limitations, both approaches to induction are illuminating important aspects of how relations of inductive support work. In this article I present a hybrid theory of induction (HTI), in which I acknowledge and articulate the role of both rules and matters of fact in our understanding of inductive support. According to the HTI, rules of induction accurately describe relations of inductive support when they are warranted, and a rule of induction is warranted if the right facts about the matter of the induction obtain. Crucially, the HTI allows us to address the main challenges that each tradition faces while retaining their strengths, thus obtaining a functional and accurate account of inductive support. The HTI also provides a useful general framework to examine and understand induction, to make sense of how different rules of induction can coexist and to tackle some problems in epistemology. Moreover, the HTI allows us to clarify and resolve some current debates on induction, like the apparent divide between Norton and rule-based theorists. (shrink)

According to John D. Norton's Material Theory of Induction, all reasonable inductive inferences are justified in virtue of background knowledge about local uniformities in nature. These local uniformities indicate that our samples are likely to be representative of our target population in our inductions. However, a variety of critics have noted that there are many circumstances in which induction seems to be reasonable, yet such background knowledge is apparently absent. I call such absences ‘the frontiers of science', where background scientific (...) theories do not provide information about such local uniformities. I argue that the Material Theory of Induction can be reconciled with our intuitions in favour of these inductions. I adapt an attempted justification of induction in general, the Combinatoric Justification of Induction, into a more modest rationalisation at the less foundational level that the critics discuss. Subject to a number of conditions, we can extrapolate from large samples using our knowledge of facts about the minimum proportions of representative subsets of finite sets. I also discuss some of Norton's own criticisms of his theory and argue that he is overly pessimistic. I conclude that Norton's theory at least performs well at the frontiers of science. (shrink)

John D. Norton’s “Material Theory of Induction” has been one of the most intriguing recent additions to the philosophy of induction. Norton’s account appears to be a notably natural account of actual inductive practices, although his theory has attracted considerable criticism. I detail several novel issues for his theory but argue that supplementing the Material Theory with a theory of direct inference could address these problems. I argue that if this combination is possible, a stronger theory of inductive reasoning emerges, (...) which has a more propitious answer to the Problem of Induction. (shrink)

According to John D. Norton's Material Theory of Induction, all inductive inferences are justified by local facts, rather than their formal features or some grand principles of nature's uniformity. Recently, Richard Dawid (Found Phys 45(9):1101–1109, 2015) has offered a challenge to this theory: in an adaptation of Norton's own celebrated "Dome" thought experiment, it seems that there are certain inductions that are intuitively reasonable, but which do not have any local facts that could serve to justify them in accordance with (...) Norton's requirements. Dawid's suggestion is that “raw induction” might have a limited but important role for such inferences. I argue that the Material Theory can accommodate such inductions, because there are local facts concerning the combinatoric features of the induction’s target populations that can licence the inferences in an analogous way to existing examples of material induction. Since my arguments are largely independent of the details of the Dome, Norton's theory emerges as surprisingly robust against criticisms of excessive narrowness. (shrink)

In a formal theory of induction, inductive inferences are licensed by universal schemas. In a material theory of induction, inductive inferences are licensed by facts. With this change in the conception of the nature of induction, I argue that the celebrated “problem of induction” can no longer be set up and is thereby dissolved. Attempts to recreate the problem in the material theory of induction fail. They require relations of inductive support to conform to an unsustainable, hierarchical empiricism.

I offer a meta-level analysis of realist arguments for the reliability of ampliative reasoning about the unobservable. We can distinguish form-driven and content-driven arguments for realism: form-driven arguments appeal to the form of inductive inferences, whilst content-driven arguments appeal to their specific content. After regimenting the realism debate in these terms, I will argue that the content-driven arguments are preferable. Along the way I will discuss how my analysis relates to John Norton’s recent, more general thesis that the grounds for (...) licit induction are always material. (shrink)

State of the art paper on the problem of induction: how to justify the conclusion that ‘all Fs are Gs’ from the premise that ‘all observed Fs are Gs’. The most prominent theories of contemporary philosophical literature are discussed and analysed, such as: inductivism, reliabilism, perspective of laws of nature, rationalism, falsificationism, the material theory of induction and probabilistic approaches, according to Carnap, Reichenbach and Bayesianism. In the end, we discuss the new problem of induction of Goodman, raised by the (...) grue predicate. (shrink)