Copernicus claimed that his system was preferable in part on the grounds of its superior harmony and simplicity, but left very few hints as to what was meant by these terms. Copernicus’s pupil, Rheticus, was more forthcoming. Kepler, influenced by Rheticus, articulated further the nature of the virtues of harmony and simplicity. I argue that these terms are metaphors for the structural features of the Copernican system that make it more able to effectively exploit the available data. So it is (...) a mistake to conclude that early Copernicans could only offer aesthetic or pragmatic arguments; they could and did offer evidential ones as well. Moreover, the evidential arguments they offered parallel current arguments in the philosophical literature.Keywords: Nicolaus Copernicus; Georg Joachim Rheticus; Johannes Kepler; Simplicity; Bayesianism; Hirotsugu Akaike. (shrink)

According to Hitchcock and Sober’s argument from overfitting for weak predictivism, the fact that a theory accurately predicts a portion of its data is evidence that it has been formulated by balancing simplicity and goodness-of-fit rather than overfitting data. The core argument consists of two likelihood inequalities. In this paper I show that there is a surprising accommodation-friendly implication in their argument, and contend that it is beset by a substantial difficulty, namely, there is no good reason to think that (...) their second likelihood inequality is true. (shrink)

The philosophical significance of the procedure of applying Akaike Information Criterion (AIC) to curve-fitting problems is evaluated. The theoretical justification for using AIC (the so-called Akaike's theorem) is presented in a rigorous way, and its range of validity is assessed by presenting both instances in which it is valid and counter-examples in which it is invalid. The philosophical relevance of the justification that this result gives for making one particular choice between simple and complicated hypotheses is emphasized. In addition, recent (...) claims that the methods based on Akaike's theorem are relevant to other philosophical problems associated with the notion of simplicity are presented and evaluated. (shrink)

Curve-fitting typically works by trading off goodness-of-fit with simplicity, where simplicity is measured by the number of adjustable parameters. However, such methods cannot be applied in an unrestricted way. I discuss one such correction, and explain why the exception arises. The same kind of probabilistic explanation offers a surprising resolution to a common-sense dilemma.

Recent solutions to the curve-fitting problem, described in Forster and Sober ([1995]), trade off the simplicity and fit of hypotheses by defining simplicity as the paucity of adjustable parameters. Scott De Vito ([1997]) charges that these solutions are 'conventional' because he thinks that the number of adjustable parameters may change when the hypotheses are described differently. This he believes is exactly what is illustrated in Goodman's new riddle of induction, otherwise known as the grue problem. However, the 'number of adjustable (...) parameters' is actually a loose way of referring to a quantity that is not language dependent. The quantity arises out of Akaike's theorem in a way that ensures its language invariance. (shrink)

The theory of fast and frugal heuristics, developed in a new book called Simple Heuristics that make Us Smart (Gigerenzer, Todd, and the ABC Research Group, in press), includes two requirements for rational decision making. One is that decision rules are bounded in their rationality –- that rules are frugal in what they take into account, and therefore fast in their operation. The second is that the rules are ecologically adapted to the environment, which means that they `fit to reality.' (...) The main purpose of this article is to apply these ideas to learning rules–-methods for constructing, selecting, or evaluating competing hypotheses in science, and to the methodology of machine learning, of which connectionist learning is a special case. The bad news is that ecological validity is particularly difficult to implement and difficult to understand. The good news is that it builds an important bridge from normative psychology and machine learning to recent work in the philosophy of science, which considers predictive accuracy to be a primary goal of science. (shrink)

This paper is a response to Forster and Sober's [1994] solution to the curve-fitting problem. If their solution is correct, it will provide us with a solution to the New Riddle of Induction as well as provide a basis for choosing realism over conventionalism. Examining this solution is also important as Forster and Sober incorporate it in much of their other philosophical work (see Forster [1995a, b, 1994] and Sober [1996, 1995, 1993]). I argue that Forster and Sober's solution is (...) subject precisely to the problem they seek to solve. They provide a method of choosing among hypotheses but only at the cost of requiring that we have a method of choosing between different ways of conceptualizing the world. Thus the solution raises a new problem--the world-fitting problem. (shrink)

This thesis has two goals. Firstly, we consider the problem of model selection for the purposes of prediction. In modern science predictive mathematical models are ubiquitous and can be found in such diverse fields as weather forecasting, economics, ecology, mathematical psychology, sociology, etc. It is often the case that for a given domain of inquiry there are several plausible models, and the issue then is how to discriminate between them – this is the problem of model selection. We consider approaches (...) to model selection that are used in classical [also known as frequentist] statistics, and fashionable in recent years methods of Akaike Information Criterion [AIC] and Bayes Information Criterion [BIC], the latter being a part of a broader Bayesian approach. We show the connection between AIC and BIC, and provide comparison of performance of these methods. Secondly, we consider some philosophical arguments that arise within the setting of the model selection approaches investigated in the first part. These arguments aim to provide counterexamples to the epistemic thesis of scientific realism, viz., that predictively successful scientific theories are approximately true, and to the idea that truth and predictive accuracy go together. We argue for the following claims: 1) that none of the criticisms brought forward in the philosophical literature against the AIC methodology are devastating, and AIC remains a viable method of model selection; 2) that the BIC methodology likewise survives the numerous criticisms; 3) that the counterexamples to scientific realism that ostensibly arise within the framework of model selection are flawed; 4) that in general the model selection methods discussed in this thesis are neutral with regards to the issue of scientific realism; 5) that a plurality of methodologies should be applied to the problem of model selection with full awareness of the foundational issues that each of these methodologies has. (shrink)

Probabilistic inference from frequencies, such as "Most Quakers are pacifists; Nixon is a Quaker, so probably Nixon is a pacifist" suffer from the problem that an individual is typically a member of many "reference classes" (such as Quakers, Republicans, Californians, etc) in which the frequency of the target attribute varies. How to choose the best class or combine the information? The article argues that the problem can be solved by the feature selection methods used in contemporary Big Data science: the (...) correct reference class is that determined by the features relevant to the target, and relevance is measured by correlation (that is, a feature is relevant if it makes a difference to the frequency of the target). (shrink)