Algorithmic information theory gives an idealized notion of compressibility that is often presented as an objective measure of simplicity. It is suggested at times that Solomonoff prediction, or algorithmic information theory in a predictive setting, can deliver an argument to justify Occam’s razor. This article explicates the relevant argument and, by converting it into a Bayesian framework, reveals why it has no such justificatory force. The supposed simplicity concept is better perceived as a specific inductive assumption, the assumption of effectiveness. (...) It is this assumption that is the characterizing element of Solomonoff prediction and wherein its philosophical interest lies. (shrink)

The modalities come into the world by being projections or objectivizations of our epistemic constitution. Thus this paper is a statement of Humean projectivism. In fact, it goes beyond Simon Blackburn’s version. It is also designed as a comprehensive counter-program to David Lewis’ program of Humean supervenience. In detail, the paper explains: Already the basic fact that the world is a world of states of affairs is due to the nature of our epistemic states. Objects, which figure in states of (...) affairs and which embody metaphysical modality, are constitutable by their essential properties and in fact constituted by us according to our ontological policies. What the facts are, to which the correspondence notion of truth refers, is determined by applying an epistemic or pragmatic notion of truth to the world. Causation is a specific objectivization of our conditional beliefs. Nomicity is a ‘habit of belief’, a specific way of generalizing epistemic attitudes. This covers the basic metaphysical and natural modalities. The paper attempts to convey that talking of projection or objectivization is not just imagery, but a constructively realizable program. (shrink)

Ockham’s razor is the principle that, all other things being equal, scientists ought to prefer simpler theories. In recent years, philosophers have argued that simpler theories make better predictions, possess theoretical virtues like explanatory power, and have other pragmatic virtues like computational tractability. However, such arguments fail to explain how and why a preference for simplicity can help one find true theories in scientific inquiry, unless one already assumes that the truth is simple. One new solution to that problem is (...) the Ockham efficiency theorem, which states that scientists who heed Ockham’s razor retract their opinions less often and sooner than do their non-Ockham competitors. The theorem neglects, however, to consider competitors following random strategies and in many applications random strategies are known to achieve better worst-case loss than deterministic strategies. In this paper, we describe two ways to extend the result to a very general class of random, empirical strategies. The first extension concerns expected retractions, retraction times, and errors and the second extension concerns retractions in chance, times of retractions in chance, and chances of errors. (shrink)

Simple assumptions represent a decisive reason to prefer one theory to another in everyday scientific praxis. But this praxis has little philosophical justification, since there exist many notions of simplicity, and those that can be defined precisely strongly depend on the language in which the theory is formulated. The language dependence is a natural feature—to some extent—but it is also believed to be a fatal problem, because, according to a common general argument, the simplicity of a theory is always trivial (...) in a suitably chosen language. But, this trivialization argument is typically either applied to toy-models of scientific theories or applied with little regard for the empirical content of the theory. This paper shows that the trivialization argument fails, when one considers realistic theories and requires their empirical content to be preserved. In fact, the concepts that enable a very simple formulation, are not necessarily measurable, in general. Moreover, the inspection of a theory describing a chaotic billiard shows that precisely those concepts that naturally make the theory extremely simple are provably not measurable. This suggests that—whenever a theory possesses sufficiently complex consequences—the constraint of measurability prevents too simple formulations in any language. This explains why the scientists often regard their assessments of simplicity as largely unambiguous. In order to reveal a cultural bias in the scientists’ assessment, one should explicitly identify different characterizations of simplicity of the assumptions that lead to different theory selections. General arguments are not sufficient. (shrink)

Explaining the connection, if any, between simplicity and truth is among the deepest problems facing the philosophy of science, statistics, and machine learning. Say that an efficient truth finding method minimizes worst case costs en route to converging to the true answer to a theory choice problem. Let the costs considered include the number of times a false answer is selected, the number of times opinion is reversed, and the times at which the reversals occur. It is demonstrated that (1) (...) always choosing the simplest theory compatible with experience, and (2) hanging onto it while it remains simplest, is both necessary and sufficient for efficiency. †To contact the author, please write to: Department of Philosophy, Carnegie Mellon University, Baker Hall 135, Pittsburgh, PA 15213-3890; e-mail: [email protected]. (shrink)

One of the main goals of scientific research is to provide a description of the empirical data which is as accurate and comprehensive as possible, while relying on as few and simple assumptions as possible. In this paper, I propose a definition of the notion of few and simple assumptions that is not affected by known problems. This leads to the introduction of a simple model of scientific progress that is based only on empirical accuracy and conciseness. An essential point (...) in this task is the understanding of the role played by measurability in the formulation of a scientific theory. This is the key to prevent artificially concise formulations. The model is confronted here with many possible objections and with challenging cases of real progress. Although I cannot exclude that the model might have some limitations, it includes all the cases of genuine progress examined here, and no spurious one. In this model, I stress the role of the state of the art, which is the collection of all the theories that are the only legitimate source of scientific predictions. Progress is a global upgrade of the state of the art. (shrink)