We consider two players each of whom attempts to predict the behavior of the other, using no more than the history of earlier predictions. Behaviors are limited to a pair of options, conventionally denoted by 0, 1. Such players face the problem of learning to coordinate choices. The present paper formulates their situation recursion theoretically, and investigates the prospects for success. A pair of players build up a matrix with two rows and infinitely many columns, and are said to “learn” (...) each other if cofinitely many of the columns show the same number in both rows (either 0 or 1). Among other results we prove that there are two collections of players that force all other players to choose their camp. Each collection is composed of players that learn everyone else in the same collection, but no player that learns all members of one collection learns any member of the other. (shrink)

A model of inductive inquiry is defined within the context of first‐order logic. The model conceives of inquiry as a game between Nature and a scientist. To begin the game, a nonlogical vocabulary is agreed upon by the two players, along with a partition of a class of countable structures for that vocabulary. Next, Nature secretly chooses one structure from some cell of the partition. She then presents the scientist with a sequence of facts about the chosen structure. With each (...) new datum the scientist announces a guess about the cell to which the chosen structure belongs. To succeed in his or her inquiry, the scientist’s successive conjectures must be correct all but finitely often, that is, the conjectures must converge in the limit to the correct cell. Different kinds of scientists can be investigated within this framework. At opposite ends of the spectrum are dumb scientists that rely on the strategy of “induction by enumeration,” and smart scientists that rely on an operator of belief revision. We report some results about the scope and limits of these two inductive strategies. (shrink)

The remarkable transition from helpless infant to sophisticatedfive-year-old has long captured the attention of scholars interested inthe discovery of knowledge. To explain these achievements, developmentalpsychologists often compare children's discovery procedures to those ofprofessional scientists. For the child to be qualified as a ``littlescientist'', however, intellectual development must be shown to derivefrom rational hypothesis selection in the face of evidence. In thepresent paper we focus on one dimension of rational theory-choice,namely, the relation between hypothesis confirmation and evidencediversity. Psychological research suggests cultural (...) variability inappreciating evidence diversity and lack of such appreciation by youngchildren. Before reaching conclusions about the ``little scientist''thesis, however, it is essential to normatively analyze the diversityissue. We undertake such an analysis within a Bayesianperspective. (shrink)

This article argues that a successful answer to Hume's problem of induction can be developed from a sub-genre of philosophy of science known as formal learning theory. One of the central concepts of formal learning theory is logical reliability: roughly, a method is logically reliable when it is assured of eventually settling on the truth for every sequence of data that is possible given what we know. I show that the principle of induction (PI) is necessary and sufficient for logical (...) reliability in what I call simple enumerative induction. This answer to Hume's problem rests on interpreting PI as a normative claim justified by a non-empirical epistemic means-ends argument. In such an argument, a rule of inference is shown by mathematical or logical proof to promote a specified epistemic end. Since the proof concerning PI and logical reliability is not based on inductive reasoning, this argument avoids the circularity that Hume argued was inherent in any attempt to justify PI. (shrink)

This paper develops a means–end analysis of an inductive problem that arises in particle physics: how to infer from observed reactions conservation principles that govern all reactions among elementary particles. I show that there is a reliable inference procedure that is guaranteed to arrive at an empirically adequate set of conservation principles as more and more evidence is obtained. An interesting feature of reliable procedures for finding conservation principles is that in certain precisely defined circumstances they must introduce hidden particles. (...) Among the reliable inductive methods there is a unique procedure that minimizes convergence time as well as the number of times that the method revises its conservation principles. Thus the aims of reliable, fast and steady convergence to an empirically adequate theory single out a unique optimal inference for a given set of observed reactions—including prescriptions for when exactly to introduce hidden particles. (shrink)

The remarkable transition from helpless infant to sophisticatedfive-year-old has long captured the attention of scholars interested inthe discovery of knowledge. To explain these achievements, developmentalpsychologists often compare children's discovery procedures to those ofprofessional scientists. For the child to be qualified as a ``littlescientist'', however, intellectual development must be shown to derivefrom rational hypothesis selection in the face of evidence. In thepresent paper we focus on one dimension of rational theory-choice,namely, the relation between hypothesis confirmation and evidencediversity. Psychological research suggests cultural (...) variability inappreciating evidence diversity and lack of such appreciation by youngchildren. Before reaching conclusions about the ``little scientist''thesis, however, it is essential to normatively analyze the diversityissue. We undertake such an analysis within a Bayesianperspective. (shrink)

A familiar adage in the philosophy of science is that general hypotheses are better supported by varied evidence than by uniform evidence. Several studies suggest that young children do not respect this principle, and thus suffer from a defect in their inductive methodology. We argue that the diversity principle does not have the normative status that psychologists attribute to it, and should be replaced by a simple rule of probability. We then report experiments designed to detect conformity to the latter (...) rule in children's inductive judgment. The results suggest that young children in both the United States and Taiwan are sensitive to the constraints imposed by the rule on judgments of probability and evidential strength. We conclude with a suggested reinterpretation of the thesis that children's inductive methodology qualifies them as “little scientists.”. (shrink)

According to the conventional wisdom, Turing said that computing machines can be intelligent. I don't believe it. I think that what Turing really said was that computing machines –- computers limited to computing –- can only fake intelligence. If we want computers to become genuinelyintelligent, we will have to give them enough “initiative” to do more than compute. In this paper, I want to try to develop this idea. I want to explain how giving computers more ``initiative'' can allow them (...) to do more than compute. And I want to say why I believe that they will have to go beyond computation before they can become genuinely intelligent. (shrink)

Ockham’s razor is the characteristic scientific penchant for simpler, more testable, and more unified theories. Glymour’s early work on confirmation theory eloquently stressed the rhetorical plausibility of Ockham’s razor in scientific arguments. His subsequent, seminal research on causal discovery still concerns methods with a strong bias toward simpler causal models, and it also comes with a story about reliability—the methods are guaranteed to converge to true causal structure in the limit. However, there is a familiar gap between convergent reliability and (...) scientific rhetoric: convergence in the long run is compatible with any conclusion in the short run. For that reason, Carnap suggested that the proper sense of reliability for scientific inference should lie somewhere between short-run reliability and mere convergence in the limit. One natural such concept is straightest possible convergence to the truth, where straightness is explicated in terms of minimizing reversals of opinion and cycles of opinion prior to convergence. We close the gap between scientific rhetoric and scientific reliability by showing that Ockham’s razor is necessary for cycle-optimal convergence to the truth, and that patiently waiting for information to resolve conflicts among simplest hypotheses is necessary for reversal-optimal convergence to the truth. (shrink)

I propose that empirical procedures, like computational procedures, are justified in terms of truth-finding efficiency. I contrast the idea with more standard philosophies of science and illustrate it by deriving Ockham's razor from the aim of minimizing dramatic changes of opinion en route to the truth.

Belief revision theory concerns methods for reformulating an agent's epistemic state when the agent's beliefs are refuted by new information. The usual guiding principle in the design of such methods is to preserve as much of the agent's epistemic state as possible when the state is revised. Learning theoretic research focuses, instead, on a learning method's reliability or ability to converge to true, informative beliefs over a wide range of possible environments. This paper bridges the two perspectives by assessing the (...) reliability of several proposed belief revision operators. Stringent conceptions of minimal change are shown to occasion a limitation called inductive amnesia: they can predict the future only if they cannot remember the past. Avoidance of inductive amnesia can therefore function as a plausible and hitherto unrecognized constraint on the design of belief revision operators. (shrink)

The thesis of this paper is that we can justify induction deductively relative to one end, and deduction inductively relative to a different end. I will begin by presenting a contemporary variant of Hume ’s argument for the thesis that we cannot justify the principle of induction. Then I will criticize the responses the resulting problem of induction has received by Carnap and Goodman, as well as praise Reichenbach ’s approach. Some of these authors compare induction to deduction. Haack compares (...) deduction to induction, and I will critically discuss her argument for the thesis that we cannot justify the principles of deduction next. In concluding I will defend the thesis that we can justify induction deductively relative to one end, and deduction inductively relative to a different end, and that we can do so in a non-circular way. Along the way I will show how we can understand deductive and inductive logic as normative theories, and I will briefly sketch an argument to the effect that there are only hypothetical, but no categorical imperatives. (shrink)

The purpose of this survey is twofold: (1) to place some centralthemes of epistemic logic in a general epistemological context,and (2) to outline a new framework for epistemic logic developedjointly with S. Andur Pedersen unifying some key ``mainstream''epistemological concerns with the ``formal'' epistemologicalapparatus.

This paper discusses the possibility of modelling inductive inference (Gold 1967) in dynamic epistemic logic (see e.g. van Ditmarsch et al. 2007). The general purpose is to propose a semantic basis for designing a modal logic for learning in the limit. First, we analyze a variety of epistemological notions involved in identification in the limit and match it with traditional epistemic and doxastic logic approaches. Then, we provide a comparison of learning by erasing (Lange et al. 1996) and iterated epistemic (...) update (Baltag and Moss 2004) as analyzed in dynamic epistemic logic. We show that finite identification can be modelled in dynamic epistemic logic, and that the elimination process of learning by erasing can be seen as iterated belief-revision modelled in dynamic doxastic logic. Finally, we propose viewing hypothesis spaces as temporal frames and discuss possible advantages of that perspective. (shrink)

This paper discusses Kevin Kelly’s recent attempt to justify Ockham’s Razor in terms of truth-finding efficiency. It is argued that Kelly’s justification fails to warrant confidence in the empirical content of theories recommended by Ockham’s Razor. This is a significant problem if, as Kelly and many others believe, considerations of simplicity play a pervasive role in scientific reasoning, underlying even our best tested theories, for the proposal will fail to warrant the use of these theories in practical prediction.

We present a framework that provides a logic for science by generalizing the notion of logical (Tarskian) consequence. This framework will introduce hierarchies of logical consequences, the first level of each of which is identified with deduction. We argue for identification of the second level of the hierarchies with inductive inference. The notion of induction presented here has some resonance with Popper's notion of scientific discovery by refutation. Our framework rests on the assumption of a restricted class of structures in (...) contrast to the permissibility of classical first-order logic. We make a distinction between deductive and inductive inference via the notions of compactness and weak compactness. Connections with the arithmetical hierarchy and formal learning theory are explored. For the latter, we argue against the identification of inductive inference with the notion of learnable in the limit. Several results highlighting desirable properties of these hierarchies of generalized logical consequence are also presented. (shrink)

The article addresses the issue of dynamics of science, in particular of new sciences born in twentieth century and developed after the Second World War (information science, materials science, life science). The article develops the notion of search regime as an abstract characterization of dynamic patterns, based on three dimensions: the rate of growth, the degree of internal diversity of science and the associated dynamics (convergent vs. proliferating), and the nature of complementarity. The article offers a conceptual discussion for the (...) argument that new sciences follow a different pattern than established sciences and presents preliminary evidence drawn from original data in particle physics, computer science and nanoscience. (shrink)

This paper answers the philosophical contentions defended in Horsten and Welch . It contains a description of the standard format of adaptive logics, analyses the notion of dynamic proof required by those logics, discusses the means to turn such proofs into demonstrations, and argues that, notwithstanding their formal complexity, adaptive logics are important because they explicate an abundance of reasoning forms that occur frequently, both in scientific contexts and in common sense contexts.

This paper argues that formal models of coherence are useful for constructing a legal epistemology. Two main formal approaches to coherence are examined: coherence-based models of belief revision and the theory of coherence as constraint satisfaction. It is shown that these approaches shed light on central aspects of a coherentist legal epistemology, such as the concept of coherence, the dynamics of coherentist justification in law, and the mechanisms whereby coherence may be built in the course of legal decision-making.

Some think that issues to do with scientific method are last century's stale debate; Popper was an advocate of methodology, but Kuhn, Feyerabend, and others are alleged to have brought the debate about its status to an end. The papers in this volume show that issues in methodology are still very much alive. Some of the papers reinvestigate issues in the debate over methodology, while others set out new ways in which the debate has developed in the last decade. The (...) book will be of interest to philosophers and scientists alike in the reassessment it provides of earlier debates about method and current directions of research. (shrink)

Showcasing original arguments for well-defined positions, as well as clear and concise statements of sophisticated philosophical views, this volume is an ...

Formal learning theory is the mathematical embodiment of a normative epistemology. It deals with the question of how an agent should use observations about her environment to arrive at correct and informative conclusions. Philosophers such as Putnam, Glymour and Kelly have developed learning theory as a normative framework for scientific reasoning and inductive inference.

Instructions in Wason’s Selection Task underdetermine empirical subjects’ representation of the underlying problem, and its admissible solutions. We model the Selection Task as an interrogative learning problem, and reasoning to solutions as: selection of a representation of the problem; and: strategic planning from that representation. We argue that recovering Wason’s ‘normative’ selection is possible only if both stages are constrained further than they are by Wason’s formulation. We conclude comparing our model with other explanatory models, w.r.t. to empirical adequacy, and (...) modeling of bounded rationality. (shrink)

One version of the problem of induction is how to justify hypotheses in the face of data. Why advance hypothesis A rather than B — or in a probabilistic context, why attach greater probability to A than B? If the data arrive as a stream of observations (distributed through time) then the problem is to justify the associated stream of hypotheses. Several perspectives on this problem have been developed including Bayesianism (Howson and Urbach, 1993) and belief-updating (Hansson, 1999). These are (...) broad families of approaches; the citations are meant just as portals. (shrink)

links to current studies in the theory of scientific discovery. Our own theory is elaborated in four papers accessible in pdf format through the links on the left.