The Implications of the No-Free-Lunch Theorems for Meta-induction

Journal for General Philosophy of Science / Zeitschrift für Allgemeine Wissenschaftstheorie 54 (3):421-432 (2023)
  Copy   BIBTEX

Abstract

The important recent book by Schurz ( 2019 ) appreciates that the no-free-lunch theorems (NFL) have major implications for the problem of (meta) induction. Here I review the NFL theorems, emphasizing that they do not only concern the case where there is a uniform prior—they prove that there are “as many priors” (loosely speaking) for which any induction algorithm _A_ out-generalizes some induction algorithm _B_ as vice-versa. Importantly though, in addition to the NFL theorems, there are many _free lunch_ theorems. In particular, the NFL theorems can only be used to compare the expected performance of an induction algorithm _A_, considered in isolation, with the expected performance of an induction algorithm _B_, considered in isolation. There is a rich set of free lunches which instead concern the statistical _correlations_ among the generalization errors of induction algorithms. As I describe, the meta-induction algorithms that Schurz advocates as a “solution to Hume’s problem” are simply examples of such a free lunch based on correlations among the generalization errors of induction algorithms. I end by pointing out that the prior that Schurz advocates, which is uniform over bit frequencies rather than bit patterns, is contradicted by thousands of experiments in statistical physics and by the great success of the maximum entropy procedure in inductive inference.

Links

PhilArchive



    Upload a copy of this work     Papers currently archived: 92,075

External links

Setup an account with your affiliations in order to access resources via your University's proxy server

Through your library

Similar books and articles

A Twofold Tension in Schurz’s Meta-Inductive Solution to Hume’s Problem of Induction.Tomoji Shogenji - 2023 - Journal for General Philosophy of Science / Zeitschrift für Allgemeine Wissenschaftstheorie 54 (3):379-392.
Classic Methodologies in the Philosophy of Science: Introduction to the Special Issue.María de Paz & Pietro Gori - 2023 - Journal for General Philosophy of Science / Zeitschrift für Allgemeine Wissenschaftstheorie 54 (1):1-5.
BIBLIOGRAPHY. Zeitschriftenschau.Michael Anacker, Marc Breuer & Daniel Cohnitz - 2003 - Journal for General Philosophy of Science / Zeitschrift für Allgemeine Wissenschaftstheorie 34 (1):165-199.
Nachträge und Ergänzungen zur Bibliographie der Schriften von Bela Juhos.[author unknown] - 1971 - Journal for General Philosophy of Science / Zeitschrift für Allgemeine Wissenschaftstheorie 2 (2):338-339.
Verzeichnis der wissenschaftlichen Arbeiten des korrespondierenden Mitglieds der Akademie der Wissenschaft der UdSSR P. W. Kopnin.[author unknown] - 1972 - Journal for General Philosophy of Science / Zeitschrift für Allgemeine Wissenschaftstheorie 3 (1):170-200.
Carl Friedrich von Weizsäcker.Michael Drieschner - 2008 - Journal for General Philosophy of Science / Zeitschrift für Allgemeine Wissenschaftstheorie 39 (1):1-16.
Erratum: Bibliographie der Schriften von Paul Lorenzen.[author unknown] - 1996 - Journal for General Philosophy of Science / Zeitschrift für Allgemeine Wissenschaftstheorie 27 (2):421-422.
Nachträge zur Bibliographie der Schriften von Alwin Diemer.[author unknown] - 1989 - Journal for General Philosophy of Science / Zeitschrift für Allgemeine Wissenschaftstheorie 20 (2):391-391.
Introduction: Individuality, Distinguishability, and (Non-)Entanglement.Cord Friebe, Kian Salimkhani & Tina Wachter - 2022 - Journal for General Philosophy of Science / Zeitschrift für Allgemeine Wissenschaftstheorie 53 (3):235-237.
Peter Godfrey-Smith: Metazoa: Animal Life and the Birth of the Mind.Supriya Bajpai & Lalit Saraswat - 2022 - Journal for General Philosophy of Science / Zeitschrift für Allgemeine Wissenschaftstheorie 53 (4):605-609.
Books Received. [REVIEW][author unknown] - 1990 - Journal for General Philosophy of Science / Zeitschrift für Allgemeine Wissenschaftstheorie 21 (2):405-406.
Eingegangene Bücher.[author unknown] - 1982 - Journal for General Philosophy of Science / Zeitschrift für Allgemeine Wissenschaftstheorie 13 (2):412-414.

Analytics

Added to PP
2023-03-19

Downloads
22 (#710,249)

6 months
8 (#362,756)

Historical graph of downloads
How can I increase my downloads?

Citations of this work

Adaptive Algorithms for Meta-Induction.Ronald Ortner - 2023 - Journal for General Philosophy of Science / Zeitschrift für Allgemeine Wissenschaftstheorie 54 (3):433-450.

Add more citations

References found in this work

No Free Lunch Theorems for Optimization.D. H. Wolpert & W. G. Macready - 1997 - IEEE Transactions on Evolutionary Computation 1 (1):67–82.

Add more references