Information theory and statistical mechanics II.

Information, entropy, probability: these three terms are closely interconnected in the prevalent understanding of statistical mechanics, both when this field is taught to students at an introductory level and in advanced research into the field’s foundations. This paper examines the interconnection between these three notions in light of recent research in the foundations of statistical mechanics. It disentangles these concepts and highlights their differences, at the same time explaining why they came to be so closely linked in the literature. In (...) the literature the term ‘information’ is often linked to entropy and probability in discussions of Maxwell’s Demon and its attempted exorcism by the Landauer-Bennett thesis, and in analyses of the spin echo experiments. The direction taken in the present paper is a different one. Here we discuss the statistical mechanical underpinning of the notions of probability and entropy, and this constructive approach shows that information plays no fundamental role in these concepts, although it can be conveniently used in a sense that we shall specify. (shrink)

In a previous paper (Duncan, T.L., Semura, J.S. in Entropy 6:21, 2004) we considered the question, “What underlying property of nature is responsible for the second law?” A simple answer can be stated in terms of information: The fundamental loss of information gives rise to the second law. This line of thinking highlights the existence of two independent but coupled sets of laws: Information dynamics and energy dynamics. The distinction helps shed light on certain foundational questions in statistical mechanics. For (...) example, the confusion surrounding previous “derivations” of the second law from energy dynamics can be resolved by noting that such derivations incorporate one or more assumptions that correspond to the loss of information. In this paper we further develop and explore the perspective in which the second law is fundamentally a law of information dynamics. (shrink)

The argument from causal closure of the physical is usually considered the most powerful argument in favor of the ontological doctrine of physicalism. Many authors, most notably Papineau, assume that CCP implies that physicalism is supported by physics. I demonstrate, however, that physical science has no bias in the ontological debate between proponents of physicalism and dualism. I show that the arguments offered for CCP are effective only against the accounts of mental causation based on the action of the mental (...) forces of a Newtonian nature, i.e. those which manifest themselves by causing accelerations. However, it is conceivable and possible that mental causation is manifested through the redistribution of energy, momentum and other conserved quantities in the system, brought about by altering the state probability distribution within the living system and leading to anomalous correlations of neural processes. After arguing that a probabilistic, interactionist model of mental causation is conceivable, which renders the argument from causal closure of the physical ineffective, I point to some basic features that such a model must have in order to be intelligible. At the same time, I indicate the way that conclusive testing of CCP can be done within the theoretical framework of physics. (shrink)

The argument from causal closure of the physical is usually considered the most powerful argument in favor of the ontological doctrine of physicalism. Many authors, most notably Papineau, assume that CCP implies that physicalism is supported by physics. I demonstrate, however, that physical science has no bias in the ontological debate between proponents of physicalism and dualism. I show that the arguments offered for CCP are effective only against the accounts of mental causation based on the action of the mental (...) forces of a Newtonian nature, i.e. those which manifest themselves by causing accelerations. However, it is conceivable and possible that mental causation is manifested through the redistribution of energy, momentum and other conserved quantities in the system, brought about by altering the state probability distribution within the living system and leading to anomalous correlations of neural processes. After arguing that a probabilistic, interactionist model of mental causation is conceivable, which renders the argument from causal closure of the physical ineffective, I point to some basic features that such a model must have in order to be intelligible. At the same time, I indicate the way that conclusive testing of CCP can be done within the theoretical framework of physics. (shrink)

This article argues that most of the approaches to the foundations of statistical mechanics have severed their link with the original foundational project, the project of demonstrating how real mechanical systems can behave thermodynamically.

Philosophers of physics are very familiar with foundational problems in quantum mechanics and in the theory of relativity. In both fields, the puzzles, if not solved, are at least reasonably well formulated and possess well-characterized solution strategies. Sklar’s book Physics and Chance focuses on a pair of theories, thermodynamics and statistical mechanics, for which puzzles and foundational paradoxes abound, but where there is very little agreement upon the means with which they may best be approached. As he notes in the (...) introduction. (shrink)

Christopher G. Timpson provides the first full-length philosophical treatment of quantum information theory and the questions it raises for our understanding of the quantum world. He argues for an ontologically deflationary account of the nature of quantum information, which is grounded in a revisionary analysis of the concepts of information.

Proponents of Bayesian confirmation theory believe that they have the solution to a significant, recalcitrant problem in philosophy of science. It is the identification of the logic that governs evidence and its inductive bearing in science. That is the logic that lets us say that our catalog of planetary observations strongly confirms Copernicus’ heliocentric hypothesis; or that the fossil record is good evidence for the theory of evolution; or that the 3oK cosmic background radiation supports big bang cosmology. The definitive (...) solution to this problem would be a significant achievement. The problem is of central importance to philosophy of science, for, in the end, what distinguishes science from myth making is that we have good evidence for the content of science, or at least of mature sciences, whereas myths are evidentially ungrounded fictions. The core ideas shared by all versions of Bayesian confirmation theory are, at a good first approximation, that a scientist’s beliefs are or should conform to a probability measure; and that the incorporation of new evidence is through conditionalization using Bayes’ theorem. While the burden of this chapter will be to inventory why critics believe this theory may not be the solution after all, it is worthwhile first to summarize here the most appealing virtues of this simple account. There are three. First, the theory reduces the often nebulous notion of a logic of.. (shrink)

This book argues that the only kind of metaphysics that can contribute to objective knowledge is one based specifically on contemporary science as it really is, and not on philosophers' a priori intuitions, common sense, or simplifications of science. In addition to showing how recent metaphysics has drifted away from connection with all other serious scholarly inquiry as a result of not heeding this restriction, this book demonstrates how to build a metaphysics compatible with current fundamental physics, which, when combined (...) with metaphysics of the special sciences, can be used to unify physics with the other sciences without reducing these sciences to physics itself. Taking science metaphysically seriously, this book argues, means that metaphysicians must abandon the picture of the world as composed of self-subsistent individual objects, and the paradigm of causation as the collision of such objects. The text assesses the role of information theory and complex systems theory in attempts to explain the relationship between the special sciences and physics, treading a middle road between the grand synthesis of thermodynamics and information, and eliminativism about information. The consequences of the books' metaphysical theory for central issues in the philosophy of science are explored, including the implications for the realism versus empiricism debate, the role of causation in scientific explanations, the nature of causation and laws, the status of abstract and virtual objects, and the objective reality of natural kinds. (shrink)