What are the effects of word-by-word predictability on sentence processing times during the natural reading of a text? Although information complexity metrics such as surprisal and entropy reduction have been useful in addressing this question, these metrics tend to be estimated using computational language models, which require some degree of commitment to a particular theory of language processing. Taking a different approach, this study implemented a large-scale cumulative cloze task to collect word-by-word predictability data for 40 passages and (...) compute surprisal and entropy reduction values in a theory-neutral manner. A separate group of participants read the same texts while their eye movements were recorded. Results showed that increases in surprisal and entropy reduction were both associated with increases in reading times. Furthermore, these effects did not depend on the global difficulty of the text. The findings suggest that surprisal and entropy reduction independently contribute to variation in reading times, as these metrics seem to capture different aspects of lexical predictability. (shrink)

The entropy-reduction hypothesis claims that the cognitive processing difficulty on a word in sentence context is determined by the word's effect on the uncertainty about the sentence. Here, this hypothesis is tested more thoroughly than has been done before, using a recurrent neural network for estimating entropy and self-paced reading for obtaining measures of cognitive processing load. Results show a positive relation between reading time on a word and the reduction in entropy due to processing (...) that word, supporting the entropy-reduction hypothesis. Although this effect is independent from the effect of word surprisal, we find no evidence that these two measures correspond to cognitively distinct processes. (shrink)

In the last decade, formal concept analysis in a fuzzy setting has received more attention for knowledge processing tasks in various fields. The hierarchical order visualisation of generated formal concepts is a major concern for the practical application of FCA. In this process, a major issue is the huge number of formal concepts generated from ‘a large context’, and another problem is their ‘storage’ complexity. To deal with these issues a method is proposed in this paper based on Shannon (...) class='Hi'>entropy and Huffman coding. The proposed method is illustrated using crisply generated concepts such that the changes between obtained concepts can be measured using Levenshtein distance. The analysis derived from the proposed method is illustrated with an example for FCA in a fuzzy setting. (shrink)

David Albert and Barry Loewer have argued that the temporal asymmetry of our concept of causal influence or control is grounded in the statistical mechanical assumption of a low-entropy past. In this paper I critically examine Albert's and Loewer 's accounts.

Conventional wisdom holds that the von Neumann entropy corresponds to thermodynamic entropy, but Hemmo and Shenker (2006) have recently argued against this view by attacking von Neumann's (1955) argument. I argue that Hemmo and Shenker's arguments fail due to several misunderstandings: about statistical-mechanical and thermodynamic domains of applicability, about the nature of mixed states, and about the role of approximations in physics. As a result, their arguments fail in all cases: in the single-particle case, the finite particles case, (...) and the infinite particles case. (shrink)

Graph-based frames have been introduced as a logical framework which internalises an inherent boundary to knowability (referred to as ‘informational entropy’), due, e.g. to perceptual, evidential or linguistic limits. They also support the interpretation of lattice-based (modal) logics as hyper-constructive logics of evidential reasoning. Conceptually, the present paper proposes graph-based frames as a formal framework suitable for generalising Pawlak's rough set theory to a setting in which inherent limits to knowability exist and need to be considered. Technically, the present (...) paper establishes systematic connections between the first-order correspondents of Sahlqvist modal reduction principles on Kripke frames, and on the more general relational environments of graph-based and polarity-based frames. This work is part of a research line aiming at: (a) comparing and inter-relating the various (first-order) conditions corresponding to a given (modal) axiom in different relational semantics; (b) recognising when first-order sentences in the frame-correspondence languages of different relational structures encode the same ‘modal content’; (c) meaningfully transferring relational properties across different semantic contexts. The present paper develops these results for the graph-based semantics, polarity-based semantics, and all Sahlqvist modal reduction principles. As an application, we study well known modal axioms in rough set theory (such as those corresponding to seriality, reflexivity, and transitivity) on graph-based frames and show that, although these axioms correspond to different first-order conditions on graph-based frames, their intuitive meaning is retained. This allows us to introduce the notion of hyperconstructivist approximation spaces as the subclass of graph-based frames defined by the first-order conditions corresponding to the same modal axioms defining classical generalised approximation spaces, and to transfer the properties and the intuitive understanding of different approximation spaces to the more general framework of graph-based frames. The approach presented in this paper provides a base for systematically comparing and connecting various formal frameworks in rough set theory, and for the transfer of insights across different frameworks. (shrink)

The Earth agglomerates and heats. Convection cells within the planetary interior expedite the cooling process. Volcanoes evolve steam, carbon dioxide, sulfur dioxide and pyrophosphate. An acidulous Hadean ocean condenses from the carbon dioxide atmosphere. Dusts and stratospheric sulfurous smogs absorb a proportion of the Sun’s rays. The cooled ocean leaks into the stressed crust and also convects. High temperature acid springs, coupled to magmatic plumes and spreading centers, emit iron, manganese, zinc, cobalt and nickel ions to the ocean. Away from (...) the spreading centers cooler alkaline spring waters emanate from the ocean floor. These bear hydrogen, formate, ammonia, hydrosulfide and minor methane thiol. The thermal potential begins to be dissipated but the chemical potential is dammed. The exhaling alkaline solutions are frustrated in their further attempt to mix thoroughly with their oceanic source by the spontaneous precipitation of biomorphic barriers of colloidal iron compounds and other minerals. It is here we surmise that organic molecules are synthesized, filtered, concentrated and adsorbed, while acetate and methane—separate products of the precursor to the reductive acetyl-coenzyme-A pathway—are exhaled as waste. Reactions in mineral compartments produce acetate, amino acids, and the components of nucleosides. Short peptides, condensed from the simple amino acids, sequester ‘ready-made’ iron sulfide clusters to form protoferredoxins, and also bind phosphates. Nucleotides are assembled from amino acids, simple phosphates carbon dioxide and ribose phosphate upon nanocrystalline mineral surfaces. The side chains of particular amino acids register to fitting nucleotide triplet clefts. Keyed in, the amino acids are polymerized, through acid–base catalysis, to alpha chains. Peptides, the tenuous outer-most filaments of the nanocrysts, continually peel away from bound RNA. The polymers are concentrated at cooler regions of the mineral compartments through thermophoresis. RNA is reproduced through a convective polymerase chain reaction operating between 40 and 100°C. The coded peptides produce true ferredoxins, the ubiquitous proteins with the longest evolutionary pedigree. They take over the role of catalyst and electron transfer agent from the iron sulfides. Other iron–nickel sulfide clusters, sequestered now by cysteine residues as CO-dehydrogenase and acetyl-coenzyme-A synthase, promote further chemosynthesis and support the hatchery—the electrochemical reactor—from which they sprang. Reactions and interactions fall into step as further pathways are negotiated. This hydrothermal circuitry offers a continuous supply of material and chemical energy, as well as electricity and proticity at a potential appropriate for the onset of life in the dark, a rapidly emerging kinetic structure born to persist, evolve and generate entropy while the sun shines. (shrink)

The past two decades have seen an explosion in the methods and directions of neuroscience research. Along with many others, complexity research has rapidly gained traction as both an independent research field and a valuable subdiscipline in computational neuroscience. In the past decade alone, several studies have suggested that psychiatric disorders affect the spatiotemporal complexity of both global and region-specific brain activity (Liu et al., 2013; Adhikari et al., 2017; Li et al., 2018). However, many of these studies have not (...) accounted for the distributed nature of cognition in either the global or regional complexity estimates, which may lead to erroneous interpretations of both global and region-specific entropy estimates. To alleviate this concern, we propose a novel method for estimating complexity. This method relies upon projecting dynamic functional connectivity into a low-dimensional space which captures the distributed nature of brain activity. Dimension-specific entropy may be estimated within this space, which in turn allows for a rapid estimate of global signal complexity. Testing this method on a recently acquired obsessive-compulsive disorder dataset reveals substantial increases in the complexity of both global and dimension-specific activity versus healthy controls, suggesting that obsessive-compulsive patients may experience increased disorder in cognition. To probe the potential causes of this alteration, we estimate subject-level effective connectivity via a Hopf oscillator-based model dynamic model, the results of which suggest that obsessive-compulsive patients may experience abnormally high connectivity across a broad network in the cortex. These findings are broadly in line with results from previous studies, suggesting that this method is both robust and sensitive to group-level complexity alterations. (shrink)

Determinist thought with its sui generis view on life, nature and being as a whole is a point of view that could be observed in many different cultures and beliefs. It was thanks to Greek thought that it ceased to be a cultural element and transformed into a systematic cosmology. Schools such as Leucippos, then Democritos and Stoa attempted to integrate the determinist philosophy into ontology and cosmology. In the course of time, physics and metaphysics-based determinism approaches were introduced, and (...) a wide spectrum has emerged from genetics to behaviorism, from culture to psychology, from atomism to divinity. Determinism, whether physical or metaphysical origin, ignores freedom of will and deny agency competence over human behavior. Due to this feature, it is opposed by ethical theories, legal philosophies and religions. When the arguments for determinism are possible to disprove logically and philosophically, this is not so easy when the claims base themselves on scientific base. As the logical consequence of this novel fact, it is important to question the epistemological value of scientific knowledge and critically analyze the data of experiments and clinical studies in terms of methodology when answering any hypothesis such as neuro-biological, neuro-psychological, or neuro-theological argumentations. On the other hand, it is necessary to reach alternative experiments on the same subject or to show that it is possible to interpret them in different ways, as in the example of the Libet experiment. The neurobiological determinism based on biological reductionism, emerged as the result of ignoring the ontological difference of the mind, equating the mind with the brain, or defining mentality as an epiphenomenon of the brain. The main divergence stems from the acceptance of materialist philosophy. Paradigms that reduce existence only to matter do not take the metaphysical possibilities into account. In this case, although the problems called qualia or subjective experience stand there unresolved, the claim is preserved. Although many new developments such as the discovery of the entropy law, the big bang theory, and quantum physics have shaken the materialist philosophy, modern science resists an epistemological revision. However, with the current epistemology, it does not seem possible to grasp both the universe and the being as a whole. This is the most important reason why every attempt to understand the nature and spiritual side of human beings fails despite numerous experiments on the brain. However, the human brain is an organ that seems sophisticated and its secrets cannot be easily solved. Since there is not enough information about the brain, there is not enough evidence to claim that the brain, and therefore the mind, are part of the deterministic universe. Increasing brain researches since the last quarter of the twentieth century has revealed that genes, neurons and particularly brain chemistry claim much greater role than expected in human behavior. These results have been instrumentalized by some researchers for a radical claim that free will is an illusion, while by others it has led to the acceptance of will as less important over actions than was thought. Both ideas adopted a model of biological determinism in which freedom of will was ignored. Hypotheses based on controversial interpretations of various experiments raised concerns about religious, moral, and legal responsibility. Although man cannot be thought of as a non-free being from the point of view of common sense, the smog screen over the truth would not be lifted unless the scientific data in question had a correct interpretation. At first glance, it seems unreasonable to discuss universal determinism in the quantum universe. Nevertheless, the claim that strong causality prevails in the material world, including consciousness, remains in place. Therefore, firstly criticizing determinism and then examining biological determinism will help to fix the conceptual framework. This article aims to explain why genetics and neurobiology, while acknowledging their importance in the realization of behavior, can’t completely abolish moral agency. Some hypotheses attribute consciousness and free will to the physico-shimic structure of the brain, the random activity of neurons, or the ability to automatically transform inputs into outputs with the advantage of genetic information. This is the most sensitive and important point of being human; it attacks free will. Paradoxically, while global civilization of our time promises infinite freedom to human beings the science of the same age tries to prove that it is not free. (shrink)

Given that knowledge consists of finite models of an infinitely complex reality, how can we explain that it is still most of the time reliable? Survival in a variable environment requires an internal model whose complexity (variety) matches the complexity of the environment that is to be controlled. The reduction of the infinite complexity of the sensed environment to a finite map requires a strong mechanism of categorization. A measure of cognitive complexity (C) is defined, which quantifies the average (...) amount of trial-and-error needed to find the adequate category. C can be minimized by "probability ordering" of the possible categories, where the most probable alternatives ("defaults") are explored first. The reduction of complexity by such ordering requires a low statistical entropy for the cognized environment. This entropy is automatically kept down by the natural selection of "fit" configurations. The high probability, "default" cognitive categorizations are then merely mappings of environmentally "fit" configurations. (shrink)

This article examines cognitive process models of human sentence comprehension based on the idea of informed search. These models are rational in the sense that they strive to find a good syntactic analysis quickly. Informed search derives a new account of garden pathing that handles traditional counterexamples. It supports a symbolic explanation for local coherence as well as an algorithmic account of entropy reduction. The models are expressed in a broad framework for theories of human sentence comprehension.

Information‐theoretic complexity metrics, such as Surprisal (Hale, 2001; Levy, 2008) and Entropy Reduction (Hale, 2003), are linking hypotheses that bridge theorized expectations about sentences and observed processing difficulty in comprehension. These expectations can be viewed as syntactic derivations constrained by a grammar. However, this expectation‐based view is not limited to syntactic information alone. The present study combines structural and non‐structural information in unified models of word‐by‐word sentence processing difficulty. Using probabilistic minimalist grammars (Stabler, 1997), we extend expectation‐based models (...) to include frequency information about noun phrase animacy. Entropy reductions derived from these grammars faithfully reflect the asymmetry between subject and object relatives (Staub, 2010; Staub, Dillon, & Clifton, 2017), as well as the effect of animacy on the measured difficulty profile (Lowder & Gordon, 2012; Traxler, Morris, & Seely, 2002). Visualizing probability distributions on the remaining alternatives at particular parser states allows us to explore new, linguistically plausible interpretations for the observed processing asymmetries, including the way that expectations about the relativized argument influence the processing of particular types of relative clauses (Wagers & Pendleton, 2016). (shrink)

A word-by-word human sentence processing complexity metric is presented. This metric formalizes the intuition that comprehenders have more trouble on words contributing larger amounts of information about the syntactic structure of the sentence as a whole. The formalization is in terms of the conditional entropy of grammatical continuations, given the words that have been heard so far. To calculate the predictions of this metric, Wilson and Carroll's (1954) original entropy reduction idea is extended to infinite languages. This (...) is demonstrated with a mildly context-sensitive language that includes relative clauses formed on a variety of grammatical relations across the Accessibility Hierarchy of Keenan and Comrie (1977). Predictions are derived that correlate significantly with repetition accuracy results obtained in a sentence-memory experiment (Keenan & Hawkins, 1987). (shrink)

Searching for information is critical in many situations. In medicine, for instance, careful choice of a diagnostic test can help narrow down the range of plausible diseases that the patient might have. In a probabilistic framework, test selection is often modeled by assuming that people's goal is to reduce uncertainty about possible states of the world. In cognitive science, psychology, and medical decision making, Shannon entropy is the most prominent and most widely used model to formalize probabilistic uncertainty and (...) the reduction thereof. However, a variety of alternative entropy metrics (Hartley, Quadratic, Tsallis, Rényi, and more) are popular in the social and the natural sciences, computer science, and philosophy of science. Particular entropy measures have been predominant in particular research areas, and it is often an open issue whether these divergences emerge from different theoretical and practical goals or are merely due to historical accident. Cutting across disciplinary boundaries, we show that several entropy and entropy reduction measures arise as special cases in a unified formalism, the Sharma–Mittal framework. Using mathematical results, computer simulations, and analyses of published behavioral data, we discuss four key questions: How do various entropy models relate to each other? What insights can be obtained by considering diverse entropy models within a unified framework? What is the psychological plausibility of different entropy models? What new questions and insights for research on human information acquisition follow? Our work provides several new pathways for theoretical and empirical research, reconciling apparently conflicting approaches and empirical findings within a comprehensive and unified information-theoretic formalism. (shrink)

There is now considerable evidence that human sentence processing is expectation based: As people read a sentence, they use their statistical experience with their language to generate predictions about upcoming syntactic structure. This study examines how sentence processing is affected by readers' uncertainty about those expectations. In a self-paced reading study, we use lexical subcategorization distributions to factorially manipulate both the strength of expectations and the uncertainty about them. We compare two types of uncertainty: uncertainty about the verb's complement, reflecting (...) the next prediction step; and uncertainty about the full sentence, reflecting an unbounded number of prediction steps. We find that uncertainty about the full structure, but not about the next step, was a significant predictor of processing difficulty: Greater reduction in uncertainty was correlated with increased reading times. We additionally replicated previously observed effects of expectation violation, orthogonal to the effect of uncertainty. This suggests that both surprisal and uncertainty affect human RTs. We discuss the consequences for theories of sentence comprehension. (shrink)

In referential communication, Grice's Maxim of Quantity is thought to imply that utterances conveying unnecessary information should incur comprehension difficulties. There is, however, considerable evidence that speakers frequently encode redundant information in their referring expressions, raising the question as to whether such overspecifications hinder listeners’ processing. Evidence from previous work is inconclusive, and mostly comes from offline studies. In this article, we present two event‐related potential (ERP) experiments, investigating the real‐time comprehension of referring expressions that contain redundant adjectives in complex (...) visual contexts. Our findings provide support for both Gricean and bounded‐rational accounts. We argue that these seemingly incompatible results can be reconciled if common ground is taken into account. We propose a bounded‐rational account of overspecification, according to which even redundant words can be beneficial to comprehension to the extent that they facilitate the reduction of listeners’ uncertainty regarding the target referent. (shrink)

The Past Hypothesis is the claim that the Boltzmann entropy of the universe was extremely low when the universe began. Can we make sense of this claim when *classical* gravitation is included in the system? I first show that the standard rationale for not worrying about gravity is too quick. If the paper does nothing else, my hope is that it gets the problems induced by gravity the attention they deserve in the foundations of physics. I then try to (...) make plausible a very weak claim: that there is a well-defined Boltzmann entropy that *can* increase in *some* interesting self-gravitating systems. More work is needed before we can say whether this claim answers the threat to the standard explanation of entropy increase. (shrink)

In this paper I propose a model of the fundamental components of psychoanalytic psychotherapies that I try to explicate with contemporary theories of the Bayesian brain and the Free Energy Principle (FEP). I first show that psychoanalytic therapies require a setting (made up of several envelopes), a particular psychic state and specific processes (transference, free association, dreaming, play, reflexivity and narrativity) in order to induce psychic transformations. I then analyze how these processes of transformations operate and how they can be (...) enlightened by the FEP. I first underline the fact that psychoanalytic therapies imply non-linear processes taking time to unfold and require a setting containing high entropy processes. More precisely, these processes are characterized by an interplay between extension and reduction of free energy. This interplay also favors the emergence of new orders of subjective experience, which occur following states of disorder, according to a certain energetic threshold allowing the modification and improvement of mental functioning. These high entropy states are also characterized by random functioning and psychic malleability which favors the exploration of subjective experience in an original manner. Overall, the approach proposed in this paper support the dialogue between psychoanalysis and other fields of research while underlining how psychoanalytical theoretical and conceptual constructs can also be useful to other disciplines, in particular the neurosciences of subjectivity. (shrink)

This chapter unfolds a central philosophical problem of statistical mechanics. This problem lies in a clash between the Static Probabilities offered by statistical mechanics and the Dynamic Probabilities provided by classical or quantum mechanics. The chapter looks at the Boltzmann and Gibbs approaches in statistical mechanics and construes some of the great controversies in the field — for instance the Reversibility Paradox — as instances of this conflict. It furthermore argues that a response to this conflict is a critical choice (...) that shapes one's understanding of statistical mechanics itself, namely, whether it is to be conceived as a special or fundamental science. The chapter details some of the pitfalls of the latter ‘globalist’ position and seeks defensible ground for a kind of ‘localist’ alternative. (shrink)

Georgios Pentzaropoulos continues his investigation undertaken in 'Generating Stable Knowledge via Reduction in Entropy' (Philosophy Pathways Issue 167, 28 November 2011) looking at knowledge not as something we 'possess' -- the knowledge contained in a book, for example -- but rather as an active, or interactive process of increasing understanding through the judicious sifting and processing of raw information. As Macmurray argued in his Gifford Lectures, 'All knowledge is for the sake of action.' Instead of seeking to define (...) some abstract notion of knowledge in a vacuum, what philosophers should be getting to grips with is the notion of actionable knowledge. - Geoffrey Klempner, Editor. (shrink)

Functional reductionism characterises inter-theoretic reduction as the recovery of the upper-level behaviour described by the reduced theory in terms of the lower-level reducing theory. For instance, finding a statistical mechanical realiser that plays the functional role of thermodynamic entropy allows for establishing a reductive link between thermodynamics and statistical mechanics. This view constitutes a unique approach to reduction that enjoys a number of positive features, but has received limited attention in the philosophy of science. -/- This paper (...) aims to clarify the meaning of functional reductionism in science, with a focus on physics, to define both its place with respect to other approaches to reduction and its connection to ontology. To do so, we develop and explore two alternative frameworks for functional reduction, called Syntactic Functional Reductionism and Semantic Functional Reductionism. They represent two different possible stances on the view that expand and improve the basic functional reductionist approach along different lines, and make clear how the approach works in practice. The former elaborates on David Lewis’ account, is connected with the syntactic view of theories, is committed to a logical characterisation of functional roles, and is embedded within Nagelian reductionism. The latter adopts a semantic view of theories, spells out functional roles mainly in terms of mathematical roles within the models of theories, and is expressed in terms of the related structuralist approach to reduction. The development of these frameworks has the final goal of advancing functional reductionism, to make it a fully-fledged alternative account for reduction in science. (shrink)

This paper advocates the reduction of the inference of common cause to that of common origins. It distinguishes and subjects to critical analysis thirteen interpretations of “the inference of common cause” whose conclusions do not follow from their assumptions. Instead, I introduce six types of inferences of common origins of information signals from their receivers to reduce, in the sense of supersede and replace, the thirteen inferences of common causes. I show how the paradigmatic examples of inferences of common (...) cause, as well as a broader scope of inferences in the historical sciences, are better explained by inferences of origins. Inferences of origins from information rich coherences between receivers of information signals both fit more closely and explain better the range of examples that have traditionally been associated with inferences of common causes, as well as a broader scope of examples from the historical sciences. Shannon’s concept of information as reduction in uncertainty, rather than physicalist concepts of information that relate it to entropy or waves, simplifies the inferences, preempts objections, and avoids the underdetermination of conclusions that challenge models of inferences of causes from information transmissions. In the second part of the paper I model inferences of information about common origins from information preserved in their receivers. I distinguish information poor inferences that there were some common origins of receivers from the information richer inferences of ranges of possible common origins and the information transmission channels by which they transmitted signals to receivers. Lastly and most information rich, I distinguish the inference of the defining properties of common origins. The information transmission model from origins to receivers allows the reconceptualization of the concepts of independence as absence of intersections between information channels and reliability as the preservation of information from origins in receivers. Finally, I show how inferences of origins form the epistemic basis of the historical sciences. (shrink)

Managing Complexity in Healthcare introduces the ComEntEth (Complex Entropic Ethical) model as an integrated bio-medical and philosophical approach to understanding how people get things done in healthcare. Drawing on the complexity sciences, studies of entropy in living organisms, and the ethics of Emmanuel Levinas, healthcare is theorised as energetic relational exchanges between people as entropic and ethical entities that unfold around a central attractor: Reduction in elevated entropy or suffering in patients. Living entities are engaged in a (...) continuous struggle against the tendency to produce entropy. From the cellular to the collective of human endeavours, the tendency of complex systems is to disorder and decay. Yet in the micro-activity of healthcare enterprise, people resist this tendency by expending energy to create order and sustain life. Making sense of how this miraculous work is made possible is the foundation of this book. Through practical examples - from analysis of practitioner burnout, rural and remote healthcare, the functioning of emergency departments, to government, social and institutional responses to the COVID-19 pandemic -this new integral philosophy provides practitioners, managers, policy designers, and scholars an effective way to understand the dynamics of daily processes and practices that link the micro of everyday interactions with the macro-trends of healthcare. (shrink)

Causation is a macroscopic phenomenon. The temporal asymmetry displayed by causation must somehow emerge along with other asymmetric macroscopic phenomena like entropy increase and the arrow of radiation. I shall approach this issue by considering ‘causal inference’ techniques that allow causal relations to be inferred from sets of observed correlations. I shall show that these techniques are best explained by a reduction of causation to structures of equations with probabilistically independent exogenous terms. This exogenous probabilistic independence imposes a (...) recursive order on these equations and a consequent distinction between dependent and independent variables that lines up with the temporal asymmetry of causation. (shrink)

The book explores several open questions in the philosophy of statistical mechanics. Each chapter is written by a leading expert in the field. Here is a list of some questions that are addressed in the book: 1) Boltzmann showed how the phenomenological gas laws of thermodynamics can be derived from statistical mechanics. Since classical mechanics is a deterministic theory there are no probabilities in it. Since statistical mechanics is based on classical mechanics, all the probabilities statistical mechanics talks about cannot (...) be fundamental. However, if probabilities are epistemic, how can they play a role, as they seem to do, in laws, explanation, and prediction? 2) Many physicists use the notion of typicality instead of the one of probability when discussing statistical mechanics. What is the connection between the two notions? 3) How can one extend Boltzmann’s analysis to the quantum domain, where some theories are indeterministic? 4) Boltzmann’s explanation fundamentally involves cosmology: for the explanation to go through the Big Bang needs to have had extremely low entropy. Does the fact that the Big Bang was a low entropy state imply that it was, in some sense, “highly improbable” and requires an explanation? 5) What exactly is the connection between statistical and classical mechanics? Is the one of theory reduction or there is no such thing? 6) Statistical mechanics has two main formulation: one due to Botzmann and the other due to Gibbs. What is the connection between the two formulations . (shrink)

The search for the statistical mechanical underpinning of thermodynamic irreversibility has so far focussed on the spontaneous approach to equilibrium. But this is the search for the underpinning of what Brown and Uffink have dubbed the ‘minus first law’ of thermodynamics. In contrast, the second law tells us that certain interventions on equilibrium states render the initial state ‘irrecoverable’. In this article, I discuss the unusual nature of processes in thermodynamics, and the type of irreversibility that the second law embodies. (...) I then search for the microscopic underpinning or statistical mechanical ‘reductive basis’ of the second law of thermodynamics by taking a functionalist strategy. First, I outline the functional role of the thermodynamic entropy: for a thermally isolated system, the thermodynamic entropy is constant in quasi-static processes, but increasing in non-quasi-static processes. I then search for the statistical mechanical quantity that plays this role—rather than the role of the traditional ‘holy grail’ as described by Callender. I argue that in statistical mechanics, the Gibbs entropy plays this role. (shrink)

Defenders of physicalism often point to the reduction of chemistry to quantum physics as a paradigm for the reduction of the rest of reality to a microphysical foundation. This argument is based, however, on a misreading of the philosophical significance of the quantum revolution. A hylomorphic interpretation of quantum thermodynamics and chemistry, in which parts and wholes stand in a mutually determining relationship, better fits both the empirical facts and the actual practice of scientists. I argue that only (...) a hylomorphic interpretation of quantum mechanics is able to treat thermodynamic quantities, such as temperature and entropy, as genuinely real, which in turn provides grounds for the reality of the direction of time and of molecular structure. (shrink)

Can the second law of thermodynamics explain our mental experience of the direction of time? According to an influential approach, the past hypothesis of universal low entropy also explains how the psychological arrow comes about. We argue that although this approach has many attractive features, it cannot explain the psychological arrow after all. In particular, we show that the past hypothesis is neither necessary nor sufficient to explain the psychological arrow on the basis of current physics. We propose two (...) necessary conditions on the workings of the brain that any account of the psychological arrow of time must satisfy. And we propose a new reductive physical account of the psychological arrow of time compatible with time-symmetric physics, according to which these two conditions are also sufficient. Our proposal has some radical implications, for example, that the psychological arrow of time is fundamental, whereas the temporal direction of entropy increase in the second law of thermodynamics and the past hypothesis is derived from it, rather than the other way around. 1Introduction2A Physical Account of the Psychological Arrow of Time3Necessary Conditions for the Psychological Arrow of Time4The Psychological Arrow of Time via the Second Law of Thermodynamics and the Past Hypothesis5Why the Past Hypothesis Is Insufficient for the Psychological Arrow of Time5.1Stage 1, Version 1: From the past hypothesis to the psychological arrow via typicality5.2Stage 1, Version 2: From the past hypothesis to the psychological arrow via dynamical or causal considerations5.3Stage 2: From entropy gradient in the brain to the psychological arrow of time6Why the Past Hypothesis Is Unnecessary for the Psychological Arrow of Time7A New Reductive Account of the Psychological Arrow of Time. (shrink)

Defenders of physicalism often point to the reduction of chemistry to quantum physics as a paradigm for the reduction of the rest of reality to a microphysical foundation. This argument is based, however, on a misreading of the philosophical significance of the quantum revolution. A hylomorphic (from Aristotle’s concepts of hyle, matter, and morphe, form) interpretation of quantum thermodynamics and chemistry, in which parts and wholes stand in a mutually determining relationship, better fits both the empirical facts and (...) the actual practice of scientists. I argue that only a hylomorphic interpretation of quantum mechanics (QM) is able to treat thermodynamic quantities, such as temperature and entropy, as genuinely real, which in turn provides grounds for the reality of the direction of time and of molecular structure. (shrink)

Dissipative structures exist at all scales, systems, and at different levels of complexity. A thermodynamic theory integrating simple and complex DS is introduced, which addresses existence of growing/decaying DS based on their entropy analysis. Two entropy-based dimensionless ratios are introduced, which explain negentropy-debt payment and existence of DS with growth or decay. It is shown that excess negentropy debt payment is needed and beneficial for growing DS; but for decaying DS, it hastens its approach to perish and is (...) counter-productive. Growing complex DS tend to pay lower negentropy debt to their surroundings, due to involvement in other activities enabled by complexity; e.g. mediation for survival that is linked to their mortality. Hence, disorder of complex DS increases, due to which, their growth can be un-sustained, leading to entry in decay-phase in spite of availability of adequate mass-energy in-flows. Proper handling or reduction of complexity enables growth in the direction of ideal growth, which is limited only by availability of adequate mass-energy in-flows. (shrink)

Statistical mechanics is the name of the ongoing attempt to explain and predict certain phenomena, above all those described by thermodynamics on the basis of the fundamental theories of physics, in particular mechanics, together with certain auxiliary assumptions. In another paper in this journal, Foundations of statistical mechanics: Mechanics by itself, I have shown that some of the thermodynamic regularities, including the probabilistic ones, can be described in terms of mechanics by itself. But in order to prove those regularities, in (...) particular the time asymmetric ones, it is necessary to add to mechanics assumptions of three kinds, all of which are under debate in contemporary literature. One kind of assumptions concerns measure and probability, and here, a major debate is around the notion of “typicality.” A second assumption concerns initial conditions, and here, the debate is about the nature and status of the so-called past hypothesis. The third kind of assumptions concerns the dynamics, and here, the possibility and significance of “Maxwell's Demon” is the main topic of discussions. This article describes these assumptions and examines the justification for introducing them, emphasizing the contemporary debates around them. (shrink)

Nonlinear time series denoising is the prerequisite for extracting effective information from observation sequence. An effective chaotic signal denoising method not only has a good signal-to-noise ratio enhancement performance, but also can remain as a good unpredictable denoised signal. However, the inherent characteristics of chaos, such as extreme sensitivity to initial values and broadband spectrum, pose challenges for noise reduction of polluted chaotic signals. To address these issues, an adaptive smoothing multiscale morphological filtering is proposed to reconstruct chaotic signals. (...) In the process of noise reduction for contaminated chaotic signals, firstly, a multiscale morphological filter is constructed adaptively according to the multiscale permutation entropy of morphological filter residuals, and the contaminated signals are filtered. Secondly, the weight coefficients of scale structural element are calculated by the residual sum of squares operation, and the chaotic signals are reconstructed. Finally, the resampled filter signals are smoothed by cubic B-spline interpolation operation. In the experiment, the Lorenz signal with white Gaussian noise, the measured sunspot, and the chaotic vibration signal are reconstructed by four comparison methods. The test results show that the proposed ASMMF method has obvious advantages in noise suppression and topological trajectory restoration. (shrink)

Creation and evolution were historic allies against eternalism. However, Darwinism seemed to undercut cosmological theism and human dignity, and modern reconcilers of evolution and theology have not convinced opponents that they can preserve these concerns. Creationists find divine handiwork in natural order and freedom in human uniqueness. For them, even entropy and continuity of kinds are emblematic of the unity of nature and the needfulness of salvation. Anti‐evolutionists’ impatience and frustration are not well answered by dogmatic or mythicized science. (...) Neither is creation well served by reduction to merely empiric facts. Because creationism and evolutionism rest on the unabstractable categories of contingency and necessity, neither will disappear. (shrink)

We discuss two named-entity recognition models which use characters and character n-grams either exclusively or as an important part of their data representation. The first model is a character-level HMM with minimal context information, and the second model is a maximum-entropy conditional markov model with substantially richer context features. Our best model achieves an overall F1 of 86.07% on the English test data (92.31% on the development data). This number represents a 25% error reduction over the same model (...) without word-internal (substring) features. (shrink)

In many applications of information theory, information measures the reduction of uncertainty that results from the knowledge that an event has occurred. Even so, an item of information learned need not be the occurrence of an event but, rather, the change in probability distribution associated with an ensemble of events. This paper examines the basic account of information, which focuses on events, and reviews how it may be naturally generalized to probability distributions/measures. The resulting information measure is special case (...) of the Rényi information divergence (also known as the Rényi entropy). This information measure, herein dubbed the variational information, meaningfully assigns a numerical bit-value to arbitrary state transitions of physical systems. The information topology of these state transitions is characterized canonically by a right and left continuity spectrum defined in terms of the Kantorovich- Wasserstein metric. These continuity spectra provide a theoretical framework for characterizing the informational continuity of evolving systems and for rigorously assessing the degree to which such systems exhibit, or fail to exhibit, continuous change. (shrink)

General relativity cannot be formulated as a perturbatively renormalizable quantum field theory. An argument relying on the validity of the Bekenstein–Hawking entropy formula aims at dismissing gravity as non-renormalizable per se, against hopes that d-dimensional GR could turn out to have a non-perturbatively renormalizable d–dimensional quantum field theoretic formulation. In this note we discuss various forms of highly problematic semi-classical extrapolations assumed by both sides of the debate concerning what we call The Entropy Argument, and show that a (...) large class of dimensional reduction scenarios leads to the blow-up of Bekenstein–Hawking entropy. (shrink)

Previous work employing graph theory and nonlinear analysis has found increased spatial and temporal disorder, respectively, of functional brain connectivity in schizophrenia. We present a new method combining graph theory and nonlinear techniques that measures the temporal disorder of functional brain connections. Multichannel electroencephalographic data were windowed and functional networks were reconstructed using the minimum spanning trees of correlation matrices. Using a method based on Shannon entropy, we found elevated connection entropy in gamma activity of patients with schizophrenia; (...) however, gamma connection entropy remained elevated in patients with schizophrenia even after a reduction in symptoms due to treatment with antipsychotics. Our results are consistent with several possibilities: aberrant functional connectivity is epiphenomenal to schizophrenia, aberrant functional connectivity is a central feature but antipsychotics reduce symptoms by an independent mechanism, or connection entropy is not an appropriately sensitive measure of brain abnormalities in schizophrenia. (shrink)

In this study we evaluated heart rate variability changes in a pianist, playing in a laboratory, to investigate whether HRV changes are guided by music temporal features or by technical difficulty and/or subjective factors. The pianist was equipped with a wearable telemetry device for ECG recording during the execution of 4 classical and 5 jazz pieces. From ECG we derived the RR intervals series, and, for each piece, analyzed HRV in the time and frequency domains and performed non-linear analysis. We (...) also studied the correlation between the time course of music volume envelope and tachogram. Results showed a general reduction of parasympathetic and an increase of sympathetic activity, with the greatest changes during the classical pieces execution, the pianist appraised as more demanding than the jazz ones. The most marked changes occurred during the most technically/emotionally demanding piece, and correlation analysis revealed a negative association between music volume envelope time course and tachogram only for this piece, suggesting a modulation of the limbic system on the synchronization between heart rhythm and music temporal features. Classical music was also associated with the increase of entropy with respect to rest, indicating its effectiveness in driving flexible, healthy, heart dynamics. In conclusion, HRV seems modulated not only by the music temporal features, but also by the pianist’s emotional involvement, which is greatly influenced, in a non-trivial manner, by the technical demands and musician expertise. (shrink)

This book is an excellent collection of papers which partly spring from, and partly bear on the Study Group on the Unity of Knowledge held in various universities, October, 1967-March, 1970. The papers all bear on the problem of reduction. In "Unity of Physical Law and Levels of Description," Ilya Prigogine argues that organized structures need physical laws of organization, not of entropy only, to explain their genesis and operation." The editor’s paper, "Reducibility: Another Side Issue," argues, following (...) Polanyi, that living things as machines already transcend physics, since they demand both chemical and engineering principles for their explanation." "How is Mechanism Conceivable?" points out that ordinary ways of talking about and explaining behavior, i.e., as involving intention and purpose, differs in logic from mechanistic explanation. But this difference in logic of the two languages is "never an obstacle to the reduction of one theory to another, indeed, there is always such a noncongruence of the conceptual mesh." Anthony J. P. Kenny’s "The Homunculus Fallacy" argues against "the reckless application of human-being predicates to insufficiently human-like objects." In "Behavior, Belief, and Emotion," A. C. MacIntyre argues for the thesis that "there is no necessary connection between at least some emotions and particular forms of behavior." In "The Critique of Artificial Reason," H. Dreyfus criticizes both the empirical and a priori arguments for optimism underlying the work in artificial intelligence. It displays the underlying philosophical assumption inherent in Western philosophical tradition since Plato. The last two papers concern Polanyi’s theory of knowledge. In "Tacit Knowledge and the Concept of Mind," W. T. Scott shows how Ryle’s "Concept of Mind can be significantly extended by considering certain features of the philosophical position that Michael Polanyi has developed around the concept of tacit knowing." R. S. Cohen’s "Tacit, Social and Hopeful" discusses the difficulties in Polanyi’s epistemology and the merits of the logical reconstruction work in science. Only the papers by Dreyfus and Scott have been previously published. Throughout the collection, the editor has provided useful introductory remarks focusing upon the unifying themes in the collection.—A. S. C. (shrink)

This book is an excellent collection of papers which partly spring from, and partly bear on the Study Group on the Unity of Knowledge held in various universities, October, 1967-March, 1970. The papers all bear on the problem of reduction. In "Unity of Physical Law and Levels of Description," Ilya Prigogine argues that organized structures need physical laws of organization, not of entropy only, to explain their genesis and operation." The editor’s paper, "Reducibility: Another Side Issue," argues, following (...) Polanyi, that living things as machines already transcend physics, since they demand both chemical and engineering principles for their explanation." "How is Mechanism Conceivable?" points out that ordinary ways of talking about and explaining behavior, i.e., as involving intention and purpose, differs in logic from mechanistic explanation. But this difference in logic of the two languages is "never an obstacle to the reduction of one theory to another, indeed, there is always such a noncongruence of the conceptual mesh." Anthony J. P. Kenny’s "The Homunculus Fallacy" argues against "the reckless application of human-being predicates to insufficiently human-like objects." In "Behavior, Belief, and Emotion," A. C. MacIntyre argues for the thesis that "there is no necessary connection between at least some emotions and particular forms of behavior." In "The Critique of Artificial Reason," H. Dreyfus criticizes both the empirical and a priori arguments for optimism underlying the work in artificial intelligence. It displays the underlying philosophical assumption inherent in Western philosophical tradition since Plato. The last two papers concern Polanyi’s theory of knowledge. In "Tacit Knowledge and the Concept of Mind," W. T. Scott shows how Ryle’s "Concept of Mind can be significantly extended by considering certain features of the philosophical position that Michael Polanyi has developed around the concept of tacit knowing." R. S. Cohen’s "Tacit, Social and Hopeful" discusses the difficulties in Polanyi’s epistemology and the merits of the logical reconstruction work in science. Only the papers by Dreyfus and Scott have been previously published. Throughout the collection, the editor has provided useful introductory remarks focusing upon the unifying themes in the collection.—A. S. C. (shrink)

Entropy is ubiquitous in physics, and it plays important roles in numerous other disciplines ranging from logic and statistics to biology and economics. However, a closer look reveals a complicated picture: entropy is defined differently in different contexts, and even within the same domain different notions of entropy are at work. Some of these are defined in terms of probabilities, others are not. The aim of this chapter is to arrive at an understanding of some of the (...) most important notions of entropy and to clarify the relations between them, After setting the stage by introducing the thermodynamic entropy, we discuss notions of entropy in information theory, statistical mechanics, dynamical systems theory and fractal geometry. (shrink)

Daniel R. Brooks and E. O. Wiley have proposed a theory of evolution in which fitness is merely a rate determining factor. Evolution is driven by non-equilibrium processes which increase the entropy and information content of species together. Evolution can occur without environmental selection, since increased complexity and organization result from the likely capture at the species level of random variations produced at the chemical level. Speciation can occur as the result of variation within the species which decreases the (...) probability of sharing genetic information. Critics of the Brooks-Wiley theory argue that they have abused terminology from information theory and t thermodynamics. In this paper I review the essentials of the theory, and give an account of hierarchical physical information systems within which the theory can be interpreted. I then show how the major conceptual objections can be answered. (shrink)

The notion of reduction continues to play a key role in philosophy of mind and philosophy of cognitive science. Supporters of reductionism claim that psychological properties or explanations reduce to neural properties or explanations, while antireductionists claim that such reductions are not possible. In this book, I apply recent developments in philosophy of science, particularly the mechanistic explanation paradigm and the interventionist theory of causation, to reassess the traditional approaches to reduction in philosophy of mind. I then elaborate (...) and defend a pluralistic framework for philosophy of mind, and show how reductionist ideas can be incorporated into it. This leads to a novel synthesis of pluralism and reductionism that I call pluralistic physicalism. (shrink)

Logical information theory is the quantitative version of the logic of partitions just as logical probability theory is the quantitative version of the dual Boolean logic of subsets. The resulting notion of information is about distinctions, differences and distinguishability and is formalized using the distinctions of a partition. All the definitions of simple, joint, conditional and mutual entropy of Shannon information theory are derived by a uniform transformation from the corresponding definitions at the logical level. The purpose of this (...) paper is to give the direct generalization to quantum logical information theory that similarly focuses on the pairs of eigenstates distinguished by an observable, i.e., qudits of an observable. The fundamental theorem for quantum logical entropy and measurement establishes a direct quantitative connection between the increase in quantum logical entropy due to a projective measurement and the eigenstates that are distinguished by the measurement. Both the classical and quantum versions of logical entropy have simple interpretations as “two-draw” probabilities for distinctions. The conclusion is that quantum logical entropy is the simple and natural notion of information for quantum information theory focusing on the distinguishing of quantum states. (shrink)

Research on natural and artificial brains is proceeding at a rapid pace. However, the understanding of the essence of consciousness has changed slightly over the millennia, and only the last decade has brought some progress to the area. Scientific ideas emerged that the soul could be a product of the material body and that calculating machines could imitate brain processes. However, the authors of this book reject the previously common dualism—the view that the material and spiritual-psychic processes are separate and (...) require a completely different substance as their foundation. -/- Reductive Model of the Conscious Mind is a forward-thinking book wherein the authors identify processes that are the essence of conscious thinking and place them in the imagined, simplified structure of cells able to memorize and transmit information in the form of impulses, which they call neurons. The purpose of the study is to explain the essence of consciousness to the degree of development of natural sciences, because only the latter can find a way to embed the concept of the conscious mind in material brains. The book is divided into three parts. Part 1 works to convince readers that the emergence of consciousness does not require detailed knowledge of the structure and morphology of the brain, with the exception of some specific properties of the neural network structure that the authors attempt to point out. Part 2 proves that the biological structure of many natural brains fulfills the necessary conditions for consciousness and intelligent thinking. Similarly, Part 3 shows the ways in which artificial creatures imitating natural brains can meet these conditions, which gives great hopes for building artificially intelligent beings endowed with consciousness. Covering topics that include cognitive architecture, the embodied mind, and machine learning, this book is ideal for cognitive scientists, philosophers of mind, neuroscientists, psychologists, researchers, academicians, and advanced-level students. The book can also help to focus the research of linguists, neurologists, and biophysicists on the biophysical basis of postulated information processing into knowledge structures. (shrink)