Acknowledgements Andrea Scarantino, Nicholas Shea, Mark Sprevak, and three anonymous referees provided incisive and constructive comments, for which I am very grateful. In 2012, earlier versions of this paper were delivered in Edinburgh, at the Joint Session in Stirling, and at a workshop on natural information in Aberdeen. I thank participants for their feedback.

This article reviews current methods for evaluating models in the cognitive sciences, including theoretically based approaches, such as Bayes factors and minimum description length measures; simulation approaches, including model mimicry evaluations; and practical approaches, such as validation and generalization measures. This article argues that, although often useful in specific settings, most of these approaches are limited in their ability to give a general assessment of models. This article argues that hierarchical methods, generally, and hierarchical Bayesian methods, specifically, can provide a (...) more thorough evaluation of models in the cognitive sciences. This article presents two worked examples of hierarchical Bayesian analyses to demonstrate how the approach addresses key questions of descriptive adequacy, parameter interference, prediction, and generalization in principled and coherent ways. (shrink)

Recent decades have witnessed a sea change in thinking about emotion, which has gone from being seen as a disruptive force in human thought and action to being seen as an important source of situation- and goal-relevant information and evaluation, continuous with perception and cognition. Here I argue on philosophical and empirical grounds that the role of emotion in contributing to our ability to respond to reasons for action runs deeper still: The affective system is at the core of the (...) process of evaluatively modeling situations, actions, and outcomes, which is the foundation upon which rational deliberation and action can be built. Taking up this perspective affords new approaches to long-standing problems in the theory of reason-based action. (shrink)

Severity of Test (SoT) is an alternative to Popper's logical falsification that solves a number of problems of the logical view. It was presented by Popper himself in 1963. SoT is a less sophisticated probabilistic model of hypothesis testing than Oaksford & Chater's (O&C's) information gain model, but it has a number of striking similarities. Moreover, it captures the intuition of everyday hypothesis testing.

Human cognition requires coping with a complex and uncertain world. This suggests that dealing with uncertainty may be the central challenge for human reasoning. In Bayesian Rationality we argue that probability theory, the calculus of uncertainty, is the right framework in which to understand everyday reasoning. We also argue that probability theory explains behavior, even on experimental tasks that have been designed to probe people's logical reasoning abilities. Most commentators agree on the centrality of uncertainty; some suggest that there is (...) a residual role for logic in understanding reasoning; and others put forward alternative formalisms for uncertain reasoning, or raise specific technical, methodological, or empirical challenges. In responding to these points, we aim to clarify the scope and limits of probability and logic in cognitive science; explore the meaning of the explanation of cognition; and re-evaluate the empirical case for Bayesian rationality. (shrink)

According to Aristotle, humans are the rational animal. The borderline between rationality and irrationality is fundamental to many aspects of human life including the law, mental health, and language interpretation. But what is it to be rational? One answer, deeply embedded in the Western intellectual tradition since ancient Greece, is that rationality concerns reasoning according to the rules of logic – the formal theory that specifies the inferential connections that hold with certainty between propositions. Piaget viewed logical reasoning as defining (...) the end-point of cognitive development; and contemporary psychology of reasoning has focussed on comparing human reasoning against logical standards. (shrink)

Given the ubiquity and centrality of social and relational influences to the human experience, our conception of self-governance must adequately account for these external influences. The inclusion of socio-historical, externalist considerations into more traditional internalist accounts of autonomy has been an important feature of the debate over personal autonomy in recent years. But the relevant socio-temporal dynamics of autonomy are not only historical in nature. There are also important, and under-examined, future-oriented questions about how we retain autonomy while incorporating new (...) values into the existing set that guides our interaction with the world. In this paper, we examine these questions from two complementary perspectives: philosophy and neuroscience. After contextualizing the philosophical debate, we show the importance to theories of autonomous agency of the capacity to appropriately adapt our values and beliefs, in light of relevant experiences and evidence, to changing circumstances. We present a plausible philosophical account of this process, which we claim is generally applicable to theories about the nature of autonomy, both internalist and externalist alike. We then evaluate this account by providing a model for how the incorporation of values might occur in the brain; one that is inspired by recent theoretical and empirical advances in our understanding of the neural processes by which our beliefs are updated by new information. Finally, we synthesize these two perspectives and discuss how the neurobiology might inform the philosophical discussion. (shrink)

Humans display more conditioned fear when the conditioned stimulus in a fear conditioning paradigm is a picture of an individual from another race than when it is a picture of an individual from their own race (Olsson, Ebert, Banaji, & Phelps, 2005). These results have been interpreted in terms of a genetic “preparedness” to learn to fear individuals from different social groups (Ohman, 2005; Olsson et al., 2005). However, the associability of conditioned stimuli is strongly influenced by prior exposure to (...) those or similar stimuli. Using the Kalman filter, a normative statistical model, this article shows that superior fear conditioning to individuals from other groups is precisely what one would expect if participants perform optimal, Bayesian inference that takes their prior exposures to the different groups into account. There is therefore no need to postulate a genetic preparedness to learn to fear individuals from other races or social groups. (shrink)

Much research has linked surprise to violation of expectations, but it has been less clear how one can be surprised when one has no particular expectation. This paper discusses a computational theory based on Algorithmic Information Theory, which can account for surprises in which one initially expects randomness but then notices a pattern in stimuli. The authors present evidence that a “randomness deficiency” heuristic leads to surprise in such cases.

In reinforcement learning, a decision maker searching for the most rewarding option is often faced with the question: What is the value of an option that has never been tried before? One way to frame this question is as an inductive problem: How can I generalize my previous experience with one set of options to a novel option? We show how hierarchical Bayesian inference can be used to solve this problem, and we describe an equivalence between the Bayesian model and (...) temporal difference learning algorithms that have been proposed as models of RL in humans and animals. According to our view, the search for the best option is guided by abstract knowledge about the relationships between different options in an environment, resulting in greater search efficiency compared to traditional RL algorithms previously applied to human cognition. In two behavioral experiments, we test several predictions of our model, providing evidence that humans learn and exploit structured inductive knowledge to make predictions about novel options. In light of this model, we suggest a new interpretation of dopaminergic responses to novelty. (shrink)

This paper discusses recent evidence that violations of core knowledge offer special learning opportunities for infants and young children. Children make predictions about the world from the youngest ages. When their fail to match observed data, they show an enhanced drive to seek and retain new information about entities that violated their expectations. Finally, the authors draw comparisons between children and adults, and with other species, to explore how surprise shapes thought more broadly.

Bayesian models of human learning are becoming increasingly popular in cognitive science. We argue that their purported confirmation largely relies on a methodology that depends on premises that are inconsistent with the claim that people are Bayesian about learning and inference. Bayesian models in cognitive science derive their appeal from their normative claim that the modeled inference is in some sense rational. Standard accounts of the rationality of Bayesian inference imply predictions that an agent selects the option that maximizes the (...) posterior expected utility. Experimental confirmation of the models, however, has been claimed because of groups of agents that probability match the posterior. Probability matching only constitutes support for the Bayesian claim if additional unobvious and untested (but testable) assumptions are invoked. The alternative strategy of weakening the underlying notion of rationality no longer distinguishes the Bayesian model uniquely. A new account of rationality—either for inference or for decision-making—is required to successfully confirm Bayesian models in cognitive science. (shrink)

In general, epistemic emotions can be characterized as emotions that concern the subject's own states and mental processes and are associated with cognition and knowledge acquisition. They are the result of a cognitive inconsistency that may appear as a consequence of unexpected information that contradicts previous knowledge. They have a significant impact on the exploration and generation of knowledge about oneself and the world, as well as on conceptual changes and cognitive efficiency. There is no interspecies comparative perspective in experimental (...) studies on epistemic emotions. At first glance, this situation is not controversial, because the category of epistemic emotions has been defined in such a way that it seems to belong only to people. Inconsistencies arise when comparative research in the field of cognitive ethology, primatology or comparative psychology is analyzed. Researchers point to a number of behaviors of nonhuman animals that prove that they have a wide range of emotions - including those that stand out in the catalog of epistemic emotions, i.e. surprise, curiosity or uncertainty. The presented article is an attempt to answer the questions posed in the title and an introduction to research on an adequate model of epistemic emotions, taking into account the results of research in the above-mentioned areas. (shrink)

If Bayesian Fundamentalism existed, Jones & Love's (J&L's) arguments would provide a necessary corrective. But it does not. Bayesian cognitive science is deeply concerned with characterizing algorithms and representations, and, ultimately, implementations in neural circuits; it pays close attention to environmental structure and the constraints of behavioral data, when available; and it rigorously compares multiple models, both within and across papers. J&L's recommendation of Bayesian Enlightenment corresponds to past, present, and, we hope, future practice in Bayesian cognitive science.

Mitchell et al. argue that conditioning phenomena may be better explained by high-level, rational processes, rather than by non-cognitive associative mechanisms. This commentary argues that this viewpoint is compatible with neuroscientific data, may extend to nonhuman animals, and casts computational models of reinforcement learning in a new light.

Remarkable progress in the mathematics and computer science of probability has led to a revolution in the scope of probabilistic models. In particular, ‘sophisticated’ probabilistic methods apply to structured relational systems such as graphs and grammars, of immediate relevance to the cognitive sciences. This Special Issue outlines progress in this rapidly developing field, which provides a potentially unifying perspective across a wide range of domains and levels of explanation. Here, we introduce the historical and conceptual foundations of the approach, explore (...) how the approach relates to studies of explicit probabilistic reasoning, and give a brief overview of the field as it stands today. (shrink)

Causal reasoning is one of our most central cognitive competencies, enabling us to adapt to our world. Causal knowledge allows us to predict future events, or diagnose the causes of observed facts. We plan actions and solve problems using knowledge about cause-effect relations. Without our ability to discover and empirically test causal theories, we would not have made progress in various empirical sciences. In the past decades, the important role of causal knowledge has been discovered in many areas of cognitive (...) psychology. Despite the ubiquity of causal reasoning, textbooks of cognitive psychology have neglected this growing field. The goal of The Oxford Handbook of Causal Reasoning is to fill this gap. The handbook brings together the leading researchers in the field of causal reasoning and offers state-of-the-art presentations of theories and research. It provides introductions of competing theories of causal reasoning, and discusses its role in various cognitive functions and domains. The final section presents research from neighboring fields. 1. Causal Reasoning: An Introduction Michael R. Waldmann Part I: Theories of Causal Cognition 2. Associative Accounts of Causal Cognition Mike E. Le Pelley, Oren Griffiths, and Tom Beesley 3. Rules of Causal Judgment: Mapping Statistical Information Onto Causal Beliefs José C. Perales, Andrés Catena, Antonio Cándido, and Antonio Maldonado 4. The Inferential Reasoning Theory of Causal Learning: Toward a Multi- Process Propositional Account Yannick Boddez, Jan De Houwer, and Tom Beckers 5. Causal Invariance as an Essential Constraint for Creating a Causal Representation of the World: Generalizing the Invariance of Causal Power Patricia W. Cheng and Hongjing Lu 6. The Acquisition and Use of Causal Structure Knowledge Benjamin Margolin Rottman 7. Formalizing Prior Knowledge in Causal Induction Thomas L. Griffiths 8. Causal Mechanisms Samuel G. B. Johnson and Woo-kyoung Ahn 9. Force Dynamics and Causation Phillip Wolff and Robert Thorstad 10. Mental Models and Causation P. N. Johnson- Laird and Sangeet S. Khemlani 11. Pseudocontingencies Klaus Fiedler and Florian Kutzner 12. Singular Causation David Danks 13. Cognitive Neuroscience of Causal Reasoning Joachim T. Operskalski and Aron K. Barbey Part II: Basic Cognitive Functions 14. Visual Impressions of Causality Peter White 15. Goal-Directed Actions Bernhard Hommel 16. Planning and Control Magda Osman 17. Reinforcement Learning and Causal Models Samuel J. Gershman 18. Causation and the Probability of Causal Conditionals David E. Over 19. Causal Models and Conditional Reasoning Mike Oaksford and Nick Chater 20. Concepts as Causal Models: Categorization Bob Rehder 21. Concepts as Causal Models: Induction Bob Rehder 22. Causal Explanation Tania Lombrozo and Nadya Vasilyeva 23. Diagnostic Reasoning Björn Meder and Ralf Mayrhofer 24. Inferring Causal Relations by Analogy Keith J. Holyoak and Hee-Seung Lee 25. Causal Argument Ulrike Hahn, Roland Bluhm, and Frank Zenker 26. Causality in Decision- Making York Hagmayer and Philip M. Fernbach Part III: Domains of Causal Reasoning 27. Intuitive Theories Tobias Gerstenberg and Joshua B. Tenenbaum 28. Space, Time, and Causality Marc J. Buehner 29. Causation in Legal and Moral Reasoning David A. Lagnado and Tobias Gerstenberg 30. The Role of Causal Knowledge in Reasoning About Mental Disorders Woo-kyoung Ahn, Nancy S. Kim, and Matthew S. Lebowitz 31. Causality and Causal Reasoning in Natural Language Torgrim Solstad and Oliver Bott 32. Social Attribution and Explanation Denis Hilton Part IV: Development, Phylogeny, and Culture 33. The Development of Causal Reasoning Paul Muentener and Elizabeth Bonawitz 34. Causal Reasoning in Non-Human Animals Christian Schloegl and Julia Fischer 35. Causal Cognition and Culture Andrea Bender, Sieghard Beller, and Douglas L. Medin. (shrink)

Primatologists generally agree that monkeys lack higher-order intentional capacities related to theory of mind. Yet the discovery of the so-called "mirror neurons" in monkeys suggests to many neuroscientists that they have the rudiments of intentional understanding. Given a standard philosophical view about intentional understanding, which requires higher-order intentionahty, a paradox arises. Different ways of resolving the paradox are assessed, using evidence from neural, cognitive, and behavioral studies of humans and monkeys. A decisive resolution to the paradox requires substantial additional empirical (...) work and perhaps a rejection of the standard philosophical view. (shrink)