Viewing the brain as an organ of approximate Bayesian inference can help us understand how it represents the self. We suggest that inferred representations of the self have a normative function: to predict and optimise the likely outcomes of social interactions. Technically, we cast this predict-and-optimise as maximising the chance of favourable outcomes through active inference. Here the utility of outcomes can be conceptualised as prior beliefs about final states. Actions based on interpersonal representations can therefore be (...) understood as minimising surprise – under the prior belief that one will end up in states with high utility. Interpersonal representations thus serve to render interactions more predictable, while the affective valence of interpersonal inference renders self-perception evaluative. Distortions of self-representation contribute to major psychiatric disorders such as depression, personality disorder and paranoia. The approach we review may therefore operationalise the study of interpersonal representations in pathological states. (shrink)

Cognitive approaches contribute to our understanding of delusions by providing an explanatory framework that extends beyond the personal level to the sub personal level of information-processing systems. According to one influential cognitive approach, two factors are required to account for the content of a delusion, its initial adoption as a belief, and its persistence. This chapter reviews Bayesian developments of the two-factor framework.

We criticise Shepard's notions of “invariance” and “universality,” and the incorporation of Shepard's work on inference into the general framework of his paper. We then criticise Tenenbaum and Griffiths' account of Shepard (1987b), including the attributed likelihood function, and the assumption of “weak sampling.” Finally, we endorse Barlow's suggestion that minimum message length (MML) theory has useful things to say about the Bayesian inference problems discussed by Shepard and Tenenbaum and Griffiths. [Barlow; Shepard; Tenenbaum & Griffiths].

Shepard has argued that a universal law should govern generalization across different domains of perception and cognition, as well as across organisms from different species or even different planets. Starting with some basic assumptions about natural kinds, he derived an exponential decay function as the form of the universal generalization gradient, which accords strikingly well with a wide range of empirical data. However, his original formulation applied only to the ideal case of generalization from a single encountered stimulus to a (...) single novel stimulus, and for stimuli that can be represented as points in a continuous metric psychological space. Here we recast Shepard's theory in a more general Bayesian framework and show how this naturally extends his approach to the more realistic situation of generalizing from multiple consequential stimuli with arbitrary representational structure. Our framework also subsumes a version of Tversky's set-theoretic model of similarity, which is conventionally thought of as the primary alternative to Shepard's continuous metric space model of similarity and generalization. This unification allows us not only to draw deep parallels between the set-theoretic and spatial approaches, but also to significantly advance the explanatory power of set-theoretic models. Key Words: additive clustering; Bayesian inference; categorization; concept learning; contrast model; features; generalization; psychological space; similarity. (shrink)

The study tests the hypothesis that conditional probability judgments can be influenced by causal links between the target event and the evidence even when the statistical relations among variables are held constant. Three experiments varied the causal structure relating three variables and found that (a) the target event was perceived as more probable when it was linked to evidence by a causal chain than when both variables shared a common cause; (b) predictive chains in which evidence is a cause of (...) the hypothesis gave rise to higher judgments than diagnostic chains in which evidence is an effect of the hypothesis; and (c) direct chains gave rise to higher judgments than indirect chains. A Bayesian learning model was applied to our data but failed to explain them. An explanation-based hypothesis stating that statistical information will affect judgments only to the extent that it changes beliefs about causal structure is consistent with the results. (shrink)

A generalized Bayesian inference nets model is proposed to aid researchers to construct Bayesian inference nets for various applications. The benefit of such a model is well demonstrated by applying GBINM in constructing a hierarchical Bayesian fuzzy inference nets to diagnose five important types of cardiovascular diseases. The patients' medical records with doctors' confirmed diagnostic results obtained from two hospitals in China are used to design and verify HBFIN. Bayesian theorem is used to (...) calculate the propagation of probability and address the uncertainties involved in each sequential stage of inference nets to deduce the disease. The validity and effectiveness of proposed approach is witnessed clearly from testing results obtained. (shrink)

Collaboration requires agents to coordinate their behavior on the fly, sometimes cooperating to solve a single task together and other times dividing it up into sub‐tasks to work on in parallel. Underlying the human ability to collaborate is theory‐of‐mind (ToM), the ability to infer the hidden mental states that drive others to act. Here, we develop Bayesian Delegation, a decentralized multi‐agent learning mechanism with these abilities. Bayesian Delegation enables agents to rapidly infer the hidden intentions of others by (...) inverse planning. We test Bayesian Delegation in a suite of multi‐agent Markov decision processes inspired by cooking problems. On these tasks, agents with Bayesian Delegation coordinate both their high‐level plans (e.g., what sub‐task they should work on) and their low‐level actions (e.g., avoiding getting in each other's way). When matched with partners that act using the same algorithm, Bayesian Delegation outperforms alternatives. Bayesian Delegation is also a capable ad hoc collaborator and successfully coordinates with other agent types even in the absence of prior experience. Finally, in a behavioral experiment, we show that Bayesian Delegation makes inferences similar to human observers about the intent of others. Together, these results argue for the centrality of ToM for successful decentralized multi‐agent collaboration. (shrink)

We introduce a graphical framework for Bayesian inference that is sufficiently general to accommodate not just the standard case but also recent proposals for a theory of quantum Bayesian inference wherein one considers density operators rather than probability distributions as representative of degrees of belief. The diagrammatic framework is stated in the graphical language of symmetric monoidal categories and of compact structures and Frobenius structures therein, in which Bayesian inversion boils down to transposition with respect (...) to an appropriate compact structure. We characterize classical Bayesian inference in terms of a graphical property and demonstrate that our approach eliminates some purely conventional elements that appear in common representations thereof, such as whether degrees of belief are represented by probabilities or entropie quantities. We also introduce a quantum-like calculus wherein the Frobenius structure is noncommutative and show that it can accommodate Leifer's calculus of 'conditional density operators'. The notion of conditional independence is also generalized to our graphical setting and we make some preliminary connections to the theory of Bayesian networks. Finally, we demonstrate how to construct a graphical Bayesian calculus within any dagger compact category. (shrink)

The theory of personal probability needs to be developed as a logic of credibility in order to provide an adequate basis for the theories of scientific inference and rational decision making. But standard systems of personal probability impose formal structures on probability relationships which are too restrictive to qualify them as logics of credibility. Moreover, some rules for conditional probability have no justification as principles of credibility. A formal system of qualitative probability which is free of these defects and (...) which leads to a presuppositionless representation theorem is sketched. (shrink)

Scientists often study hypotheses that they know to be false. This creates an interpretive problem for Bayesians because the probability assigned to a hypothesis is typically interpreted as the probability that the hypothesis is true. I argue that solving the interpretive problem requires coming up with a new semantics for Bayesian inference. I present and contrast two new semantic frameworks, and I argue that both of them support the claim that there is pervasive pragmatic encroachment on whether a (...) given Bayesian probability assignment is rational. (shrink)

Why are conditional degrees of belief in an observation E, given a statistical hypothesis H, aligned with the objective probabilities expressed by H? After showing that standard replies are not satisfactory, I develop a suppositional analysis of conditional degree of belief, transferring Ramsey’s classical proposal to statistical inference. The analysis saves the alignment, explains the role of chance-credence coordination, and rebuts the charge of arbitrary assessment of evidence in Bayesian inference. Finally, I explore the implications of this (...) analysis for Bayesian reasoning with idealized models in science. (shrink)

In this article, I first give a short outline of the different interpretations of the concept of probability that emerged in the twentieth century. In what follows, I give an overview of the main problems and problematic concepts from the philosophy of probability and show how they relate to Bayesian inference. In this overview, I emphasise that the understanding of the main concepts related to different interpretations of probability influences the understanding and status of Bayesian inference. (...) In the conclusion, I express that, from a broad epistemological point of view, a kind of compatibilism between the two main lines of interpretations of probability is worth pursuing, as they represent different aspects of the epistemological process. (shrink)

Probability updating via Bayes' rule often entails extensive informational and computational requirements. In consequence, relatively few practical applications of Bayesian adaptive control techniques have been attempted. This paper discusses an alternative approach to adaptive control, Bayesian in spirit, which shifts attention from the updating of probability distributions via transitional probability assessments to the direct updating of the criterion function, itself, via transitional utility assessments. Results are illustrated in terms of an adaptive reinvestment two-armed bandit problem.

This paper develops a trivalent semantics for indicative conditionals and extends it to a probabilistic theory of valid inference and inductive learning with conditionals. On this account, (i) all complex conditionals can be rephrased as simple conditionals, connecting our account to Adams's theory of p-valid inference; (ii) we obtain Stalnaker's Thesis as a theorem while avoiding the well-known triviality results; (iii) we generalize Bayesian conditionalization to an updating principle for conditional sentences. The final result is a unified (...) semantic and probabilistic theory of conditionals with attractive results and predictions. (shrink)

An influential argument is that mental processes can be explained at three different levels of analysis: the functional, algorithmic, and implementation level. Identity attribution (the process whereby an identity is attributed to another individual or to the self) has been rarely explored at the functional level. To address this, here I propose a theory of identity attribution grounded on Bayesian inference, being the latter a well-established functional perspective in cognitive science. The theory posits that an identity is inferred (...) based on observations about a target’s features, about the context, and about motivational factors. This inference can be made based upon multiple sources of observations, with prior beliefs becoming more prominent when observations are fewer in number. The theory offers an interpretation of key processes driving identity attribution, potentially providing a platform for integrating different perspectives on identity in psychology and sociology. (shrink)

Bayes’ formula is a fundamental statistical method for inference judgments in uncertain situations used by both laymen and professionals. However, since people often fail in situations where Bayes’ formula can be applied, how to improve their performance in Bayesian situations is a crucial question. We based our research on a widely accepted beneficial strategy in Bayesian situations, representing the statistical information in the form of natural frequencies. In addition to this numerical format, we used five visualizations: a (...) 2×2-table, a unit square, an icon array, a tree diagram, and a double-tree diagram. In an experiment with 688 undergraduate students, we empirically investigated the effectiveness of three graphical properties of visualizations: area-proportionality, use of discrete and countable statistical entities, and graphical transparency of the nested-sets structure. We found no additional beneficial effect of area-proportionality. In contrast, the representation of discrete objects seems to be beneficial. Furthermore, our results show a strong facilitating effect of making the nested-sets structure of a Bayesian situation graphically transparent. Our results contribute to answering the questions of how and why a visualization could facilitate judgment and decision making in situations of uncertainty. (shrink)

We report two issues concerning diverging sets of Bayesian (conditional) probabilities-divergence of "posteriors"-that can result with increasing evidence. Consider a set P of probabilities typically, but not always, based on a set of Bayesian "priors." Fix E, an event of interest, and X, a random variable to be observed. With respect to P, when the set of conditional probabilities for E, given X, strictly contains the set of unconditional probabilities for E, for each possible outcome X = x, (...) call this phenomenon dilation of the set of probabilities (Seidenfeld and Wasserman 1993). Thus, dilation contrasts with the asymptotic merging of posterior probabilities reported by Savage (1954) and by Blackwell and Dubins (1962). (1) In a wide variety of models for Robust Bayesian inference the extent to which X dilates E is related to a model specific index of how far key elements of P are from a distribution that makes X and E independent. (2) At a fixed confidence level, (1-α), Classical interval estimates A n for, e.g., a Normal mean θ have length O(n -1/2 ) (for sample size n). Of course, the confidence level correctly reports the (prior) probability that θ ∈ A n ,P(A n )=1-α , independent of the prior for θ . However, as shown by Pericchi and Walley (1991), if an ε -contamination class is used for the prior on the parameter θ , there is asymptotic (posterior) dilation for the A n , given the data. If, however, the intervals A ′ n are chosen with length $O(\sqrt{\log (\text{n})/\text{n})}$ , then there is no asymptotic dilation. We discuss the asymptotic rates of dilation for ClassClassical and Bayesian interval estimates and relate these to Bayesian hypothesis testing. (shrink)

Decoupling is a general principle that allows us to separate simple components in a complex system. In statistics, decoupling is often expressed as independence, no association, or zero covariance relations. These relations are sharp statistical hypotheses, that can be tested using the FBST - Full Bayesian Significance Test. Decoupling relations can also be introduced by some techniques of Design of Statistical Experiments, DSEs, like randomization. This article discusses the concepts of decoupling, randomization and sparsely connected statistical models in the (...) epistemological framework of cognitive constructivism. (shrink)

The formalism of operational statistics, a generalized approach to probability and statistics, provides a setting within which inference strategies can be studied with great clarity. This paper is concerned with the asymptotic behavior of the Bayesian inference strategy in this setting. We consider a sequence of posterior distributions, obtained from a prior as a result of successive conditionings by the events of an admissible sequence. We identify certain statistical hypotheses whose limiting posterior probabilities converge to one. We (...) describe these hypotheses, and show that when the prior is vague, they contain those probability models which represent the long-run relative frequencies of occurrence for the events in the sequence. (shrink)

Consistent with Barbey & Sloman (B&S), it is proposed that performance on Bayesian inference tasks is well explained by nested sets theory (NST). However, contrary to those authors' view, it is proposed that NST does better by dispelling with dual-systems assumptions. This article examines why, and sketches out a series of NST's core principles, which were not previously defined.

Scientists and Bayesian statisticians often study hypotheses that they know to be false. This creates an interpretive problem because the Bayesian probability of a hypothesis is typically interpreted as a degree of belief that the hypothesis is true. In this paper, I present and contrast two solutions to the interpretive problem, both of which involve reinterpreting the Bayesian framework in such a way that pragmatic factors directly determine in part how probability assignments are interpreted and whether a (...) given probability assignment is rational. I argue that there is an important sense in which the two solutions are equivalent, and I suggest that the two reinterpretations can help us do Bayesian inference better. I also explore various features of the two reinterprations, including their relations to the standard Bayesian interpretation of probability and to the Law of Likelihood. (shrink)

Science is about evaluation, persuasion and logic. In scientific debate, scientists collectively evaluate theories by persuading each other in regard to epistemological qualities such as deduction and fact. There is, however, a flaw intrinsic to evaluation-by-persuasion: an individual can attempt and even succeed in persuading others by asserting that their reasoning is logical when it is not. This is a problem since, from an epistemological perspective, it is not always transparent nor obvious when a persuasive assertion is actually deductively warranted. (...) Empirical research upon reasoning, indeed, supports the notion that assertions are often strongly persuasive for reasons other than their logic. The unreliability of the link between persuasion and logic raises an important methodological issue: how do scientists debate in a manner such that claimed but false “logical” arguments are ignored, and only warranted arguments get to determine theory preference? This need for soundness in debate is a particularly important epistemological concern in cases where the deductive qualities of persuasive argument are not overt, and so cannot be directly checked --such as when they are founded upon Bayesianism probabilistic coherence. The argument presented here is that scientists make the qualities of probabilistic and nonprobabilistic inference sound (and so warranted) through how they organize their debate. Scientists, I argue, abide by “epistemological quality control practices” that limit the persuasive power of unsound arguments upon theory evaluation. Examples of such debate quality control practices are publicness, clarity, openness to criticism, and the collective promotion of attempts at theory conjecture and refutation. Methodologically, these quality control practices are extralogical since they do not directly provide scientific inferences with additional logical warrantedness. They function instead in science to generate an epistemological evaluative environment in which persuasiveness is due, and only due, to logic (i.e. sound). Their methodological role is therefore to make what is warranted de papyri (in our principles of rationality – epistemologically competence) also what is persuasive in evaluation and debate de cognitio (in our exercise of such principles – epistemologically performance). Several limitations exist upon the soundness of Bayesian inferential coherence – surreptitious revision, logical omniscience, uncertain evidence, old evidence, and new hypotheses. Bayesianism, as a result, can only exist if it is pursued in a debate that is regulated by quality control practices over its inferences (for instance, practices that ensure there is autonomy of inference, diligence of inference, probity of evidence, auditability of inference and assiduousness of conjecture). In this context, one can reinterpret Popper’s concern with criticism, openness, refutation and conjecture, as deriving not (as he thought) directly from the needs of logic, but, indirectly, from the need of scientists to create epistemological soundness. (shrink)

This book grew out of previously published papers of mine composed over a period of years; they have been reworked (sometimes beyond recognition) so as to form a reasonably coherent whole. Part One treats of informative inference. I argue (Chapter 2) that the traditional principle of induction in its clearest formulation (that laws are confirmed by their positive cases) is clearly false. Other formulations in terms of the 'uniformity of nature' or the 'resemblance of the future to the past' (...) seem to me hopelessly unclear. From a Bayesian point of view, 'learning from experience' goes by conditionalization (Bayes' rule). The traditional stum bling block for Bayesians has been to fmd objective probability inputs to conditionalize upon. Subjective Bayesians allow any probability inputs that do not violate the usual axioms of probability. Many subjectivists grant that this liberality seems prodigal but own themselves unable to think of additional constraints that might plausibly be imposed. To be sure, if we could agree on the correct probabilistic representation of 'ignorance' (or absence of pertinent data), then all probabilities obtained by applying Bayes' rule to an 'informationless' prior would be objective. But familiar contra dictions, like the Bertrand paradox, are thought to vitiate all attempts to objectify 'ignorance'. BuUding on the earlier work of Sir Harold Jeffreys, E. T. Jaynes, and the more recent work ofG. E. P. Box and G. E. Tiao, I have elected to bite this bullet. In Chapter 3, I develop and defend an objectivist Bayesian approach. (shrink)

mentation for languages such as Chinese. Almost no NLP task is truly standalone. The end-to-end performance of natural Most current systems for higher-level, aggre-.

This paper addresses a common challenge with computational cognitive models: identifying parameter values that are both theoretically plausible and generate predictions that match well with empirical data. While computational models can offer deep explanations of cognition, they are computationally complex and often out of reach of traditional parameter fitting methods. Weak methodology may lead to premature rejection of valid models or to acceptance of models that might otherwise be falsified. Mathematically robust fitting methods are, therefore, essential to the progress of (...) computational modeling in cognitive science. In this article, we investigate the capability and role of modern fitting methods—including Bayesian optimization and approximate Bayesian computation—and contrast them to some more commonly used methods: grid search and Nelder–Mead optimization. Our investigation consists of a reanalysis of the fitting of two previous computational models: an Adaptive Control of Thought—Rational model of skill acquisition and a computational rationality model of visual search. The results contrast the efficiency and informativeness of the methods. A key advantage of the Bayesian methods is the ability to estimate the uncertainty of fitted parameter values. We conclude that approximate Bayesian computation is (a) efficient, (b) informative, and (c) offers a path to reproducible results. (shrink)

The conflict of narrowness and precision in direct inference occurs if a body of evidence contains estimates for frequencies in a certain reference class and less precise estimates for frequencies in a narrower reference class. To develop a solution to this conflict, I draw on ideas developed by Paul Thorn and John Pollock. First, I argue that Kyburg and Teng’s solution to the conflict of narrowness and precision leads to unreasonable direct inference probabilities. I then show that Thorn’s (...) recent solution to the conflict leads to unreasonable direct inference probabilities. Based on my analysis of Thorn’s approach, I propose a natural distribution for a Bayesian analysis of the data directly obtained from studying members of the narrowest reference class. (shrink)