Remarkable progress in the mathematics and computer science of probability has led to a revolution in the scope of probabilistic models. In particular, ‘sophisticated’ probabilistic methods apply to structured relational systems such as graphs and grammars, of immediate relevance to the cognitive sciences. This Special Issue outlines progress in this rapidly developing field, which provides a potentially unifying perspective across a wide range of domains and levels of explanation. Here, we introduce the historical and conceptual foundations of the (...) approach, explore how the approach relates to studies of explicit probabilistic reasoning, and give a brief overview of the field as it stands today. (shrink)

Probabilistic methods are providing new explanatory approaches to fundamental cognitive science questions of how humans structure, process and acquire language. This review examines probabilistic models defined over traditional symbolic structures. Language comprehension and production involve probabilistic inference in such models; and acquisition involves choosing the best model, given innate constraints and linguistic and other input. Probabilistic models can account for the learning and processing of language, while maintaining the sophistication of symbolic models. A recent burgeoning of (...) theoretical developments and online corpus creation has enabled large models to be tested, revealing probabilistic constraints in processing, undermining acquisition arguments based on a perceived poverty of the stimulus, and suggesting fruitful links with probabilistic theories of categorization and ambiguity resolution in perception. (shrink)

The problems of access—retrieving linguistic structure from some mental grammar —and disambiguation—choosing among these structures to correctly parse ambiguous linguistic input—are fundamental to language understanding. The literature abounds with psychological results on lexical access, the access of idioms, syntactic rule access, parsing preferences, syntactic disambiguation, and the processing of garden‐path sentences. Unfortunately, it has been difficult to combine models which account for these results to build a general, uniform model of access and disambiguation at the lexical, idiomatic, and syntactic levels. (...) For example, psycholinguistic theories of lexical access and idiom access and parsing theories of syntactic rule access have almost no commonality in methodology or coverage of psycholinguistic data. This article presents a single probabilistic algorithm which models both the access and disambiguation of linguistic knowledge. The algorithm is based on a parallel parser which ranks constructions for access, and interpretations for disambiguation, by their conditional probability. Low‐ranked constructions and interpretations are pruned through beam‐search; this pruning accounts, among other things, for the garden‐path effect. I show that this motivated probabilistic treatment accounts for a wide variety of psycholinguistic results, arguing for a more uniform representation of linguistic knowledge and for the use of probabilistically‐enriched grammars and interpreters as models of human knowledge of and processing of language. (shrink)

This study presents a probabilistic model of melody perception, which infers the key of a melody and also judges the probability of the melody itself. The model uses Bayesian reasoning: For any “surface” pattern and underlying “structure,” we can infer the structure maximizing P(structure|surface) based on knowledge of P(surface, structure). The probability of the surface can then be calculated as ∑ P(surface, structure), summed over all structures. In this case, the surface is a pattern of notes; the structure is (...) a key. A generative model is proposed, based on three principles: (a) melodies tend to remain within a narrow pitch range; (b) note‐to‐note intervals within a melody tend to be small; and (c) notes tend to conform to a distribution (or key profile) that depends on the key. The model is tested in three ways. First, it is tested on its ability to identify the keys of a set of folksong melodies. Second, it is tested on a melodic expectation task in which it must judge the probability of different notes occurring given a prior context; these judgments are compared with perception data from a melodic expectation experiment. Finally, the model is tested on its ability to detect incorrect notes in melodies by assigning them lower probabilities than the original versions. (shrink)

Enculturation is known to shape the perception of meter in music but this is not explicitly accounted for by current cognitive models of meter perception. We hypothesize that meter perception is a strategy for increasing the predictability of rhythmic patterns and that the way in which it is shaped by the cultural environment can be understood in terms of probabilistic predictive coding. Based on this hypothesis, we present a probabilistic model of meter perception that uses statistical properties of (...) the relation between rhythm and meter to infer meter from quantized rhythms. We show that our model can successfully predict annotated time signatures from quantized rhythmic patterns derived from folk melodies. Furthermore, we show that by inferring meter, our model can better predict the onsets of future events than a similar probabilistic model that does not infer meter. Finally, we demonstrate how our model can be used in a proof-of-concept simulation of enculturation. From this simulation, we derive a class of rhythms that are likely to be interpreted differently by enculturated listeners with different histories of exposure to rhythms. (shrink)

Experimental research shows that human sentence processing uses information from different levels of linguistic analysis, for example, lexical and syntactic preferences as well as semantic plausibility. Existing computational models of human sentence processing, however, have focused primarily on lexico‐syntactic factors. Those models that do account for semantic plausibility effects lack a general model of human plausibility intuitions at the sentence level. Within a probabilistic framework, we propose a wide‐coverage model that both assigns thematic roles to verb–argument pairs and determines (...) a preferred interpretation by evaluating the plausibility of the resulting (verb, role, argument) triples. The model is trained on a corpus of role‐annotated language data. We also present a transparent integration of the semantic model with an incremental probabilistic parser. We demonstrate that both the semantic plausibility model and the combined syntax/semantics model predict judgment and reading time data from the experimental literature. (shrink)

Several theoretical publications on the Dirac equation published during the last decades have shown that, an interpretation is possible, which ascribes the origin of electron spin and magnetic moment to an autonomous circular motion of the point-like charged particle around a fixed centre. In more recent publications an extension of the original so called “Zitterbewegung Interpretation” of quantum mechanics was suggested, in which the spin results from an average of instantaneous spin vectors over a Zitterbewegung period. We argue that, the (...) corresponding autonomous motion of the electron should, if it is real, determine non-relativistic spin measurements. Such a direct connection with the established formal quantum mechanical description of spin measurements, into which spin is introduced as a “non-classical” quantity has, to our knowledge, not been reported. In the present work we show that, under certain “model assumptions” concerning the proposed autonomous motion, results of spin measurements, including measurements of angular correlations in singlet systems, can indeed be correctly described using classical probabilities. The success of the model is evidence for the “reality” of the assumed autonomous motion. The resulting model violates the Bell—inequalities to the same extent as quantum mechanics. (shrink)

My research program proposes that children have representations and learning mechanisms that can be characterized as causal models of the world Bayesian Fundamentalism.”.

In this paper, we present a probabilistic-based method to predict malaria disease at an early stage. Malaria is a very dangerous disease that creates a lot of health problems. Therefore, there is a need for a system that helps us to recognize this disease at early stages through the visual symptoms and from the environmental data. In this paper, we proposed a Bayesian network model to predict the occurrences of malaria disease. The proposed BN model is built on different (...) attributes of the patient’s symptoms and environmental data which are divided into training and testing parts. Our proposed BN model when evaluated on the collected dataset found promising results with an accuracy of 81%. One the other hand, F1 score is also a good evaluation of these probabilistic models because there is a huge variation in class data. The complexity of these models is very high due to the increase of parent nodes in the given influence diagram, and the conditional probability table also becomes more complex. (shrink)

If we are eventually to understand the capability of higher organisms for perceptual recognition, generalization, recall, and thinking, we must first have answers to three fundamental questions: 1. How is information about the physical world sensed, or detected, by the biological system? 2. In what form is information stored, or remembered? 3. How does information contained in storage, or in memory, influence recognition and behavior? The first of these questions is in the.

As is clear to any user of software, quality control of software has not reached the same levels of sophistication as it has with traditional manufacturing. In this paper we argue that this is because insufficient thought is being given to the methods of reasoning under uncertainty that are appropriate to this domain. We then describe how we have built a large-scale Bayesian network to overcome the difficulties that have so far been met in software quality control. This exploits a (...) number of recent advances in tool support for constructing large networks. We end the paper by describing how the network was validated and illustrate the range of reasoning styles that can be modelled with this tool. (shrink)

In coal mining industry, the running state of mine ventilators plays an extremely significant role for the safe and reliable operation of various industrial productions. To guarantee the better reliability, safety, and economy of mine ventilators, in view of early detection and effective fault diagnosis of mechanical faults which could prevent unscheduled downtime and minimize maintenance fees, it is imperative to construct some viable mathematical models for mine ventilator fault diagnosis. In this article, we plan to establish a data-based mine (...) ventilator fault diagnosis method to handle situations where engineers are absent or they are incapable of coming to a conclusion from multisource data. In the process of building the mine ventilator fault diagnosis model, considering that probabilistic rough sets could reduce the errors triggered by incompleteness, inconsistency, and inaccuracy without needing any additional assumptions and Pythagorean fuzzy multigranulation rough sets over the two universes’ model could effectively handle data representation, fusion, and analysis issues, we generalize the existing PF MGRSs over the two universes’ model to the PRS setting, as well as to further establish a novel model named Pythagorean fuzzy multigranulation probabilistic rough sets over two universes. In the granular computing paradigm, three types of PF MG-PRSs over two universes based on the risk attitude of engineers are proposed at first. Afterwards, several basic propositions of the newly proposed model are explored. Moreover, a PF multigranulation probabilistic model for mine ventilator fault diagnosis based on PF MG-PRSs over two universes is investigated. At last, a real-world case study of dealing with a mine ventilator fault diagnosis problem is given to illustrate the practicality of the presented model, and a validity test, a sensitivity analysis, and a comparison analysis are further explored to demonstrate the effectiveness of the presented model. (shrink)

Over the past decades or so the probabilistic model of rational belief has enjoyed increasing interest from researchers in epistemology and the philosophy of science. Of course, such probabilistic models were used for much longer in economics, in game theory, and in other disciplines concerned with decision making. Moreover, Carnap and co-workers used probability theory to explicate philosophical notions of confirmation and induction, thereby targeting epistemic rather than decision-theoretic aspects of rationality. However, following Carnap’s early applications, philosophy has (...) more recently seen an increased popularity of probabilistic models in other areas concerned with the philosophical analysis of belief: there are models targeting coherence, informativeness, simplicity, and so on.In brief, the probabilistic model of belief comprises of a language, detailing the propositions about which an agent is supposed to have beliefs, and a function over the language that expresses beliefs: .. (shrink)

Let L be a language containing the modal operator B - for full belief. An information model is a set E of stable L-theories. A sentence is valid if it is accepted in all theories of every model.

A propositional logic is defined which in addition to propositional language contains a list of probabilistic operators of the form P ≥s (with the intended meaning ‘‘the probability is at least s’’). The axioms and rules syntactically determine that ranges of probabilities in the corresponding models are always finite. The completeness theorem is proved. It is shown that completeness cannot be generalized to arbitrary theories.

Monogenesis of language is widely accepted, but the conventional argument seems to be mistaken; a simple probabilistic model shows that polygenesis is likely. Other prehistoric inventions are discussed, as are problems in tracing linguistic lineages. Language is a system of representations; within such a system, words can evoke complex and systematic responses. Along with its social functions, language is important to humans as a mental instrument. Indeed, the invention of language,that is the accumulation of symbols to represent emotions, objects, (...) and acts may be the most important event in human evolution, because so many developments follow from it. For example, Edward Sapir speculated that some embryonic form of language must have been available to early man to help him fashion tools from stone (Sapir,1921). Sophisticated biface stone tools date to early Homo erectus some 1.5 million years ago, suggesting a similar age for language. This paper considers whether the invention of language occurred at only one pre-historic site or at several sites. In other words, did language emerge by monogenesis or polygenesis? Early thinkers believed in monogenesis, against a background of divine creation. Perhaps the best known account is the biblical story of Adam giving names to plants and animals in the Garden of Eden. Similar legends are found among many peoples. Modern linguists too assume monogenesis, but on probabilistic grounds (see, for instance, Southworth and Daswani, 1974, p.314). The argument seems to be that the invention of language is an extremely unlikely event, because symbolization involves abstraction and requires synchronized insight by several individuals; therefore, the probability of occurrence at more than one site must be vanishingly small. We have found no explicit quantitative treatment of this question in the literature, but the underlying logic has to be the multiplication of probabilities. If p is small at one site,then p.p for two sites is smaller still, and so on. This reasoning is false, as we show here. The fallacy lies in the focus on two particular sites rather than consideration of all pairs of sites. (shrink)

Words are the essence of communication: They are the building blocks of any language. Learning the meaning of words is thus one of the most important aspects of language acquisition: Children must first learn words before they can combine them into complex utterances. Many theories have been developed to explain the impressive efficiency of young children in acquiring the vocabulary of their language, as well as the developmental patterns observed in the course of lexical acquisition. A major source of disagreement (...) among the different theories is whether children are equipped with special mechanisms and biases for word learning, or their general cognitive abilities are adequate for the task. We present a novel computational model of early word learning to shed light on the mechanisms that might be at work in this process. The model learns word meanings as probabilistic associations between words and semantic elements, using an incremental and probabilistic learning mechanism, and drawing only on general cognitive abilities. The results presented here demonstrate that much about word meanings can be learned from naturally occurring child-directed utterances (paired with meaning representations), without using any special biases or constraints, and without any explicit developmental changes in the underlying learning mechanism. Furthermore, our model provides explanations for the occasionally contradictory child experimental data, and offers predictions for the behavior of young word learners in novel situations. (shrink)

In this paper, we describe a model that learns semantic representations from the distributional statistics of language. This model, however, goes beyond the common bag‐of‐words paradigm, and infers semantic representations by taking into account the inherent sequential nature of linguistic data. The model we describe, which we refer to as a Hidden Markov Topics model, is a natural extension of the current state of the art in Bayesian bag‐of‐words models, that is, the Topics model of Griffiths, Steyvers, and Tenenbaum (2007), (...) preserving its strengths while extending its scope to incorporate more fine‐grained linguistic information. (shrink)

David Danks. Psychological Theories of Categorizations as Probabilistic Models.

The sampling-based motion planner is the mainstream method to solve the motion planning problem in high-dimensional space. In the process of exploring robot configuration space, this type of algorithm needs to perform collision query on a large number of samples, which greatly limits their planning efficiency. Therefore, this paper uses machine learning methods to establish a probabilistic model of the obstacle region in configuration space by learning a large number of labeled samples. Based on this, the high-dimensional samples’ rapid (...) collision query is realized. The influence of number of Gaussian components on the fitting accuracy is analyzed in detail, and a self-adaptive model training method based on Greedy expectation-maximization algorithm is proposed. At the same time, this method has the capability of online updating and can eliminate model fitting errors due to environmental changes. Finally, the model is combined with a variety of sampling-based motion planners and is validated in multiple sets of simulations and real world experiments. The results show that, compared with traditional methods, the proposed method has significantly improved the planning efficiency. (shrink)

Severity of Test (SoT) is an alternative to Popper's logical falsification that solves a number of problems of the logical view. It was presented by Popper himself in 1963. SoT is a less sophisticated probabilistic model of hypothesis testing than Oaksford & Chater's (O&C's) information gain model, but it has a number of striking similarities. Moreover, it captures the intuition of everyday hypothesis testing.

We need not propose, as Carey does, a radical discontinuity between core cognition, which is responsible for abstract structure, and language and which are responsible for learning and conceptual change. From a probabilistic models view, conceptual structure and learning reflect the same principles, and they are both in place from the beginning.

We discuss generalized pobabilistic models for which states not necessarily obey Kolmogorov's axioms of probability. We study the relationship between properties and probabilistic measures in this setting, and explore some possible interpretations of these measures.

Name der Zeitschrift: Cognitive Linguistics Jahrgang: 27 Heft: 1 Seiten: 1-33.

Rational models vary in their goals and sources of justification. While the assumptions of some are grounded in the environment, those of others are induced and so require more traditional sources of justification, such as generalizability to dissimilar tasks and making novel predictions. Their contribution to scientific understanding will remain uncertain until standards of evidence are clarified.

Suppose that we acquire various items of information from various sources and that our degree of confidence in the content of the information set is sufficiently high to believe the information. Now a new item of information is being presented by a new information source. Are we justified to add this new item of information to what we already believe? Consider the following parable: “I go to a lecture about wildlife in Greenland which was supposed to be delivered by an (...) expert in the field. When I arrive I notice that the expert has excused himself and that the biology department has sent a newcomer to fill in for him. I have no beliefs about wildlife in Greenland, but I do have some beliefs about Greenland’s climate and about the kinds of climate conditions that various types of wildlife favor. Suppose that our newcomer proclaims that large colonies of elk roam in a particular valley on the southern tip of Greenland. Then I would certainly be willing to accept this item of information. But suppose that he proclaims that large colonies of armadillos roam in the same valley. Then I would not be willing to accept this item of information. Why do I accept the former but not the latter item of information? Let us suppose that neither item of information is logically inconsistent with what I already believe. Clearly, the former item of information is not inconsistent. But also the latter item is not: after all, there may be small pockets of Greenland with special climatological conditions and some Texan sailors may have set loose a pair of armadillos as a practical joke. But whereas the former item of information is quite plausible given my previous beliefs, the latter item of information is not. And this is what makes for the difference. Now suppose that our newcomer proclaims that large colonies of wild boars roam this valley in Greenland. I am not that sure anymore. Given everything I believe, I find wild boars in Greenland more plausible than armadillos in Greenland, but certainly less plausible than elk in Greenland. Had our expert presented the lecture and provided precisely the 2 same information, then I would have been willing to adopt the belief that there are wild boars in Greenland, but, with our newcomer delivering the lecture, I am not willing to do so. It is not that I would believe anything out of the expert’s mouth: also he could not have convinced me that there are armadillos in Greenland. But when it comes to wild boars, the difference between the expert’s and the newcomer’s credentials simply makes for the difference.” What we learn from this story is that the question of belief expansion has something to do with the reliability of the information source as well as with the plausibility of the new information, given what I already believe. The more reliable the information source is, the less plausible the new information needs to be given what I already believe, for me to be justified to add the belief to our belief set. The more plausible the new information is given what I already believe, the less reliable the information source needs to be given what I already believe, for me to be justified to add the belief to my belief set. The challenge is: can a precise account of this relationship be provided? (shrink)

In this paper we discuss the process of building a joint probability distribution from an input set of low-dimensional probability distributions. Since the solution of the problem for a consistent input set of probability distributions is known we concentrate on a setup where the input probability distributions are inconsistent. In this case the iterative proportional fitting procedure, which converges in the consistent case, tends to come to cycles. We propose a new algorithm that converges even in inconsistent case. The important (...) property of the algorithm is that it can be efficiently implemented exploiting decomposability of considered distributions. (shrink)

We study probabilistic logic under the viewpoint of the coherence principle of de Finetti. In detail, we explore how probabilistic reasoning under coherence is related to model- theoretic probabilistic reasoning and to default reasoning in System . In particular, we show that the notions of g-coherence and of g-coherent entailment can be expressed by combining notions in model-theoretic probabilistic logic with concepts from default reasoning. Moreover, we show that probabilistic reasoning under coherence is a generalization (...) of default reasoning in System . That is, we provide a new probabilistic semantics for System , which neither uses infinitesimal probabilities nor atomic bound (or big-stepped) probabilities. These results also provide new algorithms for probabilistic reasoning under coherence and for default reasoning in System , and they give new insight into default reasoning with conditional objects. (shrink)

The aim of the paper is to develop the notion of partial probability distributions as being more realistic models of belief systems than the standard accounts. We formulate the theory of partial probability functions independently of any classical semantic notions. We use the partial probability distributions to develop a formal semantics for partial propositional calculi, with extensions to predicate logic and higher order languages. We give a proof theory for the partial logics and obtain soundness and completeness results.

When the likelihood ratio approach is employed for evidential reasoning in law, it is often necessary to employ subjective probabilities, which are probabilities derived from the opinions and judgement of a human. At least three concerns arise from the use of subjective probabilities in legal applications. Firstly, human beliefs concerning probabilities can be vague, ambiguous and inaccurate. Secondly, the impact of this vagueness, ambiguity and inaccuracy on the outcome of a probabilistic analysis is not necessarily fully understood. Thirdly, the (...) provenance of subjective probabilities and the associated potential sources of vagueness, ambiguity and inaccuracy tend to be poorly understood, making it difficult for the outcome of probabilistic reasoning to be explained and validated, which is crucial in legal applications. The former two concerns have been addressed by a wide body of research in AI. The latter, however, has received little attention. This paper presents a novel approach to employ argumentation to reason about probability distributions in probabilistic models. It introduces a range of argumentation schemes and corresponding sets of critical questions for the construction and validation of argument models that define sets of probability distributions. By means of an extended example, the paper demonstrates how the approach, argumentation schemes and critical questions can be employed for the development of models and their validation in legal applications of the likelihood ratio approach to evidential reasoning. (shrink)

We study probabilistic characterisation of a random model of a finite set of first order axioms. Given a set of first order axioms.