People often struggle with Bayesian reasoning. However, research showed that people’s performance (and rationality) can be supported by the way of representing the statistical information. First, research showed that using natural frequencies instead of probabilities as format of statistical information increases people’s performance in Bayesian situations thoroughly. Second, research also yielded that people’s performance increases through using visualization. We build our paper on existing research in this field. The main aim is to analyse people’s strategies in Bayesian situations that are (...) still erroneous although statistical information is represented by natural frequencies and visualizations. In particular, we compare two pairs of visualization with similar numerical information (tree diagram vs. unit square and double-tree diagram vs. 2x2-table) concerning their impact on people’s erroneous strategies in Bayesian situations. For this aim, we conducted an experiment with 540 university students. The students were randomly assigned to four conditions that are defined by the four different visualizations of statistical information. The students were asked to indicate a fraction as response in four Bayesian situations. We documented the numerator and the denominator of the students’ responses representing a basic set and a subset in a Bayesian situation. Our results show that people’s erroneous strategies are highly dependent on the visualization. A central finding is that the visualization’s characteristic of making the nested-sets structure of a Bayesian situation transparent has a facilitating effect on people’s Bayesian reasoning. For example, compared to the unit square, a tree diagram does not explicitly visualize the set-subset relations that are relevant in a Bayesian situation. Accordingly, compared to a unit square, a tree diagram partly hinders people to find the correct denominator in a Bayesian situation, and, in particular, triggers to select a wrong numerator. By analyzing people’s erroneous strategies in Bayesian situations, we contribute to investigating approaches to facilitate Bayesian reasoning and to further develop the teaching of Bayesian reasoning. (shrink)

In the present paper we empirically investigate the psychometric properties of some of the most famous statistical and logical cognitive illusions from the “heuristics and biases” research program by Daniel Kahneman and Amos Tversky, who nearly 50 years ago introduced fascinating brain teasers such as the famous Linda problem, the Wason card selection task, and so-called Bayesian reasoning problems (e.g., the mammography task). In the meantime, a great number of articles has been published that empirically examine single cognitive illusions, theoretically (...) explaining people’s faulty thinking, or proposing and experimentally implementing measures to foster insight and to make these problems accessible to the human mind. Yet these problems have thus far usually been empirically analyzed on an individual-item level only (e.g., by experimentally comparing participants’ performance on various versions of one of these problems). In this paper, by contrast, we examine these illusions as a group and look at the ability to solve them as a psychological construct. Based on an sample ofN= 2,643 Luxembourgian school students of age 16–18 we investigate the internal psychometric structure of these illusions (i.e., Are they substantially correlated? Do they form a reflexive or a formative construct?), their connection to related constructs (e.g., Are they distinguishable from intelligence or mathematical competence in a confirmatory factor analysis?), and the question of which of a person’s abilities can predict the correct solution of these brain teasers (by means of a regression analysis). (shrink)

In teaching statistics in secondary schools and at university, two visualizations are primarily used when situations with two dichotomous characteristics are represented: 2×2 tables and tree diagrams. Both visualizations can be depicted either with probabilities or with frequencies. Visualizations with frequencies have been shown to help students significantly more in Bayesian reasoning problems than probability visualizations do. Because tree diagrams or double-trees (which are largely unknown in school) are node-branch-structures, these two visualizations (compared to the 2×2 table) can even simultaneously (...) display probabilities on branches and frequencies inside the nodes. This is a teaching advantage as it allows the frequency concept to be used to better understand probabilities. However, 2×2 tables and (double-) trees have a decisive disadvantage: While joint probabilities (e.g., P(AB)) are represented in 2×2 tables but no conditional probabilities (e.g., P(A|B)), it is exactly the other way around with (double-) trees. Therefore, a visualization that is equally suitable for the representation of joint probabilities and conditional probabilities is desirable. In this article, we present a new visualization—the frequency net—in which all absolute frequencies and all types of probabilities can be depicted. In addition to a detailed theoretical analysis of the frequency net, we report the results of a study with 249 university students that shows that “net diagrams” can improve reasoning without previous instruction to a similar extent as 2×2 tables and double-trees. Regarding questions about conditional probabilities, frequency visualizations (2×2 table, double-tree, or net diagram with natural frequencies) are consistently superior to probability visualizations. The frequency net performs as well as the frequency double-tree. Only the 2×2 table with frequencies—the only visualization that participants were already familiar with —led to higher performance rates. If, on the other hand, a question about a joint probability had to be answered, all implemented visualizations clearly supported participants’ performance, and no uniform format effect becomes visible. Participants reached the highest performance in the versions with probability 2×2 tables and probability net diagrams. Furthermore, after conducting a detailed error analysis, we report interesting error shifts between the two information formats and the different visualizations and give recommendations for teaching probability. (shrink)