An experiment was conducted to test the effectiveness of brief instruction in information structuring (i.e., representing and integrating information) for improving the coherence of probability judgments and binary choices among intelligence analysts. Forty-three analysts were presented with comparable sets of Bayesian judgment problems before and immediately after instruction. After instruction, analysts’ probability judgments were more coherent (i.e., more additive and compliant with Bayes theorem). Instruction also improved the coherence of binary choices regarding category membership: after instruction, subjects were more likely (...) to invariably choose the category to which they assigned the higher probability of a target’s membership. The research provides a rare example of evidence-based validation of effectiveness in instruction to improve the statistical assessment skills of intelligence analysts. Such instruction could also be used to improve the assessment quality of other types of experts who are required to integrate statistical information or make probabilistic assessments. (shrink)

This individual differences study examined the relationships between three executive functions (updating, shifting, and inhibition), measured as latent variables, and performance on two cognitively demanding subtests of the Adult Decision Making Competence battery: Applying Decision Rules and Consistency in Risk Perception. Structural equation modelling showed that executive functions contribute differentially to performance in these two tasks, with Applying Decision Rules being mainly related to inhibition and Consistency in Risk Perception mainly associated to shifting. The results suggest that the successful application (...) of decision rules requires the capacity to selectively focus attention and inhibit irrelevant (or no more relevant) stimuli. They also suggest that consistency in risk perception depends on the ability to shift between judgement contexts. (shrink)