Cognitive architectures are unified theories of cognition that take the form of computational formalisms. They support computational models that collectively account for large numbers of empirical regularities using small numbers of computational mechanisms. Empirical coverage and parsimony are the most prominent criteria by which architectures are designed and evaluated, but they are not the only ones. This paper considers three additional criteria that have been comparatively undertheorized. (a) Successful architectures possess subjective and intersubjective meaning, making cognition comprehensible to individual cognitive (...) scientists and organizing groups of like-minded cognitive scientists into genuine communities. (b) Successful architectures provide idioms that structure the design and interpretation of computational models. (c) Successful architectures are strange: They make provocative, often disturbing, and ultimately compelling claims about human information processing that demand evaluation. (shrink)

The term conceptual simulation refers to a type of everyday reasoning strategy commonly called “what if” reasoning. It has been suggested in a number of contexts that this type of reasoning plays an important role in scientific discovery; however, little direct evidence exists to support this claim. This article proposes that conceptual simulation is likely to be used in situations of informational uncertainty, and may be used to help scientists resolve that uncertainty. We conducted two studies to investigate the relationship (...) between conceptual simulation and informational uncertainty. Study 1 was an in vivo study of expert scientists; the results suggest that scientists do use conceptual simulation in situations of informational uncertainty, and that they use conceptual simulation to make inferences from their data using the analogical reasoning process of alignment by similarity detection. Study 2 experimentally manipulated experts' level of uncertainty and provides further support for the hypothesis that conceptual simulation is more likely to be used in situations of informational uncertainty. Finally, we discuss the relationship between conceptual simulation and other types of reasoning using qualitative mental models. (shrink)

Interruptions are often inevitable and occur many times in daily life (Ratwani & Trafton, 2010). Interruptions at work can disrupt progress on tasks and result in costly mistakes (Brumby, Cox, Back...

Allen Newell (1973) once observed that psychology researchers were playing “twenty questions with nature,” carving up human cognition into hundreds of individual phenomena but shying away from the difficult task of integrating these phenomena with unifying theories. We argue that research on cognitive control has followed a similar path, and that the best approach toward unifying theories of cognitive control is that proposed by Newell, namely developing theories in computational cognitive architectures. Threaded cognition, a recent theory developed within the ACT-R (...) cognitive architecture, offers promise as a unifying theory of cognitive control that addresses multitasking phenomena for both laboratory and applied task domains. (shrink)

We have developed a process model that learns in multiple ways while finding faults in a simple control panel device. The model predicts human participants' learning through its own learning. The model's performance was systematically compared to human learning data, including the time course and specific sequence of learned behaviors. These comparisons show that the model accounts very well for measures such as problem‐solving strategy, the relative difficulty of faults, and average fault‐finding time. More important, because the model learns and (...) transfers its learning across problems, it also accounts for the faster problem‐solving times due to learning when examined across participants, across faults, and across the series of 20 trials on an individual participant basis. The model shows how learning while problem solving can lead to more recognition‐based performance, and helps explain how the shape of the learning curve can arise through learning and be modified by differential transfer. Overall, the quality of the correspondence appears to have arisen from procedural, declarative, and episodic learning all taking place within individual problem‐solving episodes. (shrink)

A postcompletion error is a type of procedural error that occurs after the main goal of a task has been accomplished. There is a strong theoretical foundation accounting for postcompletion errors (Altmann & Trafton, 2002; Byrne & Bovair, 1997). This theoretical foundation has been leveraged to develop a logistic regression model of postcompletion errors based on reaction time and eye movement measures (Ratwani, McCurry, & Trafton, 2008). This study further develops and extends this predictive model by (a) validating the model (...) and the general set of predictors on a new task to test the robustness of the model, and (b) determining which specific theoretical components are most important to postcompletion error prediction. (shrink)

We investigated the impact of frequency of interruptions in a simulated medical visual search task. Participants performed the visual search task during which they were interrupted by a number-classification task in 25, 50, or 75% of all trials, respectively, reflecting the frequency conditions. Target presence and interruption were varied within-subjects, and interruption frequency was varied between-subjects. Globally, on a frequency condition level, participants in the low frequency condition had longer mean response times for the primary visual search task than in (...) the high condition, but there were no other performance differences between the three frequency conditions. Locally, on the level of specific interruption effects, accuracy decreased directly after interruptions for target present but not for target absent trials. Furthermore, interruptions caused significant interruption costs, reflected in slower overall RTs in interrupted than in uninterrupted trials. The combined findings show that especially for critical visual search tasks as in the medical field, interruptions—regardless of frequency—should be avoided. (shrink)

Cognitive architectures are theories of cognition that try to capture the essential representations and mechanisms that underlie cognition. Research in cognitive architectures has gradually moved from a focus on the functional capabilities of architectures to the ability to model the details of human behavior, and, more recently, brain activity. Although there are many different architectures, they share many identical or similar mechanisms, permitting possible future convergence. In judging the quality of a particular cognitive model, it is pertinent to not just (...) judge its fit to the experimental data but also its simplicity and ability to make predictions. (shrink)

Researchers are beginning to transition from studying human–automation interaction to human–autonomy teaming. This distinction has been highlighted in recent literature, and theoretical reasons why the psychological experience of humans interacting with autonomy may vary and affect subsequent collaboration outcomes are beginning to emerge (de Visser et al., 2018;Wynne and Lyons, 2018). In this review, we do a deep dive into human–autonomy teams (HATs) by explaining the differences between automation and autonomy and by reviewing the domain of human–human teaming to make (...) inferences for HATs. We examine the domain of human–human teaming to extrapolate a few core factors that could have relevance for HATs. Notably, these factors involve critical social elements within teams that are central (as argued in this review) for HATs. We conclude by highlighting some research gaps that researchers should strive toward answering, which will ultimately facilitate a more nuanced and complete understanding of HATs in a variety of real-world contexts. (shrink)

This paper addresses a common challenge with computational cognitive models: identifying parameter values that are both theoretically plausible and generate predictions that match well with empirical data. While computational models can offer deep explanations of cognition, they are computationally complex and often out of reach of traditional parameter fitting methods. Weak methodology may lead to premature rejection of valid models or to acceptance of models that might otherwise be falsified. Mathematically robust fitting methods are, therefore, essential to the progress of (...) computational modeling in cognitive science. In this article, we investigate the capability and role of modern fitting methods—including Bayesian optimization and approximate Bayesian computation—and contrast them to some more commonly used methods: grid search and Nelder–Mead optimization. Our investigation consists of a reanalysis of the fitting of two previous computational models: an Adaptive Control of Thought—Rational model of skill acquisition and a computational rationality model of visual search. The results contrast the efficiency and informativeness of the methods. A key advantage of the Bayesian methods is the ability to estimate the uncertainty of fitted parameter values. We conclude that approximate Bayesian computation is (a) efficient, (b) informative, and (c) offers a path to reproducible results. (shrink)

We present a novel way of accounting for similarity judgments. Our approach posits that similarity stems from three main sources—familiarity, priming, and inherent perceptual likeness. Here, we explore each of these constructs and demonstrate their individual and combined effectiveness in explaining similarity judgments. Using these three measures, our account of similarity explains ratings of simple, color-based perceptual stimuli that display asymmetry effects, as well as more complicated perceptual stimuli with structural properties; more traditional approaches to similarity solve one or the (...) other and have difficulty accounting for both. Overall, our work demonstrates the importance of each of these components of similarity in explaining similarity judgments, both individually and together, and suggests important implications for other similarity approaches. (shrink)

We describe a new approach for developing and validating cognitive process models. We develop graphical models (specifically, hidden Markov models) both from human empirical data on a task, as well as from synthetic data traces generated by a cognitive process model of human behavior on the task. We show that considering differences between the two graphical models can unveil substantive and nuanced imperfections of cognitive process models that can then be addressed to increase their fidelity to empirical data.

When a person decides to do something in the future, she forms an intention and her intention persists. Philosophers have thought about the rational requirement that an agent’s intention persists until its execution. But philosophers have neglected to think about the causal memory mechanisms that could enable this kind of persistence and its role in rational long-term agency. Our aim of this paper is to fill this gap by arguing that memory for intention is a specific kind of memory. We (...) do this by evaluating and rejecting standard declarative accounts of memory for intention and arguing for the plausibility of an alternative model of memory for intention. We argue for the alternative by spelling out a number of computational principles that could enable retaining and retrieving intentions from long-term memory. These principles could explain a number of core features of intentions. (shrink)

We test people's ability to optimize performance across two concurrent tasks. Participants performed a number entry task while controlling a randomly moving cursor with a joystick. Participants received explicit feedback on their performance on these tasks in the form of a single combined score. This payoff function was varied between conditions to change the value of one task relative to the other. We found that participants adapted their strategy for interleaving the two tasks, by varying how long they spent on (...) one task before switching to the other, in order to achieve the near maximum payoff available in each condition. In a second experiment, we show that this behavior is learned quickly and remained stable for as long as the payoff function did not change. The results of this work show that people are adaptive and flexible in how they prioritize and allocate attention in a dual-task setting. However, it also demonstrates some of the limits regarding people's ability to optimize payoff functions. (shrink)

It has been suggested that the enterprise of developing mechanistic theories of the human cognitive architecture is flawed because the theories produced are not directly falsifiable. Newell attempted to sidestep this criticism by arguing for a Lakatosian model of scientific progress in which cognitive architectures should be understood as theories that develop over time. However, Newell's own candidate cognitive architecture adhered only loosely to Lakatosian principles. This paper reconsiders the role of falsification and the potential utility of Lakatosian principles in (...) the development of cognitive architectures. It is argued that a lack of direct falsifiability need not undermine the scientific development of a cognitive architecture if broadly Lakatosian principles are adopted. Moreover, it is demonstrated that the Lakatosian concepts of positive and negative heuristics for theory development and of general heuristic power offer methods for guiding the development of an architecture and for evaluating the contribution and potential of an architecture's research program. (shrink)

Human control of action in routine situations involves a flexible interplay between (a) task-dependent serial ordering constraints; (b) top-down, or intentional, control processes; and (c) bottom-up, or environmentally triggered, affordances. In addition, the interaction between these influences is modulated by learning mechanisms that, over time, appear to reduce the need for top-down control processes while still allowing those processes to intervene at any point if necessary or if desired. We present a model of the acquisition and control of goal-directed action (...) that goes beyond existing models by operationalizing an interface between two putative systems—a routine and a non-routine system—thereby demonstrating how explicitly represented goals can interact with the emergent task representations that develop through learning in the routine system. The gradual emergence of task representations offers an explanation for the transfer of control with experience from the non-routine goal-based system to the routine system. At the same time it allows action selection to be sensitive both to environmental triggers and to biasing from multiple levels within the goal system. (shrink)

Cognitive architectures - task-general theories of the structure and function of the complete cognitive system - are sometimes argued to be more akin to frameworks or belief systems than scientific theories. The argument stems from the apparent non-falsifiability of existing cognitive architectures. Newell was aware of this criticism and argued that architectures should be viewed not as theories subject to Popperian falsification, but rather as Lakatosian research programs based on cumulative growth. Newell's argument is undermined because he failed to demonstrate (...) that the development of Soar, his own candidate architecture, adhered to Lakatosian principles. This paper presents detailed case studies of the development of two cognitive architectures, Soar and ACT-R, from a Lakatosian perspective. It is demonstrated that both are broadly Lakatosian, but that in both cases there have been theoretical progressions that, according to Lakatosian criteria, are pseudo-scientific. Thus, Newell's defense of Soar as a scientific rather than pseudo-scientific theory is not supported in practice. The ACT series of architectures has fewer pseudo-scientific progressions than Soar, but it too is vulnerable to accusations of pseudo-science. From this analysis, it is argued that successive versions of theories of the human cognitive architecture must explicitly address five questions to maintain scientific credibility. (shrink)

How do people interleave attention when multitasking? One dominant account is that the completion of a subtask serves as a cue to switch tasks. But what happens if switching solely at subtask boundaries led to poor performance? We report a study in which participants manually dialed a UK-style telephone number while driving a simulated vehicle. If the driver were to exclusively return his or her attention to driving after completing a subtask (i.e., using the single break in the xxxxx-xxxxxx representational (...) structure of the number), then we would expect to see a relatively poor driving performance. In contrast, our results show that drivers choose to return attention to steering control before the natural subtask boundary. A computational modeling analysis shows that drivers had to adopt this strategy to meet the required performance objective of maintaining an acceptable lateral position in the road while dialing. Taken together these results support the idea that people can strategically control the allocation of attention in multitask settings to meet specific performance criteria. (shrink)

Individual differences in the strategies that control sequential behavior were investigated in an experiment in which participants memorized sentences and then wrote them by hand, in a non‐cursive style. Thirty‐two participants each wrote eight sentences, which had hierarchical structures with five levels. The dataset included over 31,000 letters. Despite the deliberately constrained nature of the task and stimuli, 23 patterns of behavior were identified from the durations of pauses that occurred before the inscription of letters at four chunk levels, spanning (...) letters, words, phrases, and sentences. A critical path task analytic model, Graphical Production of Memorized Sentences (GPoMS), shows that the control of writing relies on cues that continuously switch between motor actions and chunk retrievals in a just‐in‐time fashion at the level of letter information. GPoMS explains the individual differences in terms of variants of a motor production mechanism and variants of a chunk retrieval mechanism, which involve varying degrees of parallelism between cognitive actions and motor actions. A graphical technique for constructing GPoMS models was developed that enabled the estimation of ongoing working memory demands during production. (shrink)

This paper explores the interaction between implicit and explicit processes during skill learning, in terms of top-down learning (that is, learning that goes from explicit to implicit knowledge) versus bottom-up learning (that is, learning that goes from implicit to explicit knowledge). Instead of studying each type of knowledge (implicit or explicit) in isolation, we stress the interaction between the two types, especially in terms of one type giving rise to the other, and its effects on learning. The work presents an (...) integrated model of skill learning that takes into account both implicit and explicit processes and both top-down and bottom-up learning. We examine and simulate human data in the Tower of Hanoi task. The paper shows how the quantitative data in this task may be captured using either top-down or bottom-up approaches, although top-down learning is a more apt explanation of the human data currently available. These results illustrate the two different directions of learning (top-down versus bottom-up), and thereby provide a new perspective on skill learning. Ó 2003 Elsevier B.V. All rights reserved. (shrink)