Reinforcement learning approaches to cognitive modeling represent task acquisition as learning to choose the sequence of steps that accomplishes the task while maximizing a reward. However, an apparently unrecognized problem for modelers is choosing when, what, and how much to reward; that is, when (the moment: end of trial, subtask, or some other interval of task performance), what (the objective function: e.g., performance time or performance accuracy), and how much (the magnitude: with binary, categorical, or continuous values). In this article, (...) we explore the problem space of these three parameters in the context of a task whose completion entails some combination of 36 state–action pairs, where all intermediate states (i.e., after the initial state and prior to the end state) represent progressive but partial completion of the task. Different choices produce profoundly different learning paths and outcomes, with the strongest effect for moment. Unfortunately, there is little discussion in the literature of the effect of such choices. This absence is disappointing, as the choice of when, what, and how much needs to be made by a modeler for every learning model. (shrink)

Information management systems improve the retention of information in large collections. As such they act as memory prostheses, implying an ideal basis in human memory models. Since humans process information by association, and situate it in the context of space and time, systems should maximize their effectiveness by mimicking these functions. Since human attentional capacity is limited, systems should scaffold cognitive efforts in a comprehensible manner. We propose the Principles of Mnemonic Associative Knowledge (P-MAK), which describes a framework for semantically (...) identifying, organizing, and retrieving information, and for encoding episodic events by time and stimuli. Inspired by prominent human memory models, we propose associative networks as a preferred representation. Networks are ideal for their parsimony, flexibility, and ease of inspection. Networks also possess topological properties—such as clusters, hubs, and the small world—that aid analysis and navigation in an information space. Our cognitive perspective addresses fundamental problems faced by information management systems, in particular the retrieval of related items and the representation of context. We present evidence from neuroscience and memory research in support of this approach, and discuss the implications of systems design within the constraints of P-MAK’s principles, using text documents as an illustrative semantic domain. (shrink)

People can learn to perform new tasks very quickly by making use of lower‐level skills they have developed when learning previous tasks. Hoekstra, Martens, and Taatgen model this process, showing how a system trained on simple tasks (visual search and two working memory tasks) can then quickly learn to perform the attentional blink task, and it ends up making the same sorts of errors as people do.

The question of domain-specific versus domain-general processing is an ongoing source of inquiry surrounding cognitive control. Using a comparative evolutionary approach, Stout (2010) proposed two components of cognitive control: coordinating hierarchical action plans and social cognition. This article reports additional molecular and experimental evidence supporting a domain-general attentional process coordinating hierarchical action plans, with the earliest such control processing originating in the capacity of dynamic foraging behaviors—predating the vertebrate-invertebrate divergence (c. 700 million years ago). Further discussion addresses evidence required for (...) additional, domain-specific, cognitive control processes, noting that proposed social processes may simply provide emotionally valenced representational information to the above hierarchical process. (shrink)

Topics in Cognitive Science, Volume 14, Issue 3, Page 467-491, July 2022.

For decisions between many alternatives, the benchmark result is Hick's Law: that response time increases log-linearly with the number of choice alternatives. Even when Hick's Law is observed for response times, divergent results have been observed for error rates—sometimes error rates increase with the number of choice alternatives, and sometimes they are constant. We provide evidence from two experiments that error rates are mostly independent of the number of choice alternatives, unless context effects induce participants to trade speed for accuracy (...) across conditions. Error rate data have previously been used to discriminate between competing theoretical accounts of Hick's Law, and our results question the validity of those conclusions. We show that a previously dismissed optimal observer model might provide a parsimonious account of both response time and error rate data. The model suggests that people approximate Bayesian inference in multi-alternative choice, except for some perceptual limitations. (shrink)

Chemistry educator Alex H. Johnstone is perhaps best known for his insight that chemistry is best explained using macroscopic, submicroscopic, and symbolic perspectives. But in his writings, he stressed a broader thesis, namely that teaching should be guided by scientific research on how the brain learns: cognitive science. Since Johnstone’s retirement, science’s understanding of learning has progressed rapidly. A surprising discovery has been when solving chemistry problems of any complexity, reasoning does not work: students must apply very-well-memorized facts and algorithms. (...) Following Johnstone’s advice, we review recent discoveries of cognitive science research. Instructional strategies are recommended that cognitive studies have shown help students learn chemistry. (shrink)

A long history of research has revealed many neurophysiological changes and concomitant behavioral impacts of sleep deprivation, sleep restriction, and circadian rhythms. Little research, however, has been conducted in the area of computational cognitive modeling to understand the information processing mechanisms through which neurobehavioral factors operate to produce degradations in human performance. Our approach to understanding this relationship is to link predictions of overall cognitive functioning, or alertness, from existing biomathematical models to information processing parameters in a cognitive architecture, leveraging (...) the strengths from each to develop a more comprehensive explanation. The integration of these methodologies is used to account for changes in human performance on a sustained attention task across 88 h of total sleep deprivation. The integrated model captures changes due to time awake and circadian rhythms, and it also provides an account for underlying changes in the cognitive processes that give rise to those effects. The results show the potential for developing mechanistic accounts of how fatigue impacts cognition, and they illustrate the increased explanatory power that is possible by combining theoretical insights from multiple methodologies. (shrink)

Humans use their spatial information processing abilities flexibly to facilitate problem solving and decision making in a variety of tasks. This article explores the question of whether a general strategy can be adapted for performing two different spatial orientation tasks by testing the predictions of a computational cognitive model. Human performance was measured on an orientation task requiring participants to identify the location of a target either on a map (find‐on‐map) or within an egocentric view of a space (find‐in‐scene). A (...) general strategy instantiated in a computational cognitive model of the find‐on‐map task, based on the results from Gunzelmann and Anderson (2006), was adapted to perform both tasks and used to generate performance predictions for a new study. The qualitative fit of the model to the human data supports the view that participants were able to tailor a general strategy to the requirements of particular spatial tasks. The quantitative differences between the predictions of the model and the performance of human participants in the new experiment expose individual differences in sample populations. The model provides a means of accounting for those differences and a framework for understanding how human spatial abilities are applied to naturalistic spatial tasks that involve reasoning with maps. (shrink)

Marr's levels of analysis—computational, algorithmic, and implementation—have served cognitive science well over the last 30 years. But the recent increase in the popularity of the computational level raises a new challenge: How do we begin to relate models at different levels of analysis? We propose that it is possible to define levels of analysis that lie between the computational and the algorithmic, providing a way to build a bridge between computational- and algorithmic-level models. The key idea is to push the (...) notion of rationality, often used in defining computational-level models, deeper toward the algorithmic level. We offer a simple recipe for reverse-engineering the mind's cognitive strategies by deriving optimal algorithms for a series of increasingly more realistic abstract computational architectures, which we call “resource-rational analysis.”. (shrink)

Constraints and dependencies among the elements of embodied cognition form patterns or microstrategies of interactive behavior. Hard constraints determine which microstrategies are possible. Soft constraints determine which of the possible microstrategies are most likely to be selected. When selection is non‐deliberate or automatic the least effort microstrategy is chosen. In calculating the effort required to execute a microstrategy each of the three types of operations, memory retrieval, perception, and action, are given equal weight; that is, perceptual‐motor activity does not have (...) a privileged status with respect to memory. Soft constraints can work contrary to the designer's intentions by making the access of perfect knowledge in‐the‐world more effortful than the access of imperfect knowledge in‐the‐head. These implications of soft constraints are tested in two experiments. In experiment 1 we varied the perceptual‐motor effort of accessing knowledge in‐the‐world as well as the effort of retrieving items from memory. In experiment 2 we replicated one of the experiment 1 conditions to collect eye movement data. The results suggest that milliseconds matter. Soft constraints lead to a reliance on knowledge in‐the‐head even when the absolute difference in perceptual‐motor versus memory retrieval effort is small, and even when relying on memory leads to a higher error rate and lower performance. We discuss the implications of soft constraints for routine interactive behavior, accounts of embodied cognition, and tool and interface design. (shrink)

Constraints and dependencies among the elements of embodied cognition form patterns or microstrategies of interactive behavior. Hard constraints determine which microstrategies are possible. Soft constraints determine which of the possible microstrategies are most likely to be selected. When selection is non-deliberate or automatic the least effort microstrategy is chosen. In calculating the effort required to execute a microstrategy each of the three types of operations, memory retrieval, perception, and action, are given equal weight; that is, perceptual-motor activity does not have (...) a privileged status with respect to memory. Soft constraints can work contrary to the designer's intentions by making the access of perfect knowledge in-the-world more effortful than the access of imperfect knowledge in-the-head. These implications of soft constraints are tested in two experiments. In experiment 1 we varied the perceptual-motor effort of accessing knowledge in-the-world as well as the effort of retrieving items from memory. In experiment 2 we replicated one of the experiment 1 conditions to collect eye movement data. The results suggest that milliseconds matter. Soft constraints lead to a reliance on knowledge in-the-head even when the absolute difference in perceptual-motor versus memory retrieval effort is small, and even when relying on memory leads to a higher error rate and lower performance. We discuss the implications of soft constraints for routine interactive behavior, accounts of embodied cognition, and tool and interface design. (shrink)

The relation between mind and brain is one of the big scientific questions that has attracted scientists’ attention for centuries but also eluded their understanding. In this book, William Uttal provides a critical review of cognitive neuroscience, focusing on a specific question: What do the brain-imaging techniques developed in the last two decades or so—mostly functional magnetic resonance imaging and positron emission tomography —tell us about the brain-mind problem? His unambiguous and abrasive answer is: nothing.The book is organized in nine (...) chapters. The introductory chapter provides historical, methodological, and philosophical background. Importantly, it highlights a shift in the way neuroscientists think about modularity and localization. Traditionally, researchers using brain imaging have tended to subscribe to a strong view of modularity and localization, where distinct cognitive modules are assumed to be localized in well-defined regions of the brain. In the l .. (shrink)

The various behavioral disciplines model human behavior in distinct and incompatible ways. Yet, recent theoretical and empirical developments have created the conditions for rendering coherent the areas of overlap of the various behavioral disciplines. The analytical tools deployed in this task incorporate core principles from several behavioral disciplines. The proposed framework recognizes evolutionary theory, covering both genetic and cultural evolution, as the integrating principle of behavioral science. Moreover, if decision theory and game theory are broadened to encompass other-regarding preferences, they (...) become capable of modeling all aspects of decision making, including those normally considered “psychological,” “sociological,” or “anthropological.” The mind as a decision-making organ then becomes the organizing principle of psychology. (Published Online April 27 2007) Key Words: behavioral game theory; behavioral science; evolutionary theory; experimental psychology; gene-culture coevolution; rational actor model; socialization. (shrink)

This paper presents an attempt to bridge the gap between logical and cognitive treatments of strategic reasoning in games. There have been extensive formal debates about the merits of the principle of backward induction among game theorists and logicians. Experimental economists and psychologists have shown that human subjects, perhaps due to their bounded resources, do not always follow the backward induction strategy, leading to unexpected outcomes. Recently, based on an eye-tracking study, it has turned out that even human subjects who (...) produce the outwardly correct ‘backward induction answer’ use a different internal reasoning strategy to achieve it. The paper presents a formal language to represent different strategies on a finer-grained level than was possible before. The language and its semantics help to precisely distinguish different cognitive reasoning strategies, that can then be tested on the basis of computational cognitive models and experiments with human subjects. The syntactic framework of the formal system provides a generic way of constructing computational cognitive models of the participants of the Marble Drop game. (shrink)

(2013). Statistical models as cognitive models of individual differences in reasoning. Argument & Computation: Vol. 4, Formal Models of Reasoning in Cognitive Psychology, pp. 89-102. doi: 10.1080/19462166.2012.674061.

A dynamic context model of interactive behavior was developed to explain results from two experiments that tested the effects of interaction costs on encoding strategies, cognitive representations, and response selection processes in a decision-making and a judgment task. The model assumes that the dynamic context defined by the mixes of internal and external representations and processes are sensitive to the interaction cost imposed by the task environment. The model predicts that changes in the dynamic context may lead to systematic biases (...) in cognitive representations and processes that eventually influence decision-making and judgment outcomes. Consistent with the predictions by the model, results from the experiments showed that as interaction costs increased, encoding strategies and cognitive representations shifted from perception-based to memory-based. Memory-based comparisons of the stimuli enhanced the similarity and dominance effects, and led to stronger systematic biases in response outcomes in a choice task. However, in a judgment task, memory-based representations enhanced only the dominance effects. Results suggested that systematic response biases in the dominance context were caused by biases in the cognitive representations of the stimuli, but response biases in the similarity context were caused by biases in the comparison process induced by the choice task. Results suggest that changes in interaction costs not only change whether information was assessed from the external world or from memory but also introduce systematic biases in the cognitive representation of the information, which act as biased inputs to the subsequent decision-making and judgment processes. Results are consistent with the idea of interactive cognition, which proposes that representations and processes are contingent on the dynamic context defined by the information flow between the external task environment and internal cognition. (shrink)

Pour la plupart des systèmes de représentation de la connaissance orientés concept, l’un des problèmes principaux relève de la commodité technique. A savoir, la représentation de connaissance en termes prototypiques, tout comme la possibilité d’exploiter des formes de raisonnement conceptuel basées sur la typicalité, ne sont pas autorisées. Au contraire, dans les sciences cognitives, il existe des données en faveur de concepts prototypiques, et des formes non-monotoniques de raisonnement conceptuel ont été largement étudiées. Ce fossé cognitif concernant la représentation et (...) le raisonnement constitue un problème pour les systèmes computationnels, puisque l’information prototypique joue un rôle crucial dans plusieurs tâches importantes. Dans la lignée des théories du raisonnement et de la rationalité dites du double processus, nous soutenons que la représentation conceptuelle dans les systèmes computationnels devrait dépendre de (au moins) deux composantes représentationnelles, chacune spécialisée dans le traitement de différents genres de processus de raisonnement. Dans cet article, nous présentons les avantages computationnels de cette approche en termes de double processus, et les comparons brièvement avec d’autres solutions d’orientation logique, adoptées pour traiter du même problème. (shrink)

Cognitive neuroscience is the branch of neuroscience that studies the neural mechanisms underpinning cognition and develops theories explaining them. Within cognitive neuroscience, computational neuroscience focuses on modeling behavior, using theories expressed as computer programs. Up to now, computational theories have been formulated by neuroscientists. In this paper, we present a new approach to theory development in neuroscience: the automatic generation and testing of cognitive theories using genetic programming (GP). Our approach evolves from experimental data cognitive theories that explain “the mental (...) program” that subjects use to solve a specific task. As an example, we have focused on a typical neuroscience experiment, the delayed-match-to-sample (DMTS) task. The main goal of our approach is to develop a tool that neuroscientists can use to develop better cognitive theories. (shrink)

: Psychological explanations of philosophical intuitions can help us assess their evidentiary value, and our warrant for accepting them. To explain and assess conceptual or classificatory intuitions about specific situations, some philosophers have suggested explanations which invoke heuristic rules proposed by cognitive psychologists. The present paper extends this approach of intuition assessment by heuristics-based explanation, in two ways: It motivates the proposal of a new heuristic, and shows that this metaphor heuristic helps explain important but neglected intuitions: general factual intuitions (...) which have been highly influential in the philosophies of mind and perception but neglected in on-going debates in the epistemology of philosophy. To do so, the paper integrates results from three philosophically pertinent but hitherto largely unconnected strands of psychological research: research on intuitive judgement, analogy and metaphor, and memory-based processing, respectively. The paper shows that the heuristics-based explanation thus obtained satisfies the key requirements cognitive psychologists impose on such explanations, that it can explain the philosophical intuitions targeted, and that this explanation supports normative assessment of the intuitions' evidentiary value: It reveals whether particular intuitions are due to proper exercise of cognitive competencies or constitute cognitive illusions. (shrink)

This study provides evidence for implicit learning in syntactic comprehension. By reanalyzing data from a syntactic priming experiment (Thothathiri & Snedeker, 2008), we find that the error signal associated with a syntactic prime influences comprehenders' subsequent syntactic expectations. This follows directly from error‐based implicit learning accounts of syntactic priming, but it is unexpected under accounts that consider syntactic priming a consequence of temporary increases in base‐level activation. More generally, the results raise questions about the principles underlying the maintenance of implicit (...) statistical knowledge relevant to language processing, and about possible functional motivations for syntactic priming. (shrink)

We present a comprehensive empirical evaluation of the ACT‐R–based model of sentence processing developed by Lewis and Vasishth (2005) (LV05). The predictions of the model are compared with the results of a recent meta‐analysis of published reading studies on retrieval interference in reflexive‐/reciprocal‐antecedent and subject–verb dependencies (Jäger, Engelmann, & Vasishth, 2017). The comparison shows that the model has only partial success in explaining the data; and we propose that its prediction space is restricted by oversimplifying assumptions. We then implement a (...) revised model that takes into account differences between individual experimental designs in terms of the prominence of the target and the distractor in memory‐ and context‐dependent cue‐feature associations. The predictions of the original and the revised model are quantitatively compared with the results of the meta‐analysis. Our simulations show that, compared to the original LV05 model, the revised model accounts for the data better. The results suggest that effects of prominence and variable cue‐feature associations need to be considered in the interpretation of existing empirical results and in the design and planning of future experiments. With regard to retrieval interference in sentence processing and to the broader field of psycholinguistic studies, we conclude that well‐specified models in tandem with high‐powered experiments are needed in order to uncover the underlying cognitive processes. (shrink)

We explore the interaction between oculomotor control and language comprehension on the sentence level using two well-tested computational accounts of parsing difficulty. Previous work (Boston, Hale, Vasishth, & Kliegl, 2011) has shown that surprisal (Hale, 2001; Levy, 2008) and cue-based memory retrieval (Lewis & Vasishth, 2005) are significant and complementary predictors of reading time in an eyetracking corpus. It remains an open question how the sentence processor interacts with oculomotor control. Using a simple linking hypothesis proposed in Reichle, Warren, and (...) McConnell (2009), we integrated both measures with the eye movement model EMMA (Salvucci, 2001) inside the cognitive architecture ACT-R (Anderson et al., 2004). We built a reading model that could initiate short “Time Out regressions” (Mitchell, Shen, Green, & Hodgson, 2008) that compensate for slow postlexical processing. This simple interaction enabled the model to predict the re-reading of words based on parsing difficulty. The model was evaluated in different configurations on the prediction of frequency effects on the Potsdam Sentence Corpus. The extension of EMMA with postlexical processing improved its predictions and reproduced re-reading rates and durations with a reasonable fit to the data. This demonstration, based on simple and independently motivated assumptions, serves as a foundational step toward a precise investigation of the interaction between high-level language processing and eye movement control. (shrink)

This paper develops a novel psycholinguistic parser and tests it against experimental and corpus reading data. The parser builds on the recent research into memory structures, which argues that memory retrieval is content‐addressable and cue‐based. It is shown that the theory of cue‐based memory systems can be combined with transition‐based parsing to produce a parser that, when combined with the cognitive architecture ACT‐R, can model reading and predict online behavioral measures (reading times and regressions). The parser's modeling capacities are tested (...) against self‐paced reading experimental data (Grodner & Gibson, 2005), eye‐tracking experimental data (Staub, 2011), and a self‐paced reading corpus (Futrell et al., 2018). (shrink)

Cognitive architectures have often been applied to data from individual experiments. In this paper, I develop an ACT-R reader that can model a much larger set of data, eye-tracking corpus data. It is shown that the resulting model has a good fit to the data for the considered low-level processes. Unlike previous related works, the model achieves the fit by estimating free parameters of ACT-R using Bayesian estimation and Markov-Chain Monte Carlo techniques, rather than by relying on the mix of (...) manual selection + default values. The method used in the paper is generalizable beyond this particular model and data set and could be used on other ACT-R models. (shrink)

We explore the developmental paradox of false belief understanding. This paradox follows from the claim that young infants already have an understanding of false belief, despite the fact that they consistently fail the elicited-response false belief task. First, we argue that recent proposals to solve this paradox are unsatisfactory because they (i) try to give a full explanation of false belief understanding in terms of a single system, (ii) fail to provide psychological concepts that are sufficiently fine-grained to capture the (...) cognitive requirements for the various manifestations of false belief understanding, and (iii) ignore questions about system interaction. Second, we present a dual-system solution to the developmental paradox of false belief understanding that combines a layered model of perspective taking with an inhibition-selection-representation mechanism that operates on different levels. We discuss recent experimental findings that shed light on the interaction between these two systems, and suggest a number of directions for future research. (shrink)

The purpose of cognitive models is to make predictive simulations of human behaviour, but this is often done at the aggregate level. Cranford, Gonzalez, Aggarwal, Cooney, Tambe, and Lebiere show that they can automatically customize a model to a particular individual on‐the‐fly, and use it to make specific predictions about their next actions, in the context of a particular cybersecurity game.

This work is an initial step toward developing a cognitive theory of cyber deception. While widely studied, the psychology of deception has largely focused on physical cues of deception. Given that present‐day communication among humans is largely electronic, we focus on the cyber domain where physical cues are unavailable and for which there is less psychological research. To improve cyber defense, researchers have used signaling theory to extended algorithms developed for the optimal allocation of limited defense resources by using deceptive (...) signals to trick the human mind. However, the algorithms are designed to protect against adversaries that make perfectly rational decisions. In behavioral experiments using an abstract cybersecurity game (i.e., Insider Attack Game), we examined human decision‐making when paired against the defense algorithm. We developed an instance‐based learning (IBL) model of an attacker using the Adaptive Control of Thought‐Rational (ACT‐R) cognitive architecture to investigate how humans make decisions under deception in cyber‐attack scenarios. Our results show that the defense algorithm is more effective at reducing the probability of attack and protecting assets when using deceptive signaling, compared to no signaling, but is less effective than predicted against a perfectly rational adversary. Also, the IBL model replicates human attack decisions accurately. The IBL model shows how human decisions arise from experience, and how memory retrieval dynamics can give rise to cognitive biases, such as confirmation bias. The implications of these findings are discussed in the perspective of informing theories of deception and designing more effective signaling schemes that consider human bounded rationality. (shrink)

It has been suggested that the enterprise of developing mechanistic theories of the human cognitive architecture is flawed because the theories produced are not directly falsifiable. Newell attempted to sidestep this criticism by arguing for a Lakatosian model of scientific progress in which cognitive architectures should be understood as theories that develop over time. However, Newell's own candidate cognitive architecture adhered only loosely to Lakatosian principles. This paper reconsiders the role of falsification and the potential utility of Lakatosian principles in (...) the development of cognitive architectures. It is argued that a lack of direct falsifiability need not undermine the scientific development of a cognitive architecture if broadly Lakatosian principles are adopted. Moreover, it is demonstrated that the Lakatosian concepts of positive and negative heuristics for theory development and of general heuristic power offer methods for guiding the development of an architecture and for evaluating the contribution and potential of an architecture's research program. (shrink)

The past 25 years have witnessed an increasing awareness of the importance of cognitive control in the regulation of complex behavior. It now sits alongside attention, memory, language, and thinking as a distinct domain within cognitive psychology. At the same time it permeates each of these sibling domains. This introduction reviews recent work on cognitive control in an attempt to provide a context for the fundamental question addressed within this topic: Is cognitive control to be understood as resulting from the (...) interaction of multiple distinct control processes, or are the phenomena of cognitive control emergent? (shrink)

Cognitive architectures - task-general theories of the structure and function of the complete cognitive system - are sometimes argued to be more akin to frameworks or belief systems than scientific theories. The argument stems from the apparent non-falsifiability of existing cognitive architectures. Newell was aware of this criticism and argued that architectures should be viewed not as theories subject to Popperian falsification, but rather as Lakatosian research programs based on cumulative growth. Newell's argument is undermined because he failed to demonstrate (...) that the development of Soar, his own candidate architecture, adhered to Lakatosian principles. This paper presents detailed case studies of the development of two cognitive architectures, Soar and ACT-R, from a Lakatosian perspective. It is demonstrated that both are broadly Lakatosian, but that in both cases there have been theoretical progressions that, according to Lakatosian criteria, are pseudo-scientific. Thus, Newell's defense of Soar as a scientific rather than pseudo-scientific theory is not supported in practice. The ACT series of architectures has fewer pseudo-scientific progressions than Soar, but it too is vulnerable to accusations of pseudo-science. From this analysis, it is argued that successive versions of theories of the human cognitive architecture must explicitly address five questions to maintain scientific credibility. (shrink)

Information‐theoretic complexity metrics, such as Surprisal (Hale, 2001; Levy, 2008) and Entropy Reduction (Hale, 2003), are linking hypotheses that bridge theorized expectations about sentences and observed processing difficulty in comprehension. These expectations can be viewed as syntactic derivations constrained by a grammar. However, this expectation‐based view is not limited to syntactic information alone. The present study combines structural and non‐structural information in unified models of word‐by‐word sentence processing difficulty. Using probabilistic minimalist grammars (Stabler, 1997), we extend expectation‐based models to include (...) frequency information about noun phrase animacy. Entropy reductions derived from these grammars faithfully reflect the asymmetry between subject and object relatives (Staub, 2010; Staub, Dillon, & Clifton, 2017), as well as the effect of animacy on the measured difficulty profile (Lowder & Gordon, 2012; Traxler, Morris, & Seely, 2002). Visualizing probability distributions on the remaining alternatives at particular parser states allows us to explore new, linguistically plausible interpretations for the observed processing asymmetries, including the way that expectations about the relativized argument influence the processing of particular types of relative clauses (Wagers & Pendleton, 2016). (shrink)

Diagrams are a form of spatial representation that supports reasoning and problem solving. Even when diagrams are external, not to mention when there are no external representations, problem solving often calls for internal representations, that is, representations in cognition, of diagrammatic elements and internal perceptions on them. General cognitive architectures—Soar and ACT-R, to name the most prominent—do not have representations and operations to support diagrammatic reasoning. In this article, we examine some requirements for such internal representations and processes in cognitive (...) architectures. We discuss the degree to which DRS, our earlier proposal for such an internal representation for diagrams, meets these requirements. In DRS, the diagrams are not raw images, but a composition of objects that can be individuated and thus symbolized, while, unlike traditional symbols, the referent of the symbol is an object that retains its perceptual essence, namely, its spatiality. This duality provides a way to resolve what anti-imagists thought was a contradiction in mental imagery: the compositionality of mental images that seemed to be unique to symbol systems, and their support of a perceptual experience of images and some types of perception on them. We briefly review the use of DRS to augment Soar and ACT-R with a diagrammatic representation component. We identify issues for further research. (shrink)

Going from cognitive theory to neural data to ACT‐R models, the authors relate brain activity in a lexical ambiguity priming task to brain processes that resolve ambiguity in word meanings. These detailed data were tested and found compatible to the results of an ACT‐R computational model of reinforcement learning (RL). The model confirms and extends the behavioral findings to provide a RL account of individual differences in lexical ambiguity resolution.

We investigate how Reinforcement Learning methods can be used to solve the production selection and production ordering problem in ACT‐R. We focus on four algorithms from the Q learning family, tabular Q and three versions of Deep Q Networks, as well as the ACT‐R utility learning algorithm, which provides a baseline for the Q algorithms. We compare the performance of these five algorithms in a range of lexical decision tasks framed as sequential decision problems.