Tasks, tools, and techniques that we perform, use, and acquire, define the elements of expertise which we value as the hallmarks of goal-driven behavior. Somehow, the creation of tools enables us to define new tasks, or is it that the envisioning of new tasks drives us to invent new tools? Or maybe it is that new tools engender new techniques which then result in new tasks? This jumble of issues will be explored and discussed in this diverse collection of papers. (...) Individually, few of the papers are related to each other by topic or by techniques of analysis. Collectively, all focus on tasks performed using tools and discuss the techniques of tool use which enable differences in performance and expertise across individuals, societies, and (even) species. -/- . (shrink)

Constraints and dependencies among the elements of embodied cognition form patterns or microstrategies of interactive behavior. Hard constraints determine which microstrategies are possible. Soft constraints determine which of the possible microstrategies are most likely to be selected. When selection is non‐deliberate or automatic the least effort microstrategy is chosen. In calculating the effort required to execute a microstrategy each of the three types of operations, memory retrieval, perception, and action, are given equal weight; that is, perceptual‐motor activity does not have (...) a privileged status with respect to memory. Soft constraints can work contrary to the designer's intentions by making the access of perfect knowledge in‐the‐world more effortful than the access of imperfect knowledge in‐the‐head. These implications of soft constraints are tested in two experiments. In experiment 1 we varied the perceptual‐motor effort of accessing knowledge in‐the‐world as well as the effort of retrieving items from memory. In experiment 2 we replicated one of the experiment 1 conditions to collect eye movement data. The results suggest that milliseconds matter. Soft constraints lead to a reliance on knowledge in‐the‐head even when the absolute difference in perceptual‐motor versus memory retrieval effort is small, and even when relying on memory leads to a higher error rate and lower performance. We discuss the implications of soft constraints for routine interactive behavior, accounts of embodied cognition, and tool and interface design. (shrink)

The framework of plateaus, dips, and leaps shines light on periods when individuals may be inventing new methods of skilled performance. We begin with a review of the role performance plateaus have played in experimental psychology, human–computer interaction, and cognitive science. We then reanalyze two classic studies of individual performance to show plateaus and dips which resulted in performance leaps. For a third study, we show how the statistical methods of Changepoint Analysis plus a few simple heuristics may direct our (...) focus to periods of performance change for individuals. For the researcher, dips become the marker of exploration where performance suffers as new methods are invented and tested. Leaps mark the implementation of a successful new method and an incremental jump above the path plotted by smooth and steady log–log performance increments. The methods developed during these dips and leaps are the key to surpassing one's teachers and acquiring extreme expertise. (shrink)

Acquiring expertise in a task is often thought of as an automatic process that follows inevitably with practice according to the log‐log law (aka: power law) of learning. However, as Ericsson, Chase, and Faloon (1980) showed, this is not true for digit‐span experts and, as we show, it is certainly not true for Tetris players at any level of expertise. Although some people may simply “twitch” faster than others, the limit to Tetris expertise is not raw keypress time but the (...) techniques acquired by players that allow them to use the tools provided by the hardware and software to compensate for the game's relentlessly increasing drop speed. Unfortunately, these increases in drop speed between Tetris levels make performance plateaus very short and quickly followed by game death. Hence, a player's success at discovering, exploring, and practicing new techniques for the tasks of board preparation, board maintenance, optimal placement discovery, zoid rotation, lateral movement of zoids, and other tasks important to expertise in Tetris is limited. In this paper, we analyze data collected from 492 Tetris players to reveal the challenges they confronted while constructing expertise via the discovery of new techniques for gameplay at increasingly difficult levels of Tetris. (shrink)

Tetris provides a difficult, dynamic task environment within which some people are novices and others, after years of work and practice, become extreme experts. Here we study two core skills; namely, choosing the goal or objective function that will maximize performance and a feature-based analysis of the current game board to determine where to place the currently falling zoid so as to maximize the goal. In Study 1, we build cross-entropy reinforcement learning models to determine whether different goals result in (...) different feature weights. Two of these optimization strategies quickly rise to performance plateaus, whereas two others continue toward higher but more jagged heights. In Study 2, we compare the zoid placement decisions made by our best CERL models with those made by 67 human players. Across 370,131 human game episodes, two CERL models picked the same zoid placements as our lowest scoring human for 43% of the placements and as our three best scoring experts for 65% of the placements. Our findings suggest that people focus on maximizing points, not number of lines cleared or number of levels reached. They also show that goal choice influences the choice of zoid placements for CERLs and suggest that the same is true of humans. Tetris has a repetitive task structure that makes Tetris more tractable and more like a traditional experimental psychology paradigm than many more complex games or tasks. Hence, although complex, Tetris is not overwhelmingly complex and presents a right-sized challenge to cognitive theories, especially those of integrated cognitive systems. (shrink)

Tetris provides a difficult, dynamic task environment within which some people are novices and others, after years of work and practice, become extreme experts. Here we study two core skills; namely, choosing the goal or objective function that will maximize performance and a feature-based analysis of the current game board to determine where to place the currently falling zoid so as to maximize the goal. In Study 1, we build cross-entropy reinforcement learning models to determine whether different goals result in (...) different feature weights. Two of these optimization strategies quickly rise to performance plateaus, whereas two others continue toward higher but more jagged heights. In Study 2, we compare the zoid placement decisions made by our best CERL models with those made by 67 human players. Across 370,131 human game episodes, two CERL models picked the same zoid placements as our lowest scoring human for 43% of the placements and as our three best scoring experts for 65% of the placements. Our findings suggest that people focus on maximizing points, not number of lines cleared or number of levels reached. They also show that goal choice influences the choice of zoid placements for CERLs and suggest that the same is true of humans. Tetris has a repetitive task structure that makes Tetris more tractable and more like a traditional experimental psychology paradigm than many more complex games or tasks. Hence, although complex, Tetris is not overwhelmingly complex and presents a right-sized challenge to cognitive theories, especially those of integrated cognitive systems. (shrink)

Reinforcement learning approaches to cognitive modeling represent task acquisition as learning to choose the sequence of steps that accomplishes the task while maximizing a reward. However, an apparently unrecognized problem for modelers is choosing when, what, and how much to reward; that is, when (the moment: end of trial, subtask, or some other interval of task performance), what (the objective function: e.g., performance time or performance accuracy), and how much (the magnitude: with binary, categorical, or continuous values). In this article, (...) we explore the problem space of these three parameters in the context of a task whose completion entails some combination of 36 state–action pairs, where all intermediate states (i.e., after the initial state and prior to the end state) represent progressive but partial completion of the task. Different choices produce profoundly different learning paths and outcomes, with the strongest effect for moment. Unfortunately, there is little discussion in the literature of the effect of such choices. This absence is disappointing, as the choice of when, what, and how much needs to be made by a modeler for every learning model. (shrink)

The ability to learn complex tasks is fundamental to being human. Rahman and Gray examine this process in the context of learning to play a simple video game, using a tool called SpotLight to examine the low‐level process of skill and strategy improvements during this process. This paper was awarded the Allen Newell Best Student‐Led Paper Award at ICCM 2019.

Why games? How could anyone consider action games an experimental paradigm for Cognitive Science? In 1973, as one of three strategies he proposed for advancing Cognitive Science, Allen Newell exhorted us to “accept a single complex task and do all of it.” More specifically, he told us that rather than taking an “experimental psychology as usual approach,” we should “focus on a series of experimental and theoretical studies around a single complex task” so as to demonstrate that our theories of (...) human cognition were powerful enough to explain “a genuine slab of human behavior” with the studies fitting into a detailed theoretical picture. Action games represent the type of experimental paradigm that Newell was advocating and the current state of programming expertise and laboratory equipment, along with the emergence of Big Data and naturally occurring datasets, provide the technologies and data needed to realize his vision. Action games enable us to escape from our field's regrettable focus on novice performance to develop theories that account for the full range of expertise through a twin focus on expertise sampling and longitudinal studies of simple and complex tasks. (shrink)

Understanding the nature of errors in a simple, rule‐based task—programming a VCR—required analyzing the interactions among human cognition, the artifact, and the task. This analysis was guided by least‐effort principles and yielded a control structure that combined a rule hierarchy task‐to‐device with display‐based difference‐reduction. A model based on this analysis was used to trace action protocols collected from participants as they programmed a simulated VCR. Trials that ended without success (the show was not correctly programmed) were interrogated to yield insights (...) regarding problems in acquiring the control structure. For successful trials (the show was correctly programmed), steps that the model would make were categorized as matches to the model; steps that the model would not make were violations of the model. The model was able to trace the vast majority of correct keystrokes and yielded a business‐as‐usual account of the detection and correction of errors. Violations of the model fell into one of two fundamental categories. The model provided insights into certain subcategories of errors; whereas, regularities within other subcategories of error suggested limitations to the model. Although errors were rare when compared to the total number of correct actions, they were important. Errors were made on 4% of the keypresses that, if not detected, would have prevented two‐thirds of the shows from being successfully recorded. A misprogrammed show is a minor annoyance to the user. However, devices with the approximate complexity of a VCR are ubiquitous and have found their way into emergency rooms, airplane cockpits, power plants, and so on. Errors of ignorance may be reduced by training; however, errors in the routine performance of skilled users can only be reduced by design. (shrink)

This paper brings the intellectual tools of cognitive science to bear on resolving the “paradox of the active user” [Interfacing Thought: Cognitive Aspects of Human–Computer Interaction, Cambridge, MIT Press, MA, USA]—the persistent use of inefficient procedures in interactive tasks by experienced or even expert users when demonstrably more efficient procedures exist. The goal of this paper is to understand the roots of this paradox by finding regularities in these inefficient procedures. We examine three very different data sets. For each data (...) set, we first satisfy ourselves that the preferred procedures used by some subjects are indeed less efficient than the recommended procedures. We then amass evidence, for each set, and conclude that when a preferred procedure is used instead of a more efficient, recommended procedure, the preferred procedure tends to have two major characteristics: (1) the preferred procedure is a well‐practiced, generic procedure that is applicable either within the same task environment in different contexts or across different task environments, and (2) the preferred procedure is composed of interactive components that bring fast, incremental feedback on the external problem states. The support amassed for these characteristics leads to a new understanding of the paradox. In interactive tasks, people are biased towards the use of general procedures that start with interactive actions. These actions require much less cognitive effort as each action results in an immediate change to the external display that, in turn, cues the next action. Unfortunately for the users, the bias to use interactive unit tasks leads to a path that requires more effort in the long run. Our data suggest that interactive behavior is composed of a series of distributed choices; that is, people seldom make a once‐and‐for‐all decision on procedures. This series of biased selection of interactive unit tasks often leads to a stable suboptimal level of performance. (shrink)

Acquiring expertise in a task is often thought of as an automatic process that follows inevitably with practice according to the log‐log law (aka: power law) of learning. However, as Ericsson, Chase, and Faloon (1980) showed, this is not true for digit‐span experts and, as we show, it is certainly not true for Tetris players at any level of expertise. Although some people may simply “twitch” faster than others, the limit to Tetris expertise is not raw keypress time but the (...) techniques acquired by players that allow them to use the tools provided by the hardware and software to compensate for the game's relentlessly increasing drop speed. Unfortunately, these increases in drop speed between Tetris levels make performance plateaus very short and quickly followed by game death. Hence, a player's success at discovering, exploring, and practicing new techniques for the tasks of board preparation, board maintenance, optimal placement discovery, zoid rotation, lateral movement of zoids, and other tasks important to expertise in Tetris is limited. In this paper, we analyze data collected from 492 Tetris players to reveal the challenges they confronted while constructing expertise via the discovery of new techniques for gameplay at increasingly difficult levels of Tetris. (shrink)

Argument about euthanasia in Australia intensified following the world's first legal euthanasia death of Bob Dent under the Northern Territory's short-lived Rights of the Terminally Ill Act 1995. This paper takes stock of the implacably opposed positions on euthanasia following Bob Dent's death, which provides a focus for the controversy, and identifies the key doctrines which separate adversaries in the euthanasia debate and their associated incommensurable intuitions.

Visual working memory is a construct hypothesized to store a small amount of accurate perceptual information that can be brought to bear on a task. Much research concerns the construct's capacity and the precision of the information stored. Two prominent theories of VWM representation have emerged: slot-based and continuous-resource mechanisms. Prior modeling work suggests that a continuous resource that varies over trials with variable capacity and a potential to make localization errors best accounts for the empirical data. Questions remain regarding (...) the variability in VWM capacity and precision. Using a novel eye-tracking paradigm, we demonstrate that VWM facilitates search and exhibits effects of fixation frequency and recency, particularly for prior targets. Whereas slot-based memory models cannot account for the human data, a novel continuous-resource model does capture the behavioral and eye tracking data, and identifies the relevant resource as item activation. (shrink)

Constraints and dependencies among the elements of embodied cognition form patterns or microstrategies of interactive behavior. Hard constraints determine which microstrategies are possible. Soft constraints determine which of the possible microstrategies are most likely to be selected. When selection is non-deliberate or automatic the least effort microstrategy is chosen. In calculating the effort required to execute a microstrategy each of the three types of operations, memory retrieval, perception, and action, are given equal weight; that is, perceptual-motor activity does not have (...) a privileged status with respect to memory. Soft constraints can work contrary to the designer's intentions by making the access of perfect knowledge in-the-world more effortful than the access of imperfect knowledge in-the-head. These implications of soft constraints are tested in two experiments. In experiment 1 we varied the perceptual-motor effort of accessing knowledge in-the-world as well as the effort of retrieving items from memory. In experiment 2 we replicated one of the experiment 1 conditions to collect eye movement data. The results suggest that milliseconds matter. Soft constraints lead to a reliance on knowledge in-the-head even when the absolute difference in perceptual-motor versus memory retrieval effort is small, and even when relying on memory leads to a higher error rate and lower performance. We discuss the implications of soft constraints for routine interactive behavior, accounts of embodied cognition, and tool and interface design. (shrink)

How can we study bounded rationality? We answer this question by proposing rational task analysis —a systematic approach that prevents experimental researchers from drawing premature conclusions regarding the rationality of agents. RTA is a methodology and perspective that is anchored in the notion of bounded rationality and aids in the unbiased interpretation of results and the design of more conclusive experimental paradigms. RTA focuses on concrete tasks as the primary interface between agents and environments and requires explicating essential task elements, (...) specifying rational norms, and bracketing the range of possible performance, before contrasting various benchmarks with actual performance. After describing RTA’s core components we illustrate its use in three case studies that examine human memory updating, multitasking behavior, and melioration. We discuss RTA’s characteristic elements and limitations by comparing it to related approaches. We conclude that RTA provides a useful tool to render the study of bounded rationality more transparent and less prone to theoretical confusion. (shrink)

Reinforcement learning (RL) models of decision-making cannot account for human decisions in the absence of prior reward or punishment. We propose a mechanism for choosing among available options based on goal-option association strengths, where association strengths between objects represent previously experienced object proximity. The proposed mechanism, Goal-Proximity Decision-making (GPD), is implemented within the ACT-R cognitive framework. GPD is found to be more efficient than RL in three maze-navigation simulations. GPD advantages over RL seem to grow as task difficulty is increased. (...) An experiment is presented where participants are asked to make choices in the absence of prior reward. GPD captures human performance in this experiment better than RL. (shrink)

Although certain aspects of C.S. Lewis's work have been studied in great detail, others have been comparatively neglected. This collection of essays looks at Lewis's life and work, and those of his friends and associates, from many different angles, but all connected through a common theme of identity. Questions of identity are essential to the understanding of any writer. The ways authors perceive themselves and who they are, the communities they belong to by birth or choice, inevitably influence their work. (...) The way they present other people, real or fictional, are also rooted in their own conception of identity. In this volume, scholars from several countries examine gender and family roles; national, regional, racial and professional identities; membership of a particular church; ideological attachments and personal descriptions, either with regard to Lewis and those who knew him and influenced him, or in a study of their writings. Authors studied here include J.R.R. Tolkien, Dorothy L. Sayers, Charles Williams, George MacDonald and T.S. Eliot. (shrink)

Though not deriving from European modernity at all, the Chinese tradition of Neo‐Confucianism bean many similarities to the American pragmatic tradition….

Well known as the British politician responsible for the Balfour Declaration during World War I, James Balfour was also a philosopher. Long forgotten, his remarkable book The Foundations of Belief (1895) merits contemporary reassessment. Critical of modern compartmentalization, Balfour argues for an integration of religion, philosophy, and science---a position now often identified as postmodern. This article presents some of Balfour’s contemporary scholarly significance, and hints at his usefulness in undergraduate teaching.

Drawing on philosophy, theology and psychoanalysis as well as on literary criticism, this collection of essays explores a range of fantasy texts with particular attention to the various ways in which they seek to deal with the reality of death. The essays uncover some fascinating links, and indeed tensions, between the writers discussed.