The picture-word interference paradigm has been used to investigate the time course of processes involved in word retrieval, but is challenging to implement online due to dependence on measurements of vocal reaction time. We performed a series of four experiments to examine picture-word interference and facilitation effects in a form of covert picture naming, with and without gamification. A target picture was accompanied by an audio word distractor that was either unrelated, phonologically-related, associatively-related, or categorically-related to the picture. (...) Participants were instructed to judge whether the name of the target picture ended in the phoneme assigned to the block by pressing corresponding keys as quickly and accurately as possible. Experiments 1 and 2 successfully replicated categorical interference and phonological facilitation effects at different optimal stimulus-onset-asynchronies between words and pictures. Experiment 3 demonstrated that a key gamification feature motivated faster speed at the expense of accuracy in the gamified vs. experimental format of the task. Experiment 4 adopted the optimal SOAs and verified that the gamification reveals expected interference and facilitation effects despite the speed-accuracy tradeoff. These studies confirmed that categorical interference occurs earlier than phonological facilitation, while both processes are independent from articulation and inherent to word retrieval itself. The covert PWI paradigm and its gamification have methodological value for neuroimaging studies in which articulatory artifacts obscure word retrieval processes, and may be developed into potential online word-finding assessments that can reveal word retrieval difficulties with greater sensitivity. (shrink)

Grammatical gender processing during language production has classically been studied using the so-called picture-word interference (PWI) task. In this procedure, participants are presented with pictures they must name using target nouns while ignoring superimposed written distractor nouns. Variations in response times are expected depending on the congruency between the gender values of targets and distractors. However, there have been disparate results in terms of the mandatory character of an agreement context to observe competitive gender effects and the interpretation of (...) the direction of these effects in Romance languages, this probably due to uncontrolled variables such as animacy. In the present study, we conducted two PWI experiments with European Portuguese speakers who were asked to produce bare nouns. The percentage of animate targets within the list was manipulated: 0, 25, 50, and 100%. A gender congruency effect was found restricted to the 0% list (all targets were inanimate). Results support the selection of gender in transparent languages in the absence of an agreement context, as predicted by the Gender Acquisition and Processing (GAP) hypothesis (Sá-Leite et al.,2019), and are interpreted through the attentional mechanisms involved in the PWI paradigm, in which the processing of animate targets would be favored to the detriment of distractors due to biological relevance and semantic prioritization. (shrink)

Between‐trial effects in Stroop‐like interference tasks are linked to differences in the amount of cognitive control. Trials following an incongruent trial show less interference, an effect suggested to result from the increased control caused by the incongruent previous trial (known as the Gratton effect). In this study, we show that cognitive control not only results in a different amount of interference but also in a different locus of the interference. That is, the stage of the task (...) that shows the most interference changes as a function of the preceding trial. Using computational cognitive modeling, we explain these effects by a difference in the amount of processing of the irrelevant dimension of the stimulus. (shrink)

I present a computational-level model of semantic interference effects in online word production within a rate–distortion framework. I consider a bounded-rational agent trying to produce words. The agent's action policy is determined by maximizing accuracy in production subject to computational constraints. These computational constraints are formalized using mutual information. I show that semantic similarity-based interference among words falls out naturally from this setup, and I present a series of simulations showing that the model captures some of the key (...) empirical patterns observed in Stroop and Picture–Word Interference paradigms, including comparisons to human data from previous experiments. (shrink)

ABSTRACTThis research investigated whether precues engage proactive control to reduce emotional interference during speech production. A picture-word interference task required participants to name target pictures accompanied by taboo, negative, or neutral distractors. Proactive control was manipulated by presenting precues that signalled the type of distractor that would appear on the next trial. Experiment 1 included one block of trials with precues and one without, whereas Experiment 2 mixed precued and uncued trials. Consistent with previous research, picture naming was (...) slowed in both experiments when distractors were taboo or negative compared to neutral, with the greatest slowing effect when distractors were taboo. Evidence that precues engaged proactive control to reduce interference from taboo distractors was found in Experiment 1. In contrast, mixing precued trials in Experiment 2 resulted in no taboo cueing benefit. These results suggest that item-level proactive control can b... (shrink)

This article discusses how sequential sampling models can be integrated in a cognitive architecture. The new theory Retrieval by Accumulating Evidence in an Architecture (RACE/A) combines the level of detail typically provided by sequential sampling models with the level of task complexity typically provided by cognitive architectures. We will use RACE/A to model data from two variants of a picture–word interference task in a psychological refractory period design. These models will demonstrate how RACE/A enables interactions between sequential sampling (...) and long-term declarative learning, and between sequential sampling and task control. In a traditional sequential sampling model, the onset of the process within the task is unclear, as is the number of sampling processes. RACE/A provides a theoretical basis for estimating the onset of sequential sampling processes during task execution and allows for easy modeling of multiple sequential sampling processes within a task. (shrink)

Although Sign Languages are gestural languages, the fact remains that some linguistic information can also be conveyed by spoken components as mouthing. Mouthing usually tend to reproduce the more relevant phonetic part of the equivalent spoken word matching with the manual sign. Therefore, one crucial issue in sign language is to understand whether mouthing is part of the signs themselves or not, and to which extent it contributes to the construction of signs meaning. Another question is to know whether mouthing (...) patterns constitute a phonological or a semantic cue in the lexical sign entry. This study aimed to investigate the role of mouthing on the processing of lexical signs in French Sign Language (LSF), according the type of bilingualism (intramodal vs. bimodal). For this purpose, a behavioral sign-picture lexical decision experiment was designed. Intramodal signers (native deaf adults) and Bimodal signers (fluent hearing adults) have to decide as fast as possible whether a picture matched with the sign seen just before. Five experimental conditions in which the pair sign-mouthing were congruent or incongruent were created. Our results showed a strong interference effect when the sign-mouthing matching was incongruent, reflected by higher error rates and lengthened reaction times compared with the congruent condition. This finding suggests that both groups of signers use the available lexical information contained in mouthing during accessing the sign meaning. In addition, deaf intramodal signers were strongly interfered than hearing bimodal signers. Taken together, our data indicate that mouthing is a determining factor in LSF lexical access, specifically in deaf signers. (shrink)

Semantics traditionally focuses on linguistic meaning. In recent years, the Super Linguistics movement has tried to broaden the scope of inquiry in various directions, including an extension of semantics to talk about the meaning of pictures. There are close similarities between the interpretation of language and of pictures. Most fundamentally, pictures, like utterances, can be either true or false of a given state of affairs, and hence both express propositions (Zimmermann, 2016; Greenberg, 2013; Abusch, 2015). Moreover, sequences of pictures, like (...) sequences of utterances, can be used to tell stories. Wordless picture books, comics, and film are cases in point. In this paper I pick up the project of providing a dynamic semantic account of pictorial story-telling, started by Abusch (2012) and continued by Abusch & Rooth (2017); Maier & Bimpikou (2019); Fernando (2020). More specifically, I propose here a semantics of speech and thought bubbles by adding event reference to PicDRT. To get there I first review the projection-based semantics for pictures (section 1), noting the fundamental distinction between symbolic and iconic meaning that makes speech bubbles especially interesting (section 2). I then review the dynamic PicDRT framework for pictorial narratives (section 3), add events (section 4), and propose an account of speech bubbles as quotational event modification (section 5). I end with a brief look at other conventional, symbolic enrichments in comics (section 6). (shrink)

We already have a distinction between the intension and extension of terms. This is not simply the distinction that is operative in philosophy of mind, body, and action. There, the concern is with things, and with a physicalistic or a mentalistic account of them. The physicalist says he supports an ‘extensional’ analysis of things, the mentalist an ‘intensional’. So, the physicalist says that, in the end, only ‘the extensional language of physical science’ will do in ontology. But, associating this physical-mental (...) dichotomy with the intension-extension distinction as applied to terms is misleading. The ontological issue is obscured by the association. An ontologist wants, like Spinoza or Berkeley, to know whetherthingsare extended or not, and in what respects. This question makes central the concept of space, or more generally of ‘field’, ‘domain’. Unfortunately, the same word ‘extension’ is used also for the spread or location of athingin space. To dissociate the extension of a term, a logical notion, from the ontological notion of the spatial status of a thing, I introduce the new word ‘extention’. This coinage correlates, not with the ‘intension’ of terms—the logical correlate of ‘extension’—but with ‘intention’, a word that fortunately already has common currency, and reeks with connotations that have logical ties with ‘consciousness’. So, from here on, we have two dichotomies: intension-extension applying to terms, and intention-extention applying to things. Since terms are things, both sorts of considerations are relevant to them, the logical one and the ontological. Only the latter applies to, say, stones or persons, since these are not linguistic terms. (shrink)

We already have a distinction between the intension and extension of terms. This is not simply the distinction that is operative in philosophy of mind, body, and action. There, the concern is with things, and with a physicalistic or a mentalistic account of them. The physicalist says he supports an ‘extensional’ analysis of things, the mentalist an ‘intensional’. So, the physicalist says that, in the end, only ‘the extensional language of physical science’ will do in ontology. But, associating this physical-mental (...) dichotomy with the intension-extension distinction as applied to terms is misleading. The ontological issue is obscured by the association. An ontologist wants, like Spinoza or Berkeley, to know whetherthingsare extended or not, and in what respects. This question makes central the concept of space, or more generally of ‘field’, ‘domain’. Unfortunately, the same word ‘extension’ is used also for the spread or location of athingin space. To dissociate the extension of a term, a logical notion, from the ontological notion of the spatial status of a thing, I introduce the new word ‘extention’. This coinage correlates, not with the ‘intension’ of terms—the logical correlate of ‘extension’—but with ‘intention’, a word that fortunately already has common currency, and reeks with connotations that have logical ties with ‘consciousness’. So, from here on, we have two dichotomies: intension-extension applying to terms, and intention-extention applying to things. Since terms are things, both sorts of considerations are relevant to them, the logical one and the ontological. Only the latter applies to, say, stones or persons, since these are not linguistic terms. (shrink)

People have always wondered how thinking takes place and what thoughts are constructed from. We typically experience our thoughts as involving pictorial (or sensory) contents or as being in words. Although this idea has been enshrined in psychology as the “dual code” theory of reasoning and memory, serious questions have been raised concerning this view. It appears that whatever the form of our thoughts it is unlikely that it is anything like our experience of them. But if thought is not (...) in pictures or words, what form does it take? If we do not sometimes think in words, then what actually goes on when we think by engaging in an “inner dialogue”? And if we do not sometimes think in pictures, what goes on when we reason by creating and examining “mental images”? (shrink)

Can suggestion, particularly hypnotic suggestion, influence cognition? Addressing this intriguing question experimentally is on the rise in cognitive research, nowhere more prevalently than in the domain of cognitive control and attention. This may well rest on the intuitive connection between hypnotic suggestion and attention, where the hypnotist controls the subject’s attention. Particularly impressive has been the work of Raz and his colleagues demonstrating the modulation and even the complete elimination of classic Stroop color–word interference when subjects are given a (...) posthypnotic suggestion that words are meaningless. Overriding a highly practiced, possibly even automatic response like reading is testament to the attentional control that can be exerted under hypnotic suggestion. What else do we need to know—in the Stroop context and more broadly—to obtain a clear picture of how suggestion can orchestrate attention? (shrink)

Pictures have always played a prominent role in philosophical speculation about the mind, but the concept of a picture has itself been the object of philosophical scrutiny only intermittently. As a matter of fact, it was studied most intensively in the course of a theological controversy in the Eastern Roman Empire, during the eighth century - which is a sufficient indication of its marginal place in the history of philosophy. Perhaps this is because pictures have never produced in us the (...) theoretical paralysis which Augustine famously associated with time, but have on the contrary generally seemed too unproblematic to deserve much time from philosophers. Even today, after several decades of accumulating theory, philosophers with no stake in the matter are often impervious to its charm. I feel some sympathy for this attitude, because the task of explaining the nature of depiction is, I believe, one which calls for the refinement rather than refutation of our first thoughts about it. But a precise understanding of depiction is both a necessary prolegomenon to a significant part of aesthetics, and a useful prophylactic against confusion in the theory of the imagination. Besides, there is also the pleasure of the chase, which J. L. Austin nonchalantly appealed to many years before the Research Assessment Exercise was inaugurated. (shrink)

This is a review of the 2013 film Words and Pictures. Surprisingly, the film is not about justifying a role for the humanities in education but, rather, a battle to determine which is more valuable—literature or art?. At a time when many schools question if these have any value at all, this film uses passionate and afflicted teachers to explore which is most important and finds valuable intersections between the two.