Previous studies have identified the critical role of the left fusiform cortex in visual word form processing, learning, and memory. However, this so-called visual word form area's other functions are not clear. In this study, we used fMRI and the subsequent memory paradigm to examine whether the putative VWFA was involved in the processing and successful memory encoding of faces as well as words. Twenty-two native Chinese speakers were recruited to memorize the visual (...) forms of faces and Chinese words. Episodic memory for the studied material was tested 3. h after the scan with a recognition test. The fusiform face area and the VWFA were functionally defined using separate localizer tasks. We found that, both within and across subjects, stronger activity in the VWFA was associated with better recognition memory of both words and faces. Furthermore, activation in the VWFA did not differ significantly during the encoding of faces and words. Our results revealed the important role of the so-called VWFA in face processing and memory and supported the view that the left mid-fusiform cortex plays a general role in the successful processing and memory of different types of visual objects. © 2010 Elsevier Inc. (shrink)

A central component in the E-Z Reader model is a two-stage word processing mechanism made responsible for both the triggering of eye movements and sequential shifts of attention. We point to problems with both the verbal description of this mechanism and its computational implementation in the simulation. As an alternative, we consider the use of a connectionist processing module in combination with a more indirect form of cognitive eye-movement control.

Interest in orthographic processing reflects an expansion, not constriction, of the scope of research in visual word recognition. Transposition effects are merely one aspect of investigations into orthographic encoding, while open bigrams can accommodate differences across languages. The target article's inaccurate characterization of the study of orthographic processing is not conducive to the advancement of VWR research.

Frost's article advocates for universal models of reading and critiques recent models that concentrate in what has been described as “cracking the orthographic code.” Although the challenge to develop models that can account for word recognition beyond Indo-European languages is welcomed, we argue that reading models should also be constrained by general principles of visual processing and object recognition.

In a digital era that neglects handwriting, the current study is significant because it examines the mechanisms underlying this process. We recruited 9- to 10-year-old Chinese children, who were at an important period of handwriting development, and adult college students, for both behavioral and electroencephalogram experiments. We designed four learning conditions: handwriting Chinese, viewing Chinese, drawing shapes followed by Chinese recognition, and drawing shapes followed by English recognition. Both behavioral and EEG results showed that HC facilitated visual word (...) recognition compared to VC, and behavioral results showed that HC facilitated visual word recognition compared to drawing shapes. HC and VC resulted in a lateralization of the N170 in adults, but not in children. Taken together, the results of the study suggest benefits of handwriting on the neural processing and behavioral performance in response to Chinese characters. The study results argue for maintaining handwriting practices to promote the perception of visual word forms in the digital age. (shrink)

When word pairs having a familiar order are sequentially flashed on a computer in their non-familiar order, , observers have a strong phenomenology of seeing them in familiar order . Reversal errors remained frequent even when participants obtained perceptual experience of reverse-display items by beginning with a block of longer-duration trials. A forced-choice order-detection procedure reduced but did not eliminate reversal errors, showing that “fast pairs” is a robust perceptual illusion. Even adjective + noun pairs showed reversal errors, and (...) reversal errors increased with the log frequency of the word pair, consistent with a strong role for statistical processing at the level of multi-word units. (shrink)

In this event-related potential study a masking technique that prevents conscious perception of words and non-words through attentional distraction was used to reveal the temporal dynamics of word processing under non-conscious and conscious conditions. In the non-conscious condition, ERP responses differed between masked words and non-words from 112 to 160 ms after stimulus-onset over posterior brain areas. The early onset of the word–non-word differences was compatible with previous studies that reported non-conscious access to orthographic information within (...) this time period. Moreover, source localisations provided evidence for automatic activation of prelexical phonological information, whereas no evidence for non-conscious semantic processing was found. When subjects were informed about the masking technique, lexical differences occurred at later time intervals, suggesting conscious access to additional word related information. These results indicate that early visual word processing does not depend entirely on attentional resources, but that non-conscious processing probably is restricted to rather lower-level linguistic information. (shrink)

The claim that visually masked, unidentifiable words are analyzed at the level of whole word meaning has been challenged by recent findings indicating that instead, analysis occurs mainly at the subword level. The present experiments examined possible limits on subword analysis. Experiment 1 obtained semantic priming from pleasant- and unpleasant-meaning subliminal words in which no individual letter contained diagnostic information about a word’s evaluative valence; thus analysis must operate on information more complex than that contained in individual letters. (...) Experiments 2 and 3 showed that analysis must operate on information more complex than that represented by individual bigrams or trigrams . These findings suggest that while subliminal priming is driven by subword analysis, the effective units of analysis are distributed widely across at least short words. (shrink)

Through computational modeling, here we examine whether visual and task characteristics of writing systems alone can account for lateralization differences in visual word recognition between different languages without assuming influence from left hemisphere (LH) lateralized language processes. We apply a hemispheric processing model of face recognition to visual word recognition; the model implements a theory of hemispheric asymmetry in perception that posits low spatial frequency biases in the right hemisphere and high spatial frequency (HSF) (...) biases in the LH. We show two factors that can influence lateralization: (a) Visual similarity among words: The more similar the words in the lexicon look visually, the more HSF/LH processing is required to distinguish them, and (b) Requirement to decompose words into graphemes for grapheme-phoneme mapping: Alphabetic reading (involving grapheme-phoneme conversion) requires more HSF/LH processing than logographic reading (no grapheme-phoneme mapping). These factors may explain the difference in lateralization between English and Chinese orthographic processing. (shrink)

I have argued that orthographic processing cannot be understood and modeled without considering the manner in which orthographic structure represents phonological, semantic, and morphological information in a given writing system. A reading theory, therefore, must be a theory of the interaction of the reader with his/her linguistic environment. This outlines a novel approach to studying and modeling visual word recognition, an approach that focuses on the common cognitive principles involved in processing printed words across different writing (...) systems. These claims were challenged by several commentaries that contested the merits of my general theoretical agenda, the relevance of the evolution of writing systems, and the plausibility of finding commonalities in reading across orthographies. Other commentaries extended the scope of the debate by bringing into the discussion additional perspectives. My response addresses all these issues. By considering the constraints of neurobiology on modeling reading, developmental data, and a large scope of cross-linguistic evidence, I argue that front-end implementations of orthographic processing that do not stem from a comprehensive theory of the complex information conveyed by writing systems do not present a viable approach for understanding reading. The common principles by which writing systems have evolved to represent orthographic, phonological, and semantic information in a language reveal the critical distributional characteristics of orthographic structure that govern reading behavior. Models of reading should thus be learning models, primarily constrained by cross-linguistic developmental evidence that describes how the statistical properties of writing systems shape the characteristics of orthographic processing. When this approach is adopted, a universal model of reading is possible. (shrink)

By hypothesis, awareness is involved in the modulation of feedback from semantics to the lexical level in the visual word recognition system. When subjects are aware of the fact that there are many related prime–target pairs in a semantic priming experiment, this knowledge is used to configure the system to feed activation back from semantics to the lexical level so as to facilitate processing. When subjects are unaware of this fact, the default set is maintained in which (...) activation is not fed back from semantics to the lexical level so as to conserve limited resources. Qualitative differences in the pattern of data from two lexical decision experiments that employ masked priming are consistent with this hypothesis. Semantic context and stimulus quality interact when the prime is processed with awareness whereas these same two factors produce additive effects on RT when the prime is unlikely to have been processed with awareness. These experiments thus illustrate one way in which awareness affects the dynamics of visual word recognition. (shrink)

We agree with many of the principles proposed by Frost but highlight crucial caveats and report research findings that challenge several assertions made in the target article. We discuss the roles that visual processing, development, and bilingualism play in visual word recognition and reading. These are overlooked in all current models, but are fundamental to any universal model of reading.

Pulvermüller's account of lexical representation has implications for visual word recognition, given the claim we make that a foveally presented word is precisely split and contralaterally projected to the two hemispheres, and that this splitting conditions the whole process of visual word recognition. This elaboration of Pulvermüller's account raises issues of hemispheric differences and collaboration.

In Chinese orthography, the most common character structure consists of a semantic radical on the left and a phonetic radical on the right ; the minority, opposite arrangement also exists. Recent studies showed that SP character processing is more left hemisphere lateralized than PS character processing. Nevertheless, it remains unclear whether this is due to phonetic radical position or character type frequency. Through computational modeling with artificial lexicons, in which we implement a theory of hemispheric asymmetry in perception (...) but do not assume phonological processing being LH lateralized, we show that the difference in character type frequency alone is sufficient to exhibit the effect that the dominant type has a stronger LH lateralization than the minority type. This effect is due to higher visual similarity among characters in the dominant type than the minority type, demonstrating the modulation of visual similarity of words on hemispheric lateralization. (shrink)

We investigate how mood inductions impact the neural processing of emotional adjectives in one’s first language and a formally acquired second language. Twenty-three student participants took part in an EEG experiment with two separate sessions. Happy or sad mood inductions were followed by series of individually presented positive, negative, or neutral adjectives in L1 or L2 and evaluative decisions had to be performed. Visual event-related potentials elicited during word processing were analyzed during N1, Early Posterior Negativities, (...) N400, and the Late Positive Potential. Mood induction differentially impacted word processing already on the N1, with stronger left lateralization following happy than sad mood induction in L1, but not in L2. Moreover, regardless of language, early valence modulation was found following happy but not sad mood induction. Over occipital areas, happy mood elicited larger amplitudes of the mood-congruent positive words, whereas over temporal areas mood-incongruent negative words had higher amplitudes. In the EPN-windows, effects of mood and valence largely persisted, albeit with no difference between L1 and L2. N400 amplitude was larger for L2 than for L1. On the LPP, mood-incongruent adjectives elicited larger amplitudes than mood-congruent ones. Results reveal a remarkably early valence-general effect of mood induction on cortical processing, in line with previous reports of N1 as a first marker of contextual integration. Interestingly, this effect differed between L1 and L2. Moreover, mood-congruent effects were found in perceptual processing and mood-incongruent ERP amplification in higher-order evaluative stages. (shrink)

Although it is well documented that language plays an important role in cognitive development, there are different views concerning the mechanisms underlying these effects. Some argue that even early in development, effects of words stem from top‐down knowledge, whereas others argue that these effects stem from auditory input affecting attention allocated to visual input. Previous research (e.g., Robinson & Sloutsky, 2004a) demonstrated that non‐speech sounds attenuate processing of corresponding visual input at 8, 12, and 16 months of (...) age, whereas the current study demonstrates that words attenuate visual processing at 10 months but not at 16 months (Experiment 1). Furthermore, prefamiliarization with non‐speech sounds (Experiment 2) resulted in able processing of visual input by 16‐month‐olds. These findings suggest that some effects of labels found early in development may stem from familiarity with human speech. The possibility of general‐auditory factors underlying the effects of words on cognitive development is discussed. (shrink)

A neurally plausible model of how the process of visually perceiving a letter in the context of a word is learned, and how such processing occurs in adults is proposed. The model consists of a collection of abstract letter feature detector neurons and their interconnections. The model also includes a learning rule that specifies how these interconnections evolve with experience. The interconnections between neurons can be interpreted as representing the spatially redundant, sequentially redundant, and transgraphemic information in letter (...) string displays. Anderson, Silverstein, Ritz, and Jones's (1977) “Brain‐State‐in‐a‐Box” (BSB) neural mechanism is then used to implement the proposed model. The resulting system makes explicit qualitative predictions using both letter recognition accuracy and reaction time as dependent measures. In particular, the model offers an integrated explanation of some experiments involving manipulations of orthographic regularity, masking, case alternations, and experience with words. The similarities and differences between the model and models proposed by Adams (1979) and McClelland and Rumelhart (1981) are also discussed. (shrink)

1. To list Pound’s triumphs of recognition in the realm of art, music, or literature is by itself no more enlightening than to catalog his oversights. Thus, for example, his instant and almost uncanny responsiveness to the work of Henri Gaudier-Brzeska is not more informative than his bizarre ranking of Francis Picabia’s paintings above those of Picasso or Matisse. Clearly it is essential to know, with as much specificity as possible, exactly what Pound said about a particular work of art (...) or literature and, equally important, given the frequent shifts of emphasis and interest throughout his long career, just when these opinions were first formulated. Like every reader of the The Cantos, I am conscious of the enormous service rendered by Pound scholars whose research is giving us a more complete inventory of the poet’s various statements and positions, and it would be foolish to take my point here as a derogation of such efforts. But a list, no matter how complete, is not an argument, and an inventory, no matter how scrupulously assembled, is not an explanation; a recurrent problem in Pound studies is that too often the compoilation of discrete items of information is seen as a sufficient answer to problems of interpretation and understanding. In other words, I think it essential that discussions of pound and the Visual Arts move beyond the quagmire resulting from still another frain-storm of “factual atoms” chronicling his various passions and dislikes.2. Far from implying, however, that we must therefore simply accept Pound’s brilliant discoveries and pass over his “howling blunders,” my position would emphasize the need to take his ideas seriously enough to confront them, to test them against the material to which they are a response and for which they often seek to provide an explanatory account. There are times, as I have argued in an analogous context, when it is less demeaning to give a man credit for his worst errors than to remove from him the capacity to err.3. What we require, I believe, is less a catalog of all of Pound’s specific statements about various artists, with each utterance assigned a positive or negative prefix depending upon our own personal and currently sanctioned hierarchy of values, than a careful study of the place of those statements in the logic and texture of Pound’s own work. The attempt to focus attention on The Cantos’ network of artistic references—its invocation of masterpieces and privileged moments of cultural achievement—will yield only trivial results unless the inner dynamic linking Pound’s various exampla and the actual role these play in the poem’s argument become clearer in the process. Michael André Bernstein, associate professor of English and comparative literature at the University of California, Berkeley, is the author of The Tale of the Tribe: Ezra Pound and the Modern Verse Epic and Prima della Rivoluzione , a volume of verse. He is currently completing a study of the Abject Hero and literary genealogy. His previous contribution to. (shrink)

The article is devoted to the problem of changing stylistic paradigm in the Persian poetry of XVI-XVII centuries and reflection of this process in self-consciousness of outstanding authors of the period. Parallel with preserving stable norms of traditional poetics literary practice demonstrates flexibility and forms new range of popular poetic strategies. New aesthetic criteria if ideal poetic language, expressed with epithet ‘colourful’, appears alongside with criteria of previous period, expressed with epithet ‘sweet’ and step by step gets leadership. Lyric poetry (...) of three famous authors of the period of formation and golden age of Indian style served the object of analyses. The phenomena of visualization of imagery connected with perfect poetic language illustrated by examples of ‘Poet and Poetry’ motifs located in ‘frame text’ in end of the qhazal. These motifs serve one of the regular contexts of author’s name and show author’s attitude to his creation, including stylistic preferences. Refinement of poetic fantasy being declared basic condition of creating perfect poetry described visually as coiling lasso, poetry itself as flourishing garden, fountain or European house decorated with painting. Such characteristic of word creation has analogies in the works of Baroque style theorist Giambattista Marino. (shrink)

Previous research on associative learning has uncovered detailed aspects of the process, including what types of things are learned, how they are learned, and where in the brain such learning occurs. However, perceptual processes, such as stimulus recognition and identification, take time to unfold. Previous studies of learning have not addressed when, during the course of these dynamic recognition processes, learned representations are formed and updated. If learned representations are formed and updated while recognition is ongoing, the result of learning (...) may incorporate spurious, partial information. For example, during word recognition, words take time to be identified, and competing words are often active in parallel. If learning proceeds before this competition resolves, representations may be influenced by the preliminary activations present at the time of learning. In three experiments using word learning as a model domain, we provide evidence that learning reflects the ongoing dynamics of auditory and visual processing during a learning event. These results show that learning can occur before stimulus recognition processes are complete; learning does not wait for ongoing perceptual processing to complete. (shrink)

Studies of native syntactic processing often target phrase structure violations that do not occur in natural production. In contrast, this study examines how variation in basic word order is processed, looking specifically at structures traditionally labelled as violations but that do occur naturally. We examined Swedish verb-second and verb-third word order processing in adult native Swedish speakers, manipulating sentence-initial adverbials in acceptability judgements, in simultaneously recorded event-related potentials to visually presented sentences and in a written sentence (...) completion task. An initial corpus study showed that the adverbials differ in frequency in fronted position, and although all occur mainly with V2 word order, kanske occurs more frequently with V3 in natural production than both idag and hemma. The experimental results reflected these patterns such that V2 sentences were overall more frequently produced and were deemed more acceptable than V3 sentences. The ERP results consisted of a biphasic N400/P600 response to V3 word order that indicated effects of word retrieval and sentence reanalysis. We also found consistent effects of adverbials. As predicted, V3 was produced more frequently and judged as more acceptable in Kanske sentences than in sentences with the other two adverbials. The ERP analyses showed stronger effects for idag and hemma with V3, especially regarding the P600. The results suggest that the naturally occurring word order ‘violation’, V3 with kanske, is processed differently than V3 with other adverbials where the V2 norm is stronger. Moreover, these patterns are related to individuals’ own production patterns. Overall, the results suggest a more varied native word order processing than previously reported. (shrink)

ObjectivesTo document the auditory processing, visual attention, digit memory, phonological processing, and receptive language abilities of individual children with identified word reading difficulties.DesignTwenty-four children with word reading difficulties and 28 control children with good word reading skills participated. All children were aged between 8 and 11 years, with normal hearing sensitivity and typical non-verbal intelligence. Both groups of children completed a test battery designed to assess their auditory processing, visual attention, digit memory, (...) phonological processing, and receptive language.ResultsWhen compared to children who were good readers, children with word reading difficulties obtained significantly lower average scores on tests of auditory processing, including the frequency pattern test, gaps in noise, frequency discrimination, Dichotic Digit difference Test, and Listening in Spatialized Noise. The two groups did not differ on the discrimination measures of sinusoidal amplitude modulation or iterated rippled noise. The results from children with word reading difficulties showed that 5 children (21%) had comorbid deficits in auditory processing, visual attention, and backward digit memory; whereas 12 children (50%) had comorbid auditory processing and visual attention deficits only, and 2 children (8%) had comorbid deficits in auditory processing and digit memory; the remaining children had only auditory processing, visual attention, or digit memory deficits.ConclusionThe current study highlights the general co-existence of auditory processing, memory, and visual attention deficits in children with word reading difficulties. It is also noteworthy, however, that only one fifth of the current cohort had deficits across all measured tasks. Hence, our results also show the significant individual variability inherent in children with word reading difficulties. (shrink)

Many situations require the simultaneous processing of auditory and visual information, however, stimuli presented to one sensory modality can sometimes interfere with processing in a second sensory modality (i.e., modality dominance). The current study further investigated modality dominance by examining how task demands and bimodal presentation affect speeded auditory and visual discriminations. Participants in the current study had to quickly determine if two words, two pictures, or two word-picture pairings were the same or different, and (...) we manipulated task demands across three different conditions. In an immediate recognition task, there was only one second between the two stimuli/stimulus pairs and auditory dominance was found. Compared to the respective unimodal baselines, pairing pictures and words together slowed down visual responses and sped up auditory responses. Increasing the interstimulus interval to four seconds and blocking verbal rehearsal weakened auditory dominance effects, however, conflicting and redundant visual cues sped up auditory discriminations. Thus, simultaneously presenting pictures and words had different effects on auditory and visual processing, with bimodal presentation slowing down visual processing and speeding up auditory processing. These findings are consistent with a proposed mechanism underlying auditory dominance, which posits that auditory stimuli automatically grab attention and attenuate/delay visual processing. (shrink)

Prior reports suggest that affective effects in visual word processing cannot be fully explained by a dimensional perspective of emotions based on valence and arousal. In the current study, we focused on the contribution of approach and avoidance motivational systems that are related to different action components to the processing of emotional words. To this aim, we compared frontal alpha asymmetries and brain oscillations elicited by anger words associated with approach motivational tendencies, and fear words that (...) may trigger either avoidance, approach or no action tendencies. The participants’ task was to make decisions about approaching or distancing from the concepts represented by words. The results of cluster-based and beamforming analyses revealed increased gamma power band synchronization for fear words relative to anger words between 725 and 750 ms, with an estimated neural origin in the temporal pole. These findings were interpreted to reflect a conflict between different action tendencies underlying the representation of fear words in semantic and emotional memories, when trying to achieve task requirements. These results are in line with the predictions made by the fear-hinders-action hypothesis. Additionally, current data highlights the contribution of motivational features to the representation and processing of emotional words. (shrink)

People categorize objects slowly when visual input is highly impoverished instead of optimal. While bottom-up models may explain a decision with optimal input, perceptual hypothesis testing (PHT) theories implicate top-down processes with impoverished input. Brain mechanisms and the time course of PHT are largely unknown. This event-related potential study used a neuroimaging paradigm that implicated prefrontal cortex in top-down modulation of occipitotemporal cortex. Subjects categorized more impoverished and less impoverished real and pseudo objects. PHT theories predict larger impoverishment effects (...) for real than pseudo objects because top-down processes modulate knowledge only for real objects, but different PHT variants predict different timing. Consistent with parietal-prefrontal PHT variants, around 250 ms, the earliest impoverished real object interaction started on an N3 complex, which reflects interactive cortical activity for object cognition. N3 impoverishment effects localized to both prefrontal and occipitotemporal cortex for real objects only. The N3 also showed knowledge effects by 230 ms that localized to occipitotemporal cortex. Later effects reflected (a) word meaning in temporal cortex during the N400, (b) internal evaluation of prior decision and memory processes and secondary higher-order memory involving anterotemporal parts of a default mode network during posterior positivity (P600), and (c) response related activity in posterior cingulate during an anterior slow wave (SW) after 700 ms. Finally, response activity in supplementary motor area during a posterior SW after 900 ms showed impoverishment effects that correlated with RTs. Convergent evidence from studies of vision, memory, and mental imagery which reflects purely top-down inputs, indicates that the N3 reflects the critical top-down processes of PHT. A hybrid multiple-state interactive, PHT and decision theory best explains the visual constancy of object cognition. (shrink)

The early right anterior negativity (ERAN) in event-related potentials (ERPs) is typically elicited by syntactically unexpected events in Western tonal music. We examined how visual predictive information influences syntactic processing, how musical or non-musical cues have different effects, and how they interact with sequential effects between trials, which could modulate with the strength of the sense of established tonality. The EEG was recorded from musicians who listened to chord sequences paired with one of four types of visual (...) stimuli; two provided predictive information about the syntactic validity of the last chord through either musical notation of the whole sequence, or the word “regular” or “irregular”, while the other two, empty musical staves or a blank screen, provided no information. Half of the sequences ended with the syntactically invalid Neapolitan sixth chord, while the other half ended with the Tonic chord. Clear ERAN was observed in frontocentral electrodes in all conditions. A principal component analysis was performed on the grand average response in the audio-only condition, to separate spatio-temporal dynamics of different scalp areas as principal components and use them to extract auditory-related neural activities in the other visual-cue conditions. The first principal component (PC1) showed a symmetrical frontocentral topography, while the second (PC2) showed a right-lateralized frontal concentration. A source analysis confirmed the relative contribution of temporal sources to the former and a right frontal source to the latter. Cue predictability affected only the ERAN projected onto PC1, especially when the previous trial ended with the Tonic chord. The ERAN in PC2 was reduced in the trials following Neapolitan endings in general. However, the extent of this reduction differed between cue-types, whereby it was nearly absent when musical notation was used, regardless of whether the staves were filled with notes or empty. The results suggest that the right frontal areas carry out the primary role in musical syntactic analysis and integration of the ongoing context, which produce schematic expectations that, together with the veridical expectation incorporated by the temporal areas, inform musical syntactic processing in musicians. (shrink)

If the cortex is an associative memory, strongly connected cell assemblies will form when neurons in different cortical areas are frequently active at the same time. The cortical distributions of these assemblies must be a consequence of where in the cortex correlated neuronal activity occurred during learning. An assembly can be considered a functional unit exhibiting activity states such as full activation (“ignition”) after appropriate sensory stimulation (possibly related to perception) and continuous reverberation of excitation within the assembly (a putative (...) memory process). This has implications for cortical topographies and activity dynamics of cell assemblies forming during language acquisition, in particular for those representing words. Cortical topographies of assemblies should be related to aspects of the meaning of the words they represent, and physiological signs of cell assembly ignition should be followed by possible indicators of reverberation. The following postulates are discussed in detail: (1) assemblies representing phonological word forms are strongly lateralized and distributed over perisylvian cortices; (2) assemblies representing highly abstract words such as grammatical function words are also strongly lateralized and restricted to these perisylvian regions; (3) assemblies representing concrete content words include additional neurons in both hemispheres; (4) assemblies representing words referring to visual stimuli include neurons in visual cortices; and (5) assemblies representing words referring to actions include neurons in motor cortices. Two main sources of evidence are used to evaluate these proposals: (a) imaging studies focusing on localizing word processing in the brain, based on stimulus-triggered event-related potentials (ERPs), positron emission tomography (PET), and functional magnetic resonance imaging (fMRI), and (b) studies of the temporal dynamics of fast activity changes in the brain, as revealed by high-frequency responses recorded in the electroencephalogram (EEG) and magnetoencephalogram (MEG). These data provide evidence for processing differences between words and matched meaningless pseudowords, and between word classes, such as concrete content and abstract function words, and words evoking visual or motor associations. There is evidence for early word class-specific spreading of neuronal activity and for equally specific high-frequency responses occurring later. These results support a neurobiological model of language in the Hebbian tradition. Competing large-scale neuronal theories of language are discussed in light of the data summarized. Neurobiological perspectives on the problem of serial order of words in syntactic strings are considered in closing. Key Words: associative learning; cell assembly; cognition; cortex; ERP; EEG; fMRI; language; lexicon; MEG; PET; word category. (shrink)

The two contrasting theoretical approaches to visual perception, the constructivist and the ecological, are briefly presented and illustrated through their analyses of space and size perception. Earlier calls for their reconciliation and unification are reviewed. Neurophysiological, neuropsychological, and psychophysical evidence for the existence of two quite distinct visual systems, the ventral and the dorsal, is presented. These two perceptual systems differ in their functions; the ventral system's central function is that of identification, while the dorsal system is mainly (...) engaged in the visual control of motor behavior. The strong parallels between the ecological approach and the functioning of the dorsal system, and between the constructivist approach and the functioning of the ventral system are noted. It is also shown that the experimental paradigms used by the proponents of these two approaches match the functions of the respective visual systems. A dual-process approach to visual perception emerges from this analysis, with the ecological-dorsal process transpiring mainly without conscious awareness, while the constructivist-ventral process is normally conscious. Some implications of this dual-process approach to visual-perceptual phenomena are presented, with emphasis on space perception. Key Words: constructivist; dual-process approach; ecological; size perception; space perception; two visual systems; visual perception theories. (shrink)

When a piece of fruit is in a bowl, and the bowl is on a table, we appreciate not only the individual objects and their features, but also the relations containment and support, which abstract away from the particular objects involved. Independent representation of roles (e.g., containers vs. supporters) and “fillers” of those roles (e.g., bowls vs. cups, tables vs. chairs) is a core principle of language and higherlevel reasoning. But does such role-filler independence also arise in automatic visual (...) processing? Here, we show that it does, by exploring a surprising error that such independence can produce. In four experiments, participants saw a stream of images containing different objects arranged in forcedynamic relations — e.g., a phone contained in a basket, a marker resting on a garbage can, or a knife sitting in a cup. Participants had to respond to a single target image (e.g., a phone in a basket) within a stream of distractors presented under time constraints. Surprisingly, even though participants completed this task quickly and accurately, they false-alarmed more often to images matching the target’s relational category than to those that did not — even when those images involved completely different objects. In other words, participants searching for a phone in a basket were more likely to mistakenly respond to a knife in a cup than to a marker on a garbage can. Follow-up experiments ruled out strategic responses and also controlled for various confounding image features. We suggest that visual processing represents relations abstractly, in ways that separate roles from fillers. (shrink)

We investigated the effects of everyday language exposure on the prediction of orthographic and phonological forms of a highly predictable word during listening comprehension. Native Japanese speakers in Tokyo (Experiment 1) and Berlin (Experiment 2) listened to sentences that contained a predictable word and viewed four objects. The critical object represented the target word (e.g., /sakana/;fish), an orthographic competitor (e.g., /tuno/;horn), a phonological competitor (e.g., /sakura/;cherry blossom), or an unrelated word (e.g., /hon/;book). The three other objects (...) were distractors. The Tokyo group fixated the target and the orthographic competitor over the unrelated objects before the target word was mentioned, suggesting that they pre-activated the orthographic form of the target word. The Berlin group showed a weaker bias toward the target than the Tokyo group, and they showed a tendency to fixate the orthographic competitor only when the orthographic similarity was very high. Thus, prediction effects were weaker in the Berlin group than in the Tokyo group. We found no evidence for the prediction of phonological information. The obtained group differences support probabilistic models of prediction, which regard the built-up language experience as a basis of prediction. (shrink)

Recent studies have documented substantial variability among typical listeners in how gradiently they categorize speech sounds, and this variability in categorization gradience may link to how listeners weight different cues in the incoming signal. The present study tested the relationship between categorization gradience and cue weighting across two sets of English contrasts, each varying orthogonally in two acoustic dimensions. Participants performed a four‐alternative forced‐choice identification task in a visual world paradigm while their eye movements were monitored. We found that (...) (a) greater categorization gradience derived from behavioral identification responses corresponds to larger secondary cue weights derived from eye movements; (b) the relationship between categorization gradience and secondary cue weighting is observed across cues and contrasts, suggesting that categorization gradience may be a consistent within‐individual property in speech perception; and (c) listeners who showed greater categorization gradience tend to adopt a buffered processing strategy, especially when cues arrive asynchronously in time. (shrink)

During the COVID-19 pandemic, questions have been raised about the impact of face masks on communication in classroom settings. However, it is unclear to what extent visual obstruction of the speaker’s mouth or changes to the acoustic signal lead to speech processing difficulties, and whether these effects can be mitigated by semantic predictability, i.e., the availability of contextual information. The present study investigated the acoustic and visual effects of face masks on speech intelligibility and processing speed (...) under varying semantic predictability. Twenty-six children and twenty-six adults performed an internet-based cued shadowing task, in which they had to repeat aloud the last word of sentences presented in audio-visual format. The results showed that children and adults made more mistakes and responded more slowly when listening to face mask speech compared to speech produced without a face mask. Adults were only significantly affected by face mask speech when both the acoustic and the visual signal were degraded. While acoustic mask effects were similar for children, removal of visual speech cues through the face mask affected children to a lesser degree. However, high semantic predictability reduced audio-visual mask effects, leading to full compensation of the acoustically degraded mask speech in the adult group. Even though children did not fully compensate for face mask speech with high semantic predictability, overall, they still profited from semantic cues in all conditions. Therefore, in classroom settings, strategies that increase contextual information such as building on students’ prior knowledge, using keywords, and providing visual aids, are likely to help overcome any adverse face mask effects. (shrink)

Number processing abilities are important for academic and personal development. The course of initial specialization of ventral occipito-temporal cortex sensitivity to visual number processing is crucial for the acquisition of numeric and arithmetic skills. We examined the visual N1, the electrophysiological correlate of vOTC activation across five time points in kindergarten, middle and end of first grade, second grade, and fifth grade. A combination of cross-sectional and longitudinal EEG data of a total of 62 children at (...) varying familial risk for dyslexia were available to form groups of 23, 22, 27, 27, and 42 participants for each of the five time points. The children performed a target detection task which included visual presentation of single digits, false fonts, and letters to derive measures for coarse and fine digit sensitive processing across development. The N1 amplitude analyses indicated coarse and fine sensitivity characterized by a stronger N1 to digits than false fonts across all five time points, and stronger N1 to digits than letters at all but the second time point. In addition, lower arithmetic skills were associated with stronger coarse N1 digit sensitivity over the left hemisphere in second grade, possibly reflecting allocation of more attentional resources or stronger reliance on the verbal system in children with poorer arithmetic skills. To summarize, our results show persistent visual N1 sensitivity to digits that is already present early on in pre-school and remains stable until fifth grade. This pattern of digit sensitivity development clearly differs from the relatively sharp rise and fall of the visual N1 sensitivity to words or letters between kindergarten and middle of elementary school and suggests unique developmental trajectories for visual processing of written characters that are relevant to numeracy and literacy. (shrink)