Much research has explored developing sound representations in language, but less work addresses developing representations of other sound patterns. This study examined preschool children's musical representations using two different tasks: discrimination and sound–picture association. Melodic contour—a musically relevant property—and instrumental timbre, which is less musically relevant, were tested. In Experiment 1, children failed to associate cartoon characters to melodies with maximally different pitch contours, with no advantage for melody preexposure. Experiment 2 also used different-contour melodies and found good discrimination, whereas (...) association was at chance. Experiment 3 replicated Experiment 2, but with a large timbre change instead of a contour change. Here, discrimination and association were both excellent. Preschool-aged children may have stronger or more durable representations of timbre than contour, particularly in more difficult tasks. Reasons for weaker association of contour than timbre information are discussed, along with implications for auditory development. (shrink)

Voluntary stream segregation was investigated in cochlear implant users and normal-hearing listeners using a segregation-promoting objective approach which evaluated the role of spectral and amplitude-modulation rate separations on stream segregation and its build-up. Sequences of 9 or 3 pairs of A and B narrowband noise bursts were presented which differed in either center frequency of the noise band, the AM-rate, or both. In some sequences, the last B burst was delayed by 35 ms from their otherwise-steady temporal position. In the (...) other sequences, the last B bursts were temporally advanced from 0 to 10 ms. A single interval yes/no procedure was utilized to measure participants’ sensitivity in identifying delayed vs. no-delay sequences. A higher d′ value showed the higher ability to segregate the A and B subsequences. For NH listeners, performance improved with each spectral separation. However, for CI users, performance was only significantly better for the condition with the largest spectral separation. Additionally, performance was significantly poorer for the largest AM-rate separation than for the condition with no AM-rate separation for both groups. The significant effect of sequence duration in both groups indicated that listeners made more improvement with lengthening the duration of stimulus sequences, supporting the build-up effect. The results of this study suggest that CI users are less able than NH listeners to segregate NBN bursts into different auditory streams when they are moderately separated in the spectral domain. Contrary to our hypothesis, our results indicate that AM-rate separation may interfere with the segregation of streams of NBN. Additionally, our results add evidence to the literature that CI users build up stream segregation at a rate comparable to NH listeners, when the inter-stream spectral separations are adequately large. (shrink)

Primary progressive aphasia is a clinical syndrome in which patients progressively lose speech and language abilities. Three variants are recognized: logopenic, associated with phonology and/or short-term verbal memory deficits accompanied by left temporo-parietal atrophy; semantic, associated with semantic deficits and anterior temporal lobe atrophy; non-fluent associated with grammar and/or speech-motor deficits and inferior frontal gyrus atrophy. Here, we set out to investigate whether the three variants of PPA can be dissociated based on error patterns in a single language task. We (...) recruited 21 lvPPA, 28 svPPA, and 24 nfvPPA patients, together with 31 healthy controls, and analyzed their performance on an auditory noun-to-verb generation task, which requires auditory analysis of the input, access to and selection of relevant lexical and semantic knowledge, as well as preparation and execution of speech. Task accuracy differed across the three variants and controls, with lvPPA and nfvPPA having the lowest and highest accuracy, respectively. Critically, machine learning analysis of the different error types yielded above-chance classification of patients into their corresponding group. An analysis of the error types revealed clear variant-specific effects: lvPPA patients produced the highest percentage of “not-a-verb” responses and the highest number of semantically related nouns ; in contrast, svPPA patients produced the highest percentage of “unrelated verb” responses and the highest number of light verbs. Taken together, our findings indicate that error patterns in an auditory verb generation task are associated with the breakdown of different neurocognitive mechanisms across PPA variants. Specifically, they corroborate the link between temporo-parietal regions with lexical processing, as well as ATL with semantic processes. These findings illustrate how the analysis of pattern of responses can help PPA phenotyping and heighten diagnostic sensitivity, while providing insights on the neural correlates of different components of language. (shrink)

ObjectivesTo document the auditory processing, visual attention, digit memory, phonological processing, and receptive language abilities of individual children with identified word reading difficulties.DesignTwenty-four children with word reading difficulties and 28 control children with good word reading skills participated. All children were aged between 8 and 11 years, with normal hearing sensitivity and typical non-verbal intelligence. Both groups of children completed a test battery designed to assess their auditory processing, visual attention, digit memory, phonological processing, and receptive language.ResultsWhen (...) compared to children who were good readers, children with word reading difficulties obtained significantly lower average scores on tests of auditory processing, including the frequency pattern test, gaps in noise, frequency discrimination, Dichotic Digit difference Test, and Listening in Spatialized Noise. The two groups did not differ on the discrimination measures of sinusoidal amplitude modulation or iterated rippled noise. The results from children with word reading difficulties showed that 5 children (21%) had comorbid deficits in auditory processing, visual attention, and backward digit memory; whereas 12 children (50%) had comorbid auditory processing and visual attention deficits only, and 2 children (8%) had comorbid deficits in auditory processing and digit memory; the remaining children had only auditory processing, visual attention, or digit memory deficits.ConclusionThe current study highlights the general co-existence of auditory processing, memory, and visual attention deficits in children with word reading difficulties. It is also noteworthy, however, that only one fifth of the current cohort had deficits across all measured tasks. Hence, our results also show the significant individual variability inherent in children with word reading difficulties. (shrink)

This study aimed to explore the psychophysical bases of multisensory surface stickiness perception by investigating how sensitively humans perceive different levels of stickiness intensity conveyed by auditory, tactile, and visual cues. First, we sorted five different sticky stimuli by perceived intensity in ascending order for each modality separately and evaluated the discrimination sensitivities of each participant using a fitted psychometric curve. Results showed that perceptual intensity orders were not identical to physical intensity order and that the sequential order of (...) perceived intensities for different modalities was inconsistent. Moreover, estimated perceptual sensitivities to surface stickiness indicated that auditory cues result in better discrimination sensitivity than tactile and visual cues. Second, we calculated the relative perceptual distances of stickiness intensities using multidimensional scaling. A follow-up statistical test demonstrated that the perceptual mapping of vision and touch are similar but that auditory perception is different. These results suggest that the discriminability of stickiness intensity is best served by auditory cues and that texture information processing in the auditory domain is distinctive from that of other modalities. (shrink)

Audiovisual interaction in speech perception is well defined in adults. Despite the large body of evidence suggesting that children are also sensitive to visual input, very few empirical studies have been conducted. To further investigate whether visual inputs influence auditory perception of phonemes in preschoolers in the same way as in adults, we conducted an audiovisual identification test. The auditory stimuli were presented either in an auditory condition only or simultaneously with a visual presentation of the articulation (...) of the vowel /e/ or /ø/. The results suggest that, although all participants experienced visual influence on auditory perception, substantial individual differences exist in the 5- to 6-year-old group. While additional work is required to confirm this hypothesis, we suggest that auditory and visual systems are developing at that age and that multisensory phonological categorization of the rounding contrast took place only in children whose sensory systems and sensorimotor representations were mature. (shrink)

Excessive dog barking is among the leading sources of noise pollution world-wide; however, the reasons for the annoyance of barking to people remained uninvestigated. Our questions were: is the annoyance rating affected by the acoustic parameters of barks; does the attributed inner state of the dog and the nuisance caused by its barks correlate; does the gender and country of origin affect the subjects’ sensitivity to barking. Participants from Hungary (N = 100) and Brazil (N = 60) were tested (...) with sets of 27 artificial bark sequences. Subjects rated each bark according to the inner state of the dog and the annoyance caused by the particular bark. Subjects from both countries found high-pitched barks the most annoying: however, harsh, fast-pulsing, low-pitched barks were also unpleasant. Men found high-pitched barks more annoying than the women did. Annoyance ratings showed positive correlation with assumed negative inner states of the dog, positive emotional ratings showed negative correlation with the annoyance level. This is the first indication that acoustic features that were selected for effective vocal signalling may be annoying for human listeners. Among the explanations for this effect the role of affective communication and similar bioacoustics of particular animal vocalizations and baby cries are discussed. (shrink)

What makes a human voice agreeable is a matter of scientific discussion. Whereas prosody was shown to play a role regarding “male-female” attraction, the impact of frequency modulations in “non-sexual”, notably commercial, contexts has attracted little attention. Another point unaddressed in the literature is auditory sensitivity to short-term frequency modulations as current studies focus more on sentence. Thirty French female operators were recorded over the phone. All “bonjour” greeting words were classified in terms of frequency modulation linearity and (...) orientation at the syllable and word levels. Then, the different voices were played back to students and seniors who had to rate each voice according to their degree of agreeableness. Listeners preferred non-monotonous voices. Differences between age-classes were greater than between sex-classes. Results suggest that short-term frequency changes are important for auditory evaluation of voice agreeableness. This study opens new research perspectives concerning the importance of prosody during consumer-seller interactions. (shrink)

The sensitive period for phonetic learning, evidenced by improved native speech processing and declined non-native speech processing, represents an early milestone in language acquisition. We examined the extent that sensory encoding of speech is altered by experience during this period by testing two hypotheses: early sensory encoding of non-native speech declines as infants gain native-language experience, and music intervention reverses this decline. We longitudinally measured the frequency-following response, a robust indicator of early sensory encoding along the auditory pathway, to (...) a Mandarin lexical tone in 7- and 11-months-old monolingual English-learning infants. Infants received either no intervention or music intervention randomly between FFR recordings. The language-experience group exhibited the expected decline in FFR pitch-tracking accuracy to the Mandarin tone, while the music-intervention group did not. Our results support both hypotheses and demonstrate that both language and music experiences alter infants’ speech encoding. (shrink)

Sound symbolism refers to non‐arbitrary mappings between the sounds of words and their meanings and is often studied by pairing auditory pseudowords such as “maluma” and “takete” with rounded and pointed visual shapes, respectively. However, it is unclear what auditory properties of pseudowords contribute to their perception as rounded or pointed. Here, we compared perceptual ratings of the roundedness/pointedness of large sets of pseudowords and shapes to their acoustic and visual properties using a novel application of representational similarity (...) analysis (RSA). Representational dissimilarity matrices (RDMs) of the auditory and visual ratings of roundedness/pointedness were significantly correlated crossmodally. The auditory perceptual RDM correlated significantly with RDMs of spectral tilt, the temporal fast Fourier transform (FFT), and the speech envelope. Conventional correlational analyses showed that ratings of pseudowords transitioned from rounded to pointed as vocal roughness (as measured by the harmonics‐to‐noise ratio, pulse number, fraction of unvoiced frames, mean autocorrelation, shimmer, and jitter) increased. The visual perceptual RDM correlated significantly with RDMs of global indices of visual shape (the simple matching coefficient, image silhouette, image outlines, and Jaccard distance). Crossmodally, the RDMs of the auditory spectral parameters correlated weakly but significantly with those of the global indices of visual shape. Our work establishes the utility of RSA for analysis of large stimulus sets and offers novel insights into the stimulus parameters underlying sound symbolism, showing that sound‐to‐shape mapping is driven by acoustic properties of pseudowords and suggesting audiovisual cross‐modal correspondence as a basis for language users' sensitivity to this type of sound symbolism. (shrink)

BackgroundSome children appear to not hear well in class despite normal hearing sensitivity. These children may be referred for auditory processing disorder (APD) assessment but can also have attention, language, and/or reading disorders. Despite presenting with similar concerns regarding hearing difficulties in difficult listening conditions, the overall profile of deficits can vary in children with suspected or confirmed APD. The current study used cluster analysis to determine whether subprofiles of difficulties could be identified within a cohort of children (...) presenting for auditory processing assessment.MethodsNinety school-aged children (7–13 years old) with suspected APDs were included in a cluster analysis. All children had their reading, language, cognition and auditory processing assessed. Parents also completed the Children’s Auditory Performance Scale (CHAPS). Cluster analysis was based on tasks where age-norms were available, including word reading (Castles and Coltheart irregular and non-words test), phonological awareness (Queensland University Inventory of Literacy), language [Comprehensive Language of Assessment-4, Comprehensive Assessment of Spoken Language (CASL)], sustained attention (Continuous Performance Test), working memory (digits forward and backward), and auditory processing [Frequency Pattern Test (FPT), Dichotic Digits Test (DDT)]. Hierarchical cluster analysis was undertaken to determine the optimal number of clusters for the data, followed by... (shrink)

Cognitive Science, Volume 46, Issue 2, February 2022.

Three experiments investigated the nature of visuo-auditory crossmodal cueing in a triadic setting: participants had to detect an auditory signal while observing another agent’s head facing one of the two laterally positioned auditory sources. Experiment 1 showed that when the agent’s eyes were open, sounds originating on the side of the agent’s gaze were detected faster than sounds originating on the side of the agent’s visible ear; when the agent’s eyes were closed this pat-tern of responses was (...) reversed. Two additional experiments showed that the results were sensitive to whether participants could infer a hearing function on the part of the agent. When no ear was depicted on the agent, only a gaze-side advantage was observed , but when the agent’s ear was covered , an ear side advantage was observed only when hearing could still be inferred but not when hearing was inferred to be diminished . The findings are discussed in the context of inferential and simulation processes and joint attention mechanisms. (shrink)

This investigation examined age-related differences in auditory-visual integration as reflected on perceptual judgments of temporally misaligned AV English sentences spoken by native English and native Spanish talkers. In the detection task, it was expected that slowed auditory temporal processing of older participants, relative to younger participants, would be manifest as a shift in the range over which participants would judge asynchronous stimuli as synchronous. The older participants were also expected to exhibit greater declines in speech recognition for asynchronous (...) AV stimuli than younger participants. Talker accent was hypothesized to influence listener performance, with older listeners exhibiting a greater narrowing of the AV simultaneity window and much poorer recognition of asynchronous AV foreign-accented speech compared to younger listeners. Participant groups included younger and older participants with normal hearing and older participants with hearing loss. Stimuli were video recordings of sentences produced by native English and native Spanish talkers. The video recordings were altered in 50 ms steps by delaying either the audio or video onset. Participants performed a detection task in which they judged whether the sentences were synchronous or asynchronous, and performed a recognition task for multiple synchronous and asynchronous conditions. Both the detection and recognition tasks were conducted at the individualized signal-to-noise ratio corresponding to approximately 70% correct speech recognition performance for synchronous AV sentences. Older listeners with and without hearing loss generally showed wider AV simultaneity windows than younger listeners, possibly reflecting slowed auditory temporal processing in auditory lead conditions and reduced sensitivity to asynchrony in auditory lag conditions. However, older and younger listeners were affected similarly by misalignment of auditory and visual signal onsets on the speech recognition task. This suggests that older listeners are negatively impacted by temporal misalignments for speech recognition, even when they do not notice that the stimuli are asynchronous. Overall, the findings show that when listener performance is equated for simultaneous AV speech signals, age effects are apparent in detection judgments but not in recognition of asynchronous speech. (shrink)

Background:The Taiwan Nursing Accreditation Council has proposed eight core professional nursing qualities including ethical literacy. Consequently, nursing ethics education is a required course for student nurses. These courses are intended to improve the ethical literacy. Moral sensitivity is the cornerstone of ethical literacy, and learning moral sensitivity is the initial step towards developing ethical literacy.Objectives:To explore the effect of nursing ethics educational interventions based on multiple teaching strategies on student nurses moral sensitivity. Based on the visual, (...) class='Hi'>auditory and kinaesthetic model, three strategies were developed for determining the programme components and corresponding learning styles.Research design:This was a quasi-experimental study.Participants:A total of 234 junior-college student nurses participated in this study. All participants were aged 18–19 years.Ethical considerations:The study protocol was approved by the institutional review boards of Kaohsiung Veterans General Hospital. Only the participants who signed an informed consent form took part in the study. The participants were permitted to withdraw from the study at any point if they wished to do so without affecting their academic score.Results:The scores of Modified Moral Sensitivity Questionnaire for Student Nurses were significantly improved after the intervention of integrating multiple teaching strategies. Significant relationships were observed between the satisfaction scores of two teaching strategies and moral sensitivity. The results indicated that using multiple teaching strategies is effective for promoting nursing ethics learning.Conclusion:This strategy was consistent with the student nurses’ preferred learning style and was used to correct their erroneous ethical conceptions, assisting in developing their ethical knowledge. (shrink)

A tendency of auditory cortical neurons to respond at the beginning of major transitions in sounds rather than providing a continuously updated spectral-temporal profile may impede the generation of combination-sensitivity for certain classes of stimuli. Potential consequences of the cortical encoding of voiced stop-consonants on representational principles derived from orderly output constraints are discussed.

Exposure to delayed sensory feedback changes perceived simultaneity between action and feedback [temporal recalibration ] and even modulates the sense of agency over the feedback. To date, however, it is not clear whether the modulation of SoA by TR is caused by a change in perceptual sensitivity or decision criterion of self-agency. This experimental research aimed to tease apart these two by applying the signal detection theory to the agency judgment over auditory feedback after voluntary action. Participants heard (...) a short sequence of tone pips with equal inter-onset intervals, and they reproduced it by pressing a computer mouse. The delay of each tone pip after the mouse press was manipulated as 80 or 180 ms. Subsequently, the participants reproduced it, in which the delay was fixed at 80 ms and there was a 50% chance that the computer took over the control of the tone pips from the participants. The participants’ task was to discriminate who controlled the tone pips and to judge synchrony between tone pips and mouse presses. Results showed that the modulation of the SoA by the TR is caused by a shift in the decision criterion but not in the perceptual sensitivity of agency. (shrink)

Audiologic assessment of infants and young children with suspected hearing loss requires selection of differential diagnostic techniques that are age-appropriate and appropriate to the child’s developmental capabilities. Objective assessment includes electrophysiologic and electroacoustic methods: otoacoustic emissions, auditory brainstem response, auditory steady-state response, tympanometry and acoustic reflex. The use of behavioural methods in audiologic assessment requires a response from the patient. Depending on the child’s age, the following methods can be performed: visual reinforcement audiometry, conditioned play audiometry, pure tone (...) audiometry, and speech audiometry. Audiologic assessment in infants and children provides estimation of auditory sensitivity, evaluation of the integrity of auditory system andidentification of possible intervention options in case of existing hearing loss. Early detection and treatment of hearing loss in childhood is essential to ensure optimal speech and language development in the early years of life and optimal school performance for older children. (shrink)

© 2016 Elsevier LtdJumping spiders are famous for their visually driven behaviors [1]. Here, however, we present behavioral and neurophysiological evidence that these animals also perceive and respond to airborne acoustic stimuli, even when the distance between the animal and the sound source is relatively large and with stimulus amplitudes at the position of the spider of ∼65 dB sound pressure level. Behavioral experiments with the jumping spider Phidippus audax reveal that these animals respond to low-frequency sounds by freezing—a common (...) anti-predatory behavior characteristic of an acoustic startle response. Neurophysiological recordings from auditory-sensitive neural units in the brains of these jumping spiders showed responses to low-frequency tones —recordings that also represent the first record of acoustically responsive neural units in the jumping spider brain. Responses persisted even when the distances between spider and stimulus source exceeded 3 m and under anechoic conditions. Thus, these spiders appear able to detect airborne sound at distances in the acoustic far-field region, beyond the near-field range often thought to bound acoustic perception in arthropods that lack tympanic ears [2]. Furthermore, direct mechanical stimulation of hairs on the patella of the foreleg was sufficient to generate responses in neural units that also responded to airborne acoustic stimuli—evidence that these hairs likely play a role in the detection of acoustic cues. We suggest that these auditory responses enable the detection of predators and facilitate an acoustic startle response. Video. (shrink)

Humans are capable of extracting recurring patterns from their environment via statistical learning (SL), an ability thought to play an important role in language learning and learning more generally. While much work has examined statistical learning in infants and adults, less work has looked at the developmental trajectory of SL during childhood to see whether it is fully developed in infancy or improves with age, like many other cognitive abilities. A recent study showed modality‐based differences in the effect of age (...) during childhood: While visual SL improved with age, auditory SL did not. This finding was taken as evidence for modality‐based differences in SL. However, since that study used auditory linguistic stimuli (syllables), the differential effect of age may have been driven by stimulus type (linguistic vs. non‐linguistic) rather than modality. Here, we ask whether age will affect performance similarly in the two modalities when non‐linguistic auditory stimuli are used (familiar sounds instead of syllables). We conduct a large‐scale study of children's performance on visual and non‐linguistic auditory SL during childhood (ages 5–12 years). The results show a similar effect of age in both modalities: Unlike previous findings, both visual and non‐linguistic auditory SL improved with age. These findings highlight the stimuli‐sensitive nature of SL and suggest that modality‐based differences may be stimuli‐dependent, and that age‐invariance may be limited to linguistic stimuli. (shrink)

Previous studies of auditory statistical learning have typically presented learners with sequential structural information that is uniformly distributed across the entire exposure corpus. Here we present learners with nonuniform distributions of structural information by altering the organization of trisyllabic nonsense words at midstream. When this structural change was unmarked by low‐level acoustic cues, or even when cued by a pitch change, only the first of the two structures was learned. However, both structures were learned when there was an explicit (...) cue to the midstream change or when exposure to the second structure was tripled in duration. These results demonstrate that successful extraction of the structure in an auditory statistical learning task reduces the ability to learn subsequent structures, unless the presence of two structures is marked explicitly or the exposure to the second is quite lengthy. The mechanisms by which learners detect and use changes in distributional information to maintain sensitivity to multiple structures are discussed from both behavioral and computational perspectives. (shrink)

The human experience is shaped by information from different perceptual channels, but it is still debated whether and how differential experience influences language use. To address this, we compared congenitally blind, blindfolded, and sighted people's descriptions of the same motion events experienced auditorily by all participants (i.e., via sound alone) and conveyed in speech and gesture. Comparison of blind and sighted participants to blindfolded participants helped us disentangle the effects of a lifetime experience of being blind versus the task-specific effects (...) of experiencing a motion event by sound alone. Compared to sighted people, blind people's speech focused more on path and less on manner of motion, and encoded paths in a more segmented fashion using more landmarks and path verbs. Gestures followed the speech, such that blind people pointed to landmarks more and depicted manner less than sighted people. This suggests that visual experience affects how people express spatial events in the multimodal language and that blindness may enhance sensitivity to paths of motion due to changes in event construal. These findings have implications for the claims that language processes are deeply rooted in our sensory experiences. (shrink)

Postnatal parent-infant physiological regulatory effects described in the previous paper (Part I) are viewed here as being biologically contiguous with events that occur prenatally, preparing and sensitizing the fetus to the average microenvironment into which the infant is expected, based on its evolutionary past, to be born. Following McKenna (1986), evidence (some of which is circumstantial) is presented concerning fetal hearing and fetal amniotic liquid breathing as they are affected both by maternal cardiovascular blood flow sounds in the uterus and (...) by fluctuating maternal blood sugar levels. These data are linked in turn to the infant’s postulated postnatal responsivity to parental sensory cues, including auditory and vestibular respiratory cues that may assist infants as they “learn” to breathe and, for some, to resist a SIDS event. Data on the respiratory and vocalizing behavior of normal and hearing-impaired persons are used to show that not all forms of human breathing are innate; some forms develop with experience. These data reveal how human infants learn, for example, to coordinate higher and lower brain respiratory nuclei in the context of learning initially to cry with intent and purpose and later to speak. Voluntary, cortex-based breathing emerges at the same time that infants are most likely to die from SIDS, between 2 and 4 months of age. This switch between voluntary and involuntary breathing during both sleep (while dreaming) and wake cycles, which depends on the integration of higher cortical and lower brain stem nuclei, is complex and is possibly the basis of the human species’ unique susceptibility to SIDS—a syndrome as yet unrecognized in other species. These human infant vulnerabilities, including delayed maturity, can explain in part why natural selection ought to favor increased infant sensitivity to parental sensory cues provided by a caregiver—stimuli available in the evolving parental care environment that included parent-infant co-sleeping for more than 4–5 million years of human evolution. (shrink)

Because human languages vary in sound and meaning, children must learn which distinctions their language uses. For speech perception, this learning is selective: initially infants are sensitive to most acoustic distinctions used in any language1–3, and this sensitivity reflects basic properties of the auditory system rather than mechanisms specific to language4–7; however, infants’ sensitivity to non-native sound distinctions declines over the course of the first year8. Here we ask whether a similar process governs learning of word meanings. (...) We investigated the sensitivity of 5-month-old infants in an English-speaking environment to a conceptual distinction that is marked in Korean but not English; that is, the distinction between ‘tight’ and ‘loose’ fit of one object to another9,10. Like adult Korean speakers but unlike adult English speakers, these infants detected this distinction and divided a continuum of motion-into-contact actions into tightand loose-fit categories. Infants’ sensitivity to this distinction is linked to representations of object mechanics11that are shared by non-human animals12–14. Language learning therefore seems to develop by linking linguistic forms to universal, pre-existing representations of sound and meaning. Our research focuses on the crosscutting conceptual distinctions between actions producing loose- and tight-fitting contact relationships (compare left and right columns in Fig. 1a) and actions producing containment versus support relationships (compare first and second rows in Fig. 1a). As early as Korean and English children begin to talk about such actions, they categorize them differently from one another and similarly to Korean- and Englishspeaking adults9,15. Moreover, English and Korean adults differ in their performance on non-linguistic categorization tasks involving heterogeneous examples of these actions, in accord with the differing semantics of their languages16,17, whereas the performance of young children on such tasks has been mixed9,10,18,19.. (shrink)

The computations involved in statistical learning have long been debated. Here, we build on work suggesting that a basic memory process, chunking, may account for the processing of statistical regularities into larger units. Drawing on methods from the memory literature, we developed a novel paradigm to test statistical learning by leveraging a robust phenomenon observed in serial recall tasks: that short‐term memory is fundamentally shaped by long‐term distributional learning. In the statistically induced chunking recall (SICR) task, participants are exposed to (...) an artificial language, using a standard statistical learning exposure phase. Afterward, they recall strings of syllables that either follow the statistics of the artificial language or comprise the same syllables presented in a random order. We hypothesized that if individuals had chunked the artificial language into word‐like units, then the statistically structured items would be more accurately recalled relative to the random controls. Our results demonstrate that SICR effectively captures learning in both the auditory and visual modalities, with participants displaying significantly improved recall of the statistically structured items, and even recall specific trigram chunks from the input. SICR also exhibits greater test–retest reliability in the auditory modality and sensitivity to individual differences in both modalities than the standard two‐alternative forced‐choice task. These results thereby provide key empirical support to the chunking account of statistical learning and contribute a valuable new tool to the literature. (shrink)

As recently highlighted, despite a burgeoning field of sensory ethnography, the practices, production, and accountability of the senses in specific social interactional contexts remain sociologically under-explored. To contribute original insights to a literature on the sensuous body in physical–cultural contexts, here we adopt an ethnomethodologically sensitive perspective to focus on the accomplishment, social organization, and accountability of sensoriality in interaction. Exploring instances of the senses at work in social interaction, we utilize data from two ethnographic research projects to investigate the (...) production of running-together and swimming-together by skilled, experienced practitioners. We focus on two interlinked sensory modalities: auditory attunement, and vision and intercorporeality, identified as key dimensions of sensory embodiment and “togethering” in these particular domains. (shrink)

Perceptual modalities have been traditionally considered the product of dedicated biological systems producing information for higher cognitive processing. Psychological and neuropsychological evidence is offered which undermines this point of view and an alternative account of modality from the enactive approach to understanding cognition is suggested. Under this view, a perceptual modality is a stable form of perception which is structured not just by the biological sensitivities of the agent, but by their goals and the set of skills or expertise which (...) they are deploying at a given time. Such a view suggests that there is no such thing as an experience that is purely visual, auditory, or otherwise modal and that our attempts to understand consciousness and the mind must be conducted within a framework that provides an account of embodied, goal-directed adaptive coping with the world. (shrink)

This chapter offers the beginning of an enactive account of auditory experience—particularly the experience of listening sensitively to music. It investigates how sensorimotor regularities grant perceptual access to music qua music. Two specific claims are defended: (1) music manifests experientially as having complex spatial content; (2) sensorimotor regularities constrain this content. Musical content is thus brought to phenomenal presence by bodily exploring structural features of music. We enact musical content.

Lip reading is the ability to partially understand speech by looking at the speaker's lips. It improves the intelligibility of speech in noise when audio-visual perception is compared with audio-only perception. A recent set of experiments showed that seeing the speaker's lips also enhances sensitivity to acoustic information, decreasing the auditory detection threshold of speech embedded in noise [J. Acoust. Soc. Am. 109 (2001) 2272; J. Acoust. Soc. Am. 108 (2000) 1197]. However, detection is different from comprehension, and (...) it remains to be seen whether improved sensitivity also results in an intelligibility gain in audio-visual speech perception. In this work, we use an original paradigm to show that seeing the speaker's lips enables the listener to hear better and hence to understand better. The audio-visual stimuli used here could not be differentiated by lip reading per se since they contained exactly the same lip gesture matched with different compatible speech sounds. Nevertheless, the noise-masked stimuli were more intelligible in the audio-visual condition than in the audio-only condition due to the contribution of visual information to the extraction of acoustic cues. Replacing the lip gesture by a non-speech visual input with exactly the same time course, providing the same temporal cues for extraction, removed the intelligibility benefit. This early contribution to audio-visual speech identification is discussed in relationships with recent neurophysiological data on audio-visual perception. (shrink)

Sensory deficits are a feature of autism and schizophrenia, as well as the upper end of their non-clinical spectra. The mismatch negativity, an index of pre-attentive auditory processing, is particularly sensitive in detecting such deficits; however, little is known about the relationship between the visual MMN to facial emotions and autism and schizophrenia spectrum symptom domains. We probed the vMMN to happy, sad, and neutral faces in 61 healthy adults, and evaluated their degree of autism and schizophrenia spectrum traits (...) using the Autism Spectrum Quotient and Schizotypal Personality Questionnaire. The vMMN to happy faces was significantly larger than the vMMNs to sad and neutral faces. The vMMN to happy faces was associated with interpersonal difficulties as indexed by AQ Communication and Attention to Detail subscales, and SPQ associated with more interpersonal difficulties. These data suggest that pre-attentive processing of positive affect might be more specific to the interpersonal features associated with autism and schizophrenia. These findings add valuable insights into the growing body of literature investigating symptom-specific neurobiological markers of autism and schizophrenia spectrum conditions. (shrink)

In order to uncover the inner workings of our capacities, we look to ‘effects’. Most of us have the capacity to distinguish between spoken ‘ba’ and ‘fa’ sounds. One thought is that this is achieved through aural sensitivities that detect changes in vibration picked up by the eardrum. But the McGurk Effect suggests that there is more to the story. Without changing the incoming vibrations, sound experience can be modulated by showing a video of a mouth making a ‘ba’ sound (...) or a ‘fa’ sound with a consistent sound overlaid. We learn that our overall auditory experiences are at least in part determined by visual cues in addition to what’s first picked up by our eardrums. The McGurk Effect gives us a hint into the inner workings of audition and helps us better understand the capacity to discriminate sounds of a certain sort. -/- In the present paper, the focus is on emotional capacities and a well known effect – recalcitrance. Recalcitrant emotions, such as fearing the dog even though one knows that the dog is harmless or being angry with one’s partner even when one realises it was only in a dream that the partner was nasty, have played the role of effect in much theorising about emotions. But in my view, we’ve stayed a bit too close to home, aiming to fit the effect into a paradigm – the representationalist paradigm – that isn’t fit for purpose. I will use this criticism as a launching off point to introduce a different way of thinking about emotions that is better suited to making sense of recalcitrance. I will argue that emotions are transitions between representational states rather than being representational states themselves. The view is better suited to make sense of recalcitrance and, at the end of the paper, I will offer reasons for thinking that main points that speak in favour of a representationalist approach to emotion can be recaptured or explained away by the transitions view. (shrink)