The pattern of ups and downs in a sequence with varying pitch can be heard as a melodic contour. Contrary to single pitch, the neural representation of melodic contour information in the auditory cortex is rarely investigated, and it is not clear whether the processing entails a hemispheric asymmetry. The present magnetoencephalography study assessed the neuromagnetic responses of N = 18 normal-hearing adults to four-note sequences with fixed vs. varying pitch that were presented either monaurally or diotically; data (...) were analyzed using minimum-norm reconstructions. The first note of the sequences elicited prominent transient activity in posterior auditory regions (Planum temporale), especially contralateral to the ear of entry. In contrast, the response to the subsequent notes originated from more anterior areas (Planum polare) and was larger for melodic contours than for fixed pitch sequences, independent from the ear of entry and without hemispheric asymmetry. Together, the results point to a gradient in the early cortical processing of melodic contours, both in spatial and functional terms, where posterior auditory activity reflects the onset of a pitch sequence and anterior activity reflects its subsequent notes, including the difference between sequences with fixed pitch and melodic contours. (shrink)

Current models of cortical speech and language processing include multiple regions within the temporal lobe of both hemispheres. Human communication, by necessity, involves complex interactions between regions subserving speech and language processing with those involved in more general cognitive functions. To assess these interactions, we utilized an ecologically salient conversation-based approach. This approach mandates that we first clarify activity patterns at the earliest stages of cortical speech processing. Therefore, we examined high gamma (70-150 Hz) responses within the electrocorticogram (ECoG) recorded (...) simultaneously from Heschl’s gyrus (HG) and lateral surface of the superior temporal gyrus (STG). Subjects were neurosurgical patients undergoing evaluation for treatment of medically intractable epilepsy. They performed an expanded version of the Mini-mental state examination (MMSE), which included additional spelling, naming, and memory-based tasks. ECoG was recorded from HG and the STG using multicontact depth and subdural electrode arrays, respectively. Differences in high gamma activity during listening to the interviewer and the subject's self-generated verbal responses were quantified for each recording site and across sites within HG and STG. The expanded MMSE produced widespread activation in auditory cortex of both hemispheres. No significant difference was found between activity during listening to the interviewer's questions and the subject's answers in posteromedial HG (auditory core cortex). A different pattern was observed throughout anterolateral HG and posterior and middle portions of lateral STG (non-core auditory cortical areas), where activity was significantly greater during listening compared to speaking. No systematic task-specific differences in the degree of suppression during speaking relative to listening were found in posterior and middle STG. Individual sites could, however, exhibit task-related variability in the degree of suppression during speaking compared to listening. The current study demonstrates that ECoG recordings can be acquired in time-efficient dialog-based paradigms, permitting examination of language and cognition in an ecologically salient manner. The results obtained from auditory cortex serve as a foundation for future studies addressing patterns of activity beyond auditory cortex that subserve human communication. (shrink)

In the social world, multiple sensory channels are used concurrently to facilitate communication. Among human and nonhuman pri- mates, faces and voices are the primary means of transmitting social signals (Adolphs, 2003; Ghazanfar and Santos, 2004). Primates recognize the correspondence between species-specific facial and vocal expressions (Massaro, 1998; Ghazanfar and Logothetis, 2003; Izumi and Kojima, 2004), and these visual and auditory channels can be integrated into unified percepts to enhance detection and discrimination. Where and how such communication signals are (...) integrated at the neural level are poorly understood. In particular, it is unclear what role “unimodal” sensory areas, such as the auditory cortex, may play. We recorded local field potential activity, the signal that best correlates with human imaging and event-related potential signals, in both the core and lateral belt regions of the auditory cortex in awake behaving rhesus monkeys while they viewed vocalizing conspecifics. We demonstrate unequivocally that the primate auditory cortex integrates facial and vocal signals through enhancement and suppression of field potentials in both the core and lateral belt regions. The majority of these multisensory responses were specific to face/voice integration, and the lateral belt region shows a greater frequency of multisensory integration than the core region. These multisensory processes in the auditory cortex likely occur via recip- rocal interactions with the superior temporal sulcus. (shrink)

Anatomical studies propose that the primate auditory cortex contains more fields than have actually been functionally confirmed or described. Spatially resolved functional magnetic resonance imaging (fMRI) with carefully designed acoustical stimulation could be ideally suited to extend our understanding of the processing within these fields. However, after numerous experiments in humans, many auditory fields remain poorly characterized. Imaging the macaque monkey is of particular interest as these species have a richer set of anatomical and neurophysiological data to (...) clarify the source of the imaged activity. We functionally mapped the auditory cortex of behaving and of anesthetized macaque monkeys with high resolution fMRI. By optimizing our imaging and stimulation procedures, we obtained robust activity throughout auditory cortex using tonal and band-passed noise sounds. Then, by varying the frequency content of the sounds, spatially specific activity patterns were observed over this region. As a result, the activity patterns could be assigned to many auditory cortical fields, including those whose functional properties were previously undescribed. The results provide an extensive functional tessellation of the macaque auditory cortex and suggest that 11 fields contain neurons tuned for the frequency of sounds. This study provides functional support for a model where three fields in primary auditory cortex are surrounded by eight neighboring ‘‘belt’’ fields in non-primary auditory cortex. The findings can now guide neurophysiological recordings in the monkey to expand our understanding of the processing within these fields. Additionally, this work will improve fMRI investigations of the human auditory cortex. (shrink)

Merging the information from different senses is essential for successful interaction with real-life situations. Indeed, sensory integration can reduce perceptual ambiguity, speed reactions, or change the qualitative sensory experience. It is widely held that integration occurs at later processing stages and mostly in higher association cortices; however, recent studies suggest that sensory convergence can occur in primary sensory cortex. A good model for early convergence proved to be the auditory cortex, which can be modulated by visual and (...) tactile stimulation; however, given the large number and small size of auditory fields, neither human imaging nor microelectrode recordings have systematically identified which fields are susceptible to multisensory influences. To reconcile findings from human imaging with anatomical knowledge from nonhuman primates, we exploited high-resolution imaging (functional magnetic resonance imaging) of the macaque monkey to study the modulation of auditory processing by visual stimulation. Using a functional parcellation of auditory cortex, we localized modulations to individual fields. Our results demonstrate that both primary (core) and nonprimary (belt) auditory fields can be activated by the mere presentation of visual scenes. Audiovisual convergence was restricted to caudal fields [prominently the core field (primary auditory cortex) and belt fields (caudomedial field, caudolateral field, and mediomedial field)] and continued in the auditory parabelt and the superior temporal sulcus. The same fields exhibited enhancement of auditory activation by visual stimulation and showed stronger enhancement for less effective stimuli, two characteristics of sensory integration. Together, these findings reveal multisensory modulation of auditory processing prominently in caudal fields but also at the lowest stages of auditory cortical processing. (shrink)

To form a coherent percept of the environment, our brain combines information from different senses. Such multisensory integration occurs in higher association cortices; but supposedly, it also occurs in early sensory areas. Confirming the latter hypothesis, we unequivocally demonstrate supra-additive integration of touch and sound stimulation at the second stage of the auditory cortex. Using high-resolution fMRI of the macaque monkey, we quantified the integration of auditory broad-band noise and tactile stimulation of hand and foot in anaesthetized (...) animals. Integration was found posterior to and along the lateral side of the primary auditory cortex in the caudal auditory belt. Integration was stronger for temporally coincident stimuli and obeyed the principle of inverse effectiveness: greater enhancement for less effective stimuli. These findings demonstrates that multisensory integration occurs early and close to primary sensory areas and—because it occurs in anaesthetized animals—suggests that this integration is mediated by preattentive bottom-up mechanisms. (shrink)

Training can influence behavioral performance and lead to brain reorganization. In particular, training in one modality, for example, auditory, can improve performance in another modality, for example, visual. Previous research suggests that one of the mechanisms behind this phenomenon could be the cross-modal recruitment of the sensory areas, for example, the auditory cortex. Studying expert musicians offers a chance to explore this process. Rhythm is an aspect of music that can be presented in various modalities. We designed (...) an fMRI experiment in which professional pianists and non-musicians discriminated between two sequences of rhythms presented auditorily or visually. Behavioral results showed that musicians performed in both visual and auditory rhythmic tasks better than non-musicians. We found no significant between-group differences in fMRI activations within the auditory cortex. However, we observed that musicians had increased activation in the right Inferior Parietal Lobe when compared to non-musicians. We conclude that the musicians’ superior visual rhythm discrimination is not related to cross-modal recruitment of the auditory cortex; instead, it could be related to activation in higher-level, multimodal areas in the cortex. (shrink)

This study aims to decode the hemodynamic responses evoked by multiple sound-categories using functional near-infrared spectroscopy. The six different sounds were given as stimuli. The oxy-hemoglobin concentration changes are measured in both hemispheres of the auditory cortex while 18 healthy subjects listen to 10-s blocks of six sound-categories. Long short-term memory networks were used as a classifier. The classification accuracy was 20.38 ± 4.63% with six class classification. Though LSTM networks’ performance was a little higher than chance levels, (...) it is noteworthy that we could classify the data subject-wise without feature selections. (shrink)

It has been well documented that the auditory system in the superior temporal cortex is responsible for processing basic auditory sound features, such as sound frequency and intensity, while the prefrontal cortex is involved in higher-order auditory functions, such as language processing and auditory episodic memory. The temporal auditory cortex has vast forward anatomical projections to the prefrontal auditory cortex, connecting with the lateral, medial, and orbital parts of the prefrontal (...) cortex. The connections between the auditory cortex and the prefrontal cortex thus help in localizing, recognizing, and comprehending external auditory inputs. In addition, the medial prefrontal cortex is believed to be a core region of episodic memory retrieval and is one of the most important regions in the default mode network. However, previous neural evidence with regard to the comparison between basic auditory processing and auditory episodic memory retrieval mainly comes from fMRI studies. The specific neural networks and the corresponding critical frequency bands of neuronal oscillations underlying the two auditory functions remain unclear. In the present study, we reported results of direct cortical stimulations during stereo-electro-encephalography recording in a patient with drug-resistant epilepsy. Electrodes covered the superior temporal gyrus, the operculum and the insula cortex of bilateral hemispheres, the prefrontal cortex, the parietal lobe, the anterior and middle cingulate cortex, and the amygdala of the left hemisphere. Two types of auditory hallucinations were evoked with direct cortical stimulations, which were consistent with the habitual seizures. The noise hallucinations, i.e., “I could hear buzzing noises in my head,” were evoked with the stimulation of the superior temporal gyrus. The episodic memory hallucinations “I could hear a young woman who was dressed in a red skirt saying: What is the matter with you?,” were evoked with the stimulation of MPFC. The patient described how she had met this young woman when she was young and that the woman said the same sentence to her. Furthermore, by analyzing the high gamma power induced by direct electrical stimulation, two dissociable neural networks underlying the two types of auditory hallucinations were localized. Taken together, the present results confirm the hierarchical processing of auditory information by showing the different involvements of the primary auditory cortex vs. the prefrontal cortex in the two types of auditory hallucinations. (shrink)

Background Speech understanding may rely not only on auditory, but also on visual information. Non-invasive functional neuroimaging techniques can expose the neural processes underlying the integration of multisensory processes required for speech understanding in humans. Nevertheless, noise (from fMRI) limits the usefulness in auditory experiments, and electromagnetic artefacts caused by electronic implants worn by subjects can severely distort the scans (EEG, fMRI). Therefore, we assessed audio-visual activation of temporal cortex with a silent, optical neuroimaging technique: functional near-infrared (...) spectroscopy (fNIRS). Methods We studied temporal cortical activation as represented by concentration changes of oxy- and deoxy-hemoglobin in four, easy-to-apply fNIRS optical channels of 33 normal-hearing adult subjects and 5 post-lingually deaf cochlear implant (CI) users in response to supra-threshold unisensory auditory and visual, as well as to congruent auditory-visual speech stimuli. Results Activation effects were not visible from single fNIRS channels. However, by discounting physiological noise through reference channel subtraction, auditory, visual and audiovisual speech stimuli evoked concentration changes for all sensory modalities in both cohorts (p<0.001). Auditory stimulation evoked larger concentration changes than visual stimuli (p<0.001). A saturation effect was observed for the audiovisual condition. Conclusions Physiological, systemic noise can be removed from fNIRS signals by reference channel subtraction. The observed multisensory enhancement of an auditory cortical channel can be plausibly described by a simple addition of the auditory and visual signals with saturation. (shrink)

Though dividing one’s attention between two input streams typically impairs performance, detecting a behaviorally relevant stimulus can sometimes enhance the encoding of unrelated information presented at the same time. Previous research has shown that selection of this kind boosts visual cortical activity and memory for concurrent items. An important unanswered question is whether such effects are reflected in processing quality and functional connectivity in visual regions and in the hippocampus. In this fMRI study, participants were asked to memorize a stream (...) of naturalistic images and press a button only when they heard a predefined target tone. Images could be presented with a target tone, with a distractor tone, or without a tone. Auditory target detection increased activity throughout the ventral visual cortex but lowered it in the hippocampus. Enhancements in functional connectivity between the ventral visual cortex and the hippocampus were also observed following auditory targets. Multi-voxel pattern classification of image category was more accurate on target tone trials than on distractor and no tone trials in the fusiform gyrus and parahippocampal gyrus. This effect was stronger in visual cortical clusters whose activity was more correlated with the hippocampus on target tone than on distractor tone trials. In agreement with accounts suggesting that subcortical noradrenergic influences play a role in the attentional boost effect, auditory target detection also caused an increase in locus coeruleus activity and phasic pupil responses. These findings outline a network of cortical and subcortical regions that are involved in the selection and processing of information presented at behaviorally relevant moments. (shrink)

Empirical work is reviewed which correlates the presence or absence of various parts of the auditory evoked potential with the disappearance and reemergence of auditory sensation during induction of and recovery from anesthesia. As a result, the hypothesis is generated that the electrophysiological correlate of auditory sensation is whatever neural activity generates the middle latency waves of the auditory evoked potential. This activity occurs from 20 to 80 ms poststimulus in the primary and secondary areas of (...) the auditory cortex. Evidence is presented suggesting that earlier or later waves in the auditory evoked potential do not covary with auditory sensation (as opposed to auditory perception) and it is therefore suggested that they are possibly not the electrophysiological correlates of sensation. (shrink)

We describe a patient LS, profoundly deaf in both ears from birth, with underdeveloped superior temporal gyri. Without hearing aids, LS displays no ability to detect sounds below a fixed threshold of 60 dBs, which classifies him as clinically deaf. Under these no-hearing-aid conditions, when presented with a forced-choice paradigm in which he is asked to consciously respond, he is unable to make above-chance judgments about the presence or location of sounds. However, he is able to make above-chance judgments about (...) the content of sounds presented to him under forced-choice conditions. We demonstrated that LS has faint sensations from auditory stimuli, but questionable awareness of auditory content. LS thus has a form of type-2 deaf hearing with respect to auditory content. As in the case of a subject with acquired deafness and deaf hearing reported on a previous occasion, LS’s condition of deaf hearing is akin in some respects to type-2 blindsight. As for the case of type 2 blindsight the case indicates that a form of conscious hearing can arise in the absence of a fully developed auditory cortex. (shrink)

The posterior parietal cortex (PPC) is the most likely site where egocentric spatial relationships are represented in the brain. PPC cells receive visual, auditory, somaesthetic, and vestibular sensory inputs; oculomotor, head, limb, and body motor signals; and strong motivational projections from the limbic system. Their discharge increases not only when an animal moves towards a sensory target, but also when it directs its attention to it. PPC lesions have the opposite effect: sensory inattention and neglect. The PPC does (...) not seem to contain a “map” of the location of objects in space but a distributed neural network for transforming one set of sensory vectors into other sensory reference frames or into various motor coordinate systems. Which set of transformation rules is used probably depends on attention, which selectively enhances the synapses needed for making a particular sensory comparison or aiming a particular movement. (shrink)

Music-based interventions (MBI) have become increasingly widely adopted for dementia and related disorders. Previous research shows that music engages reward-related regions through functional connectivity with the auditory system, but evidence for the effectiveness of MBI is mixed in older adults with mild cognitive impairment (MCI) and Alzheimer’s disease (AD). This underscores the need for a unified mechanistic understanding to motivate MBIs. The main objective of the present study is to characterize the intrinsic connectivity of the auditory and reward (...) systems in healthy aging individuals with MCI, and those with AD. Using resting-state fMRI data from the Alzheimer’s Database Neuroimaging Initiative, we tested resting-state functional connectivity within and between auditory and reward systems in older adults with MCI, AD, and age-matched healthy controls (N = 105). Seed-based correlations were assessed from regions of interest (ROIs) in the auditory network (i.e., anterior superior temporal gyrus, posterior superior temporal gyrus, Heschl’s Gyrus), and the reward network (i.e., nucleus accumbens, caudate, putamen, and orbitofrontal cortex). AD individuals were lower in both within-network and between-network functional connectivity in the auditory network and reward networks compared to MCI and controls. Furthermore, graph theory analyses showed that the MCI group had higher clustering and local efficiency than both AD and control groups, whereas AD individuals had lo... (shrink)

Recent studies in human and nonhuman primates demonstrate that auditory objects, including speech sounds, are identified in anterior superior temporal cortex projecting directly to inferior frontal regions and not along a posterior pathway, as classically assumed. By contrast, the role of posterior temporal regions in speech and language remains largely unexplained, although a concept of vocal gestures may be helpful.

Some 20 years ago Todd and colleagues proposed that rhythm perception is mediated by the conjunction of a sensory representation of the auditory input and a motor representation of the body (Todd, 1994a, 1995 ), and that a sense of motion from sound is mediated by the vestibular system (Todd, 1992a, 1993b ). These ideas were developed into a sensory-motor theory of rhythm and beat induction (Todd et al., 1999 ). A neurological substrate was proposed which might form the (...) biological basis of the theory (Todd et al., 2002 ). The theory was implemented as a computational model and a number of experiments conducted to test it. In the following time there have been several key developments. One is the demonstration that the vestibular system is primal to rhythm perception, and in related work several experiments have provided further evidence that rhythm perception is body dependent. Another is independent advances in imaging, which have revealed the brain areas associated with both vestibular processing and rhythm perception. A third is the finding that vestibular receptors contribute to auditory evoked potentials (Todd et al., 2014a, b ). These behavioral and neurobiological developments demand a theoretical overview which could provide a new synthesis over the domain of rhythm perception. In this paper we suggest four propositions as the basis for such a synthesis. (1) Rhythm perception is a form of vestibular perception; (2) Rhythm perception evokes both external and internal guidance of somatotopic representations; (3) A link from the limbic system to the internal guidance pathway mediates the “dance habit”; (4) The vestibular reward mechanism is innate. The new synthesis provides an explanation for a number of phenomena not often considered by rhythm researchers. We discuss these along with possible computational implementations and alternative models and propose a number of new directions for future research. (shrink)

Although research on the mismatch negativity (MMN) has been ongoing for 40 years, the generation process of the MMN remains largely unknown. In this study, we used a single-trial EEG-fMRI coupling method which can analyse neural activity with both high temporal and high spatial resolution and thus assess the generation process of the MMN. We elicited the MMN with an auditory oddball paradigm while recording simultaneous EEG and fMRI. We divided the MMN into five equal-durational phases. Utilizing the single-trial (...) variability of the MMN, we analysed the neural generators of the five phases, thereby determining the spatiotemporal generation process of the MMN. We found two distinct bottom-up prediction error propagations: first from the auditory cortex to the motor areas and then from the auditory cortex to the inferior frontal gyrus (IFG). Our results support the regularity-violation hypothesis of MMN generation. (shrink)

We propose that synesthetic cross‐activation between the primary auditory cortex and the anatomically adjacent insula may help explain two puzzling conditions—autonomous sensory meridian response (ASMR) and misophonia—in which quotidian sounds involuntarily trigger strong emotional responses. In ASMR the sounds engender relaxation, while in misophonia they trigger an aversive response. The insula both plays an important role in autonomic nervous system control and integrates multiple interoceptive maps representing the physiological state of the body to substantiate a dynamic representation of (...) emotional wellbeing. We propose that in ASMR cross‐activation of the map for affective (sensual) touch leads to an increase in subjective wellbeing and parasympathetic activity. Conversely, in misophonia the effect of the cross‐activation is to decrease emotional wellbeing and increase sympathetic activity. Our hypothesis also illuminates the connection between hearing and wellbeing more broadly and helps explain why so many people experience decreased wellbeing from modern urban soundscapes. (shrink)

In this chapter we present a new approach to research in music perception allowing one to investigate how musical sound representations are formed in the human brain. By studying subjects' brain responses to unattended stimuli we can determine, for instance, whether neural circuits are more readily activated by musical sounds implicitly learned than by unfamiliar sounds even in non-musicians. Indeed, neuronal populations seem to respond more efficiently to pitch deviations within sound patterns following the rules of Western scale structure, rather (...) than to deviations inside patterns artificially created. Moreover, neural circuits are selectively activated by mistunings inside tonal melodies or by out-of-key chords inside harmonic cadences even when attention is not directed towards the sounds. These data together suggest that incoming sounds are more efficiently processed when they match the neural templates derived from our musical culture. The existence of 'musical memories' in the auditory cortex that are effortlessly activated enabling us, e.g., to identify and recognize speech vs. music sounds can thus be postulated. (shrink)

Word in noise identification is facilitated by acoustic differences between target and competing sounds and temporal separation between the onset of the masker and that of the target. Younger and older adults are able to take advantage of onset delay when the masker is dissimilar to the target word, but only younger adults are able to do so when the masker is similar. We examined the neural underpinning of this age difference using cortical evoked responses to words masked by either (...) Babble or Noise when the masker preceded the target word by 100 or 600 ms in younger and older adults, after adjusting the signal-to-noise ratios to equate behavioural performance across age groups and conditions. For the 100 ms onset delay, the word in noise elicited an acoustic change complex response that was comparable in younger and older adults. For the 600 ms onset delay, the ACC was modulated by both masker type and age. In older adults, the ACC to a word in babble was not affected by the increase in onset delay whereas younger adults showed a benefit from longer delays. Hence, the age difference in sensitivity to temporal delay is indexed by early activity in the auditory cortex. These results are consistent with the hypothesis that an increase in onset delay improves stream segregation in younger adults in both noise and babble, but only in noise for older adults and that this change in stream segregation is evident in early cortical processes. (shrink)

We currently exist in a post-biological age. Mixed-realities shape the way in which we live modern life; half in physical form, half in a hyper-mediated virtual environment of network protocols. This article discusses network-based impacts on neurological navigation and the ways in which the human auditory cortex is developing through conjuncture with post-biological combinations of sound. In doing so, it examines the capacity of the human brain in decoding and understanding the abundance of sound in confluent, variegated realms (...) of existence and how such increased perceptions expand consciousness and, in turn, affect sonic creativity as a somewhat mimicry or response to our immediate auditory environments. Conclusively, it will be argued that the exploration of sound-based creativity can be reinterpreted for post-biological spaces, taking particular aim at the reflective approaches of musique concrète and how such technologically infused ideas can be transformed and recontextualized to match the power and capacity of today’s hybrid environments of occupancy. (shrink)

BackgroundUp-to-date information about the trends of age-related hearing loss and how this varies between countries is essential to plan for an adequate health-system response. Therefore, this study aimed to assess the research hotpots and trends in ARHL and to provide the basis and direction for future research.Materials and methodsThe Web of Science Core Collection database was searched and screened according to the inclusion criteria during 2002–2021. Bibliometric analyses were conducted by CiteSpace software and VOSviewer software.ResultsThe query identified 1,496 publications, which (...) showed a growth trend of this filed. These publications were from 62 countries, the United States of America showed its tremendous impact on this field in publication outputs, total citations, and international collaborations, China following in second. The Journal of Hearing Research was the most productive journal. Weijia Kong published the most papers, and the most productive institution was Washington University. The keyword “presbycusis” ranked first in research frontiers and appeared earlier, and the keywords “age-related hearing loss,” “risk,” “dementia,” “auditory cortex,” “association,” and “decline” began to appear in recent years.ConclusionThe annual number of publications has grown rapidly in the past two decades and will continue to grow. Epidemiological investigation and laboratory research are lasting hot spots, besides future research will focus on the association between ARHL and cognitive decline, dementia, and Alzheimer’s disease. (shrink)