Following in a psychological and musicological tradition beginning with Leonard Meyer, and continuing through David Huron, we present a functional, cognitive account of the phenomenon of expectation in music, grounded in computational, probabilistic modeling. We summarize a range of evidence for this approach, from psychology, neuroscience, musicology, linguistics, and creativity studies, and argue that simulating expectation is an important part of understanding a broad range of human faculties, in music and beyond.

While much has been written about whether visual perception is cognitively penetrable, the analogous question with respect to auditory perception has received very little attention. Here we argue that instances of top-down modulation of auditory processing, although extensive, do not constitute cases of cognitive penetration of auditory perception since the changes in the phenomenology of auditory perception caused by top-down influences cannot plausibly be attributed to the listeners’ discursive thoughts.

Auditory verbal hallucinations (AVHs) are a highly complex and rich phenomena, and this has a number of important clinical, theoretical and methodological implications. However, until recently, this fact has not always been incorporated into the experimental designs and theoretical paradigms used by researchers within the cognitive sciences. In this paper, we will briefly outline two recent examples of phenomenologically informed approaches to the study of AVHs taken from a cognitive science perspective. In the first example, based on Larøi and (...) Woodward (Harv Rev Psychiatry 15:109–117, 2007 ), it is argued that reality monitoring studies examining the cognitive underpinnings of hallucinations have not reflected the phenomenological complexity of AVHs in their experimental designs and theoretical framework. The second example, based on Jones (Schizophr Bull, in press, 2010 ), involves a critical examination of the phenomenology of AVHs in the context of two other prominent cognitive models: inner speech and intrusions from memory. It will be shown that, for both examples, the integration of a phenomenological analysis provides important improvements both on a methodological, theoretical and clinical level. This will be followed by insights and critiques from philosophy and clinical psychiatry—both of which offer a phenomenological alternative to the empiricist–rationalist conceptualisation of AVHs inherent to the cognitive sciences approach. Finally, the paper will conclude with ideas as to how the cognitive sciences may integrate these latter perspectives into their methodological and theoretical programmes. (shrink)

Auditory verbal hallucinations (AVHs) are a highly complex and rich phenomena, and this has a number of important clinical, theoretical and methodological implications. However, until recently, this fact has not always been incorporated into the experimental designs and theoretical paradigms used by researchers within the cognitive sciences. In this paper, we will briefly outline two recent examples of phenomenologically informed approaches to the study of AVHs taken from a cognitive science perspective. In the first example, based on Larøi and (...) Woodward (Harv Rev Psychiatry 15:109–117, 2007), it is argued that reality monitoring studies examining the cognitive underpinnings of hallucinations have not reflected the phenomenological complexity of AVHs in their experimental designs and theoretical framework. The second example, based on Jones (Schizophr Bull, in press, 2010), involves a critical examination of the phenomenology of AVHs in the context of two other prominent cognitive models: inner speech and intrusions from memory. It will be shown that, for both examples, the integration of a phenomenological analysis provides important improvements both on a methodological, theoretical and clinical level. This will be followed by insights and critiques from philosophy and clinical psychiatry—both of which offer a phenomenological alternative to the empiricist–rationalist conceptualisation of AVHs inherent to the cognitive sciences approach. Finally, the paper will conclude with ideas as to how the cognitive sciences may integrate these latter perspectives into their methodological and theoretical programmes. (shrink)

Music-based interventions (MBI) have become increasingly widely adopted for dementia and related disorders. Previous research shows that music engages reward-related regions through functional connectivity with the auditory system, but evidence for the effectiveness of MBI is mixed in older adults with mild cognitive impairment (MCI) and Alzheimer’s disease (AD). This underscores the need for a unified mechanistic understanding to motivate MBIs. The main objective of the present study is to characterize the intrinsic connectivity of the auditory and reward (...) systems in healthy aging individuals with MCI, and those with AD. Using resting-state fMRI data from the Alzheimer’s Database Neuroimaging Initiative, we tested resting-state functional connectivity within and between auditory and reward systems in older adults with MCI, AD, and age-matched healthy controls (N = 105). Seed-based correlations were assessed from regions of interest (ROIs) in the auditory network (i.e., anterior superior temporal gyrus, posterior superior temporal gyrus, Heschl’s Gyrus), and the reward network (i.e., nucleus accumbens, caudate, putamen, and orbitofrontal cortex). AD individuals were lower in both within-network and between-network functional connectivity in the auditory network and reward networks compared to MCI and controls. Furthermore, graph theory analyses showed that the MCI group had higher clustering and local efficiency than both AD and control groups, whereas AD individuals had lo... (shrink)

According to the hierarchical model of sensory information processing, sensory inputs are transmitted to cortical areas, which are crucial for complex auditory and speech processing, only after being processed in subcortical areas (Hickok and Poeppel, 2007; Rauschecker and Scott, 2009). However, studies using electroencephalography (EEG) indicate that distinguishing simultaneous auditory inputs involves a widely distributed neural network, including the medial temporal lobe, which is essential for declarative memory, and posterior association cortices (Alain et al., 2001; Squire et al., (...) 2004). More recent studies have even demonstrated plasticity of auditory signals as low as the brainstem (Suga, 2008). Collectively, studies suggest that the functional architecture of perceptual processing involves primarily top-down modulation (Suga et al., 2002; Gilbert and Li, 2013; Chandrasekaran et al., 2014). Top-down influences exerted throughout the auditory systems (Lotto and Holt, 2011) include: memory (Goldinger, 1998)1, attention (Choi et al., 2014), which has been found to modulate auditory encoding in the cochlea, a subcortical area (Maison et al., 2001), (prior) knowledge of syntax or words (Ganong, 1980; Warren, 1984)2, and experience-based expectations pertaining to the speaker's accent (Deutsch, 1996; Deutsch et al., 2004; Irino and Patterson, 2006), gender (Johnson et al., 1999), and vocal folds or tract (Irino and Patterson, 2002; Patterson and Johnsrude, 2008) . (shrink)

Previous studies of auditory expectation have focused on the expectedness perceived by listeners retrospectively in response to events. In contrast, this research examines predictive uncertainty —a property of listeners' prospective state of expectation prior to the onset of an event. We examine the information-theoretic concept of Shannon entropy as a model of predictive uncertainty in music cognition. This is motivated by the Statistical Learning Hypothesis, which proposes that schematic expectations reflect probabilistic relationships between sensory events learned implicitly through (...) exposure. Using probability estimates from an unsupervised, variable-order Markov model, 12 melodic contexts high in entropy and 12 melodic contexts low in entropy were selected from two musical repertoires differing in structural complexity (simple and complex). Musicians and non-musicians listened to the stimuli and provided explicit judgments of perceived uncertainty (explicit uncertainty). We also examined an indirect measure of uncertainty computed as the entropy of expectedness distributions obtained using a classical probe-tone paradigm where listeners rated the perceived expectedness of the final note in a melodic sequence (inferred uncertainty). Finally, we simulate listeners' perception of expectedness and uncertainty using computational models of auditory expectation. A detailed model comparison indicates which model parameters maximize fit to the data and how they compare to existing models in the literature. The results show that listeners experience greater uncertainty in high-entropy musical contexts than low-entropy contexts. This effect is particularly apparent for inferred uncertainty and is stronger in musicians than non-musicians. Consistent with the Statistical Learning Hypothesis, the results suggest that increased domain-relevant training is associated with an increasingly accurate cognitive model of probabilistic structure in music. (shrink)

People are ingesting various information from different sense organs all the time to complete different cognitive tasks. The brain integrates and regulates this information. The two significant sensory channels for receiving external information are sight and hearing that have received extensive attention. This paper mainly studies the effect of music and visual-auditory stimulation on electroencephalogram of happy emotion recognition based on a complex system. In the experiment, the presentation was used to prepare the experimental stimulation program, and the cognitive (...) neuroscience experimental paradigm of EEG evoked by happy emotion pictures was established. Using 93 videos as natural stimuli, fMRI data were collected. Finally, the collected EEG signals were removed with the eye artifact and baseline drift, and the t-test was used to analyze the significant differences of different lead EEG data. Experimental data shows that, by adjusting the parameters of the convolutional neural network, the highest accuracy of the two-classification algorithm can reach 98.8%, and the average accuracy can reach 83.45%. The results show that the brain source under the combined visual and auditory stimulus is not a simple superposition of the brain source of the single visual and auditory stimulation, but a new interactive source is generated. (shrink)

This paper addresses the question whether we can conceive of music cognition in ecosemiotic terms. It claims that music knowledge must be generated as a tool for adaptation to the sonic world and calls forth a shift from a structural description of music as an artifact to a process-like approach to dealing with music. As listeners, we are observers who construct and organize our knowledge and bring with us our observational tools. What matters is not merely the sonic world (...) in its objective qualities, but the world as perceived. In order to make these claims operational we can rely on the ecological concept of coping with the sonic world and the cybernetic concepts of artificial and adaptive devices. Listeners, on this view, are able to change their semantic relations with the sonic world through functional adaptations at the level of sensing, acting and coordinating between action and perception. This allows us to understand music in functional terms of what it affords to us and not merely in terms of its acoustic qualities. There are, however, degrees of freedom and constraints which shape the semiotization of the sonic world. As such we must consider the role of event perception and cognitive economy: listeners do not perceive the acoustical environment in terms of phenomenological descriptions but as ecological events. (shrink)

Auditory stimulation training (AST) has been proposed as a potential treatment for chil-dren with specific language impairments (SLI). The current study was designed to test this as-sumption by using an AST with technically modulated musical material (ASTM) in a random-ized control group design. A total of 101 preschool children (62 male, 39 females; mean age = 4.52 years, SD = 0.62) with deficits in speech comprehension and poor working memory ca-pacity were randomly allocated into one of two treatment groups (...) or a control group. Children in the ASTM group (n = 40) received three 30-minute sessions per week over 12 weeks, whereas children in the comparison group received pedagogical activities during these intervals (n = 24). Children in the control group (n = 37) received no treatment. Working memory, phoneme dis-crimination and speech perception skills were tested prior to (baseline) and after treatment. Chil-dren in the ASTM group showed significantly greater working memory capacity, speech per-ception, and phoneme discrimination skills after treatment, whereas children in the other groups did not show such improvement. Taken together, these results suggest that ASTM can enhance auditory cognitive performance in children with SLI. (shrink)

It might be suggested that in auditory experience elements of the material world are not apparent to us in the way they are in vision and touch, and that this constitutes a shortcoming in the kind of cognitive contact with the world provided by auditory perception. I develop this suggestion, and then set out a way of thinking about the appearances of sound-producing events that might provide a response.

It might be suggested that in auditory experience elements of the material world are not apparent to us in the way they are in vision and touch, and that this constitutes a shortcoming in the kind of cognitive contact with the world provided by auditory perception. I develop this suggestion, and then set out a way of thinking about the appearances of sound‐producing events that might provide a response.1Thanks to James Stazicker for very helpful comments and suggestions.

This paper addresses the question whether we can conceive of music cognition in ecosemiotic terms. It claims that music knowledge must be generated as a tool for adaptation to the sonic world and calls forth a shift from a structural description of music as an artifact to a process-like approach to dealing with music. As listeners, we are observers who construct and organize our knowledge and bring with us our observational tools. What matters is not merely the sonic world (...) in its objective qualities, but the world as perceived. In order to make these claims operational we can rely on the ecological concept of coping with the sonic world and the cybernetic concepts of artificial and adaptive devices. Listeners, on this view, are able to change their semantic relations with the sonic world through functional adaptations at the level of sensing, acting and coordinating between action and perception. This allows us to understand music in functional terms of what it affords to us and not merely in terms of its acoustic qualities. There are, however, degrees of freedom and constraints which shape the semiotization of the sonic world. As such we must consider the role of event perception and cognitive economy: listeners do not perceive the acoustical environment in terms of phenomenological descriptions but as ecological events. (shrink)

A basic function of cognition is to detect regularities in sensory input to facilitate the prediction and recognition of future events. It has been proposed that these implicit expectations arise from an internal predictive coding model, based on knowledge acquired through processes such as statistical learning, but it is unclear how different types of statistical information affect listeners’ memory for auditory stimuli. We used a combination of behavioral and computational methods to investigate memory for non-linguistic auditory sequences. (...) Participants repeatedly heard tone sequences varying systematically in their information-theoretic properties. Expectedness ratings of tones were collected during three listening sessions, and a recognition memory test was given after each session. Information-theoretic measures of sequential predictability significantly influenced listeners’ expectedness ratings, and variations in these properties had a significant impact on memory performance. Predictable sequences yielded increasingly better memory performance with increasing exposure. Computational simulations using a probabilistic model of auditory expectation suggest that listeners dynamically formed a new, and increasingly accurate, implicit cognitive model of the information-theoretic structure of the sequences throughout the experimental session. (shrink)

Older adults with age-related hearing loss often use hearing aids to compensate. However, certain challenges in speech perception, especially in noise still exist, despite today’s HA technology. The current study presents an evaluation of a home-based auditory exercises program that can be used during the adaptation process for HA use. The home-based program was developed at a time when telemedicine became prominent in part due to the COVID-19 pandemic. The study included 53 older adults with age-related symmetrical sensorineural hearing (...) loss. They were divided into three groups depending on their experience using HAs. Group 1: Experienced users. Group 2: New users. Group 3: Non-users. These three groups underwent auditory exercises for 3 weeks. The auditory tasks included auditory detection, auditory discrimination, and auditory identification, as well as comprehension with basic and more complex stimuli, presented in quiet and in noisy listening conditions. All participants completed self-assessment questionnaires before and after the auditory exercises program and underwent a cognitive test at the end. Self-assessed improvements in hearing ability were observed across the HA users groups, with significant changes described by new users. Overall, speech perception in noise was poorer than in quiet. Speech perception accuracy was poorer in the non-users group compared to the users in all tasks. In sessions where stimuli were presented in quiet, similar performance was observed among new and experienced uses. New users performed significantly better than non-users in all speech in noise tasks; however, compared to the experienced users, performance differences depended on task difficulty. The findings indicate that HA users, even new users, had better perceptual performance than their peers who did not receive hearing aids. (shrink)

We present one of the first quantitative studies on auditory verbal experiences (“hearing voices”) and auditory verbal agency (inner speech, and specifically “talking to (imaginary) voices or characters”) in healthy participants across states of consciousness. Tools of quantitative linguistic analysis were used to measure participants’ implicit knowledge of auditory verbal experiences (VE) and auditory verbal agencies (VA), displayed in mentation reports from four different states. Analysis was conducted on a total of 569 mentation reports from rapid (...) eye movement (REM) sleep, non‐REM sleep, sleep onset, and waking. Physiology was controlled with the nightcap sleep–wake mentation monitoring system. Sleep‐onset hallucinations, traditionally at the focus of scientific attention on auditory verbal hallucinations, showed the lowest degree of VE and VA, whereas REM sleep showed the highest degrees. Degrees of different linguistic‐pragmatic aspects of VE and VA likewise depend on the physiological states. The quantity and pragmatics of VE and VA are a function of the physiologically distinct state of consciousness in which they are conceived. (shrink)

We present one of the first quantitative studies on auditory verbal experiences and auditory verbal agency voices or characters”) in healthy participants across states of consciousness. Tools of quantitative linguistic analysis were used to measure participants’ implicit knowledge of auditory verbal experiences and auditory verbal agencies, displayed in mentation reports from four different states. Analysis was conducted on a total of 569 mentation reports from rapid eye movement sleep, non-REM sleep, sleep onset, and waking. Physiology was (...) controlled with the nightcap sleep–wake mentation monitoring system. Sleep-onset hallucinations, traditionally at the focus of scientific attention on auditory verbal hallucinations, showed the lowest degree of VE and VA, whereas REM sleep showed the highest degrees. Degrees of different linguistic-pragmatic aspects of VE and VA likewise depend on the physiological states. The quantity and pragmatics of VE and VA are a function of the physiologically distinct state of consciousness in which they are conceived. (shrink)

This paper defends two theses about sensory objects. The more general thesis is that directly sensed objects are those delivered by sub-personal processes. It is shown how this thesis runs counter to perceptual atomism, the view that wholes are always sensed indirectly, through their parts. The more specific thesis is that while the direct objects of audition are all composed of sounds, these direct objects are not all sounds—here, a composite auditory object is a temporal sequence of sounds (whereas (...) a composite visual object is a spatial composite). Many composite objects are directly heard in the sense just mentioned. There is a great variety of such composite auditory objects—melodies, harmonies, sequences of phonemes, individual voices, meaning-carrying sounds, and so on. This diversity of auditory objects has an important application to aesthetics. Perceivers do not naturally or easily attend simultaneously to auditory objects that overlap in time. Yet, aesthetic appreciation depends on such an allocation of attention to overlapping objects. (shrink)

Two priming experiments demonstrated exogenous attentional persistence to the fundamental auditory dimensions of frequency (Experiment 1) and time (Experiment 2). In a divided-attention task, participants responded to an independent dimension, the identification of three-tone sequence patterns, for both prime and probe stimuli. The stimuli were specifically designed to parallel the local–global hierarchical letter stimuli of [Navon D. (1977). Forest before trees: The precedence of global features in visual perception. Cognitive Psychology, 9, 353–383] and the task was designed to parallel (...) subsequent work in visual attention using Navon stimuli [Robertson, L. C. (1996). Attentional persistence for features of hierarchical patterns. Journal of Experimental Psychology: General, 125, 227–249; Ward, L. M. (1982). Determinants of attention to local and global features of visual forms. Journal of Experimental Psychology: Human Perception and Performance, 8, 562–581]. The results are discussed in terms of previous work in auditory attention and previous approaches to auditory local–global processing. (shrink)

Much research has explored developing sound representations in language, but less work addresses developing representations of other sound patterns. This study examined preschool children's musical representations using two different tasks: discrimination and sound–picture association. Melodic contour—a musically relevant property—and instrumental timbre, which is less musically relevant, were tested. In Experiment 1, children failed to associate cartoon characters to melodies with maximally different pitch contours, with no advantage for melody preexposure. Experiment 2 also used different-contour melodies and found good discrimination, whereas (...) association was at chance. Experiment 3 replicated Experiment 2, but with a large timbre change instead of a contour change. Here, discrimination and association were both excellent. Preschool-aged children may have stronger or more durable representations of timbre than contour, particularly in more difficult tasks. Reasons for weaker association of contour than timbre information are discussed, along with implications for auditory development. (shrink)

Attention is often conceived as a gateway to consciousness . Although endogenous spatial attention may be independent of conscious perception , exogenous spatial orienting seems instead to be an important modulator of CP . Here, we investigate the role of auditory alerting in CP in normal observers. We used a behavioral task in which phasic alerting tones were presented either at unpredictable or at predictable time intervals prior to the occurrence of a near-threshold visual target. We find, for the (...) first time in neurologically intact observers, that phasic alertness increases CP, both objectively and subjectively. This result is consistent with evidence showing that phasic alerting can ameliorate the spatial bias exhibited by visual neglect patients . The alerting network may increase the activity of fronto-parietal networks involved in top-down amplification required to bring a stimulus into consciousness. (shrink)

Our auditory experience involves the experience of auditory objects—sequences of distinct sounds, or parts of continuous sounds—that are experienced as grouped together into a single sound or “stream” of sounds. In this paper I argue that it is not possible to explain what it is to experience an auditory object as such—i.e. to experience a sequence of sounds as grouped—in purely auditory terms; rather, to experience an auditory object as such is to experience a sequence (...) of sounds as having been (apparently) produced by the same source. (shrink)

The aim of the paper is to present and analyze problems associated with the mechanisms of auditory perception (especially those responsible for speech perception), their specific disorders and functions. I discuss research on speech perception in the broader theoretical context of the mechanistic model of scientific explanation and the perspective of cognitive implantology that explores the possibilities for building hybrid auditory systems.

Auditory scene analysis is critical for complex auditory processing. We study auditory segregation from the neural network perspective, and develop a framework for primitive auditory scene analysis. The architecture is a laterally coupled two‐dimensional network of relaxation oscillators with a global inhibitor. One dimension represents time and another one represents frequency. We show that this architecture, plus systematic delay lines, can in real time group auditory features into a stream by phase synchrony and segregate different (...) streams by desynchronization. The network demonstrates a set of psychological phenomena regarding primitive auditory scene analysis, including dependency on frequency proximity and the rate of presentation, sequential capturing, and competition among different perceptual organizations. We offer a neurocomputational theory—shifting synchronization theory—for explaining how auditory segregation might be achieved in the brain, and the psychological phenomenon of stream segregation. Possible extensions of the model are discussed. (shrink)

ObjectivesTo document the auditory processing, visual attention, digit memory, phonological processing, and receptive language abilities of individual children with identified word reading difficulties.DesignTwenty-four children with word reading difficulties and 28 control children with good word reading skills participated. All children were aged between 8 and 11 years, with normal hearing sensitivity and typical non-verbal intelligence. Both groups of children completed a test battery designed to assess their auditory processing, visual attention, digit memory, phonological processing, and receptive language.ResultsWhen compared (...) to children who were good readers, children with word reading difficulties obtained significantly lower average scores on tests of auditory processing, including the frequency pattern test, gaps in noise, frequency discrimination, Dichotic Digit difference Test, and Listening in Spatialized Noise. The two groups did not differ on the discrimination measures of sinusoidal amplitude modulation or iterated rippled noise. The results from children with word reading difficulties showed that 5 children (21%) had comorbid deficits in auditory processing, visual attention, and backward digit memory; whereas 12 children (50%) had comorbid auditory processing and visual attention deficits only, and 2 children (8%) had comorbid deficits in auditory processing and digit memory; the remaining children had only auditory processing, visual attention, or digit memory deficits.ConclusionThe current study highlights the general co-existence of auditory processing, memory, and visual attention deficits in children with word reading difficulties. It is also noteworthy, however, that only one fifth of the current cohort had deficits across all measured tasks. Hence, our results also show the significant individual variability inherent in children with word reading difficulties. (shrink)