Sound symbolism is a non‐arbitrary correspondence between sound and meaning. The majority of studies on sound symbolism have focused on consonants and vowels, and the sound‐symbolic properties of suprasegmentals, particularly phonation types, have been largely neglected. This study examines the size and shape symbolism of four phonation types: modal and creaky voices, falsetto, and whisper. Japanese speakers heard 12 novel words (e.g., /íbi/, /ápa/) pronounced with the four types of phonation and rated the size and roundedness/pointedness (...) each of the 48 stimuli seemed to represent on seven‐point scales. The results showed that phonation types as well as consonantal and vocalic features influenced the ratings. Creaky voice was associated with larger and more pointed images than modal voice, which was in turn associated with larger and more pointed images than whisper. Falsetto was also associated with roundedness but not with smallness. These results shed new light on the acoustic approaches to sound symbolism and suggest the significance of phonation types and other suprasegmental features in the phenomenon. (shrink)

Religious ritual in ancient Greece regularly incorporated music, so much so that certain instruments or vocal genres frequently became associated with the religious veneration of specific gods. The Attic cult of Pan and the Nymphs should also be included among this group: though little is often known about the specific ritual practices, the literary and visual evidence associated with the cults make repeated reference to music performed on the panpipes—and to auditory and sensory stimuli more generally—as a prominent feature (...) of the worship of these gods. I consider the Vari Cave, sacred to Pan and the Nymphs, together with the surviving marble votive reliefs from that space, to explore the sounds and sensations associated with the veneration of the rural gods. I argue that the sensory experience offered by the cave and the images within it would have enhanced the worshiper's experience of the ritual and the gods for whom they were performed. In this way, visual and auditory perceptions blurred together to create a powerful experience of the divine. (shrink)

This paper holds an evolutionary approach to musical semantics. Revolving around the nature/nurture dichotomy, it considers the role of the dispositional machinery to respond to sounding stimuli. Conceiving of music as organized sound, it stresses the dynamic tension between music as a collection of vibrational events and their potential of being structured. This structuring, however, is not gratuitous. It depends on levels of processing that rely on evolutionary older levels of reacting to the sounds as well as higher-level (...) functions of the brain, which allow listeners to emancipate themselves from mere acoustic processing of sounds to the level of epistemic interactions with the sounding music. These interactions are partly autonomous and partly constrained, but they all stress the realization of systemic cognition in the context of a living system‘s interactions with the environment. As such, listeners can be conceived as adaptive devices, which can build up new semiotic linkages with the sounding world. (shrink)

This study investigated visual statistical learning (VSL) in 24 deaf signers and 24 hearing non‐signers. Previous research with hearing individuals suggests that SL mechanisms support literacy. Our first goal was to assess whether VSL was associated with reading ability in deaf individuals, and whether this relation was sustained by a link between VSL and sign language skill. Our second goal was to test the Auditory Scaffolding Hypothesis, which makes the prediction that deaf people should be impaired in sequential processing tasks. (...) For the VSL task, we adopted a modified version of the triplet learning paradigm, with stimuli presented sequentially across space and time. Results revealed that measures of sign language skill (sentence comprehension/repetition) did not correlate with VSL scores, possibly due to the sequential nature of our VSL task. Reading comprehension scores (PIAT‐R) were a significant predictor of VSL accuracy in hearing but not deaf people. This finding might be due to the sequential nature of the VSL task and to a less salient role of the sequential orthography‐to‐phonology mapping in deaf readers compared to hearing readers. The two groups did not differ in VSL scores. However, when reading ability was taken into account, VSL scores were higher for the deaf group than the hearing group. Overall, this evidence is inconsistent with the Auditory Scaffolding Hypothesis, suggesting that humans can develop efficient sequencing abilities even in the absence of sound. (shrink)

As with any sensory input, music might be expected to incorporate the processing of information about the safety of the environment. Little research has been done on how such processing has evolved and how different kinds of sounds may affect the experience of certain environments. In this article, we investigate if music, as a form of auditory information, can trigger the experience of safety. We hypothesized that there should be an optimal, subjectively preferred degree of information density of musical sounds, (...) at which safety-related information can be processed optimally; any deviation from the optimum, that is, both higher and lower levels of information density, should elicit experiences of higher stress and danger; and in general, sonic scenarios with music should reduce experiences of stress and danger more than other scenarios. In Experiment 1, the information density of short music-like rhythmic stimuli was manipulated via their tempo. In an initial session, listeners adjusted the tempo of the stimuli to what they deemed an appropriate tempo. In an ensuing session, the same listeners judged their experienced stress and danger in response to the same stimuli, as well as stimuli exhibiting tempo variants. Results are consistent with the existence of an optimum information density for a given rhythm; the preferred tempo decreased for increasingly complex rhythms. The hypothesis that any deviation from the optimum would lead to experiences of higher stress and danger was only partly fit by the data. In Experiment 2, listeners should indicate their experience of stress and danger in response to different sonic scenarios: music, natural sounds, and silence. As expected, the music scenarios were associated with lowest stress and danger whereas both natural sounds and silence resulted in higher stress and danger. Overall, the results largely fit the hypothesis that music seemingly carries safety-related information about the environment. (shrink)

In this chapter we present a new approach to research in music perception allowing one to investigate how musical sound representations are formed in the human brain. By studying subjects' brain responses to unattended stimuli we can determine, for instance, whether neural circuits are more readily activated by musical sounds implicitly learned than by unfamiliar sounds even in non-musicians. Indeed, neuronal populations seem to respond more efficiently to pitch deviations within sound patterns following the rules of Western (...) scale structure, rather than to deviations inside patterns artificially created. Moreover, neural circuits are selectively activated by mistunings inside tonal melodies or by out-of-key chords inside harmonic cadences even when attention is not directed towards the sounds. These data together suggest that incoming sounds are more efficiently processed when they match the neural templates derived from our musical culture. The existence of 'musical memories' in the auditory cortex that are effortlessly activated enabling us, e.g., to identify and recognize speech vs. music sounds can thus be postulated. (shrink)

Background: The intrauterine hearing experience differs from the extrauterine hearing exposure within a neonatal intensive care unit (NICU) setting. Also, the listening experience of a neonate drastically differs from that of an adult. Several studies have documented that the sound level within a NICU exceeds the recommended threshold by far, possibly related to hearing loss thereafter. The aim of this study was, firstly, to precisely define the dynamics of sounds within an incubator and, secondly, to give clinicians and caregivers (...) an idea about what can be heard “inside the box.” Methods: Audio recordings within an incubator were conducted at the Pediatric Simulation Center of the Medical University Vienna. They contained recorded music, speech and synthesized sounds. To understand the dynamics of sounds around and within the incubator the following stimuli were used: broadband noise with decreasing sound level in ten steps of 6 dB, sine waves (62.5, 125, 250, 500, 1000, 2000, 4000, 8000 and 16000 Hz), logarithmic sweep (Chirp) over the frequency band 20 Hz to 21 kHz, singing male voice, singing and whispering female voice. Results: Our results confirm a protective effect of the incubator from noises above 500 Hz in conditions of “no-flow” and show almost no protective effect of an incubator cover. We, furthermore, observed a strong boost of low frequencies below 125 Hz within the incubator, as well as a notable increase of higher frequency noises with open access doors, a significant resonant effect of the incubator, and a considerable masking effect of the respiratory support against any other source of noise or sound stimulation even for “low-flow” conditions. Conclusion: Our study reveals high noise levels of air supply at high flow rates and the boost of low frequencies within the incubator. Education of medical staff and family members as well as modifications of the physical environment should aim at reducing noise exposure of preterm infants in the incubator. Audiovisual material is provided as supplementary material. (shrink)

This study aims to decode the hemodynamic responses evoked by multiple sound-categories using functional near-infrared spectroscopy. The six different sounds were given as stimuli. The oxy-hemoglobin concentration changes are measured in both hemispheres of the auditory cortex while 18 healthy subjects listen to 10-s blocks of six sound-categories. Long short-term memory networks were used as a classifier. The classification accuracy was 20.38 ± 4.63% with six class classification. Though LSTM networks’ performance was a little higher than chance (...) levels, it is noteworthy that we could classify the data subject-wise without feature selections. (shrink)

Motion-sound synesthesia is characterized by illusory auditory sensations linked to the pattern and rhythms of motion of visually experienced but soundless object, like an optical flow array, a ball bouncing or a horse galloping. In an MRI study with a group of three synesthetes and a group of eighteen control participants, we found structural changes in the brains of synesthetes in the subcortical multisensory areas of the superior and inferior colliculi. In addition, functional magnetic resonance imaging data showed activity (...) in motion-sensitive regions, as well as temporal and occipital areas, and the cerebellum. However, the synesthetes had a higher activation within the left and right cuneus, with stronger activations when viewing optical flow stimuli. There was also a general difference in connectivity of the colliculi with the above mentioned regions between the two groups. These findings implicate low-level mechanisms within the human neuroaxis as a substrate for local connectivity and cross activity between perceptual processes that are “distant” in terms of cortical topography. The present findings underline the importance of considering the role of subcortical systems and their connectivity to multimodal regions of the cortex and they strengthen a parsimonious account of synesthesia, at the least of the visual-auditory type. (shrink)

Sound moves us. Nowhere is this more apparent than in our responses to genuine emotional vocalizations, be they heartfelt distress cries or raucous laughter. Here, we present perceptual ratings and a description of a freely available, large database of natural affective vocal sounds from human infants, adults and domestic animals, the Oxford Vocal (OxVoc) Sounds database. This database consists of 173 non-verbal sounds expressing a range of happy, sad, and neutral emotional states. Ratings are presented for the sounds on (...) a range of dimensions from a number of independent participant samples. Perceptions related to valence, including distress, vocalizer mood, and listener mood are presented in Study 1. Perceptions of the arousal of the sound, listener motivation to respond and valence (positive, negative) are presented in Study 2. Perceptions of the emotional content of the stimuli in both Study 1 and 2 were consistent with the predefined categories (e.g., laugh stimuli perceived as positive). While the adult vocalizations received more extreme valence ratings, rated motivation to respond to the sounds was highest for the infant sounds. The major advantages of this database are the inclusion of vocalizations from naturalistic situations, which represent genuine expressions of emotion, and the inclusion of vocalizations from animals and infants, providing comparison stimuli for use in cross-species and developmental studies. The associated website provides a detailed description of the physical properties of each sound stimulus along with cross-category descriptions. (shrink)

Loudness is the magnitude of the auditory sensation that a listener experiences when exposed to a sound. Several sound attributes are reported to affect loudness, such as the sound pressure level at the listener's ears and the spectral content. In addition to these physical attributes of the stimulus, some subjective attributes also appear to affect loudness. When presented with a sound, a listener interacts with an auditory object and can focus on several aspects of the latter. (...) Loudness appears to differ depending on how listeners apprehend this object, notably whether they focus on the sound that reaches their ears or that is produced by the source. The way listeners focus on the auditory object may depend on the stimulus itself. For instance, they might be more likely to focus on the sound emitted by the source if the latter is visible. The instructions given by the experimenters can also explicitly direct the listener's focus on the sound reaching the ears or emitted by the source. The present review aims at understanding how listeners focus on the auditory object depending on the stimuli and instructions they are provided with, and to describe how loudness depends on this focus. (shrink)

This book is an interdisciplinary project that brings together ideas from aesthetics, philosophy, psychology, and music sociology as an expansion of German philosopher Hans-Georg Gadamer’s theory on the aesthetics of play. This way of thinking focuses on an ontology of the process of musicking rather than an ontology of discovering fixed and static musical objects. In line with this idea, the author discusses the importance of participation and involvement in this process of musicking, whether as a listener or as a (...) performer. Christensen then goes on to critique and update Gadamer's theory by presenting incompatibilities between it and recent theories of aesthetic emotions and embodiment. He proposes that emotions are ‘constructed’ rather than ‘caused’, that the mind uses a system of ‘filters’ to respond to sonic stimuli and thus constructs aesthetic feelings and experiences. In turn, this approach provides music with a route into the development of social capital and inter-subjective communication. This work builds on the hermeneutical steps already taken by Gadamer and those before him, continuing his line of thought beyond his work. It will be of great interest to scholars in music aesthetics as well as a variety of other music related fields, including music psychology, philosophy and science and technology studies. (shrink)

To form a coherent percept of the environment, our brain combines information from different senses. Such multisensory integration occurs in higher association cortices; but supposedly, it also occurs in early sensory areas. Confirming the latter hypothesis, we unequivocally demonstrate supra-additive integration of touch and sound stimulation at the second stage of the auditory cortex. Using high-resolution fMRI of the macaque monkey, we quantified the integration of auditory broad-band noise and tactile stimulation of hand and foot in anaesthetized animals. Integration (...) was found posterior to and along the lateral side of the primary auditory cortex in the caudal auditory belt. Integration was stronger for temporally coincident stimuli and obeyed the principle of inverse effectiveness: greater enhancement for less effective stimuli. These findings demonstrates that multisensory integration occurs early and close to primary sensory areas and—because it occurs in anaesthetized animals—suggests that this integration is mediated by preattentive bottom-up mechanisms. (shrink)

In typical statistical learning studies, researchers define sequences in terms of the probability of the next item in the sequence given the current item (or items), and they show that high probability sequences are treated as more familiar than low probability sequences. Existing accounts of these phenomena all assume that participants represent statistical regularities more or less as they are defined by the experimenters—as sequential probabilities of symbols in a string. Here we offer an alternative, or possibly supplementary, hypothesis. Specifically, (...) rather than identifying or labeling individual stimuli discretely in order to predict the next item in a sequence, we need only assume that the participant is able to represent the stimuli as evincing particular similarity relations to one another, with sequences represented as trajectories through this similarity space. We present experiments in which this hypothesis makes sharply different predictions from hypotheses based on the assumption that sequences are learned over discrete, labeled stimuli. We also present a series of simulation models that encode stimuli as positions in a continuous two‐dimensional space, and predict the next location from the current location. Although no model captures all of the data presented here, the results of three critical experiments are more consistent with the view that participants represent trajectories through similarity space rather than sequences of discrete labels under particular conditions. (shrink)

Recently, researchers have expanded the investigation into attentional biases toward positive stimuli; however, few studies have examined attentional biases toward positive auditory information. In three experiments, the present study employed an emotional spatial cueing task using emotional sounds as cues and auditory stimuli or visual stimuli as targets to explore whether auditory or visual spatial attention could be modulated by positive auditory cues. Experiment 3 also examined the temporal dynamics of cross-modal auditory bias toward positive natural sounds (...) using event-related potentials. The behavioral results of the three experiments consistently demonstrated that response times to targets were faster after positive auditory cues than they were after neutral auditory cues in the valid condition, indicating that healthy participants showed a selective auditory attentional bias and cross-modal attentional bias toward positive natural sounds. The results of Experiment 3 showed that N1 amplitudes were more negative after positive sounds than they were after neutral sounds, which further provided electrophysiological evidence that positive auditory information enhances attention at early stages in healthy adults. The results of the experiments performed in the present study suggest that humans exhibit an attentional bias toward positive natural sounds. (shrink)

In a century where humans and machines—powered by artificial intelligence or not—increasingly work together, it is of interest to understand human processing of multi-sensory stimuli in relation to attention and working memory. This paper explores whether and when supporting visual information with rhythmic auditory stimuli can optimize multi-sensory information processing. In turn, this can make the interaction between humans or between machines and humans more engaging, rewarding and activating. For this purpose a novel working memory paradigm was developed (...) where participants are presented with a series of five target digits randomly interchanged with five distractor digits. Their goal is to remember the target digits and recall them orally. Depending on the condition support is provided by audio and/or rhythm. It is expected that the sound will lead to a better performance. It is also expected that this effect of sound is different in case of rhythmic and non-rhythmic sound. Last but not least, some variability is expected across participants. To make correct conclusions, the data of the experiment was statistically analyzed in a classic way, but also predictive models were developed in order to predict outcomes based on a range of input variables related to the experiment and the participant. The effect of auditory support could be confirmed, but no difference was observed between rhythmic and non-rhythmic sounds. Overall performance was indeed affected by individual differences, such as visual dominance or perceived task difficulty. Surprisingly a music education did not significantly affect the performance and even tended toward a negative effect. To better understand the underlying processes of attention, also brain activation data, e.g., by means of electroencephalography, should be recorded. This approach can be subject to a future work. (shrink)

Distractibility is one of the key features of attention deficit hyperactivity disorder and has been associated with alterations in the neural orienting and alerting networks. Task-irrelevant stimuli are thus expected to have detrimental effects on the performance of patients with ADHD. However, task-irrelevant presentation of novel sounds seems to have the opposite effect and improve subsequent attentional performance particularly in patients with ADHD. Here, we aimed to understand the neural modulations of the attention networks underlying these improvements. Fifty boys (...) participated in a functional magnetic resonance imaging study in which unique or repeatedly presented sounds were placed before a visual flanker task in 2/3 of the trials. We found that presenting any sound improved task performance in all participants, but the underlying neural mechanisms differed for the type of sound. Familiar sounds led to a stronger increase in activity in the left posterior insula in patients with ADHD compared to typically developing peers. Novel sounds led to activations of the fronto-temporoparietal ventral attention network, likewise in ADHD and TD. These changes in signaling by novelty in the right inferior frontal gyrus were directly related to improved response speed showing that neural orienting network activity following novel sounds facilitated subsequent attentional performance. This mechanism of behavioral enhancement by short distractions could potentially be useful for cognitive trainings or homework situations. (shrink)

Audio features such as inharmonicity, noisiness, and spectral roll-off have been identified as correlates of “noisy” sounds. However, such features are likely involved in the experience of multiple semantic timbre categories of varied meaning and valence. This paper examines the relationships of stimulus properties and audio features with the semantic timbre categories raspy/grainy/rough, harsh/noisy, and airy/breathy. Participants rated a random subset of 52 stimuli from a set of 156 approximately 2-s orchestral instrument sounds representing varied instrument families, registers, and (...) both traditional and extended playing techniques. Stimuli were rated on the three semantic categories of interest, as well as on perceived playing exertion and emotional valence. Correlational analyses demonstrated a strong negative relationship between positive valence and perceived physical exertion. Exploratory linear mixed models revealed significant effects of extended technique and pitch register on valence, the perception of physical exertion, raspy/grainy/rough, and harsh/noisy. Instrument family was significantly related to ratings of airy/breathy. With an updated version of the Timbre Toolbox, we used 44 summary audio features, extracted from the stimuli using spectral and harmonic representations, as input for various models built to predict mean semantic ratings for each sound on the three semantic categories, on perceived exertion, and on valence. Random Forest models predicting semantic ratings from audio features outperformed Partial Least-Squares Regression models, consistent with previous results suggesting that non-linear methods are advantageous in timbre semantic predictions using audio features. Relative Variable Importance measures from the models among the three semantic categories demonstrate that although these related semantic categories are associated in part with overlapping features, they can be differentiated through individual patterns of audio feature relationships. (shrink)

Hearing loss in old age, which often goes untreated, has far-reaching consequences. Furthermore, reduction of cognitive abilities and dementia can also occur, which also affects quality of life. The aim of this study was to investigate the hearing performance of seniors without hearing complaints with respect to speech perception in noise and the ability to localize sounds. Results were tested for correlations with age and cognitive performance. The study included 40 subjects aged between 60 and 90 years with not self-reported (...) hearing problems. The subjects were screened for dementia. Audiological tests included pure-tone audiometry and speech perception in two types of background noise which was either co-located or spatially separated from the target speech. Sound localization ability was assessed and hearing performance was self-evaluated by a questionnaire. Speech in noise and sound localization was compared with young normal hearing adults. Although considering themselves as hearing normal, 17 subjects had at least a mild hearing loss. There was a significant negative correlation between hearing loss and dementia screening score. Speech perception in noise decreased significantly with age. There were significant negative correlations between speech perception in noise and DemTect score for both spatial configurations. Mean SRTs obtained in the co-located noise condition with amplitude-modulated noise were on average 3.1 dB better than with continuous noise. This gap-listening effect was severely diminished compared to a younger normal hearing subject group. In continuous noise, spatial separation of speech and noise led to better SRTs compared to the co-located masker condition. SRTs in MSNF deteriorated in modulated noise compared to continuous noise by 2.6 dB. Highest impact of age was found for speech perception scores using noise stimuli with temporal modulation in binaural test conditions. Mean localization error was in the range of young adults. Mean amount of front/back confusions was 11.5% higher than for young adults. Speech perception tests in the presence of temporally modulated noise can serve as a screening method for early detection of hearing disorders in older adults. This allows for early prescription of hearing aids. (shrink)

The goal of this study is to investigate whether different types of structures and lexical tones of Chinese characters cause different processing fluency. In Experiment 1, participants’ explicit affective assessments of Chinese characters with different structures, frequencies, and lexical tones were analyzed. Results indicated that participants showed explicit preferences and dispreferences to different structures and lexical tones. In Experiment 2, participants’ implicit responses to different structures and lexical tones were investigated using a metaphor experimental paradigm. Results were consistent with the (...) major findings of Experiment 1. In Experiments 3 and 4, participants’ recognition of words of different structures and lexical tones were analyzed. Results revealed that participants had a better memory for Surround structure characters when stimuli were visually presented and for Tone 3 when stimuli were auditorily presented. Finally, the significance and implications of this study are discussed. (shrink)

In this article, we consider music and noise in terms of vibrational and transferable energy as well as from the evolutionary significance of the hearing system of Homo sapiens. Music and sound impinge upon our body and our mind and we can react to both either positively or negatively. Much depends, in this regard, on the frequency spectrum and the level of the sound stimuli, which may sometimes make it possible to set music apart from noise. There (...) are, however, two levels of description: the physical-acoustic description of the sound and the subjective-psychological reactions by the listeners. Starting from a vibrational approach to sound and music, we first investigate how sound may activate the sense of touch and the vestibular system of the inner ear besides the sense of hearing. We then touch upon distinct issues such as the relation between low-frequency sounds and annoyance, the harmful effect of loud sound and noise, the direct effects of overstimulation with sound, the indirect effects of unwanted sounds as related to auditory neurology, and the widespread phenomenon of liking loud sound and music, both from the point of view of behavioral and psychological aspects. (shrink)

Previous research has shown that although infants follow the gaze direction of robots, robot gaze does not facilitate infants’ learning for objects. The present study examined whether robot gaze affects infants’ object learning when the gaze behavior was accompanied by verbalizations. Twelve-month-old infants were shown videos in which a robot with accompanying verbalizations gazed at an object. The results showed that infants not only followed the robot’s gaze direction but also preferentially attended to the cued object when the ostensive verbal (...) signal was present. Moreover, infants showed enhanced processing of the cued object when ostensive and referential verbal signals were increasingly present. These effects were not observed when mere nonverbal sound stimuli instead of verbalizations were added. Taken together, our findings indicate that robot gaze accompanying verbalizations facilitates infants’ object learning, suggesting that verbalizations are important in the design of robot agents from which infants can learn. Keywords: gaze following; humanoid robot; infant learning; verbalization; cognitive development. (shrink)

Disparate theoretical viewpoints construe hypnotic suggestibility either as a stable trait, largely determined by underlying cognitive aptitude, or as a flexible skill amenable to attitudinal factors including beliefs and expectations. Circumscribed findings support both views. The present study attempted to consolidate these orthogonal perspectives through the lens of expectancy modification. We surreptitiously controlled light and sound stimuli to convince participants that they were responding strongly to hypnotic suggestions for visual and auditory hallucinations. Extending our previous findings, we indexed (...) hypnotic suggestibility by de-automatizing an involuntary audiovisual phenomenon—the McGurk effect. Here we show that, regardless of expectancy modification, the experimental procedure led to heightened expectations concerning future hypnotic response. We found little effect of expectation, however, on actual response to suggestion. Our findings intimate that, at least in the present experimental context, expectation hardly correlates with—and is unlikely to be a primary determinant of—high hypnotic suggestibility. (shrink)

Previous research has demonstrated that ratings of the perceived pleasantness and quality of odors can be modulated by auditory stimuli presented at around the same time. Here, we extend these results by assessing whether the hedonic congruence between odor and sound stimuli can modulate the perception of odor intensity, pleasantness, and quality in untrained participants. Unexpectedly, our results reveal that broadband white noise, which was rated as unpleasant in a follow-up experiment, actually had a more pronounced effect (...) on participants’ odor ratings than either the consonant or dissonant musical selections. In particular, participants rated the six smells used as being less pleasant and less sweet when they happened to be listening to white noise, as compared to any one of the other music conditions. What is more, these results also add evidence to support the existence of a close relationship between an odor’s hedonic character and the perception of odor quality. So, for example, independent of the sound condition, pleasant odors were rated as sweeter, less dry, and brighter than the unpleasant odors. These results are discussed in terms of their implications for the understanding of crossmodal correspondences between olfactory and auditory stimuli. (shrink)

We tested the hypothesis that perception of an alternative image in ambiguous figures would be manifest as high-frequency (gamma) components that become synchronized over multiple scalp sites as a ''cognitive binding'' process occurs. For 171 combinations of data from 19 electrodes, obtained from 17 subjects and 10 replicate stimuli, we calculated the difference in correlation between the response to first seeing an ambiguous figure and when the alternative percept for that figure became consciously realized (cognitively bound). Numerous statistically significant (...) correlation differences occurred in all frequency bands tested with ambiguous-figure stimulation, but not in two kinds of control data (a reaction-time test to sound stimuli and a no-task, mind-wandering test). Statistically significant correlation changes were widespread, involving frontal, parietal, central, and occipital regions of both hemispheres. Correlation changes were evident at each of five frequency bands, ranging up to 62.5 Hz. Most of the statistically significant correlation changes were not between adjacent sites but between sites relatively distant, both ipsilateral and contralateral. Typically, these correlation changes occurred in more than one frequency band. These results suggest that cognitive binding is a distinct mental state that is reliably induced by ambiguous-figure perception tasks. Coherent oscillations at multiple frequencies may reflect the mechanism by which such binding occurs. Moreover, different coherent frequencies may mediate different components of the total cognitive-binding process. (shrink)

Words sound slightly different each time they are said, both by the same talker and across talkers. Rather than hurting learning, lab studies suggest that talker variability helps infants learn similar sounding words. However, very little is known about how much variability infants hear within a single talker or across talkers in naturalistic input. Here, we quantified these types of talker variability for highly frequent words spoken to 44 infants, from naturalistic recordings sampled longitudinally over a year of life (...) (from 6 to 17 months). We used non‐contrastive acoustic measurements (e.g., mean pitch, duration, harmonics‐to‐noise ratio) and holistic measures of sound similarity (normalized acoustic distance) to quantify acoustic variability. We find three key results. First, pitch‐based variability was generally lower for infants' top talkers than across their other talkers, but overall acoustic distance is higher for tokens from the top talker versus the others. Second, the amount of acoustic variability infants heard could not be predicted from, and thus was not redundant with, other properties of the input such as the number of talkers or tokens, or proportion of speech from particular sources (e.g., women, children, electronics). Finally, we find that patterns of pitch‐based acoustic variability heard in naturalistic input were similar to those found with in‐lab stimuli that facilitated word learning. This large‐scale quantification of talker variability in infants' everyday input sets the stage for linking naturally occurring variability “in the wild” to early word learning. (shrink)

Odour-sound correspondences provide some of the most fascinating and intriguing examples of crossmodal associations, in part, because it is unclear from where exactly they originate. Although frequently used as similes, or figures of speech, in both literature and poetry, such smell-sound correspondences have recently started to attract the attention of experimental researchers too. To date, the findings clearly demonstrate that the majority of non-synaesthetic individuals associate orthonasally-presented odours with various different sound properties, e.g., pitch, instrument type, and (...) timbre, in a non-random manner. What is more, these auditory-olfactory associations exhibit a number of features that are common to other crossmodal associations, such as their consistency over time, and their bidirectionality. However, the psychological mechanism underpinning these associations in the general population remain unclear, with a number of distinct hypotheses having been put forward over the years. In this chapter, we consider auditory-olfactory associations in art and science, focusing on poetry, music composition, and performance. First, we provide examples of the use of auditory-olfactory synaesthetic metaphors in poetry, from William Shakespeare through to Romanticism, illustrating how crossmodal associations have appeared in literature for centuries. Then, we move on to focus on music composition and performance, describing a number of examples where auditory stimuli have been purposely matched with crossmodally corresponding olfactory and/or visual stimuli. Considering the scientific study of smell-sound correspondences, we review the key psychophysical studies demonstrating that, beyond the artistic context, robust and non-random crossmodal associations are also triggered in the majority of the general population. We discuss a number of hypotheses that have been put forward over the years to account for such associations, focusing on the idea that certain correspondences between olfactory and auditory stimuli are mediated by the emotional character of the component stimuli. (shrink)

The sounds that result from our movement and that mark the outcome of our actions typically convey useful information concerning the state of our body and its movement, as well as providing pertinent information about the stimuli with which we are interacting. Here we review the rapidly growing literature investigating the influence of non-veridical auditory cues (i.e., inaccurate in terms of their context, timing, and/or spectral distribution) on multisensory body and action perception, and on motor behavior. Inaccurate auditory cues (...) provide a unique opportunity to study cross-modal processes: the ability to detect the impact of each sense when they provide a slightly different message is greater. Additionally, given that similar cross-modal processes likely occur regardless of the accuracy or inaccuracy of sensory input, studying incongruent interactions are likely to also help us predict interactions between congruent inputs. The available research convincingly demonstrates that perceptions of the body, of movement, and of surface contact features (e.g., roughness) are influenced by the addition of non-veridical auditory cues. Moreover, auditory cues impact both motor behavior and emotional valence, the latter showing that sounds that are highly incongruent with the performed movement induce feelings of unpleasantness (perhaps associated with lower processing fluency). Such findings are relevant to the design of auditory cues associated with product interaction, and the use of auditory cues in sport performance and therapeutic situations given the impact on motor behavior. (shrink)

Since sound and music are powerful forces and drivers of human behavior and physiology, we propose the use of sonification to activate healthy breathing patterns in participants to induce relaxation. Sonification is often used in the context of biofeedback as it can represent an informational, non-invasive and real-time stimulus to monitor, motivate or modify human behavior. The first goal of this study is the proposal and evaluation of a distance-based biofeedback system using a tempo- and phase-aligned sonification strategy to (...) adapt breathing patterns and induce states of relaxation. A second goal is the evaluation of several sonification stimuli on 18 participants that were recruited online and of which we analyzed psychometric and behavioral data using, respectively questionnaires and respiration rate and ratio. Sonification stimuli consisted of filtered noise mimicking a breathing sound, nature environmental sounds and a musical phrase. Preliminary results indicated the nature stimulus as most pleasant and as leading to the most prominent decrease of respiration rate. The noise sonification had the most beneficial effect on respiration ratio. While further research is needed to generalize these findings, this study and its methodological underpinnings suggest the potential of the proposed biofeedback system to perform ecologically valid experiments at participants' homes during the COVID-19 pandemic. (shrink)

Previous studies have shown that Chinese speakers and non-Chinese speakers exhibit different patterns of cross-modal congruence for the lexical tones of Mandarin Chinese, depending on which features of the pitch they attend to. But is this pattern of language-specific listening a conscious cultural strategy or an automatic processing effect? If automatic, does it also apply when the same pitch contours no longer sound like speech? Implicit Association Tests (IATs) provide an indirect measure of cross-modal association. In a series of (...) IAT studies, conducted with participants with three kinds of language backgrounds (Chinese-dominant bilinguals, Chinese balanced bilinguals, and English speakers with no Chinese experience) we find language-specific congruence effects for Mandarin lexical tones but not for matched sine-wave stimuli. That is, for linguistic stimuli, non-Chinese speakers show advantages for pitch-height congruence (high-pointy, low-curvy); no congruence effects were found for Chinese speakers. For non-linguistic stimuli, all participant groups showed advantages for pitch-height congruence. The present findings suggest that non-lexical tone congruence (high-pointy, low-curvy) is a basic congruence pattern, and the acquisition of a language with lexical tone can alter this perception. (shrink)

A period of exposure to trains of simultaneous but spatially offset auditory and visual stimuli can induce a temporary shift in the perception of sound location. This phenomenon, known as the 'ventriloquist aftereffect', reflects a realignment of auditory and visual spatial representations such that they approach perceptual alignment despite their physical spatial discordance. Such dynamic changes to sensory representations are likely to underlie the brain's ability to accommodate inter-sensory discordance produced by sensory errors (particularly in sound localization) (...) and variability in sensory transduction. It is currently unknown, however, whether these plastic changes induced by adaptation to spatially disparate inputs occurs automatically or whether they are dependent on selectively attending to the visual or auditory stimuli. Here, we demonstrate that robust auditory spatial aftereffects can be induced even in the presence of a competing visual stimulus. Importantly, we found that when attention is directed to the competing stimuli, the pattern of aftereffects is altered. These results indicate that attention can modulate the ventriloquist aftereffect. © 2010 Elsevier B.V. (shrink)

How speech sounds are represented in the brain is not fully understood. The mismatch negativity has proven to be a powerful tool in this regard. The MMN event-related potential is elicited by a deviant stimulus embedded within a series of repeating standard stimuli. Listeners construct auditory memory representations of these standards despite acoustic variability. In most designs that test speech sounds, however, this variation is typically intra-category: All standards belong to the same phonetic category. In the current paper, inter-category (...) variation is presented in the standards. These standards vary in manner of articulation but share a common phonetic feature. In the standard retroflex experimental block, Mandarin Chinese speaking participants are presented with a series of “standard” consonants that share the feature [retroflex], interrupted by infrequent non-retroflex deviants. In the non-retroflex standard experimental block, non-retroflex standards are interrupted by infrequent retroflex deviants. The within-block MMN was calculated, as was the identity MMN to account for intrinsic differences in responses to the stimuli. We only observed a within-block MMN to the non-retroflex deviant embedded in the standard retroflex block. This suggests that listeners extract [retroflex] despite significant inter-category variation. In the non-retroflex standard block, because there is little on which to base a coherent auditory memory representation, no within-block MMN was observed. The iMMN to the retroflex was observed in a late time-window at centro-parieto-occipital electrode sites instead of fronto-central electrodes, where the MMN is typically observed, potentially reflecting the increased difficulty posed by the added variation in the standards. In short, participants can construct auditory memory representations despite significant acoustic and inter-category phonological variation so long as a shared phonetic feature binds them together. (shrink)

Many individuals on the autism spectrum are hypersensitive to certain sensory stimuli. For this group, as well as for non-autistic individuals with sensory processing disorders, being exposed to e.g. fluorescent lights, perfume odours, and various sounds and noises can be real torment. In this article, I consider the normative implications of such offence for the design of office spaces, which is a topic that has not received any attention from philosophers. After identifying different ways in which the senses of (...) hypersensitive workers might be protected within these spaces, I show that many of such accommodations can be made at reasonable cost, before arguing that doing so ought to be a legal requirement. (shrink)

This article argues that if panpsychism is true, then there are grounds for thinking that digitally-based artificial intelligence may be incapable of having coherent macrophenomenal conscious experiences. Section 1 briefly surveys research indicating that neural function and phenomenal consciousness may be both analog in nature. We show that physical and phenomenal magnitudes—such as rates of neural firing and the phenomenally experienced loudness of sounds—appear to covary monotonically with the physical stimuli they represent, forming the basis for an analog relationship (...) between the three. Section 2 then argues that if this is true and micropsychism—the panpsychist view that phenomenal consciousness or its precursors exist at a microphysical level of reality—is also true, then human brains must somehow manipulate fundamental microphysical-phenomenal magnitudes in an analog manner that renders them phenomenally coherent at a macro level. However, Sect. 3 argues that because digital computation abstracts away from microphysical-phenomenal magnitudes—representing cognitive functions non-monotonically in terms of digits—digital computation may be inherently incapable of realizing coherent macroconscious experience. Thus, if panpsychism is true, digital AI may be incapable of achieving phenomenal coherence. Finally, Sect. 4 briefly examines our argument’s implications for Tononi’s Integrated Information Theory theory of consciousness, which we contend may need to be supplanted by a theory of macroconsciousness as analog microphysical-phenomenal information integration. (shrink)

This article will consider sound as a glue between internal and external experience, a link between sensing and cognition, memory and perception. In looking at research in neuroscience, specifically Eugene Izhikevich’s work with models of spiking neurons, parallels may be drawn with faulty source monitoring where a subject cannot differentiate between external and internal stimuli, and with a collapsing of present into the past. These ideas will be discussed through a number of sonic artworks that have neural plasticity, (...) space and location at their core. (shrink)

Humans are capable of extracting recurring patterns from their environment via statistical learning (SL), an ability thought to play an important role in language learning and learning more generally. While much work has examined statistical learning in infants and adults, less work has looked at the developmental trajectory of SL during childhood to see whether it is fully developed in infancy or improves with age, like many other cognitive abilities. A recent study showed modality‐based differences in the effect of age (...) during childhood: While visual SL improved with age, auditory SL did not. This finding was taken as evidence for modality‐based differences in SL. However, since that study used auditory linguistic stimuli (syllables), the differential effect of age may have been driven by stimulus type (linguistic vs. non‐linguistic) rather than modality. Here, we ask whether age will affect performance similarly in the two modalities when non‐linguistic auditory stimuli are used (familiar sounds instead of syllables). We conduct a large‐scale study of children's performance on visual and non‐linguistic auditory SL during childhood (ages 5–12 years). The results show a similar effect of age in both modalities: Unlike previous findings, both visual and non‐linguistic auditory SL improved with age. These findings highlight the stimuli‐sensitive nature of SL and suggest that modality‐based differences may be stimuli‐dependent, and that age‐invariance may be limited to linguistic stimuli. (shrink)

Autonomous sensory meridian response is a complex sensory-emotional experience characterized by pleasant tingling sensations initiating at the scalp. ASMR is triggered in some people by stimuli including whispering, personal attention, and crisp sounds. Since its inception, ASMR has been likened to synesthesia, but convincing empirical data directly linking ASMR with synesthesia is lacking. In this study, we examined whether the prevalence of synesthesia is indeed significantly higher in ASMR-responders than non-responders. A sample of working adults and students were surveyed (...) about their experience with ASMR and common types of synesthesia. The proportion of synesthetes who were classified as ASMR-responders was 52%, whereas 22% of ASMR-responders were also synesthetes. These results suggest that: over half of those identifying as synesthetes also experience ASMR, and that synesthesia is up to four times as common among ASMR-responders as among non-responders. Findings also suggest a prevalence rate for ASMR of approximately 20%. Overall, the co-occurrence of ASMR and synesthesia lends empirical support to the idea that ASMR may be driven by synesthetic mechanisms, but future research would benefit from examining how ASMR and synesthesia are different, as well as similar. (shrink)

A long-standing question in cognitive science is how high-level knowledge is integrated with sensory input. For example, listeners can leverage lexical knowledge to interpret an ambiguous speech sound, but do such effects reflect direct top-down influences on perception or merely postperceptual biases? A critical test case in the domain of spoken word recognition is lexically mediated compensation for coarticulation (LCfC). Previous LCfC studies have shown that a lexically restored context phoneme (e.g., /s/ in Christma#) can alter the perceived place (...) of articulation of a subsequent target phoneme (e.g., the initial phoneme of a stimulus from a tapes-capes continuum), consistent with the influence of an unambiguous context phoneme in the same position. Because this phoneme-to-phoneme compensation for coarticulation is considered sublexical, scientists agree that evidence for LCfC would constitute strong support for top–down interaction. However, results from previous LCfC studies have been inconsistent, and positive effects have often been small. Here, we conducted extensive piloting of stimuli prior to testing for LCfC. Specifically, we ensured that context items elicited robust phoneme restoration (e.g., that the final phoneme of Christma# was reliably identified as /s/) and that unambiguous context-final segments (e.g., a clear /s/ at the end of Christmas) drove reliable compensation for coarticulation for a subsequent target phoneme. We observed robust LCfC in a well-powered, preregistered experiment with these pretested items (N = 40) as well as in a direct replication study (N = 40). These results provide strong evidence in favor of computational models of spoken word recognition that include top–down feedback. (shrink)

The ability to resist distracting stimuli whilst voluntarily focusing on a task is fundamental to our everyday cognitive functioning. Here, we investigated how this ability develops, and thereafter declines, across the lifespan using a single task/experiment. Young children (5–7 years), older children (10–11 years), young adults (20–27 years), and older adults (62–86 years) were presented with complex visual scenes. Endogenous (voluntary) attention was engaged by having the participants search for a visual target presented on either the left or right (...) side of the display. The onset of the visual scenes was preceded – at stimulus onset asynchronies (SOAs) of 50, 200, or 500 ms – by a task-irrelevant sound (an exogenous crossmodal spatial distractor) delivered either on the same or opposite side as the visual target, or simultaneously on both sides (cued, uncued, or neutral trials, respectively). Age-related differences were revealed, especially in the extreme age-groups, which showed a greater impact of crossmodal spatial distractors. Young children were highly susceptible to exogenous spatial distraction at the shortest SOA (50 ms), whereas older adults were distracted at all SOAs, showing significant exogenous capture effects during the visual search task. By contrast, older children and young adults' search performance was not significantly affected by crossmodal spatial distraction. Overall, these findings present a detailed picture of the developmental trajectory of endogenous resistance to crossmodal spatial distraction from childhood to old age and demonstrate a different efficiency in coping with distraction across the four age-groups studied. (shrink)

A number of ways of taxonomizing human learning have been proposed. We examine the evidence for one such proposal, namely, that there exist independent explicit and implicit learning systems. This combines two further distinctions, (1) between learning that takes place with versus without concurrent awareness, and (2) between learning that involves the encoding of instances (or fragments) versus the induction of abstract rules or hypotheses. Implicit learning is assumed to involve unconscious rule learning. We examine the evidence for implicit learning (...) derived from subliminal learning, conditioning, artificial grammar learning, instrumental learning, and reaction times in sequence learning. We conclude that unconscious learning has not been satisfactorily established in any of these areas. The assumption that learning in some of these tasks (e.g., artificial grammar learning) is predominantly based on rule abstraction is questionable. When subjects cannot report the rules that govern stimulus selection, this is often because their knowledge consists of instances or fragments of the training stimuli rather than rules. In contrast to the distinction between conscious and unconscious learning, the distinction between instance and rule learning is a sound and meaningful way of taxonomizing human learning. We discuss various computational models of these two forms of learning. (shrink)

A number of ways of taxonomizing human learning have been proposed. We examine the evidence for one such proposal, namely, that there exist independent explicit and implicit learning systems. This combines two further distinctions, between learning that takes place with versus without concurrent awareness, and between learning that involves the encoding of instances versus the induction of abstract rules or hypotheses. Implicit learning is assumed to involve unconscious rule learning. We examine the evidence for implicit learning derived from subliminal learning, (...) conditioning, artificial grammar learning, instrumental learning, and reaction times in sequence learning. We conclude that unconscious learning has not been satisfactorily established in any of these areas. The assumption that learning in some of these tasks is predominantly based on rule abstraction is questionable. When subjects cannot report the “implicitly learned” rules that govern stimulus selection, this is often because their knowledge consists of instances or fragments of the training stimuli rather than rules. In contrast to the distinction between conscious and unconscious learning, the distinction between instance and rule learning is a sound and meaningful way of taxonomizing human learning. We discuss various computational models of these two forms of learning. (shrink)

Processes governing the creation, perception and production of spoken words are sensitive to the patterns of speech sounds in the language user’s lexicon. Generative linguistic theory suggests that listeners infer constraints on possible sound patterning from the lexicon and apply these constraints to all aspects of word use. In contrast, emergentist accounts suggest that these phonotactic constraints are a product of interactive associative mapping with items in the lexicon. To determine the degree to which phonotactic constraints are lexically mediated, (...) we observed the effects of learning new words that violate English phonotactic constraints on phonotactic perceptual repair processes in nonword consonant-consonant-vowel stimuli. Subjects who learned such words were less likely to “repair” illegal onset clusters and report them as legal ones. Effective connectivity analyses of MRI-constrained reconstructions of simultaneously collected magnetoencephalography and EEG data showed that these behavioral shifts were accompanied by changes in the strength of influences of lexical areas on acoustic-phonetic areas. These results strengthen the interpretation of previous results suggesting that phonotactic constraints on perception are produced by top-down lexical influences on speech processing. (shrink)

Previous findings indicate that negative arousal enhances bottom-up attention biases favouring perceptual salient stimuli over less salient stimuli. The current study tests whether those effects were driven by emotional arousal or by negative valence by comparing how well participants could identify visually presented letters after hearing either a negative arousing, positive arousing or neutral sound. On each trial, some letters were presented in a high contrast font and some in a low contrast font, creating a set of (...) targets that differed in perceptual salience. Sounds rated as more emotionally arousing led to more identification of highly salient letters but not of less salient letters, whereas sounds’ valence ratings did not impact salience biases. Thus, arousal, rather than valence, is a key factor enhancing visual processing of perceptually salient targets. (shrink)

I argue that a study of the Nicomachean Ethics and of the Parva Naturalia shows that Aristotle had a notion of attention. This notion captures the common aspects of apparently different phenomena like perceiving something vividly, being distracted by a loud sound or by a musical piece, focusing on a geometrical problem. For Aristotle, these phenomena involve a specific selectivity that is the outcome of the competition between different cognitive stimuli. This selectivity is attention. I argue that Aristotle (...) studied the common aspects of the physiological processes at the basis of attention and its connection with pleasure. His notion can explain perceptual attention and intellectual attention as voluntary or involuntary phenomena. In addition, it sheds light on how attention and enjoyment can enhance our cognitive activities. (shrink)

In lieu of an abstract, here is a brief excerpt of the content:Philosophy, Psychiatry, & Psychology 11.1 (2004) 65-70 [Access article in PDF] Top-Down and Bottom-Up in Delusion Formation Jakob Hohwy Keywords delusions, top-down, bottom-up, predictive coding Some delusions may arise as responses to unusual experiences (Davies et al. 2001; Maher 1974;). The implication is that delusion formation in some cases involves some kind of bottom-up mechanism—roughly, from perception to belief. Delusion formation may also involve some kind of top-down mechanism. (...) This could be in the shape of a patient's flawed background beliefs, or biases, which somehow modulate perception or ensure delusional interpretations of experience. There is little agreement about what kind of mechanism is primary in delusion formation, or, indeed, what the particular mechanisms and their neural substrates might be.In the evaluation of top-down and bottom-up mechanisms in delusion formation, a number of conceptual questions should be addressed (Davies and Coltheart 2000). For example, if there is an experiential component, why is a hypothesis with a delusional explanation of the unusual experience seen as relevant? Why do the subjects come to believe it tenaciously? How come some unusual experiences do not develop into delusions?A number of empirical findings also need to be taken into account: for example, the damage to the autonomic system in Capgras delusion (Ellis et al. 1997), the decreased ability for fast error correction in schizophrenia (Frith and Done 1989), modulation of activity in parietal cortex in delusions of alien control and other passivity experiences (Blakemore, Oakley, and Frith 2003), and also in schizophrenia, the increased sensitivity to self-produced stimuli, such as tickling oneself (Blakemore et al. 2000) and the sound of one's own voice (Ford et al. 2001).Theory choice can also be guided by philosophical doctrines about, for example, the nature of belief, the constitutive role of rationality, and intersubjectivity and the nature of judgements about the external world. It is natural, however, to let beliefs about philosophical doctrine be secondary to empirical findings and conceptual issues.The distinction between bottom-up and top-down mechanisms is particularly sharp in John Campbell's (2001) account of delusions and in Tim Bayne and Elisabeth Pacherie's (2004) discussion of Campbell. In this discussion, top-down approaches are associated with the general philosophical doctrine of rationalism, and bottom-up approaches with the philosophical doctrine of empiricism. Campbell's account is top-down because he posits delusional framework beliefs that arise directly as a result of brain damage or malfunction, and that work in some top-down fashion on the interpretation of experience. Bayne [End Page 65] and Pacherie convincingly defend empiricism against Campbell's rationalist account. Among their many other objections, they briefly puzzle about how a delusional framework belief (e.g., that one's spouse is an impostor) in a top-down fashion could cause the damage to the autonomic system seen in the Capgras and Cotard delusions (2004, 1). I think this is a very important objection because skin conductance data are part of the evidence for the bottom-up hypothesis concerning the Capgras delusion. We could add to this, for example, that it is mysterious how belief in a top-down fashion could cause people with schizophrenia to be worse at fast error correction than normal controls, to be better at tickling themselves than normal controls, and to have an increased response to the sound of their own voice.On the other hand, although the skin conductance response (SCR) evidence suggests a bottom-up approach to the Capgras delusion, it does not explain the character of the subjective experience that is hypothesized to give rise to the delusional belief: reduced SCR is not part of the experience itself (thanks to Ian Gold for discussion of this). Something more is required to give a full account of the type of experience that gives rise to the delusion. Further, as they stand, most bottom-up accounts are unable to account for why reality testing fails for beliefs based on these experiences.Neither rationalism nor empiricism on their own seem able to address the conceptual questions while paying... (shrink)

Spoken word recognition involves a perceptual tradeoff between the reliance on the incoming acoustic signal and knowledge about likely sound categories and their co-occurrences as words. This study examined how adult second language (L2) learners navigate between acoustic-based and knowledge-based spoken word recognition when listening to highly variable, multi-talker truncated speech, and whether this perceptual tradeoff changes as L2 listeners gradually become more proficient in their L2 after multiple months of structured classroom learning. First language (L1) Mandarin Chinese listeners (...) and L1 English-L2 Mandarin adult listeners took part in a gating experiment. The L2 listeners were tested twice—once at the start of their intermediate/advanced L2 language class and again two months later. L1 listeners were only tested once. Participants were asked to identify syllable-tone words that varied in syllable token frequency (high/low according to a spoken word corpus) and syllable-conditioned tonal probability (most probable/least probable in speech given the syllable). The stimuli were recorded by 16 different talkers and presented at eight gates ranging from onset-only (gate 1) through onset+40 ms increments (gates 2 through 7) to the full word (gate 8). Mixed-effects regression modeling was used to compare performance to our previous study which used single-talker stimuli (Wiener, Lee, & Tao, 2019). The results indicated that multi-talker speech caused both L1 and L2 listeners to rely greater on knowledge-based processing of tone. L1 listeners were able to draw on distributional knowledge of syllable-tone probabilities in early gates and switch to predominantly acoustic-based processing when more of the signal was available. In contrast, L2 listeners, with their limited experience with talker range normalization, were less able to effectively transition from probability-based to acoustic-based processing. Moreover, for the L2 listeners, the reliance on such distributional information for spoken word recognition appeared to be conditioned by the nature of the acoustic signal. Single-talker speech did not result in the same pattern of probability-based tone processing, suggesting that knowledge-based processing of L2 speech may only occur under certain acoustic conditions, such as multi-talker speech. (shrink)