© 2016 Elsevier LtdJumping spiders are famous for their visually driven behaviors [1]. Here, however, we present behavioral and neurophysiological evidence that these animals also perceive and respond to airborne acoustic stimuli, even when the distance between the animal and the sound source is relatively large and with stimulus amplitudes at the position of the spider of ∼65 dB sound pressure level. Behavioral experiments with the jumping spider Phidippus audax reveal that these animals respond to low-frequency sounds by freezing—a (...) common anti-predatory behavior characteristic of an acoustic startle response. Neurophysiological recordings from auditory-sensitive neural units in the brains of these jumping spiders showed responses to low-frequency tones —recordings that also represent the first record of acoustically responsive neural units in the jumping spider brain. Responses persisted even when the distances between spider and stimulus source exceeded 3 m and under anechoic conditions. Thus, these spiders appear able to detect airborne sound at distances in the acoustic far-field region, beyond the near-field range often thought to bound acoustic perception in arthropods that lack tympanic ears [2]. Furthermore, direct mechanical stimulation of hairs on the patella of the foreleg was sufficient to generate responses in neural units that also responded to airborne acoustic stimuli—evidence that these hairs likely play a role in the detection of acoustic cues. We suggest that these auditory responses enable the detection of predators and facilitate an acoustic startle response. Video. (shrink)

It seems trivial to identify sound sequences as music or speech, particularly when the sequences come from different sound sources, such as an orchestra and a human voice. Can we also easily distinguish these categories when the sequence comes from the same sound source? On the basis of which acoustic features? We investigated these questions by examining listeners’ classification of sound sequences performed by an instrument intertwining both speech and music: the dùndún talking drum. The dùndún is commonly used (...) in south-west Nigeria as a musical instrument but is also perfectly fit for linguistic usage in what has been described as speech surrogates in Africa. One hundred seven participants from diverse geographical locations (15 different mother tongues represented) took part in an online experiment. Fifty-one participants reported being familiar with the dùndún talking drum, 55% of those being speakers of Yorùbá. During the experiment, participants listened to 30 dùndún samples of about 7s long, performed either as music or Yorùbá speech surrogate (n= 15 each) by a professional musician, and were asked to classify each sample as music or speech-like. The classification task revealed the ability of the listeners to identify the samples as intended by the performer, particularly when they were familiar with the dùndún, though even unfamiliar participants performed above chance. A logistic regression predicting participants’ classification of the samples from several acoustic features confirmed the perceptual relevance of intensity, pitch, timbre, and timing measures and their interaction with listener familiarity. In all, this study provides empirical evidence supporting the discriminating role of acoustic features and the modulatory role of familiarity in teasing apart speech and music. (shrink)

This study investigated the perception of Mandarin tonal alternations in disyllabic words. In Mandarin, a low-dipping Tone3 is converted to a high-rising Tone2 when followed by another Tone3, known as third tone sandhi. Although previous studies showed statistically significant differences in F0 between a high-rising Sandhi-Tone3 and a Tone2, native Mandarin listeners failed to correctly categorize these two tones in perception tasks. The current study utilized the visual-world paradigm in eye-tracking to further examine whether acoustic details in (...) lexical tone aid lexical access in Mandarin. Results showed that Mandarin listeners tend to process Tone2 as Tone2 whereas they tend to first process Sandhi-T3 as both Tone3 and Tone2, then later detect the acoustic differences between the two tones revealed by the sandhi context, and finally activate the target word during lexical access. The eye-tracking results suggest that subtle acoustic details of F0 may facilitate lexical access in automatic fashion in a tone language. (shrink)

Speech perception under adverse conditions is a multistage process involving a dynamic interplay among acoustic, cognitive, and linguistic factors. Nevertheless, prior research has primarily focused on factors within this complex system in isolation. The primary goal of the present study was to examine the interaction between processing depth and the acoustic challenge of noise and its effect on processing effort during speech perception in noise. Two tasks were used to represent different depths of processing. The speech (...) recognition task involved repeating back a sentence after auditory presentation, while the tiredness judgment task entailed a subjective judgment of whether the speaker sounded tired. The secondary goal of the study was to investigate whether pupil response to alteration of dynamic pitch cues stems from difficult linguistic processing of speech content in noise or a perceptual novelty effect due to the unnatural pitch contours. Task-evoked peak pupil response from two groups of younger adult participants with typical hearing was measured in two experiments. Both tasks were implemented in both experiments, and stimuli were presented with background noise in Experiment 1 and without noise in Experiment 2. Increased peak pupil dilation was associated with deeper processing, particularly in the presence of background noise. Importantly, there is a non-additive interaction between noise and task, as demonstrated by the heightened peak pupil dilation to noise in the speech recognition task as compared to in the tiredness judgment task. Additionally, peak pupil dilation data suggest dynamic pitch alteration induced an increased perceptual novelty effect rather than reflecting effortful linguistic processing of the speech content in noise. These findings extend current theories of speech perception under adverse conditions by demonstrating that the level of processing effort expended by a listener is influenced by the interaction between acoustic challenges and depth of linguistic processing. The study also provides a foundation for future work to investigate the effects of this complex interaction in clinical populations who experience both hearing and cognitive challenges. (shrink)

With Walter Benjamin's notion of the optical unconscious as its starting point, this monograph develops a theory of the acoustical unconscious that refers both to the broadening of acoustic apperception via radio and film, and to a particular mode.

Listeners are able to quite accurately distinguish between different dialects of their native language, but little is known about the process of dialect identification and the phonetic cues listeners use to identify someone's regional origin. This study examines how different segments, acoustic between-dialect distance, and the listeners' knowledge about a dialect contribute to this process. Native speakers of Grison and Zurich German were asked to categorize isolated words spoken by eight speakers of Grison and eight speakers of Zurich German. (...) Stimuli contained either none, one, or two segmental cues to regional origin. The presence of one dialect-specific segment was enough to allow for an identification rate well above chance. Sensitivity measures and analysis of reaction time showed that the two dialect groups largely relied on the same segmental cues. Acoustic distance to the other dialect, quantified as Euclidean distance in the F1×F2 vowel space, generally facilitated dialect identification, but interacted with native speakers' general knowledge about the dialects: In segments which listeners explicitly associate with one of the two dialects, acoustic distance facilitated dialect recognition to a larger extent than in segments listeners are not aware of dialectal variation. The results suggest that, depending on the prior knowledge about a dialect, acoustic variation is weighted differently. Further analysis showed that Zurich listeners were more sensitive to the dialect differences, responded faster, and presented a more-marked own-dialect response bias than Grison listeners. These findings are in line with the status of Grison German as a marked and Zurich German as a neutral dialect and suggest that, depending on their own dialect's status, listeners used different decision strategies. (shrink)

Kierkegaard steadily maintains, against Lessing, that Jesus’s contemporaries had no advantage as regards faith merely because they had personal experience of him. It is a view proposed both by Johannes Climacus and Anti-Climacus, as well as over Kierkegaard’s own signature; it is indirectly communicated and then directly communicated, and so the importance of becoming a true contemporary of Jesus can hardly be underestimated in the authorship, including the later journals. When Michel Henry considers this motif in his Phénoménologie matérielle he (...) says that it is one feature of what Kierkegaard calls “’the strange acoustics of the spiritual world’ [l’étrange acoustique du monde spirituel].” These acoustics are not those we learn about in physics: “the laws of being in common are not in fact those belonging to things and the laws of perception,” and this claim gives Henry an opportunity to continue a long standing argument with Husserl. For “here” and “there” in Henry’s account of inter-subjectivity have no relation to the intersubjectivity that is explored in the fifth of the Cartesian Meditations. Indeed, Henry goes on to say, “This spiritual acoustics, which defies the laws of perception, defines our concrete relation to the other”; that is, it gives the “how” of the relation rather than the “what” or “why.”. (shrink)

This article concerns sound aesthetic preferences for European foreign languages. We investigated the phonetic-acoustic dimension of the linguistic aesthetic pleasure to describe the “music” found in European languages. The Romance languages, French, Italian, and Spanish, take a lead when people talk about melodious language – the music-like effects in the language (a.k.a., phonetic chill). On the other end of the melodiousness spectrum are German and Arabic that are often considered sounding harsh and un-attractive. Despite the public interest, limited research (...) has been conducted on the topic of phonaesthetics, i.e., the subfield of phonetics that is concerned with the aesthetic properties of speech sounds (Crystal, 2008). Our goal is to fill the existing research gap by identifying the acoustic features that drive the auditory perception of language sound beauty. What is so music-like in the language that makes people say “it is music in my ears”? We had 45 central European participants listening to 16 auditorily presented European languages and rating each language in terms of 22 binary characteristics (e.g., beautiful – ugly and funny – boring) plus indicating their language familiarities, L2 backgrounds, speaker voice liking, demographics, and musicality levels. Findings revealed that all factors in complex interplay explain a certain percentage of variance: familiarity and expertise in foreign languages, speaker voice characteristics, phonetic complexity, musical acoustic properties, and finally musical expertise of the listener. The most important discovery was the trade-off between speech tempo and so-called linguistic melody (pitch variance): the faster the language, the flatter/more atonal it is in terms of the pitch (speech melody), making it highly appealing acoustically (sounding beautiful and sexy), but not so melodious in a “musical” sense. (shrink)

This article explores and examines research in the field of human vocalization, proposing an evolutionary sequence for human acoustic perception and productive response. This involves updating and extending Charles Darwin’s 1871 proposal that musical communi­cation predated language, while providing the anatomical and behavioral foundations for the articulacy on which it depends. In presenting evidence on which a new consensus regarding the emergence of human vocal ability may be based, we present and review contributions from a wide range of (...) disciplines, illustrating that the phenomenon of human musicality may have had more of a core function in shaping our anatomy and culture than has hitherto been recognized. Essential to the adaptive sequence on which this depends is human perceptual and productive response to the properties of the Harmonic Series. Both music and language have emerged from the auditory and performative consequences of this relationship. (shrink)

To a first-order approximation we can place most worship services on a continuum between clarity and mystery, depending on the setting and content of the service. This liturgical space can be thought of as a combination of the physical acoustics of the worship space and the qualities of the sound created during the worship service. A very clear acoustic channel emphasizes semantic content, especially speech intelligibility. An immersive, reverberant acoustic emphasizes mystery and music. One of the chief challenges (...) in acoustical design is the fact that both clarity and immersion are subjectively preferred by audiences, yet these two goals are almost mutually exclusive of one another. The movement along this continuum in liturgical space can also be seen in the religious contexts for many of the worship spaces constructed in the West in the last two millennia. In the case of religious ceremony, a free field acoustic environment provides more clarity and precision in the spoken word received from God and given to the congregation. Yet a diffuse field environment provides an embodied, otherworldly sense of the supernatural: the mystery of the faith received which cannot merely be put into words. This tension is perceptible in many of the religious controversies in the West during this time period. This article examines the history of the spaces used by early Western Catholic Christians as well as those of the traditions—Lutheran and Calvinist—that left the Catholic faith during the 16th century Reformation. By considering the stated goals of these traditions alongside the architectural and liturgical innovations they created, it can be seen that emergent liturgical spaces mirror the assumptions of their respective traditions regarding the proper balance between semantic and aesthetic communication during the worship service. The Reformed faiths' emphasis on the power of the Word is reflected in the liturgical space of their services, while the Catholic faith gave greater priority to the role of Mystery, in their liturgical space as well as their explicit theology. Once constructed, these spaces also aid the cultural transmission of the sung or spoken liturgy of each tradition to future generations. (shrink)

This commentary focuses on the nature of combinatorial properties for speech and the locus equation. The presence of some overlap in locus equation space suggests that this higher order property may not be strictly invariant and may require other cues or properties for the perception of place of articulation. Moreover, combinatorial analysis in two-dimensional space and the resultant linearity appear to have a “special” status in the development of this theoretical framework. However, place of articulation is only one of (...) many phonetic dimensions in language. It is suggested that a multidimensional space including patterns derived in the frequency, amplitude, and time domains will be needed to characterize the phonetic categories of speech, and that although the derived properties ultimately may not meet the conditions of linearity, they will reflect a higher order acoustic invariance. (shrink)

Social and linguistic perceptions are linked. On one hand, talker identity affects speech perception. On the other hand, speech itself provides information about a talker's identity. Here, we propose that the same probabilistic knowledge might underlie both socially conditioned linguistic inferences and linguistically conditioned social inferences. Our computational–level approach—the ideal adapter—starts from the idea that listeners use probabilistic knowledge of covariation between social, linguistic, and acoustic cues in order to infer the most likely explanation of the speech signals (...) they hear. As a first step toward understanding social inferences in this framework, we use a simple ideal observer model to show that it would be possible to infer aspects of a talker's identity using cue distributions based on actual speech production data. This suggests the possibility of a single formal framework for social and linguistic inferences and the interactions between them. (shrink)

The overall goal of speech perception research is to explain how spoken language is recognized and understood. In the current research framework it is assumed that the key to achieving this overall goal is to solve the lack of invariance problem. But nearly half a century of sustained effort in a variety of theoretical perspectives has failed to solve this problem. Indeed, not only has the problem not been solved, virtually no empirical candidates for solving the problem have been (...) produced. One explanation for this lack of progress is simply that no theory has yet hit upon the correct set of invariant properties. Another explanation is that the goal of solving the lack of invariance problem is itself misguided. The most basic claim of this dissertation is that the latter explanation is correct. ;The lack of progress in explaining speech perception exhibited by the current research framework, I argue, is not, in the first instance, due to the failure of individual theories to solve the lack of invariance problem, but rather to the common background assumption that doing so is in fact the key to explaining speech perception. ;My overall argument in support of this basic claim has three main components: criticism of the empirical results of research in the current framework; criticism of the formulation of theories generated in the current research framework; and the availability of an alternative account of phonetic structure. ;The heart of my argument is an analysis of the character of the theoretical weaknesses of three theories of speech perception: the motor theory of speech perception, the ecological theory of speech perception, and the theory of acoustic invariance. I show that, in each case, the particular theoretical problems result from trying to satisfy the common goal of identifying invariant properties of phonetic percepts. ;I analyze the methodological error embodied in the current approach to explaining speech perception as, in general, one of abstracting the wrong kinds of properties from the detail of the speech event, and, in particular, of abstracting away from dynamic and context-dependent properties. (shrink)

Introduction. A radical tendency in modern approaches to understanding the mechanisms of the brain is the tendency of some scientists to believe that the brain is a receptor capable of capturing thoughts; the nature of the occurrence of the thoughts themselves, however, is not to be clarified. However, speech expressing thoughts is undoubtedly the result of the work of the brain, so studies of the frequency structure of speech can be the basis for considering the material structure of the brain (...) as a kind of “antenna”. In this approach, the problem of noise protection against the background of the undeniable frequency similarity of speech and music appears to us from somewhat different positions. This study raises the question of how essential the overall height of the musical system is to the perception of music (are there musical systems that are harmful or useful, in terms of their effects on the psyche). This question is also relevant to speech perception.Methodology and sources. The main sources in which the work of the brain and the essence of consciousness are considered from the positions indicated above were for us the work of American and British neurophysiologists and psychiatrists (Sam Parnia, Peter Fenwick). These scientists are studying the phenomena that accompany clinical death, and argue that at these moments the brain functions to the greatest extent as a receiving “antenna”. Assuming that any antenna is to be tuned, we are trying to identify possible ways to “tune” the brain. To do this, we propose to study the frequency characteristics of speech (in the simplest case, when singing vowels in a calm state) for their belonging to a particular musical system, as well as the peculiarities of music perception depending on the musical system (on the height of the note “la”). Varying the frequency characteristics of speech in a particular musical system can be considered, in our opinion, the main way to “tune” the brain. The methodology of the method is based on the use of frequency analysis of sound and the basic provisions of the elementary theory of music.Results and discussion. The main conclusion made by Western psychiatrists is the brain is not an organ of thought, consciousness exists independently from outside, the work of consciousness cannot be explained by the functioning of the brain – it requires a hardware check. If the neural network is an “antenna” that captures thoughts, and its “adjustment” at the physical level can be carried out (and is carried out) through sensory systems (including the hearing organ), the study of the frequency structure of speech will answer a number of important questions, including including related and higher brain functions (insight, creativity). Our experiments (Saint Petersburg Electrotechnical University, FIBS, department of EUT) showed that the influence of the “increased” or “lowered” musical-speech system on brain activity is insignificant. The study revealed the equiprobability of the frequency structure of speech. Since our brain lacks some characteristic set of frequencies – elements of a uniformly temperamental system, it is not necessary to talk about the harmful (or any other noise) effect of the “raised” and “lowered” systems due to deviation from the “internal standard”.Conclusion. In response to the assumptions made by Western experts, we proposed a frequency interpretation of the processes occurring in the brain, which, perhaps, will explain in more detail such phenomena as inspiration, discovery, etc., which occur with minimal activity of consciousness. Despite the limited methods of hardware study of factors that influence the activity of the brain and largely determine its higher functions (for example, creativity), the results of the brain's work in relation to music (both in terms of its creation and in terms of our reaction to it) are quite analyzable, which was shown in this study. The “musicality” of speech is extremely vividly represented in its frequency structure and allows one to reveal, to one degree or another, the features of the brain. (shrink)

Numerous studies have examined the acoustic correlates of sentential stress and its underlying linguistic functionality. However, the mechanism that connects stress cues to the listener's attentional processing has remained unclear. Also, the learnability versus innateness of stress perception has not been widely discussed. In this work, we introduce a novel perspective to the study of sentential stress and put forward the hypothesis that perceived sentence stress in speech is related to the unpredictability of prosodic features, thereby capturing the (...) attention of the listener. As predictability is based on the statistical structure of the speech input, the hypothesis also suggests that stress perception is a result of general statistical learning mechanisms. To study this idea, computational simulations are performed where temporal prosodic trajectories are modeled with an n-gram model. Probabilities of the feature trajectories are subsequently evaluated on a set of novel utterances and compared to human perception of stress. The results show that the low-probability regions of F0 and energy trajectories are strongly correlated with stress perception, giving support to the idea that attention and unpredictability of sensory stimulus are mutually connected. (shrink)

Mueller et al. discuss the role of acoustic cues in detecting language structure more generally. Across languages, there are clear links between acoustic cues and syntactic structure. They show that AGL experiments implementing analogous links demonstrate that prosodic cues, as well as various auditory biases, facilitate the learning of structural rules. Some of these biases, e.g. for auditory grouping, are also present in other species.

A sound in a real space (e.g. a street or a room) is studied by acousticians as the relationship between an anechoic signal and the reverberant sound field. We define ‘anechoic signal’ a signal representing the pressure variation emitted by the sound source, while the ‘reverberant field’ is a field representing the sum of all the sound reflections of the environment in which the sound exists, delayed in time due to the positions of the sound source and the listener. The (...) auditory ability of detecting a sound and assigning it to a source depends both on the anechoic signal and the reverberant sound field. This relationship has been analysed in acoustic literature using the autocorrelation properties of the anechoic signals and objective metrics of the sound field, the last ones being the ‘room criteria’ described in ISO 3382. In this context, the ‘effective duration’ of the autocorrelation function (τe) has been proposed as key factor to ‘preferred’ values of several room criteria in relation to different kind of music signals. Relying on some similarities between the definition of ‘auditory objects’ and the sound detection in a reverberant space, this paper proposes the use of τe as a potential tool to study and catalogue auditory objects. (shrink)

This study investigated the possible prosodic transfer influences native regional dialects may have in the perception of English lexical stress by speakers of three Chinese dialects [Beijing (BJ), Changsha (CS), and Guangzhou (GZ)] compared to 20 American English (AE) speakers. F0, duration, intensity, and vowel reduction were manipulated in nonce disyllabic words. Participants performed four-word sequence recall tasks to identify lexical stress location. They performed better with natural sounds than with manipulated words. This study focused on the performance differences (...) in manipulating words. The results showed that all four-group members performed similarly processing F0 condition nonce words. BJ and CS participants were more accurate than GZ participants in duration and vowel reduction cues. Reaction time (RT) suggested that the processing time of acoustic cues differed significantly across language groups. The findings indicate that first language (L1) dialect effect is robust in second language (L2) stress perception tasks. (shrink)

Although estrogens are widely considered circulating “sex steroid hormones” typically associated with female reproduction, recent evidence suggests that estrogens can act as local modulators of brain circuits in both males and females. The functional implications of this newly characterized estrogen signaling system have begun to emerge. This essay summarizes evidence in support of the hypothesis that the rapid production of estrogens in brain circuits can drive acute changes in both the production and perception of acoustic communication behaviors. These (...) studies have revealed two fundamental neurobiological concepts: (1) estrogens can be locally produced in brain circuits, independent of levels in nearby circuits and in the circulation and (2) estrogens can have very rapid effects within these brain circuits to modulate social vocalizations, acoustic processing, and sensorimotor integration. This vertebrate‐wide span of research, including vocalizing fishes, amphibians, and birds, emphasizes the importance of comparative model systems in understanding principles of neurobiology. (shrink)

Developmental dyslexia is considered to be most effectively addressed with preventive phonics-based interventions, including grapheme-phoneme coupling and blending exercises. These intervention types require intact speech perception abilities, given their large focus on exercises with auditorily presented phonemes. Yet some children with dyslexia experience problems in this domain due to a poorer sensitivity to rise times, i.e., rhythmic acoustic cues present in the speech envelope. As a result, the often subtle speech perception problems could potentially constrain an optimal (...) response to phonics-based interventions in at-risk children. The current study therefore aimed to extend existing research by examining the presence of potential speech perception deficits in pre-readers at cognitive risk for dyslexia when compared to typically developing peers and to explore the added value of a preventive auditory intervention for at-risk pre-readers, targeting rise time sensitivity, on speech perception and other reading-related skills. To obtain the first research objective, we longitudinally compared speech-in-noise perception between 28 5-year-old pre-readers with and 30 peers without a cognitive risk for dyslexia during the second half of the third year of kindergarten. The second research objective was addressed by exploring growth in speech perception and other reading-related skills in an independent sample of 62 at-risk 5-year-old pre-readers who all combined a 12-week preventive phonics-based intervention with an auditory story listening intervention. In half of the sample, story recordings contained artificially enhanced rise times, while in the other half, stories remained unprocessed. Results revealed a slower speech-in-noise perception growth in the at-risk compared to the non-at-risk group, due to an emerged deficit at the end of kindergarten. Concerning the auditory intervention effects, both intervention groups showed equal growth in speech-in-noise perception and other reading-related skills, suggesting no boost of envelope-enhanced story listening on top of the effect of combining GraphoGame-Flemish with listening to unprocessed stories. These findings thus provide evidence for a link between speech perception problems and dyslexia, yet do not support the potential of the auditory intervention in its current form. (shrink)

In Altered Sensations: Rudolph Koenig’s Acoustical Workshop in Nineteenth-Century Paris, David Pantalony achieves the difficult goal of balancing technical detail and historical narrative in his account of Rudolph Koenig and the nineteenth-century Parisian scientific instrument trade. The Parisian instrument making trade, particularly that of acoustical instruments, was at a high point in the mid-nineteenth century. Chief among scientific instrument makers was Rudolph Koenig (1832-1901), whose atelier at 30 Hautefeuille was at once an artisanal studio, a laboratory, a workshop and a (...) showroom. The negotiations necessary for one building, and one person, to channel such different activities is one of the main themes of Pantalony’s book. Pantalony shows that Koenig’s atelier was central to disputes surrounding the creation of the “modern soundscape” (p. 170). Debates regarding analytic versus holistic conceptions of sound, “objective” visual versus “subjective” by-ear modes of perception and measurement, and experimental versus theoretical results are all prominent in the text, and all framed by the different, but not disparate, functions of Koenig’s atelier; the building acts as a multi-faceted lens through which Pantalony considers Koenig and his instruments in their artistic, intellectual, commercial and social contexts. (shrink)

The term ‘Ohm's law’ traditionally denotes the formula of Georg Simon Ohm relating voltage, current, and resistance in metallic conductors. But to students of sensory physiology and its history, ‘Ohm's law’ also denotes another relationship: the fundamental principle of auditory perception that Ohm announced in 1843. This aspect of Ohm's science has attracted very little attention, partly because his galvanic researches so thoroughly eclipsed it in success and importance, and partly because Ohm's work in physiological acoustics had so little (...) immediate impact on the science of his time. On announcing his hypothesis in 1843, Ohm found himself drawn into a bitter dispute with the physicist August Seebeck, who successfully discredited the hypothesis and forced Ohm to withdraw from the field. (shrink)

What is noise?Noise is a central concept of acoustics that distinguishes certain kinds of sounds from others. Beyond sound, notions of noise associated with the measurement process and information theory have moved to virtually all fields of science and engineering, and even the social sciences. Not surprisingly, we find not one but several different and even contradictory concepts of noise in science and engineering. How did this happen?Scientific concepts of noise have changed over time. But they have also varied in (...) relation to a respective research field or technical application. The history of acoustics is characterised by its distinct relation to human sensation and perception of hearing, music and speech. (shrink)

Action perception and recognition are core abilities fundamental for human social interaction. A parieto-frontal network (the mirror neuron system) matches visually presented biological motion information onto observers' motor representations. This process of matching the actions of others onto our own sensorimotor repertoire is thought to be important for action recognition, providing a non-mediated “motor perception” based on a bidirectional flow of information along the mirror parieto-frontal circuits. State-of-the-art machine learning strategies for hand action identification have shown better performances (...) when sensorimotor data, as opposed to visual information only, are available during learning. As speech is a particular type of action (with acoustic targets), it is expected to activate a mirror neuron mechanism. Indeed, in speech perception, motor centers have been shown to be causally involved in the discrimination of speech sounds. In this paper, we review recent neurophysiological and machine learning-based studies showing (a) the specific contribution of the motor system to speech perception and (b) that automatic phone recognition is significantly improved when motor data are used during training of classifiers (as opposed to learning from purely auditory data). (shrink)

Among human and non-human animals, the ability to respond rapidly to biologically significant events in the environment is essential for survival and development. Research has confirmed that human adult listeners respond emotionally to environmental sounds by relying on the same acoustic cues that signal emotionality in speech prosody and music. However, it is unknown whether young children also respond emotionally to environmental sounds. Here, we report that changes in pitch, rate (i.e. playback speed), and intensity (i.e. amplitude) of environmental (...) sounds trigger emotional responses in 3- to 6-year-old American and Chinese children, including four sound types: sounds of human actions, animal calls, machinery, and natural phenomena such as wind and waves. Children’s responses did not differ across the four types of sounds used but developed with age – a finding observed in both American and Chinese children. Thus, the ability to respond emotionally to non-linguistic, non-music environmental sounds is evident at three years of age – an age when the ability to decode emotional prosody in language and music emerges. We argue that general mechanisms that support emotional prosody decoding are engaged by all sounds, as reflected in emotional responses to non-linguistic acoustic input such as music and environmental sounds. (shrink)

The concept of vocal charisma has changed in the past decades from something that people have to something that people do, thereby stimulating research on how vocal charisma can be created and improved. Broadening the perspective on vocal charisma beyond the speaker’s performance itself to the context of the speech, we conducted acoustic-prosodic analyses of public speeches of two prominent Israelian politicians – Benjamin Netanyahu and Benny Gantz. The speech material consisted of 311–516 prosodic phrases per politician from the (...) election campaigns 2019–2020 and, crucially, was balanced so as to include an equal number of pre- and post-election speeches. Results show a superiority of Netanyahu over Gantz in almost all facets of vocal charisma, although Gantz caught up over time. Moreover, unlike Gantz, Netanyahu showed a strong adaptation of his vocal charisma patterns to before- and after-election contexts. Scrutinizing this versatility difference, an additional perception experiment with 42 listeners and excerpts from the two politicians’ speeches was carried out. Results show that Netanyahu’s speech excerpts were, unlike those of Gantz, mainly rated as more charismatic in those contexts in which they were performed. Gantz’ post-election speech excerpts, by contrast, were primarily rated as not fitting into that context, i.e., as unfolding their charisma better in a pre-election context. Moreover, listeners also rated Netanyahu as overall more charismatic than Gantz. The combined production and perception evidence suggests the relevance of context in the evaluation and interpretation of vocal charisma signals. (shrink)

This study investigates the phonetics of German nuclear rise-fall contours in relation to contexts that trigger either a contrastive or a non-contrastive interpretation in the answer. A rise-fall contour can be conceived of a tonal sequence of L-H-L. A production study elicited target sentences in contrastive and non-contrastive contexts. The majority of cases realized showed a nuclear rise-fall contour. The acoustic analysis of these contours revealed a significant effect of contrastiveness on the height / alignment of the accent peak (...) as a function of focus context. On the other hand, the height / alignment of the low turning point at the beginning of the rise did not show an effect of contrastiveness. In a series of semantic congruency perception tests participants judged the congruency of congruent and incongruent context-stimulus pairs based on three different sets of stimuli: (i) original data, (ii) manipulation of accent peak, and (iii) manipulation of the leading low. Listeners distinguished nuclear rise-fall contours as a function of focus context (experiment 1 and 2), however not based on manipulations of the leading low (experiment 3). The results suggest that the alignment and scaling of the accentual peak are sufficient to license a contrastive interpretation of a nuclear rise-fall contour, leaving the rising part as a phonetic onglide, or as a low tone that does not interact with the contrastivity of the context. (shrink)

Low mean fundamental frequency (F 0) in men’s voices has been found to positively influence perceptions of dominance by men and attractiveness by women using standardized speech. Using natural speech obtained during an ecologically valid social interaction, we examined relationships between multiple vocal parameters and dominance and attractiveness judgments. Male voices from an unscripted dating game were judged by men for physical and social dominance and by women in fertile and non-fertile menstrual cycle phases for desirability in short-term and long-term (...) relationships. Five vocal parameters were analyzed: mean F 0 (an acoustic correlate of vocal fold size), F 0 variation, intensity (loudness), utterance duration, and formant dispersion (D f , an acoustic correlate of vocal tract length). Parallel but separate ratings of speech transcripts served as controls for content. Multiple regression analyses were used to examine the independent contributions of each of the predictors. Physical dominance was predicted by low F 0 variation and physically dominant word content. Social dominance was predicted only by socially dominant word content. Ratings of attractiveness by women were predicted by low mean F 0, low D f , high intensity, and attractive word content across cycle phase and mating context. Low D f was perceived as attractive by fertile-phase women only. We hypothesize that competitors and potential mates may attend more strongly to different components of men’s voices because of the different types of information these vocal parameters provide. (shrink)

Multiple acoustic dimensions signal speech categories. However, dimensions vary in their informativeness; some are more diagnostic of category membership than others. Speech categorization reflects these dimensional regularities such that diagnostic dimensions carry more “perceptual weight” and more effectively signal category membership to native listeners. Yet perceptual weights are malleable. When short-term experience deviates from long-term language norms, such as in a foreign accent, the perceptual weight of acoustic dimensions in signaling speech category membership rapidly adjusts. The present study (...) investigated whether rapid adjustments in listeners’ perceptual weights in response to speech that deviates from the norms also affects listeners’ own speech productions. In a word recognition task, the correlation between two acoustic dimensions signaling consonant categories, fundamental frequency and voice onset time, matched the correlation typical of English, and then shifted to an “artificial accent” that reversed the relationship, and then shifted back. Brief, incidental exposure to the artificial accent caused participants to down-weight perceptual reliance on F0, consistent with previous research. Throughout the task, participants were intermittently prompted with pictures to produce these same words. In the block in which listeners heard the artificial accent with a reversed F0 × VOT correlation, F0 was a less robust cue to voicing in listeners’ own speech productions. The statistical regularities of short-term speech input affect both speech perception and production, as evidenced via shifts in how acoustic dimensions are weighted. (shrink)

What are the factors that contribute to (or inhibit) diachronic sound change? While acoustically motivated sound changes are well documented, research on the articulatory and audiovisual-perceptual aspects of sound change is limited. This paper investigates the interaction of articulatory variation and audiovisual speech perception in the Northern Cities Vowel Shift (NCVS), a pattern of sound change observed in the Great Lakes region of the United States. We focus specifically on the maintenance of the contrast between the vowels /ɑ/ and (...) /ɔ/, both of which are fronted as a result of the NCVS. We present results from two experiments designed to test how the NCVS is produced and perceived. In the first experiment, we present data from an articulatory and acoustic analysis of the production of fronted /ɑ/ and /ɔ/. We find that some speakers distinguish /ɔ/ from /ɑ/ with a combination of both tongue position and lip rounding, while others do so using either tongue position or lip rounding alone. For speakers who distinguish /ɔ/ from /ɑ/ along only one articulatory dimension, /ɑ/ and /ɔ/ are acoustically more similar than for speakers who produce multiple articulatory distinctions. While all three groups of speakers maintain some degree of acoustic contrast between the vowels, the question is raised as to whether these articulatory strategies differ in their perceptibility. In the perception experiment, we test the hypothesis that visual speech cues play a role in maintaining contrast between the two sounds. The results of this experiment suggest that articulatory configurations in which /ɔ/ is produced with unround lips are perceptually weaker than those in which /ɔ/ is produced with rounding, even though these configurations result in acoustically similar output. We argue that these findings have implications for theories of sound change and variation in at least two respects: 1) visual cues can shape phonological systems through misperception-based sound change, and 2) phonological systems may be optimized not only for auditory but also for visual perceptibility. (shrink)

This paper addresses the question whether we can conceive of music cognition in ecosemiotic terms. It claims that music knowledge must be generated as a tool for adaptation to the sonic world and calls forth a shift from a structural description of music as an artifact to a process-like approach to dealing with music. As listeners, we are observers who construct and organize our knowledge and bring with us our observational tools. What matters is not merely the sonic world in (...) its objective qualities, but the world as perceived. In order to make these claims operational we can rely on the ecological concept of coping with the sonic world and the cybernetic concepts of artificial and adaptive devices. Listeners, on this view, are able to change their semantic relations with the sonic world through functional adaptations at the level of sensing, acting and coordinating between action and perception. This allows us to understand music in functional terms of what it affords to us and not merely in terms of its acoustic qualities. There are, however, degrees of freedom and constraints which shape the semiotization of the sonic world. As such we must consider the role of event perception and cognitive economy: listeners do not perceive the acoustical environment in terms of phenomenological descriptions but as ecological events. (shrink)

Music impacting on speech processing is vividly evidenced in most reports involving professional musicians, while the question of whether the facilitative effects of music are limited to experts or may extend to amateurs remains to be resolved. Previous research has suggested that analogous to language experience, musicianship also modulates lexical tone perception but the influence of amateur musical experience in adulthood is poorly understood. Furthermore, little is known about how acoustic information and phonological information of lexical tones are (...) processed by amateur musicians. This study aimed to provide neural evidence of cortical plasticity by examining categorical perception of lexical tones in Chinese adults with amateur musical experience relative to the non-musician counterparts. Fifteen adult Chinese amateur musicians and an equal number of non-musicians participated in an event-related potential (ERP) experiment. Their mismatch negativities (MMNs) to lexical tones from Mandarin Tone 2–Tone 4 continuum and non-speech tone analogs were measured. It was hypothesized that amateur musicians would exhibit different MMNs to their non-musician counterparts in processing two aspects of information in lexical tones. Results showed that the MMN mean amplitude evoked by within-category deviants was significantly larger for amateur musicians than non-musicians regardless of speech or non-speech condition. This implies the strengthened processing of acoustic information by adult amateur musicians without the need of focused attention, as the detection of subtle acoustic nuances of pitch was measurably improved. In addition, the MMN peak latency elicited by across-category deviants was significantly shorter than that by within-category deviants for both groups, indicative of the earlier processing of phonological information than acoustic information of lexical tones at the pre-attentive stage. The results mentioned above suggest that cortical plasticity can still be induced in adulthood, hence non-musicians should be defined more strictly than before. Besides, the current study enlarges the population demonstrating the beneficial effects of musical experience on perceptual and cognitive functions, namely, the effects of enhanced speech processing from music are not confined to a small group of experts but extend to a large population of amateurs. (shrink)

Five experiments are reported that concern selective perception and representation following dichotic presentations of competing word pairs differing only in their initial consonants . Only one word from each pair tended to be subjectively perceived, even when participants were encouraged to guess two words. Robust selective perception effects were evidenced as a function of stimulus affective valence. Control tasks showed that these effects could not be attributed to report biases or to the acoustic properties of the stimuli. (...) The unreported words were not recognized on a two-alternative forced-choice task but were recognized with a more sensitive ranking task. Additional cognitive activity during the intertrial interval weakened memory only for the words reported as perceived. Moreover, negative affective valence decreased the recognition of words reported as consciously perceived but increased recognition of unreported words. The implications of these findings for theories of unconscious processing are discussed. (shrink)

The concept of vocal charisma has changed in the past decades from something that people have to something that people do, thereby stimulating research on how vocal charisma can be created and improved. Broadening the perspective on vocal charisma beyond the speaker’s performance itself to the context of the speech, we conducted acoustic-prosodic analyses of public speeches of two prominent Israelian politicians – Benjamin Netanyahu and Benny Gantz. The speech material consisted of 311–516 prosodic phrases per politician from the (...) election campaigns 2019–2020 and, crucially, was balanced so as to include an equal number of pre- and post-election speeches. Results show a superiority of Netanyahu over Gantz in almost all facets of vocal charisma, although Gantz caught up over time. Moreover, unlike Gantz, Netanyahu showed a strong adaptation of his vocal charisma patterns to before- and after-election contexts. Scrutinizing this versatility difference, an additional perception experiment with 42 listeners and excerpts from the two politicians’ speeches was carried out. Results show that Netanyahu’s speech excerpts were, unlike those of Gantz, mainly rated as more charismatic in those contexts in which they were performed. Gantz’ post-election speech excerpts, by contrast, were primarily rated as not fitting into that context, i.e., as unfolding their charisma better in a pre-election context. Moreover, listeners also rated Netanyahu as overall more charismatic than Gantz. The combined production and perception evidence suggests the relevance of context in the evaluation and interpretation of vocal charisma signals. (shrink)

In this paper, I will try to integrate Joel Krueger’s enactive theory of music perception with some of Erwin Straus’ reflections on different forms of experiencing spatiality and movement. Krueger (2009, 2011b) maintains that music perception is a form of active perception, in which our body and our ability to move with music act as vehicles to draw out certain features of the piece and to respond to the affordances it presents. However, the author does not specify (...) what kind of movements are involved in the enactment of music perception. I will propose such a specification, using Straus’ distinction between goal-directed and expressive movements (Straus 1930). (shrink)

This event-related potential (ERP) study examined the impact of phonological variation resulting from a vowel merger on phoneme perception. The perception of the /e/–/ε/ contrast which does not exist in Southern French-speaking regions, and which is in the process of merging in Northern French-speaking regions, was compared to the /ø/–/y/ contrast, which is stable in all French-speaking regions. French-speaking participants from Switzerland for whom the /e/–/ε/ contrast is preserved, but who are exposed to different regional variants, had to (...) perform a same-different task. They first heard four phonemically identical but acoustically different syllables (e.g., /be/–/be/–/be/–/be/), and then heard the test syllable which was either phonemically identical to (/be/) or phonemically different from (/bε/) the preceding context stimuli. The results showed that the unstable /e/–/ε/ contrast only induced a mismatch negativity (MMN), whereas the /ø/–/y/ contrast elicited both a MMN and electrophysiological differences on the P200. These findings were in line with the behavioral results in which responses were slower and more error-prone in the /e/–/ε/ deviant condition than in the /ø/–/y/ deviant condition. Together these findings suggest that the regional variability in the speech input to which listeners are exposed affects the perception of speech sounds in their own accent. (shrink)