There has been a longstanding bias in the study of spoken language towards using writing to analyse speech. This approach is problematic in that it assumes language to be derived from an autonomous mental capacity to assemble words into sentences, while failing to acknowledge culture-specific ideas linked to writing. Words and sentences are writing constructs that hardly capture the sound-making actions involved in spoken language. This book brings to light research that has long revealed structures present in all languages (...) but which do not match the writing-induced concepts of traditional linguistic analysis. It demonstrates that language processes are not physiologically autonomous, and that speech structures are structures of spoken language. It then illustrates how speech acts can be studied using instrumental records, and how multisensory experiences in semantic memory couple to these acts, offering a biologically-grounded understanding of how spoken language conveys meaning and why it develops only in humans. (shrink)

An important application of cognitive architectures is to provide human performance models that capture psychological mechanisms in a form that can be “programmed” to predict task performance of human–machine system designs. Although many aspects of human performance have been successfully modeled in this approach, accounting for multitalker speech task performance is a novel problem. This article presents a model for performance in a two-talker task that incorporates concepts from psychoacoustics, in particular, masking effects and stream formation.

This paper outlines limitations to integrating social meaning into cognitive models of speech production and processing. The authors remind the reader that acoustic space is not the same as articulatory or auditory space and they point to the benefits of using relatively uncommon dynamic methods of acoustic analysis. Further, the authors argue in favor of a more complex and socially‐informed conception of ‘style’ than is typically used in work on language cognition.

Using speech act theory from the Philosophy of Language, this paper attempts to develop an ethical framework for the phenomenon of speech processing. We use the concepts of the illocutionary force and the illocutionary content of a speech act to explain the ethics of speech processing. By emphasizing the different stages involved in speech processing, we explore the distinct ethical issues that arise in relation to each stage. Input, processing, and output (...) are the different ethically relevant stages under which a spoken item or a speech navigates within the range of speech-processing modules. Employing the illocutionary force-content distinction, we specify and characterize the input-related ethical issues, the output-related ethical issues, and the processing-related ethical issues involved in speech processing. Together with illocutionary force-content distinction, we employ the data-information distinction to characterize the stage-wise ethical issues in the phenomenon of speech processing as the ethics of collecting (speech) data, the ethics of contextualizing (speech) data/information, and the ethics of releasing the con-textualized information (processed speech). Immediate ethical issues that arise from the range of speech processing modules are distinguished from distant ethical issues. We also indicate the nature of ethical issues that arise from Speaker Independent speech technologies. (shrink)

We consider Sussman et al. 's suggestion that auditory biases for processing low-noise relationships among pairs of acoustic variables is a preadaptation for human speech processing. Data from other animal communication systems, especially those involving sexual selection, also suggest that neural biases in the receiver system can generate strong selection on the form of communication signals.

Earlier studies have shown that musically trained individuals may have a benefit in adverse listening situations when compared to non-musicians, especially in speech-on-speech perception. However, the literature provides mostly conflicting results. In the current study, by employing different measures of spoken language processing, we aimed to test whether we could capture potential differences between musicians and non-musicians in speech-on-speech processing. We used an offline measure of speech perception, which reveals a post-task response, and (...) online measures of real time spoken language processing: gaze-tracking and pupillometry. We used stimuli of comparable complexity across both paradigms and tested the same groups of participants. In the sentence recall task, musicians recalled more words correctly than non-musicians. In the eye-tracking experiment, both groups showed reduced fixations to the target and competitor words’ images as the level of speech maskers increased. The time course of gaze fixations to the competitor did not differ between groups in the speech-in-quiet condition, while the time course dynamics did differ between groups as the two-talker masker was added to the target signal. As the level of two-talker masker increased, musicians showed reduced lexical competition as indicated by the gaze fixations to the competitor. The pupil dilation data showed differences mainly in one target-to-masker ratio. This does not allow to draw conclusions regarding potential differences in the use of cognitive resources between groups. Overall, the eye-tracking measure enabled us to observe that musicians may be using a different strategy than non-musicians to attain spoken word recognition as the noise level increased. However, further investigation with more fine-grained alignment between the processes captured by online and offline measures is necessary to establish whether musicians differ due to better cognitive control or sound processing. (shrink)

Wilkins & Wakefield suggest that changes in the hominid brain made it uniquely “preadaptive” for language, yet no precursor functions served as adaptive substrates to the emergence of language. We present contrary evidence that the ability to discriminate and process rapid and complex auditory information is a cross-species function subserving communication processes including, but not limited to, human speech perception. We suggest that auditory temporal processing served as an evolutionary precursor to speech processing and consequent language (...) development in humans. (shrink)

Socio-emotional impairments are key symptoms of Autism Spectrum Disorders. This work proposes to analyze the neuronal activity related to the discrimination of emotional prosodies in autistic children as follows. Firstly, a database for single words uttered in Mexican Spanish by males, females, and children will be created. Then, optimal acoustic features for emotion characterization will be extracted, followed of a cubic kernel function Support Vector Machine in order to validate the speech corpus. As a result, human-specific acoustic properties of (...) emotional voice signals will be identified. Secondly, those identified acoustic properties will be modified to synthesize the recorded human emotional voices. Thirdly, both human and synthesized utterances will be used to study the electroencephalographic correlate of affective prosody processing in typically developed and autistic children. Finally, and on the basis of the outcomes, synthesized voice-enhanced environments will be created to develop an intervention based on social-robot and Social StoryTM for autistic children to improve affective prosodies discrimination. This protocol has been registered at BioMed Central under the following number: ISRCTN18117434. (shrink)

Speech planning is a sophisticated process. In dialog, it regularly starts in overlap with an incoming turn by a conversation partner. We show that planning spoken responses in overlap with incoming turns is associated with higher processing load than planning in silence. In a dialogic experiment, participants took turns with a confederate describing lists of objects. The confederate’s utterances (to which participants responded) were pre‐recorded and varied in whether they ended in a verb or an object noun and (...) whether this ending was predictable or not. We found that response planning in overlap with sentence‐final verbs evokes larger task‐evoked pupillary responses, while end predictability had no effect. This finding indicates that planning in overlap leads to higher processing load for next speakers in dialog and that next speakers do not proactively modulate the time course of their response planning based on their predictions of turn endings. The turn‐taking system exerts pressure on the language processing system by pushing speakers to plan in overlap despite the ensuing increase in processing load. (shrink)

The first of its kind to thoroughly cover language technology at all levels and with all modern technologies this book takes an empirical approach to the ...

Socially Responsible Investment (SRI) has grown considerably over the past three decades. One form of SRI, engagement-SRI, is today by far the most practiced form of SRI (in assets managed) and has the potential to mainstream SRI even further. However, lack of formalized engagement procedures and evaluation tools leave the engagement practice too opaque for such a mainstreaming. This article can be considered as a first step in the development of a standard for the engagement practice. By developing an engagement (...) heuristic, this article offers a more transparent engagement dialog. Drawing on Stevenson's and Austin's speech-act theories, this article develops a classification of management's responses to the signaling of allegations and controversies on two dimensions: a factual dimension concerning (dis)agreements on factual claims and an attitudinal dimension concerning (dis)agreements on responsibilities, values, and norms. On the basis of the distinctions this article develops, the authors provide for a synoptic table and offer a next-step heuristic for the engagement process that started with signaling a concern to management. The article uses an engagement logic that, while keeping the exit option for the investor open, allows management to address signaled concerns without having to let down or to opt out at the first setback in the dialog process between investor and investee corporation. (shrink)

Predictions during language comprehension are currently discussed from many points of view. One area where predictive processing may play a particular role concerns poetic language that is regularized by meter and rhyme, thus allowing strong predictions regarding the timing and stress of individual syllables. While there is growing evidence that these prosodic regularities influence language processing, less is known about the potential influence of prosodic preferences on neurophysiological processes. To this end, the present electroencephalogram study examined whether the (...) predictability of strong and weak syllables within metered speech would differ as a function of meter. Strong, i.e., accented positions within a foot should be more predictable than weak, i.e., unaccented positions. Our focus was on disyllabic pseudowords that solely differed between trochaic and iambic structure, with trochees providing the preferred foot in German. Methodologically, we focused on the omission Mismatch Negativity that is elicited when an anticipated auditory stimulus is omitted. The resulting electrophysiological brain response is particularly interesting because its elicitation does not depend on a physical stimulus. Omissions in deviant position of a passive oddball paradigm occurred at either first- or second-syllable position of the aforementioned pseudowords, resulting in a 2-by-2 design with the factors foot type and omission position. Analyses focused on the mean oMMN amplitude and latency differences across the four conditions. The result pattern was characterized by an interaction of the effects of foot type and omission position for both amplitudes and latencies. In first position, omissions resulted in larger and earlier oMMNs for trochees than for iambs. In second position, omissions resulted in larger oMMNs for iambs than for trochees, but the oMMN latency did not differ. The results suggest that omissions, particularly in initial position, are modulated by a trochaic preference in German. The preferred strong-weak pattern may have strengthened the prosodic prediction, especially for matching, trochaic stimuli, such that the violation of this prediction led to an earlier and stronger prediction error. Altogether, predictive processing seems to play a particular role in metered speech, especially if the meter is based on the preferred foot type. (shrink)

Socially Responsible Investment (SRI) has grown considerably over the past three decades. One form of SRI, engagement-SRI, is today by far the most practiced form of SRI (in assets managed) and has the potential to mainstream SRI even further. However, lack of formalized engagement procedures and evaluation tools leave the engagement practice too opaque for such a mainstreaming. This article can be considered as a first step in the development of a standard for the engagement practice. By developing an engagement (...) heuristic, this article offers a more transparent engagement dialog. Drawing on Stevenson’s and Austin’s speech-act theories, this article develops a classification of management’s responses to the signaling of allegations and controversies on two dimensions: a factual dimension concerning (dis)agreements on factual claims and an attitudinal dimension concerning (dis)agreements on responsibilities, values, and norms. On the basis of the distinctions this article develops, the authors provide for a synoptic table and offer a next-step heuristic for the engagement process that started with signaling a concern to management. The article uses an engagement logic that, while keeping the exit option for the investor open, allows management to address signaled concerns without having to let down or to opt out at the first setback in the dialog process between investor and investee corporation. (shrink)

Older adults process emotional speech differently than young adults, relying less on prosody (tone) relative to semantics (words). This study aimed to elucidate the mechanisms underlying these age-related differences via an emotional speech-in-noise test. A sample of 51 young and 47 older adults rated spoken sentences with emotional content on both prosody and semantics, presented on the background of wideband speech-spectrum noise (sensory interference) or on the background of multi-talker babble (sensory/cognitive interference). The presence of wideband noise (...) eliminated age-related differences in semantics but not in prosody when processing emotional speech. Conversely, the presence of babble resulted in the elimination of age-related differences across all measures. The results suggest that both sensory and cognitive-linguistic factors contribute to age-related changes in emotional speech processing. Because real world conditions typically involve noisy background, our results highlight the importance of testing under such conditions. (shrink)

Speech and music reflect extraordinary aspects of human cognitive abilities. Pitch, as an important parameter in the auditory domain, has been the focus of previous research on the relations between speech and music. The present study continues this line of research by focusing on two aspects of pitch processing: pitch prominence and melodic expectation. Specifically, we examined the perceived boundary of prominence for focus/accent in speech and music, plus the comparison between the pitch expectation patterns of (...) music and speech. Speech (Mandarin Chinese) and music stimuli were created with different interval steps that increased from 1 semitone to 12 semitones from the third to the fourth word/note of a sentence/melody. The results showed that ratings of both accent/focus and expectation/surprise increased with increasing semitone distance from the baseline (though this pattern was mixed with tonal stability profiles for the melodies). Nevertheless, the perceived boundary of prominence was different for music and speech, with the boundary for detecting prominence in speech higher than that in music. Expectation also showed different patterns for speech and music. The results thus favor the suggestion that speech prosody and music melody tend to require specialized pitch patterns unique to their own respective communication purposes. (shrink)

While influential works since the 1970s have widely assumed that imitation is an innate skill in both human and non-human primate neonates, recent empirical studies and meta-analyses have challenged this view, indicating other forms of reward-based learning as relevant factors in the development of social behavior. The visual input translation into matching motor output that underlies imitation abilities instead seems to develop along with social interactions and sensorimotor experience during infancy and childhood. Recently, a new visual stream has been identified (...) in both human and non-human primate brains, updating the dual visual stream model. This third pathway is thought to be specialized for dynamics aspects of social perceptions such as eye-gaze, facial expression and crucially for audio-visual integration of speech. Here, we review empirical studies addressing an understudied but crucial aspect of speech and communication, namely the processing of visual orofacial cues and its integration with vocal auditory cues. Along this review, we offer new insights from our understanding of speech as the product of evolution and development of a rhythmic and multimodal organization of sensorimotor brain networks, supporting volitional motor control of the upper vocal tract and audio-visual voices-faces integration. (shrink)

The proposition that feedback is never necessary in speech recognition is examined for utterances consisting of sequences of words. In running speech the features near word boundaries are often modified according to language-dependent rules. Application of these rules during word recognition requires top-down processing. Because isolated words are not usually modified by rules, their recognition could be achieved by bottom-up processing only.

Inner speech vs. anendophasia: Questions of information, serendipity, and the mental realm’s connection with nature.