An important application of cognitive architectures is to provide human performance models that capture psychological mechanisms in a form that can be “programmed” to predict task performance of human–machine system designs. Although many aspects of human performance have been successfully modeled in this approach, accounting for multitalker speech task performance is a novel problem. This article presents a model for performance in a two-talker task that incorporates concepts from psychoacoustics, in particular, masking effects and stream formation.

There has been a longstanding bias in the study of spoken language towards using writing to analyse speech. This approach is problematic in that it assumes language to be derived from an autonomous mental capacity to assemble words into sentences, while failing to acknowledge culture-specific ideas linked to writing. Words and sentences are writing constructs that hardly capture the sound-making actions involved in spoken language. This book brings to light research that has long revealed structures present in all languages (...) but which do not match the writing-induced concepts of traditional linguistic analysis. It demonstrates that language processes are not physiologically autonomous, and that speech structures are structures of spoken language. It then illustrates how speech acts can be studied using instrumental records, and how multisensory experiences in semantic memory couple to these acts, offering a biologically-grounded understanding of how spoken language conveys meaning and why it develops only in humans. (shrink)

Using speech act theory from the Philosophy of Language, this paper attempts to develop an ethical framework for the phenomenon of speech processing. We use the concepts of the illocutionary force and the illocutionary content of a speech act to explain the ethics of speech processing. By emphasizing the different stages involved in speech processing, we explore the distinct ethical issues that arise in relation to each stage. Input, processing, and output (...) are the different ethically relevant stages under which a spoken item or a speech navigates within the range of speech-processing modules. Employing the illocutionary force-content distinction, we specify and characterize the input-related ethical issues, the output-related ethical issues, and the processing-related ethical issues involved in speech processing. Together with illocutionary force-content distinction, we employ the data-information distinction to characterize the stage-wise ethical issues in the phenomenon of speech processing as the ethics of collecting (speech) data, the ethics of contextualizing (speech) data/information, and the ethics of releasing the con-textualized information (processed speech). Immediate ethical issues that arise from the range of speech processing modules are distinguished from distant ethical issues. We also indicate the nature of ethical issues that arise from Speaker Independent speech technologies. (shrink)

This paper outlines limitations to integrating social meaning into cognitive models of speech production and processing. The authors remind the reader that acoustic space is not the same as articulatory or auditory space and they point to the benefits of using relatively uncommon dynamic methods of acoustic analysis. Further, the authors argue in favor of a more complex and socially‐informed conception of ‘style’ than is typically used in work on language cognition.

Wilkins & Wakefield suggest that changes in the hominid brain made it uniquely “preadaptive” for language, yet no precursor functions served as adaptive substrates to the emergence of language. We present contrary evidence that the ability to discriminate and process rapid and complex auditory information is a cross-species function subserving communication processes including, but not limited to, human speech perception. We suggest that auditory temporal processing served as an evolutionary precursor to speech processing and consequent language (...) development in humans. (shrink)

We consider Sussman et al. 's suggestion that auditory biases for processing low-noise relationships among pairs of acoustic variables is a preadaptation for human speech processing. Data from other animal communication systems, especially those involving sexual selection, also suggest that neural biases in the receiver system can generate strong selection on the form of communication signals.

Earlier studies have shown that musically trained individuals may have a benefit in adverse listening situations when compared to non-musicians, especially in speech-on-speech perception. However, the literature provides mostly conflicting results. In the current study, by employing different measures of spoken language processing, we aimed to test whether we could capture potential differences between musicians and non-musicians in speech-on-speech processing. We used an offline measure of speech perception, which reveals a post-task response, and (...) online measures of real time spoken language processing: gaze-tracking and pupillometry. We used stimuli of comparable complexity across both paradigms and tested the same groups of participants. In the sentence recall task, musicians recalled more words correctly than non-musicians. In the eye-tracking experiment, both groups showed reduced fixations to the target and competitor words’ images as the level of speech maskers increased. The time course of gaze fixations to the competitor did not differ between groups in the speech-in-quiet condition, while the time course dynamics did differ between groups as the two-talker masker was added to the target signal. As the level of two-talker masker increased, musicians showed reduced lexical competition as indicated by the gaze fixations to the competitor. The pupil dilation data showed differences mainly in one target-to-masker ratio. This does not allow to draw conclusions regarding potential differences in the use of cognitive resources between groups. Overall, the eye-tracking measure enabled us to observe that musicians may be using a different strategy than non-musicians to attain spoken word recognition as the noise level increased. However, further investigation with more fine-grained alignment between the processes captured by online and offline measures is necessary to establish whether musicians differ due to better cognitive control or sound processing. (shrink)

Socio-emotional impairments are key symptoms of Autism Spectrum Disorders. This work proposes to analyze the neuronal activity related to the discrimination of emotional prosodies in autistic children as follows. Firstly, a database for single words uttered in Mexican Spanish by males, females, and children will be created. Then, optimal acoustic features for emotion characterization will be extracted, followed of a cubic kernel function Support Vector Machine in order to validate the speech corpus. As a result, human-specific acoustic properties of (...) emotional voice signals will be identified. Secondly, those identified acoustic properties will be modified to synthesize the recorded human emotional voices. Thirdly, both human and synthesized utterances will be used to study the electroencephalographic correlate of affective prosody processing in typically developed and autistic children. Finally, and on the basis of the outcomes, synthesized voice-enhanced environments will be created to develop an intervention based on social-robot and Social StoryTM for autistic children to improve affective prosodies discrimination. This protocol has been registered at BioMed Central under the following number: ISRCTN18117434. (shrink)

Speech planning is a sophisticated process. In dialog, it regularly starts in overlap with an incoming turn by a conversation partner. We show that planning spoken responses in overlap with incoming turns is associated with higher processing load than planning in silence. In a dialogic experiment, participants took turns with a confederate describing lists of objects. The confederate’s utterances (to which participants responded) were pre‐recorded and varied in whether they ended in a verb or an object noun and (...) whether this ending was predictable or not. We found that response planning in overlap with sentence‐final verbs evokes larger task‐evoked pupillary responses, while end predictability had no effect. This finding indicates that planning in overlap leads to higher processing load for next speakers in dialog and that next speakers do not proactively modulate the time course of their response planning based on their predictions of turn endings. The turn‐taking system exerts pressure on the language processing system by pushing speakers to plan in overlap despite the ensuing increase in processing load. (shrink)

The first of its kind to thoroughly cover language technology at all levels and with all modern technologies this book takes an empirical approach to the ...

Socially Responsible Investment (SRI) has grown considerably over the past three decades. One form of SRI, engagement-SRI, is today by far the most practiced form of SRI (in assets managed) and has the potential to mainstream SRI even further. However, lack of formalized engagement procedures and evaluation tools leave the engagement practice too opaque for such a mainstreaming. This article can be considered as a first step in the development of a standard for the engagement practice. By developing an engagement (...) heuristic, this article offers a more transparent engagement dialog. Drawing on Stevenson’s and Austin’s speech-act theories, this article develops a classification of management’s responses to the signaling of allegations and controversies on two dimensions: a factual dimension concerning (dis)agreements on factual claims and an attitudinal dimension concerning (dis)agreements on responsibilities, values, and norms. On the basis of the distinctions this article develops, the authors provide for a synoptic table and offer a next-step heuristic for the engagement process that started with signaling a concern to management. The article uses an engagement logic that, while keeping the exit option for the investor open, allows management to address signaled concerns without having to let down or to opt out at the first setback in the dialog process between investor and investee corporation. (shrink)

Socially Responsible Investment (SRI) has grown considerably over the past three decades. One form of SRI, engagement-SRI, is today by far the most practiced form of SRI (in assets managed) and has the potential to mainstream SRI even further. However, lack of formalized engagement procedures and evaluation tools leave the engagement practice too opaque for such a mainstreaming. This article can be considered as a first step in the development of a standard for the engagement practice. By developing an engagement (...) heuristic, this article offers a more transparent engagement dialog. Drawing on Stevenson's and Austin's speech-act theories, this article develops a classification of management's responses to the signaling of allegations and controversies on two dimensions: a factual dimension concerning (dis)agreements on factual claims and an attitudinal dimension concerning (dis)agreements on responsibilities, values, and norms. On the basis of the distinctions this article develops, the authors provide for a synoptic table and offer a next-step heuristic for the engagement process that started with signaling a concern to management. The article uses an engagement logic that, while keeping the exit option for the investor open, allows management to address signaled concerns without having to let down or to opt out at the first setback in the dialog process between investor and investee corporation. (shrink)

Predictions during language comprehension are currently discussed from many points of view. One area where predictive processing may play a particular role concerns poetic language that is regularized by meter and rhyme, thus allowing strong predictions regarding the timing and stress of individual syllables. While there is growing evidence that these prosodic regularities influence language processing, less is known about the potential influence of prosodic preferences on neurophysiological processes. To this end, the present electroencephalogram study examined whether the (...) predictability of strong and weak syllables within metered speech would differ as a function of meter. Strong, i.e., accented positions within a foot should be more predictable than weak, i.e., unaccented positions. Our focus was on disyllabic pseudowords that solely differed between trochaic and iambic structure, with trochees providing the preferred foot in German. Methodologically, we focused on the omission Mismatch Negativity that is elicited when an anticipated auditory stimulus is omitted. The resulting electrophysiological brain response is particularly interesting because its elicitation does not depend on a physical stimulus. Omissions in deviant position of a passive oddball paradigm occurred at either first- or second-syllable position of the aforementioned pseudowords, resulting in a 2-by-2 design with the factors foot type and omission position. Analyses focused on the mean oMMN amplitude and latency differences across the four conditions. The result pattern was characterized by an interaction of the effects of foot type and omission position for both amplitudes and latencies. In first position, omissions resulted in larger and earlier oMMNs for trochees than for iambs. In second position, omissions resulted in larger oMMNs for iambs than for trochees, but the oMMN latency did not differ. The results suggest that omissions, particularly in initial position, are modulated by a trochaic preference in German. The preferred strong-weak pattern may have strengthened the prosodic prediction, especially for matching, trochaic stimuli, such that the violation of this prediction led to an earlier and stronger prediction error. Altogether, predictive processing seems to play a particular role in metered speech, especially if the meter is based on the preferred foot type. (shrink)

Inner speech is commonly understood as the conscious experience of a voice within the mind. One recurrent theme in the scientific literature is that the phenomenon involves a representation of overt speech, for example, a representation of phonetic properties that result from a copy of speech instructions that were ultimately suppressed. I propose a larger picture that involves some embodied objects and their misperception. I call it “the Body Error Theory,” or BET for short. BET is a (...) form of illusionism, but the particular version I favor is a cross-modal illusion. Newly described here, my hypothesis is that the experience of inner speech arises from a mix of interoception and audition. Specifically, there is the detection of slight but well-confirmed activities in the speech musculature that occur during inner speech, which helps to transform representations of normal but quiet nonverbal sounds that inevitably occur during inner speech, from breathing to background noise, into a mistaken perception of inner speech. Simply put, activities in the speech musculature mix with sounds to create the appearance of speech sounds, which thus explains the “voice within the mind.” I also show how BET’s cross-modal system fits with standard information processing accounts for speech monitoring and how it accommodates the central insights of leading theories of inner speech. In addition, I show how BET is supported by data from experience-sampling surveys and how it can be empirically tested against its rivals. (shrink)

Speech and music reflect extraordinary aspects of human cognitive abilities. Pitch, as an important parameter in the auditory domain, has been the focus of previous research on the relations between speech and music. The present study continues this line of research by focusing on two aspects of pitch processing: pitch prominence and melodic expectation. Specifically, we examined the perceived boundary of prominence for focus/accent in speech and music, plus the comparison between the pitch expectation patterns of (...) music and speech. Speech (Mandarin Chinese) and music stimuli were created with different interval steps that increased from 1 semitone to 12 semitones from the third to the fourth word/note of a sentence/melody. The results showed that ratings of both accent/focus and expectation/surprise increased with increasing semitone distance from the baseline (though this pattern was mixed with tonal stability profiles for the melodies). Nevertheless, the perceived boundary of prominence was different for music and speech, with the boundary for detecting prominence in speech higher than that in music. Expectation also showed different patterns for speech and music. The results thus favor the suggestion that speech prosody and music melody tend to require specialized pitch patterns unique to their own respective communication purposes. (shrink)

This paper aims to clear a path for the thesis that inner speech, in the very languages we speak, is the sole medium of all conceptual thought. First, it is argued that inner speech should not be identified with the auditory imagery of speech. Since they are distinct, there may be many more episodes of inner speech than those that are accompanied by auditory imagery. Second, it is argued that it is not necessary to conceive of (...) linguistic communication as a matter of the speaker’s revealing through words an underlying thought. Rather, acts of speech may be conceived as producing cooperation by intervening on processes of thought that are essentially imagistic. So conceived, the practice of speaking in language may acquire a function wholly internal to the individual, where it adds a layer of coordination to an underlying foundation of imagistic cognition. (shrink)

The study of code-switching speech has produced a wealth of knowledge in the understanding of bilingual language processing and representation. Here, we approach this issue by using a novel network science approach to map bilingual spontaneous CS speech. In Study 1, we constructed semantic networks on CS speech corpora and conducted community detections to depict the semantic organizations of the bilingual lexicon. The results suggest that the semantic organizations of the two lexicons in CS speech (...) are largely distinct, with a small portion of overlap such that the semantic network community dominated by each language still contains words from the other language. In Study 2, we explored the effect of clustering coefficients on language choice during CS speech, by comparing clustering coefficients of words that were code-switched with their translation equivalents in the other language. The results indicate that words where the language is switched have lower clustering coefficients than their TEs in the other language. Taken together, we show that network science is a valuable tool for understanding the overall map of bilingual lexicons as well as the detailed interconnections and organizations between the two languages. (shrink)

The proposition that feedback is never necessary in speech recognition is examined for utterances consisting of sequences of words. In running speech the features near word boundaries are often modified according to language-dependent rules. Application of these rules during word recognition requires top-down processing. Because isolated words are not usually modified by rules, their recognition could be achieved by bottom-up processing only.