We examined whether facial expressions of performers influence the emotional connotations of sung materials, and whether attention is implicated in audio-visual integration of affective cues. In Experiment 1, participants judged the emotional valence of audio-visual presentations of sung intervals. Performances were edited such that auditory and visual information conveyed congruent or incongruent affective connotations. In the single-task condition, participants judged the emotional connotation of sung intervals. In the dual-task condition, participants judged the emotional connotation of intervals while performing a secondary (...) task. Judgements were influenced by melodic cues and facial expressions and the effects were undiminished by the secondary task. Experiment 2 involved identical conditions but participants were instructed to base judgements on auditory information alone. Again, facial expressions influenced judgements and the effect was undiminished by the secondary task. The results suggest that visual aspects of music performance are automatically and preattentively registered and integrated with auditory cues. (shrink)

The present study investigates shared representations of syntactic knowledge in music and action. We examined whether expectancy violations in musical harmonic sequences are also perceived as violations of the movement sequences necessary to produce them. Pianists imitated silent videos showing one hand playing chord sequences on a muted keyboard. Results indicate that, despite the absence of auditory feedback, imitation of a chord is fastest when it is congruent with the preceding harmonic context. This suggests that the harmonic rules implied by (...) observed actions induce expectations that influence action execution. As evidence that these predictions are derived at a high representational level, imitation was more accurate for harmonically incongruent chords than for congruent chords executed with unconventional fingering. The magnitude of the effects of context and goal prioritization increased with musical training. Thus, musical training may lead to a domain-general representation of musical grammar, i.e., to a grammar of action. (shrink)

Tension and suspense are powerful emotional experiences that occur in a wide variety of contexts (e.g., in music, film, literature, and everyday life). The omnipresence of tension experiences suggests that they build on very basic cognitive and affective mechanisms. However, the psychological underpinnings of tension experiences remain largely unexplained, and tension and suspense are rarely discussed from a general, domain-independent perspective. In this paper, we argue that tension experiences in different contexts (e.g., musical tension or suspense in a movie) build (...) on the same underlying psychological processes. We discuss key components of tension experiences and propose a domain-independent model of tension and suspense. According to this model, tension experiences originate from states of conflict, instability, dissonance, or uncertainty that trigger predictive processes directed at future events of emotional significance. We also discuss possible neural mechanisms underlying experiences of tension. The model provides a theoretical framework that can inform future empirical research on tension phenomena. (shrink)

What kinds of mental states can be based on epistemic reasons? The standard answer is only beliefs. I argue that perceptual states can also be based on reasons, as the result of crossmodal interactions. A perceptual state from one modality can provide a reason on which an experience in another modality is based. My argument identifies key markers of the basing relation and locates them in the crossmodal Marimba Illusion (Schutz & Kubovy 2009). The subject’s auditory experience of musical tone (...) duration is based on the reason provided by her visual representation of the length of the musician’s gesture and other stored perceptual principles. (shrink)