Audio-visual integration of emotional cues in song

Cognition and Emotion 22 (8):1457-1470 (2008)
  Copy   BIBTEX

Abstract

We examined whether facial expressions of performers influence the emotional connotations of sung materials, and whether attention is implicated in audio-visual integration of affective cues. In Experiment 1, participants judged the emotional valence of audio-visual presentations of sung intervals. Performances were edited such that auditory and visual information conveyed congruent or incongruent affective connotations. In the single-task condition, participants judged the emotional connotation of sung intervals. In the dual-task condition, participants judged the emotional connotation of intervals while performing a secondary task. Judgements were influenced by melodic cues and facial expressions and the effects were undiminished by the secondary task. Experiment 2 involved identical conditions but participants were instructed to base judgements on auditory information alone. Again, facial expressions influenced judgements and the effect was undiminished by the secondary task. The results suggest that visual aspects of music performance are automatically and preattentively registered and integrated with auditory cues.

Links

PhilArchive



    Upload a copy of this work     Papers currently archived: 91,322

External links

Setup an account with your affiliations in order to access resources via your University's proxy server

Through your library

Analytics

Added to PP
2013-12-26

Downloads
45 (#344,258)

6 months
11 (#226,803)

Historical graph of downloads
How can I increase my downloads?

References found in this work

The descent of man.Charles Darwin - 1874 - Amherst, N.Y.: Prometheus Books. Edited by Michael T. Ghiselin.
Sweet Anticipation: Music and the Psychology of Expectation.William Benjamin - 2007 - Journal of Aesthetics and Art Criticism 65 (3):333-335.
The language of music.Deryck Cooke - 1959 - New York: Oxford University Press.
The perception of emotions by ear and by eye.Beatrice de Gelder & Jean Vroomen - 2000 - Cognition and Emotion 14 (3):289-311.

View all 10 references / Add more references