Research Repository

Is there an advantage for recognizing multi-modal emotional stimuli?

Paulmann, S and Pell, MD (2011) 'Is there an advantage for recognizing multi-modal emotional stimuli?' Motivation and Emotion, 35 (2). 192 - 201. ISSN 0146-7239

Full text not available from this repository.

Abstract

Emotions can be recognized whether conveyed by facial expressions, linguistic cues (semantics), or prosody (voice tone). However, few studies have empirically documented the extent to which multi-modal emotion perception differs from uni-modal emotion perception. Here, we tested whether emotion recognition is more accurate for multi-modal stimuli by presenting stimuli with different combinations of facial, semantic, and prosodic cues. Participants judged the emotion conveyed by short utterances in six channel conditions. Results indicated that emotion recognition is significantly better in response to multi-modal versus uni-modal stimuli. When stimuli contained only one emotional channel, recognition tended to be higher in the visual modality (i. e., facial expressions, semantic information conveyed by text) than in the auditory modality (prosody), although this pattern was not uniform across emotion categories. The advantage for multi-modal recognition may reflect the automatic integration of congruent emotional information across channels which enhances the accessibility of emotion-related knowledge in memory. © 2011 Springer Science+Business Media, LLC.

Item Type: Article
Subjects: B Philosophy. Psychology. Religion > BF Psychology
Divisions: Faculty of Science and Health > Psychology, Department of
Depositing User: Jim Jamieson
Date Deposited: 24 Nov 2011 16:15
Last Modified: 17 Aug 2017 18:15
URI: http://repository.essex.ac.uk/id/eprint/1587

Actions (login required)

View Item View Item