Research Repository

How emotional prosody guides your way: Evidence from eye movements

Paulmann, Silke and Titone, Debra and Pell, Marc D (2012) 'How emotional prosody guides your way: Evidence from eye movements.' Speech Communication, 54 (1). pp. 92-107. ISSN 0167-6393

Full text not available from this repository.


This study investigated cross-modal effects of emotional voice tone (prosody) on face processing during instructed visual search. Specifically, we evaluated whether emotional prosodic cues in speech have a rapid, mandatory influence on eye movements to an emotionally-related face, and whether these effects persist as semantic information unfolds. Participants viewed an array of six emotional faces while listening to instructions spoken in an emotionally congruent or incongruent prosody (e.g.; "Click on the happy face" spoken in a happy or angry voice). The duration and frequency of eye fixations were analyzed when only prosodic cues were emotionally meaningful (pre-emotional label window: "Click on the/..."), and after emotional semantic information was available (post-emotional label window: ".../happy face"). In the pre-emotional label window, results showed that participants made immediate use of emotional prosody, as reflected in significantly longer frequent fixations to emotionally congruent versus incongruent faces. However, when explicit semantic information in the instructions became available (post-emotional label window), the influence of prosody on measures of eye gaze was relatively minimal. Our data show that emotional prosody has a rapid impact on gaze behavior during social information processing, but that prosodic meanings can be overridden by semantic cues when linguistic information is task relevant. © 2011 Elsevier B.V. All rights reserved.

Item Type: Article
Uncontrolled Keywords: Eye-tracking; Gaze; Speech processing; Affective prosody; Semantics
Subjects: B Philosophy. Psychology. Religion > BF Psychology
Divisions: Faculty of Science and Health
Faculty of Science and Health > Psychology, Department of
SWORD Depositor: Elements
Depositing User: Elements
Date Deposited: 05 Jul 2012 16:13
Last Modified: 15 Jan 2022 00:34

Actions (login required)

View Item View Item