Research Repository

Your turn to speak? Audiovisual social attention in the lab and in the wild

Dawson, Jessica and Foulsham, Tom (2021) 'Your turn to speak? Audiovisual social attention in the lab and in the wild.' Visual Cognition. ISSN 1350-6285

[img]
Preview
Text
Your turn to speak Audiovisual social attention in the lab and in the wild.pdf - Published Version
Available under License Creative Commons Attribution.

Download (2MB) | Preview

Abstract

In everyday group conversations, we must decide whom to pay attention to and when. This process of dynamic social attention is important for goals both perceptual and social. The present study investigated gaze during a conversation in a realistic group and in a controlled laboratory study where third-party observers watched videos of the same group. In both contexts, we explore how gaze allocation is related to turn-taking in speech. Experimental video clips were edited to either remove the sound, freeze the video, or transition to a blank screen, allowing us to determine how shifts in attention between speakers depend on visual or auditory cues. Gaze behaviour in the real, interactive situation was similar to the fixations made by observers watching a video. Eyetracked participants often fixated the person speaking and shifted gaze in response to changes in speaker, even when sound was removed or the video freeze-framed. These findings suggest we sometimes fixate the location of speakers even when no additional visual information can be gained. Our novel approach offers both a comparison of interactive and third-party viewing and the opportunity for controlled experimental manipulations. This delivers a rich understanding of gaze behaviour and multimodal attention during a conversation following.

Item Type: Article
Uncontrolled Keywords: Interaction; eye tracking; conversation; audiovisual; signalling
Divisions: Faculty of Science and Health > Psychology, Department of
Depositing User: Elements
Date Deposited: 13 Aug 2021 20:50
Last Modified: 13 Aug 2021 20:50
URI: http://repository.essex.ac.uk/id/eprint/30897

Actions (login required)

View Item View Item