Dawson, Jessica and Foulsham, Tom (2022) Your turn to speak? Audiovisual social attention in the lab and in the wild. Visual Cognition, 30 (1-2). pp. 116-134. DOI https://doi.org/10.1080/13506285.2021.1958038
Dawson, Jessica and Foulsham, Tom (2022) Your turn to speak? Audiovisual social attention in the lab and in the wild. Visual Cognition, 30 (1-2). pp. 116-134. DOI https://doi.org/10.1080/13506285.2021.1958038
Dawson, Jessica and Foulsham, Tom (2022) Your turn to speak? Audiovisual social attention in the lab and in the wild. Visual Cognition, 30 (1-2). pp. 116-134. DOI https://doi.org/10.1080/13506285.2021.1958038
Abstract
In everyday group conversations, we must decide whom to pay attention to and when. This process of dynamic social attention is important for goals both perceptual and social. The present study investigated gaze during a conversation in a realistic group and in a controlled laboratory study where third-party observers watched videos of the same group. In both contexts, we explore how gaze allocation is related to turn-taking in speech. Experimental video clips were edited to either remove the sound, freeze the video, or transition to a blank screen, allowing us to determine how shifts in attention between speakers depend on visual or auditory cues. Gaze behaviour in the real, interactive situation was similar to the fixations made by observers watching a video. Eyetracked participants often fixated the person speaking and shifted gaze in response to changes in speaker, even when sound was removed or the video freeze-framed. These findings suggest we sometimes fixate the location of speakers even when no additional visual information can be gained. Our novel approach offers both a comparison of interactive and third-party viewing and the opportunity for controlled experimental manipulations. This delivers a rich understanding of gaze behaviour and multimodal attention during a conversation following.
Item Type: | Article |
---|---|
Uncontrolled Keywords: | Interaction; eye tracking; conversation; audiovisual; signalling |
Divisions: | Faculty of Science and Health Faculty of Science and Health > Health and Social Care, School of Faculty of Science and Health > Psychology, Department of |
SWORD Depositor: | Unnamed user with email elements@essex.ac.uk |
Depositing User: | Unnamed user with email elements@essex.ac.uk |
Date Deposited: | 13 Aug 2021 20:50 |
Last Modified: | 30 Oct 2024 17:38 |
URI: | http://repository.essex.ac.uk/id/eprint/30897 |
Available files
Filename: Your turn to speak Audiovisual social attention in the lab and in the wild.pdf
Licence: Creative Commons: Attribution 3.0