Research Repository

Summation of visual attributes in auditory–visual crossmodal correspondences

Jonas, Clare and Spiller, Mary Jane and Hibbard, Paul (2017) 'Summation of visual attributes in auditory–visual crossmodal correspondences.' Psychonomic Bulletin and Review, 24 (4). pp. 1104-1112. ISSN 1069-9384

jonas et al multi CMC manuscript revised no tracking.pdf - Accepted Version

Download (254kB) | Preview


Crossmodal correspondences are a feature of human perception in which two or more sensory dimensions are linked together; for example, high-pitched noises may be more readily linked with small than with large objects. However, no study has yet systematically examined the interaction between different visual–auditory crossmodal correspondences. We investigated how the visual dimensions of luminance, saturation, size, and vertical position can influence decisions when matching particular visual stimuli with high-pitched or low-pitched auditory stimuli. For multidimensional stimuli, we found a general pattern of summation of the individual crossmodal correspondences, with some exceptions that may be explained by Garner interference. These findings have applications for the design of sensory substitution systems, which convert information from one sensory modality to another.

Item Type: Article
Uncontrolled Keywords: Multisensory perception; Crossmodal correspondences; Vision; Hearing
Subjects: B Philosophy. Psychology. Religion > BF Psychology
Divisions: Faculty of Science and Health
Faculty of Science and Health > Psychology, Department of
SWORD Depositor: Elements
Depositing User: Elements
Date Deposited: 14 Nov 2017 14:43
Last Modified: 18 Aug 2022 13:22

Actions (login required)

View Item View Item