Research Repository

Modeling Multisensory Integration

van Dam, LCJ and Parise, CV and Ernst, MO (2014) 'Modeling Multisensory Integration.' In: Bennett, DJ and Hill, CS, (eds.) Sensory Integration and the Unity of Consciousness. MIT Press, 209 - 229. ISBN 9780262027786

Full text not available from this repository.


The different senses, such as vision, touch, or audition, often provide redundant information for perceiving our environment. For instance, the size of an object can be determined by both sight and touch. In this chapter, Loes C.J. van Dam, Cesare V Parise, and Marc Ernst discuss the statistical optimal framework for combining redundant sensory information to maximize perceptual precision ? the Maximum Likelihood Estimation (MLE) framework ? and provides examples on how human performance approaches optimality. In the MLE framework, each cue is weighed according to its precision, that is, the more precise sensory estimate receives a higher weight when integration occurs. However, before integrating multisensory information, the perceptual system needs to determine whether or not the sensory signals correspond to the same object or event (the so-called correspondence problem). Current ideas on how the perceptual system solves the correspondence problem are provided in the same mathematical framework. Additionally, the chapter briefly reviews learning and developmental influences on multisensory integration.

Item Type: Book Section
Uncontrolled Keywords: Perception, Redundant estimates, Multisensory integration, Maximum Likelihood Estimation, Correspondence problem, Learning
Subjects: B Philosophy. Psychology. Religion > BF Psychology
Divisions: Faculty of Science and Health > Psychology, Department of
Depositing User: Jim Jamieson
Date Deposited: 27 Jul 2016 13:54
Last Modified: 17 Aug 2017 17:25

Actions (login required)

View Item View Item