Research Repository

Auditory-Visual Multisensory Interactions in Humans: Timing, Topography, Directionality, and Sources

Cappe, C and Thut, G and Romei, V and Murray, MM (2010) 'Auditory-Visual Multisensory Interactions in Humans: Timing, Topography, Directionality, and Sources.' Journal of Neuroscience, 30 (38). pp. 12572-12580. ISSN 0270-6474


Download (909kB) | Preview


Current models of brain organization include multisensory interactions at early processing stages and within low-level, including primary, cortices. Embracing this model with regard to auditory-visual (AV) interactions in humans remains problematic. Controversy surrounds the application of an additive model to the analysis of event-related potentials (ERPs), and conventional ERP analysis methods have yielded discordant latencies of effects and permitted limited neurophysiologic interpretability. While hemodynamic imaging and transcranial magnetic stimulation studies provide general support for the above model, the precise timing, superadditive/subadditive directionality, topographic stability, and sources remain unresolved. We recorded ERPs in humans to attended, but task-irrelevant stimuli that did not require an overt motor response, thereby circumventing paradigmatic caveats. We applied novel ERP signal analysis methods to provide details concerning the likely bases of AV interactions. First, nonlinear interactions occur at 60-95 ms after stimulus and are the consequence of topographic, rather than pure strength, modulations in the ERP. AV stimuli engage distinct configurations of intracranial generators, rather than simply modulating the amplitude of unisensory responses. Second, source estimations (and statistical analyses thereof) identified primary visual, primary auditory, and posterior superior temporal regions as mediating these effects. Finally, scalar values of current densities in all of these regions exhibited functionally coupled, subadditive nonlinear effects, a pattern increasingly consistent with the mounting evidence in nonhuman primates. In these ways, we demonstrate how neurophysiologic bases of multisensory interactions can be noninvasively identified in humans, allowing for a synthesis across imaging methods on the one hand and species on the other. Copyright © 2010 the authors.

Item Type: Article
Uncontrolled Keywords: Brain; Nerve Net; Humans; Electroencephalography; Acoustic Stimulation; Brain Mapping; Photic Stimulation; Auditory Perception; Visual Perception; Evoked Potentials; Signal Processing, Computer-Assisted; Adolescent; Adult; Female; Male
Subjects: R Medicine > RC Internal medicine > RC0321 Neuroscience. Biological psychiatry. Neuropsychiatry
Divisions: Faculty of Science and Health
Faculty of Science and Health > Psychology, Department of
SWORD Depositor: Elements
Depositing User: Elements
Date Deposited: 24 Apr 2013 15:25
Last Modified: 15 Jan 2022 00:31

Actions (login required)

View Item View Item