Skip to main content
Erschienen in: Experimental Brain Research 2/2008

01.02.2008 | Research Article

Multisensory integration affects ERP components elicited by exogenous cues

verfasst von: Valerio Santangelo, Rob H. J. Van der Lubbe, Marta Olivetti Belardinelli, Albert Postma

Erschienen in: Experimental Brain Research | Ausgabe 2/2008

Einloggen, um Zugang zu erhalten

Abstract

Previous studies have shown that the amplitude of event related brain potentials (ERPs) elicited by a combined audiovisual stimulus is larger than the sum of a single auditory and visual stimulus. This enlargement is thought to reflect multisensory integration. Based on these data, it may be hypothesized that the speeding up of responses, due to exogenous orienting effects induced by bimodal cues, exceeds the sum of single unimodal cues. Behavioral data, however, typically revealed no increased orienting effect following bimodal as compared to unimodal cues, which could be due to a failure of multisensory integration of the cues. To examine this possibility, we computed ERPs elicited by both bimodal (audiovisual) and unimodal (either auditory or visual) cues, and determined their exogenous orienting effects on responses to a to-be-discriminated visual target. Interestingly, the posterior P1 component elicited by bimodal cues was larger than the sum of the P1 components elicited by a single auditory and visual cue (i.e., a superadditive effect), but no enhanced orienting effect was found on response speed. The latter result suggests that multisensory integration elicited by our bimodal cues plays no special role for spatial orienting, at least in the present setting.
Fußnoten
1
Given the fact that the signal to noise ratio (SNR) of amplitude measures depends on the number of trials used to create the averages, we examined whether conditions differed in these amounts. A two-way ANOVA with the within-participants factors of Cue type (unimodal, crossmodal, or bimodal) and Cue Side (left or right) revealed no significant effects (all Fs < 2.7; Ps > 0.128), indicating that there were no differences in the number of trials between conditions.
 
Literatur
Zurück zum Zitat Beauchamp MS, Argall BD, Bodurka J, Duyn JH, Martin A (2004) Unraveling multisensory integration: Patchy organization within human STS multisensory cortex. Nat Neurosci 7:1190–1192PubMedCrossRef Beauchamp MS, Argall BD, Bodurka J, Duyn JH, Martin A (2004) Unraveling multisensory integration: Patchy organization within human STS multisensory cortex. Nat Neurosci 7:1190–1192PubMedCrossRef
Zurück zum Zitat Berger A, Henik A, Rafal R (2005) Competition between endogenous and exogenous orienting of visual attention. J Exp Psychol Gen 134:207–221PubMedCrossRef Berger A, Henik A, Rafal R (2005) Competition between endogenous and exogenous orienting of visual attention. J Exp Psychol Gen 134:207–221PubMedCrossRef
Zurück zum Zitat Bertelson P, Vroomen J, De Gelder B, Driver J (2000) The ventriloquist effect does not depend on the direction of deliberate visual attention. Percept Psychophys 62:321–332PubMed Bertelson P, Vroomen J, De Gelder B, Driver J (2000) The ventriloquist effect does not depend on the direction of deliberate visual attention. Percept Psychophys 62:321–332PubMed
Zurück zum Zitat Calvert GA, Campbell R, Brammer MJ (2000) Evidence from functional magnetic resonance imaging of crossmodal binding in the human heteromodal cortex. Curr Biol 10:649–657PubMedCrossRef Calvert GA, Campbell R, Brammer MJ (2000) Evidence from functional magnetic resonance imaging of crossmodal binding in the human heteromodal cortex. Curr Biol 10:649–657PubMedCrossRef
Zurück zum Zitat Dhamala M, Assisi CG, Jirsa VK, Steinberg FL, Kelso JAS (2007) Multisensory integration for timing engages different brain networks. Neuroimage 34:764–773PubMedCrossRef Dhamala M, Assisi CG, Jirsa VK, Steinberg FL, Kelso JAS (2007) Multisensory integration for timing engages different brain networks. Neuroimage 34:764–773PubMedCrossRef
Zurück zum Zitat Folk CL, Remington RW, Johnson JC (1992) Involuntary covert orienting is contingent on attentional control settings. J Exp Psychol Hum Percept 18:1030–1044PubMedCrossRef Folk CL, Remington RW, Johnson JC (1992) Involuntary covert orienting is contingent on attentional control settings. J Exp Psychol Hum Percept 18:1030–1044PubMedCrossRef
Zurück zum Zitat Fort A, Delpuech C, Pernier J, Giard MH (2002) Early auditory-visual interactions in human cortex during nonreduntant target identification. Cogn Brain Res 14:20–30CrossRef Fort A, Delpuech C, Pernier J, Giard MH (2002) Early auditory-visual interactions in human cortex during nonreduntant target identification. Cogn Brain Res 14:20–30CrossRef
Zurück zum Zitat Funes MJ, Lupianez J, Milliken B (2005) The role of spatial attention and other processes on the magnitude and time course of cueing effects. Cogn Process 6:98–116PubMedCrossRef Funes MJ, Lupianez J, Milliken B (2005) The role of spatial attention and other processes on the magnitude and time course of cueing effects. Cogn Process 6:98–116PubMedCrossRef
Zurück zum Zitat Giard MH, Perronet F (1999) Auditory-visual integration during multimodal object recognition in humans: a behavioral and electrophysiological study. J Cogn Neurosci 11:473–490PubMedCrossRef Giard MH, Perronet F (1999) Auditory-visual integration during multimodal object recognition in humans: a behavioral and electrophysiological study. J Cogn Neurosci 11:473–490PubMedCrossRef
Zurück zum Zitat Hillyard SA (1973) The CNV and human behaviour. In: McCallum WC, Knott JR (eds) Event-related slow potentials of the brain: their relation to behaviour. Elsevier, Amsterdam, pp 161–171 Hillyard SA (1973) The CNV and human behaviour. In: McCallum WC, Knott JR (eds) Event-related slow potentials of the brain: their relation to behaviour. Elsevier, Amsterdam, pp 161–171
Zurück zum Zitat Low KA, Miller J (1999) The usefulness of partial information: effects of go probability in the choice/Nogo task. Psychophysiology 36:288–297PubMedCrossRef Low KA, Miller J (1999) The usefulness of partial information: effects of go probability in the choice/Nogo task. Psychophysiology 36:288–297PubMedCrossRef
Zurück zum Zitat McDonald JJ, Teder-Salejarvi WA, Ward LM (2001) Multisensory integration and crossmodal attention effects in the human brain. Science 292:1791PubMedCrossRef McDonald JJ, Teder-Salejarvi WA, Ward LM (2001) Multisensory integration and crossmodal attention effects in the human brain. Science 292:1791PubMedCrossRef
Zurück zum Zitat Molholm S, Ritter W, Murray MM, Javitt DC, Schroeder CE, Foxe JJ (2002) Multisensory auditory-visual interactions during early sensory processing in humans: a high-density electrical mapping study. Cogn Brain Res 14:115–128CrossRef Molholm S, Ritter W, Murray MM, Javitt DC, Schroeder CE, Foxe JJ (2002) Multisensory auditory-visual interactions during early sensory processing in humans: a high-density electrical mapping study. Cogn Brain Res 14:115–128CrossRef
Zurück zum Zitat Santangelo V, Ho C, Spence C (2007a) Capturing spatial attention with multisensory cues. Psychon Bull Rev (in press) Santangelo V, Ho C, Spence C (2007a) Capturing spatial attention with multisensory cues. Psychon Bull Rev (in press)
Zurück zum Zitat Santangelo V, Olivetti Belardinelli M, Spence C (2007b) The suppression of reflexive visual and auditory orienting when attention is otherwise engaged. J Exp Psychol Hum Percept 33:137–148PubMedCrossRef Santangelo V, Olivetti Belardinelli M, Spence C (2007b) The suppression of reflexive visual and auditory orienting when attention is otherwise engaged. J Exp Psychol Hum Percept 33:137–148PubMedCrossRef
Zurück zum Zitat Santangelo V, Spence C (2007a) Multisensory cues capture spatial attention regardless of perceptual load. J Exp Psychol Hum Percept (in press) Santangelo V, Spence C (2007a) Multisensory cues capture spatial attention regardless of perceptual load. J Exp Psychol Hum Percept (in press)
Zurück zum Zitat Santangelo V, Spence C (2007b) Assessing the automaticity of the exogenous orienting of tactile attention. Perception (in press) Santangelo V, Spence C (2007b) Assessing the automaticity of the exogenous orienting of tactile attention. Perception (in press)
Zurück zum Zitat Santangelo V, Van der Lubbe RHJ, Olivetti Belardinelli M, Postma A (2006) Spatial attention triggered by unimodal, crossmodal, and bimodal exogenous cues: a comparison on reflexive orienting mechanisms. Exp Brain Res 173:40–48PubMedCrossRef Santangelo V, Van der Lubbe RHJ, Olivetti Belardinelli M, Postma A (2006) Spatial attention triggered by unimodal, crossmodal, and bimodal exogenous cues: a comparison on reflexive orienting mechanisms. Exp Brain Res 173:40–48PubMedCrossRef
Zurück zum Zitat Schwartz S, Vuilleumier P, Hutton C, Maravita A, Dolan RJ, Driver J (2005) Attentional load and sensory competition in human vision: modulation of fMRI responses by load at fixation during task-irrelevant stimulation in the peripheral visual field. Cereb Cortex 15:770–786PubMedCrossRef Schwartz S, Vuilleumier P, Hutton C, Maravita A, Dolan RJ, Driver J (2005) Attentional load and sensory competition in human vision: modulation of fMRI responses by load at fixation during task-irrelevant stimulation in the peripheral visual field. Cereb Cortex 15:770–786PubMedCrossRef
Zurück zum Zitat Senkowski D, Talsma D, Herrmann CS, Woldorff MG (2005) Multisensory processing and oscillatory gamma responses: effects of spatial selective attention. Exp Brain Res 166:411–426PubMedCrossRef Senkowski D, Talsma D, Herrmann CS, Woldorff MG (2005) Multisensory processing and oscillatory gamma responses: effects of spatial selective attention. Exp Brain Res 166:411–426PubMedCrossRef
Zurück zum Zitat Spence C, Driver J (1994) Covert spatial orienting in audition: exogenous and endogenous mechanisms. J Exp Psychol Human Percept 20:555–574CrossRef Spence C, Driver J (1994) Covert spatial orienting in audition: exogenous and endogenous mechanisms. J Exp Psychol Human Percept 20:555–574CrossRef
Zurück zum Zitat Spence C, Driver J (1999) A new approach to the design of multimodal warning signals. In: Harris D (ed) Engineering psychology and cognitive ergonomics. vol IV. Ashgate Publishing, Aldershot, pp 455–461 Spence C, Driver J (1999) A new approach to the design of multimodal warning signals. In: Harris D (ed) Engineering psychology and cognitive ergonomics. vol IV. Ashgate Publishing, Aldershot, pp 455–461
Zurück zum Zitat Stanford TR, Stein BE (2007) Superadditivity in multisensory integration: putting the computation in context. NeuroReport 18:787–792PubMedCrossRef Stanford TR, Stein BE (2007) Superadditivity in multisensory integration: putting the computation in context. NeuroReport 18:787–792PubMedCrossRef
Zurück zum Zitat Stein BE, Meredith MA (1993) The merging of the senses. MIT, Cambridge Stein BE, Meredith MA (1993) The merging of the senses. MIT, Cambridge
Zurück zum Zitat Stein BE, Meredith MA, Wallace MT (1993) The visually responsive neuron and beyond: multisensory integration in cat and monkey. Prog Brain Res 95:79–90PubMedCrossRef Stein BE, Meredith MA, Wallace MT (1993) The visually responsive neuron and beyond: multisensory integration in cat and monkey. Prog Brain Res 95:79–90PubMedCrossRef
Zurück zum Zitat Talsma D, Woldorff MG (2005) Selective attention and multisensory integration: multiple phases of effects on the evoked brain activity. J Cogn Neurosci 17:1098–1114PubMedCrossRef Talsma D, Woldorff MG (2005) Selective attention and multisensory integration: multiple phases of effects on the evoked brain activity. J Cogn Neurosci 17:1098–1114PubMedCrossRef
Zurück zum Zitat Teder-Sälejärvi WA, McDonald JJ, Di Russo F, Hillyard SA (2002) An analysis of audio–visual crossmodal integration by means of event-related potential (ERP) recordings. Cogn Brain Res 14:106–114CrossRef Teder-Sälejärvi WA, McDonald JJ, Di Russo F, Hillyard SA (2002) An analysis of audio–visual crossmodal integration by means of event-related potential (ERP) recordings. Cogn Brain Res 14:106–114CrossRef
Zurück zum Zitat Van der Lubbe RHJ, Havik MM, Bekker EM, Postma A (2006) Task-dependent exogenous cuing effects depend on cue modality. Psychophysiol 43:145–160CrossRef Van der Lubbe RHJ, Havik MM, Bekker EM, Postma A (2006) Task-dependent exogenous cuing effects depend on cue modality. Psychophysiol 43:145–160CrossRef
Zurück zum Zitat Van der Lubbe RHJ, Postma A (2005) Interruption from irrelevant auditory and visual onsets even when attention is in a focused state. Exp Brain Res 164:464–471PubMedCrossRef Van der Lubbe RHJ, Postma A (2005) Interruption from irrelevant auditory and visual onsets even when attention is in a focused state. Exp Brain Res 164:464–471PubMedCrossRef
Zurück zum Zitat Van der Lubbe RHJ, Van der Helden J (2006) Failure of the extended contingent attentional capture account in multimodal settings. Adv Cogn Psychol 2:255–267CrossRef Van der Lubbe RHJ, Van der Helden J (2006) Failure of the extended contingent attentional capture account in multimodal settings. Adv Cogn Psychol 2:255–267CrossRef
Zurück zum Zitat Vroomen J, Bertelson P, De Gelder B (2001) The ventriloquist effect does not depend on the direction of automatic visual attention. Percept Psychophys 63:651–659PubMed Vroomen J, Bertelson P, De Gelder B (2001) The ventriloquist effect does not depend on the direction of automatic visual attention. Percept Psychophys 63:651–659PubMed
Zurück zum Zitat Wallace MT, Meredith MA, Stein BE (1998) Multisensory integration in the superior colliculus of the alert cat. J Neurophysiol 80:1006–1010PubMed Wallace MT, Meredith MA, Stein BE (1998) Multisensory integration in the superior colliculus of the alert cat. J Neurophysiol 80:1006–1010PubMed
Zurück zum Zitat Ward LM (1994) Supramodal and modality-specific mechanisms for stimulus-driven shifts of auditory and visual attention. Can J Exp Psychol 48:242–259PubMedCrossRef Ward LM (1994) Supramodal and modality-specific mechanisms for stimulus-driven shifts of auditory and visual attention. Can J Exp Psychol 48:242–259PubMedCrossRef
Zurück zum Zitat Ward LM, McDonald JJ, Golestani N (1998) Cross-modal control of attention shifts. In: Wright RD (eds) Visual attention. Oxford University Press, New York, pp 232–268 Ward LM, McDonald JJ, Golestani N (1998) Cross-modal control of attention shifts. In: Wright RD (eds) Visual attention. Oxford University Press, New York, pp 232–268
Metadaten
Titel
Multisensory integration affects ERP components elicited by exogenous cues
verfasst von
Valerio Santangelo
Rob H. J. Van der Lubbe
Marta Olivetti Belardinelli
Albert Postma
Publikationsdatum
01.02.2008
Verlag
Springer-Verlag
Erschienen in
Experimental Brain Research / Ausgabe 2/2008
Print ISSN: 0014-4819
Elektronische ISSN: 1432-1106
DOI
https://doi.org/10.1007/s00221-007-1151-5

Weitere Artikel der Ausgabe 2/2008

Experimental Brain Research 2/2008 Zur Ausgabe

Leitlinien kompakt für die Neurologie

Mit medbee Pocketcards sicher entscheiden.

Seit 2022 gehört die medbee GmbH zum Springer Medizin Verlag

Sozialer Aufstieg verringert Demenzgefahr

24.05.2024 Demenz Nachrichten

Ein hohes soziales Niveau ist mit die beste Versicherung gegen eine Demenz. Noch geringer ist das Demenzrisiko für Menschen, die sozial aufsteigen: Sie gewinnen fast zwei demenzfreie Lebensjahre. Umgekehrt steigt die Demenzgefahr beim sozialen Abstieg.

Hirnblutung unter DOAK und VKA ähnlich bedrohlich

17.05.2024 Direkte orale Antikoagulanzien Nachrichten

Kommt es zu einer nichttraumatischen Hirnblutung, spielt es keine große Rolle, ob die Betroffenen zuvor direkt wirksame orale Antikoagulanzien oder Marcumar bekommen haben: Die Prognose ist ähnlich schlecht.

Was nützt die Kraniektomie bei schwerer tiefer Hirnblutung?

17.05.2024 Hirnblutung Nachrichten

Eine Studie zum Nutzen der druckentlastenden Kraniektomie nach schwerer tiefer supratentorieller Hirnblutung deutet einen Nutzen der Operation an. Für überlebende Patienten ist das dennoch nur eine bedingt gute Nachricht.

Thrombektomie auch bei großen Infarkten von Vorteil

16.05.2024 Ischämischer Schlaganfall Nachrichten

Auch ein sehr ausgedehnter ischämischer Schlaganfall scheint an sich kein Grund zu sein, von einer mechanischen Thrombektomie abzusehen. Dafür spricht die LASTE-Studie, an der Patienten und Patientinnen mit einem ASPECTS von maximal 5 beteiligt waren.

Update Neurologie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.