Skip to main content
Erschienen in: Experimental Brain Research 7/2014

01.07.2014 | Research Article

Phenomenology of the sound-induced flash illusion

verfasst von: Richard V. Abadi, Jonathan S. Murphy

Erschienen in: Experimental Brain Research | Ausgabe 7/2014

Einloggen, um Zugang zu erhalten

Abstract

Past studies, using pairings of auditory tones and visual flashes, which were static and coincident in space but variable in time, demonstrated errors in judging the temporal patterning of the visual flashes—the sound-induced flash illusion. These errors took one of the two forms: under-reporting (sound-induced fusion) or over-reporting (sound-induced fission) of the flash numbers. Our study had three objectives: to examine the robustness of both illusions and to consider the effects of stimulus set and response bias. To this end, we used an extended range of fixed spatial location flash–tone pairings, examined stimuli that were variable in space and time and measured confidence in judging flash numbers. Our results indicated that the sound-induced flash illusion is a robust percept, a finding underpinned by the confidence measures. Sound-induced fusion was found to be more robust than sound-induced fission and a most likely outcome when high numbers of flashes were incorporated within an incongruent flash–tone pairing. Conversely, sound-induced fission was the most likely outcome for the flash–tone pairing which contained two flashes. Fission was also shown to be strongly driven by stimuli confounds such as categorical boundary conditions (e.g. flash–tone pairings with ≤2 flashes) and compressed response options. These findings suggest whilst both fission and fusion are associated with ‘auditory driving’, the differences in the occurrence and strength of the two illusions not only reflect the separate neuronal mechanisms underlying audio and visual signal processing, but also the test conditions that have been used to investigate the sound-induced flash illusion.
Literatur
Zurück zum Zitat Alais D, Burr D (2004) The ventriloquist effect results from near-optimal bimodal integration. Curr Biol 14(3):257–262PubMedCrossRef Alais D, Burr D (2004) The ventriloquist effect results from near-optimal bimodal integration. Curr Biol 14(3):257–262PubMedCrossRef
Zurück zum Zitat Andersen TS, Tiippana K, Sams M (2004) Factors influencing audiovisual fission and fusion. Cogn Brain Res 21(3):301–308CrossRef Andersen TS, Tiippana K, Sams M (2004) Factors influencing audiovisual fission and fusion. Cogn Brain Res 21(3):301–308CrossRef
Zurück zum Zitat Andersen TS, Tiippana K, Sams M (2005) Maximum likelihood integration of rapid flashes and beeps. Neurosci Lett 380:155–160PubMedCrossRef Andersen TS, Tiippana K, Sams M (2005) Maximum likelihood integration of rapid flashes and beeps. Neurosci Lett 380:155–160PubMedCrossRef
Zurück zum Zitat Apthorp D, Alais D, Boenke LL (2013) Flash illusions induced by visual, auditory, and audiovisual stimuli. J Vis 13(5):1–15CrossRef Apthorp D, Alais D, Boenke LL (2013) Flash illusions induced by visual, auditory, and audiovisual stimuli. J Vis 13(5):1–15CrossRef
Zurück zum Zitat Barth H, Kanwisher N, Spelke E (2003) The construction of large number representations in adults. Cognition 86:201–221PubMedCrossRef Barth H, Kanwisher N, Spelke E (2003) The construction of large number representations in adults. Cognition 86:201–221PubMedCrossRef
Zurück zum Zitat Bernstein IH, Clark MH, Edelstein BA (1969) Effects of an auditory signal on visual reaction time. J Exp Psychol 80:567–569PubMedCrossRef Bernstein IH, Clark MH, Edelstein BA (1969) Effects of an auditory signal on visual reaction time. J Exp Psychol 80:567–569PubMedCrossRef
Zurück zum Zitat Bertleson P, Radeau M (1981) Cross-modal bias and perceptual fusion with auditory–visual spatial discordance. Percept Psychophys 29:578–584CrossRef Bertleson P, Radeau M (1981) Cross-modal bias and perceptual fusion with auditory–visual spatial discordance. Percept Psychophys 29:578–584CrossRef
Zurück zum Zitat Bulkin DA, Groh JM (2006) Seeing sounds: visual and auditory interactions in the brain. Curr Opin Neurobiol 16:415–419PubMedCrossRef Bulkin DA, Groh JM (2006) Seeing sounds: visual and auditory interactions in the brain. Curr Opin Neurobiol 16:415–419PubMedCrossRef
Zurück zum Zitat Burr D, Banks MS, Morrone MC (2009) Auditory dominance over vision in the perception of interval duration. Exp Brain Res 198:49–57PubMedCrossRef Burr D, Banks MS, Morrone MC (2009) Auditory dominance over vision in the perception of interval duration. Exp Brain Res 198:49–57PubMedCrossRef
Zurück zum Zitat Calvert GA, S Spence C, Stein BE (2004) (eds) The handbook of multisensory processing. Bradford Books, Cambridge Calvert GA, S Spence C, Stein BE (2004) (eds) The handbook of multisensory processing. Bradford Books, Cambridge
Zurück zum Zitat Chatterjee G, Wu D-A, Seth BR (2011) Phantom flashes caused by interactions across visual space. J Vis 11(2):14, 1–17 Chatterjee G, Wu D-A, Seth BR (2011) Phantom flashes caused by interactions across visual space. J Vis 11(2):14, 1–17
Zurück zum Zitat Dehaene S (1997) The number sense: how the mind creates mathematics. Oxford University Press, New York Dehaene S (1997) The number sense: how the mind creates mathematics. Oxford University Press, New York
Zurück zum Zitat Ernst MO, Bulthoff HH (2004) Merging the senses into a robust percept. Trends Cogn Sci 8:162–169PubMedCrossRef Ernst MO, Bulthoff HH (2004) Merging the senses into a robust percept. Trends Cogn Sci 8:162–169PubMedCrossRef
Zurück zum Zitat Fiedler A, O’Sullivan JL, Schroter H, Miller J, Ulrich R (2011) Illusory double flashes can speed up responses like physical ones: evidence from the sound-induced flash illusion. Exp Brain Res 214:113–119PubMedCrossRef Fiedler A, O’Sullivan JL, Schroter H, Miller J, Ulrich R (2011) Illusory double flashes can speed up responses like physical ones: evidence from the sound-induced flash illusion. Exp Brain Res 214:113–119PubMedCrossRef
Zurück zum Zitat Gebhard JW, Mowbray GH (1959) On discriminating the rate of visual flicker and auditory flutter. Am J Psychol 72:521–528PubMedCrossRef Gebhard JW, Mowbray GH (1959) On discriminating the rate of visual flicker and auditory flutter. Am J Psychol 72:521–528PubMedCrossRef
Zurück zum Zitat Green DM, Swets JA (1989) Signal detection theory and psychophysics. Peninsula Publishing, Los Altos Green DM, Swets JA (1989) Signal detection theory and psychophysics. Peninsula Publishing, Los Altos
Zurück zum Zitat Haladjian HH, Pylyshyn ZW (2011) Enumerating by pointing to locations: a new method for measuring the numerosity of visual object representations. Atten Percept Psychophys 73:303–308PubMedCrossRef Haladjian HH, Pylyshyn ZW (2011) Enumerating by pointing to locations: a new method for measuring the numerosity of visual object representations. Atten Percept Psychophys 73:303–308PubMedCrossRef
Zurück zum Zitat Handel S (2006) Perceptual coherence. Hearing and seeing. Oxford University Press, NYCrossRef Handel S (2006) Perceptual coherence. Hearing and seeing. Oxford University Press, NYCrossRef
Zurück zum Zitat Heron J, Whitaker D, Mc Graw PV (2004) Sensory uncertainty governs the extent of audio–visual interaction. Vis Res 44:2875–2884PubMedCrossRef Heron J, Whitaker D, Mc Graw PV (2004) Sensory uncertainty governs the extent of audio–visual interaction. Vis Res 44:2875–2884PubMedCrossRef
Zurück zum Zitat Kamitani Y, Shimojo S (2001) Sound-induced visual ‘rabbit’. J Vis 1(3):478CrossRef Kamitani Y, Shimojo S (2001) Sound-induced visual ‘rabbit’. J Vis 1(3):478CrossRef
Zurück zum Zitat Kaufman EL, Lord MW, Reese TW, Volkmann J (1949) The discrimination of visual number. Am J Psychol 62(4):498–525PubMedCrossRef Kaufman EL, Lord MW, Reese TW, Volkmann J (1949) The discrimination of visual number. Am J Psychol 62(4):498–525PubMedCrossRef
Zurück zum Zitat Mandler G, Shebo BJ (1982) Subitizing: an analysis of component processes. J Exp Psychol 111:1–22CrossRef Mandler G, Shebo BJ (1982) Subitizing: an analysis of component processes. J Exp Psychol 111:1–22CrossRef
Zurück zum Zitat McCormick D, Mamassian P (2005) Response biases in the illusory flash effect. J Vis 5(8):878CrossRef McCormick D, Mamassian P (2005) Response biases in the illusory flash effect. J Vis 5(8):878CrossRef
Zurück zum Zitat Mishra J, Martinez A, Sejnowski TT, Hillyard SA (2007) Early cross-modal interactions in auditory and visual cortex underlie a sound-induced visual illusion. J Neurosci 27:4120–4131PubMedCentralPubMedCrossRef Mishra J, Martinez A, Sejnowski TT, Hillyard SA (2007) Early cross-modal interactions in auditory and visual cortex underlie a sound-induced visual illusion. J Neurosci 27:4120–4131PubMedCentralPubMedCrossRef
Zurück zum Zitat Mishra J, Martinez A, Hillyard SA (2010) Effect of attention on early-cortical processes associated with the sound-induced extra flash illusion. J Cogn Neurosci 28:1714–1729CrossRef Mishra J, Martinez A, Hillyard SA (2010) Effect of attention on early-cortical processes associated with the sound-induced extra flash illusion. J Cogn Neurosci 28:1714–1729CrossRef
Zurück zum Zitat Onat S, Libertus K, König P (2007) Integrating audiovisual information of the control of overt attention. J Vis 7(10):1–16PubMedCrossRef Onat S, Libertus K, König P (2007) Integrating audiovisual information of the control of overt attention. J Vis 7(10):1–16PubMedCrossRef
Zurück zum Zitat Palmer SE (1999) Vision science: photons to phenomenology. Bradford Books, Cambridge Palmer SE (1999) Vision science: photons to phenomenology. Bradford Books, Cambridge
Zurück zum Zitat Philippi TG, van Erp JBF, Werkhoven PJ (2008) Multisensory temporal numerosity judgement. Brain Res 1232:116–125CrossRef Philippi TG, van Erp JBF, Werkhoven PJ (2008) Multisensory temporal numerosity judgement. Brain Res 1232:116–125CrossRef
Zurück zum Zitat Philippi TG, van Erp JBF, Werkhoven PJ (2011) Multisensory effects differ for counting small and large pulse numbers. Seeing Perceiving 24(6):565–578PubMedCrossRef Philippi TG, van Erp JBF, Werkhoven PJ (2011) Multisensory effects differ for counting small and large pulse numbers. Seeing Perceiving 24(6):565–578PubMedCrossRef
Zurück zum Zitat Radeau M, Bertelson P (1987) Audio–visual interaction and the timing of inputs. Thomas (1941) revisited. Psychol Res 49:17–22PubMedCrossRef Radeau M, Bertelson P (1987) Audio–visual interaction and the timing of inputs. Thomas (1941) revisited. Psychol Res 49:17–22PubMedCrossRef
Zurück zum Zitat Regan D, Spekreijse H (1977) Auditory–visual interactions and the correspondence between perceived auditory pace and perceived visual space. Perception 6(2):133–138PubMedCrossRef Regan D, Spekreijse H (1977) Auditory–visual interactions and the correspondence between perceived auditory pace and perceived visual space. Perception 6(2):133–138PubMedCrossRef
Zurück zum Zitat Shams L, Kamitani Y, Shimojo S (2000) Illusions. What you see is what you hear. Nature 408(6814):788PubMedCrossRef Shams L, Kamitani Y, Shimojo S (2000) Illusions. What you see is what you hear. Nature 408(6814):788PubMedCrossRef
Zurück zum Zitat Shams L, Kamitani Y, Shimojo S (2002) Visual illusion induced by sound. Cogn Brain Res 14(1):147–152CrossRef Shams L, Kamitani Y, Shimojo S (2002) Visual illusion induced by sound. Cogn Brain Res 14(1):147–152CrossRef
Zurück zum Zitat Shams L, Ma WJ, Beierholm U (2005) Sound-induced flash illusion as an optimal percept. Neuroreport 16:1923–1927PubMedCrossRef Shams L, Ma WJ, Beierholm U (2005) Sound-induced flash illusion as an optimal percept. Neuroreport 16:1923–1927PubMedCrossRef
Zurück zum Zitat Spence S (2011) Crossmodal correspondences: a tutorial review. Atten Percept Pyschophys 73:971–995CrossRef Spence S (2011) Crossmodal correspondences: a tutorial review. Atten Percept Pyschophys 73:971–995CrossRef
Zurück zum Zitat Stein BE, Meredith M (1993) The merging of senses. MIT, Cambridge Stein BE, Meredith M (1993) The merging of senses. MIT, Cambridge
Zurück zum Zitat Thomas GJ (1941) Experimental study of the influence of vision on sound localisation. J Exp Psychol 28:163–177CrossRef Thomas GJ (1941) Experimental study of the influence of vision on sound localisation. J Exp Psychol 28:163–177CrossRef
Zurück zum Zitat Trick LM, Pylyshyn ZW (1994) Why are small and large numbers enumerated differently? A limited-capacity pre-attentive stage in vision. Psychol Rev 101(1):80–102PubMedCrossRef Trick LM, Pylyshyn ZW (1994) Why are small and large numbers enumerated differently? A limited-capacity pre-attentive stage in vision. Psychol Rev 101(1):80–102PubMedCrossRef
Zurück zum Zitat Tversky A, Kahneman D (1981) The framing of decisions and psychology of choice. Science 211:453–458PubMedCrossRef Tversky A, Kahneman D (1981) The framing of decisions and psychology of choice. Science 211:453–458PubMedCrossRef
Zurück zum Zitat Vrooman J, De Gelder B (2000) Sound enhances visual perception: cross-modal effects of auditory organisation on vision. J Exp Psychol Hum 26(5):1583–1590CrossRef Vrooman J, De Gelder B (2000) Sound enhances visual perception: cross-modal effects of auditory organisation on vision. J Exp Psychol Hum 26(5):1583–1590CrossRef
Zurück zum Zitat Wada Y, Kitagawa N, Noguchi K (2003) Audio–visual integration in temporal perception. Int J Psychophys 50:117–124CrossRef Wada Y, Kitagawa N, Noguchi K (2003) Audio–visual integration in temporal perception. Int J Psychophys 50:117–124CrossRef
Zurück zum Zitat Warren DH (1979) Spatial localisation under conflict conditions: Is there a single explanation? Perception 8:323–337PubMedCrossRef Warren DH (1979) Spatial localisation under conflict conditions: Is there a single explanation? Perception 8:323–337PubMedCrossRef
Zurück zum Zitat Welsh RB, Warren DH (1980) Immediate perceptual response to intersensory discrepancy. Psychol Bull 88:638–667CrossRef Welsh RB, Warren DH (1980) Immediate perceptual response to intersensory discrepancy. Psychol Bull 88:638–667CrossRef
Zurück zum Zitat Welsh RB, Warren DH (1986) Intersensory interactions. In: Boff KR, Kaufman L, Thomas JP (eds) Handbook of perception and human performance, vol 1, sensory processes and perception. Wiley, New York, pp 1–36 Welsh RB, Warren DH (1986) Intersensory interactions. In: Boff KR, Kaufman L, Thomas JP (eds) Handbook of perception and human performance, vol 1, sensory processes and perception. Wiley, New York, pp 1–36
Zurück zum Zitat Werkhoven PJ, Van Erp JB, Philippi TG (2009) Counting visual and tactile events: the effect of attention on multisensory integration. Atten Percept Psychophys 71(8):1854–1861PubMedCrossRef Werkhoven PJ, Van Erp JB, Philippi TG (2009) Counting visual and tactile events: the effect of attention on multisensory integration. Atten Percept Psychophys 71(8):1854–1861PubMedCrossRef
Zurück zum Zitat Wilson JT, Singer W (1981) Simultaneous visual events show a long-range spatial interaction. Percept Psychophys 30:353–356PubMedCrossRef Wilson JT, Singer W (1981) Simultaneous visual events show a long-range spatial interaction. Percept Psychophys 30:353–356PubMedCrossRef
Zurück zum Zitat Yates DS, Moore DS, Starnes DS (2011) The practice of statistics. WH Freeman, New York Yates DS, Moore DS, Starnes DS (2011) The practice of statistics. WH Freeman, New York
Metadaten
Titel
Phenomenology of the sound-induced flash illusion
verfasst von
Richard V. Abadi
Jonathan S. Murphy
Publikationsdatum
01.07.2014
Verlag
Springer Berlin Heidelberg
Erschienen in
Experimental Brain Research / Ausgabe 7/2014
Print ISSN: 0014-4819
Elektronische ISSN: 1432-1106
DOI
https://doi.org/10.1007/s00221-014-3912-2

Weitere Artikel der Ausgabe 7/2014

Experimental Brain Research 7/2014 Zur Ausgabe

Leitlinien kompakt für die Neurologie

Mit medbee Pocketcards sicher entscheiden.

Seit 2022 gehört die medbee GmbH zum Springer Medizin Verlag

Nicht Creutzfeldt Jakob, sondern Abführtee-Vergiftung

29.05.2024 Hyponatriämie Nachrichten

Eine ältere Frau trinkt regelmäßig Sennesblättertee gegen ihre Verstopfung. Der scheint plötzlich gut zu wirken. Auf Durchfall und Erbrechen folgt allerdings eine Hyponatriämie. Nach deren Korrektur kommt es plötzlich zu progredienten Kognitions- und Verhaltensstörungen.

Schutz der Synapsen bei Alzheimer

29.05.2024 Morbus Alzheimer Nachrichten

Mit einem Neurotrophin-Rezeptor-Modulator lässt sich möglicherweise eine bestehende Alzheimerdemenz etwas abschwächen: Erste Phase-2-Daten deuten auf einen verbesserten Synapsenschutz.

Sozialer Aufstieg verringert Demenzgefahr

24.05.2024 Demenz Nachrichten

Ein hohes soziales Niveau ist mit die beste Versicherung gegen eine Demenz. Noch geringer ist das Demenzrisiko für Menschen, die sozial aufsteigen: Sie gewinnen fast zwei demenzfreie Lebensjahre. Umgekehrt steigt die Demenzgefahr beim sozialen Abstieg.

Hirnblutung unter DOAK und VKA ähnlich bedrohlich

17.05.2024 Direkte orale Antikoagulanzien Nachrichten

Kommt es zu einer nichttraumatischen Hirnblutung, spielt es keine große Rolle, ob die Betroffenen zuvor direkt wirksame orale Antikoagulanzien oder Marcumar bekommen haben: Die Prognose ist ähnlich schlecht.

Update Neurologie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.