nach oben

Brain Topography

Erschienen in:

01.11.2014 | Original Paper

Integration of Spoken and Written Words in Beginning Readers: A Topographic ERP Study

verfasst von: Lea B. Jost, Aleksandra K. Eberhard-Moscicka, Christine Frisch, Volker Dellwo, Urs Maurer

Erschienen in: Brain Topography | Ausgabe 6/2014

Einloggen, um Zugang zu erhalten

Abstract

Integrating visual and auditory language information is critical for reading. Suppression and congruency effects in audiovisual paradigms with letters and speech sounds have provided information about low-level mechanisms of grapheme-phoneme integration during reading. However, the central question about how such processes relate to reading entire words remains unexplored. Using ERPs, we investigated whether audiovisual integration occurs for words already in beginning readers, and if so, whether this integration is reflected by differences in map strength or topography (aim 1); and moreover, whether such integration is associated with reading fluency (aim 2). A 128-channel EEG was recorded while 69 monolingual (Swiss)-German speaking first-graders performed a detection task with rare targets. Stimuli were presented in blocks either auditorily (A), visually (V) or audiovisually (matching: AVM; nonmatching: AVN). Corresponding ERPs were computed, and unimodal ERPs summated (A + V = sumAV). We applied TANOVAs to identify time windows with significant integration effects: suppression (sumAV–AVM) and congruency (AVN–AVM). They were further characterized using GFP and 3D-centroid analyses, and significant effects were correlated with reading fluency. The results suggest that audiovisual suppression effects occur for familiar German and unfamiliar English words, whereas audiovisual congruency effects can be found only for familiar German words, probably due to lexical-semantic processes involved. Moreover, congruency effects were characterized by topographic differences, indicating that different sources are active during processing of congruent compared to incongruent audiovisual words. Furthermore, no clear associations between audiovisual integration and reading fluency were found. The degree to which such associations develop in beginning readers remains open to further investigation.

Achenbach T (1991) Manual for the child behavior checklist/4–18 and 1991 Profile. University of Vermont Department of Psychiatry, Burlington

Baayen R, Piepenbrock R, Van Rijn H (1993) The CELEX lexical database [CD-ROM]. University of Pennsylvania Linguistic Data Consortium, Philadelphia

Bentin S, Mouchetant-Rostaing Y, Giard MH, Echallier JF, Pernier J (1999) ERP manifestations of processing printed words at different psycholinguistic levels: time course and scalp distribution. J Cogn Neurosci 11(3):235–260PubMedCrossRef

Besle J, Fort A, Giard M-H (2004) Interest and validity of the additive model in electrophysiological studies of multisensory interactions. Cogn Process 5(3):189–192. doi:10.1007/s10339-004-0026-y CrossRef

Besle J, Bertrand O, Giard M-H (2009) Electrophysiological (EEG, sEEG, MEG) evidence for multiple audiovisual interactions in the human auditory cortex. Hear Res 258(1–2):143–151. doi:10.1016/j.heares.2009.06.016 PubMedCrossRef

Blau V, Reithler J, van Atteveldt N, Seitz J, Gerretsen P, Goebel R, Blomert L (2010) Deviant processing of letters and speech sounds as proximate cause of reading failure: a functional magnetic resonance imaging study of dyslexic children. Brain 133(Pt 3):868–879. doi:10.1093/brain/awp308 PubMedCrossRef

Blomert L (2011) The neural signature of orthographic–phonological binding in successful and failing reading development. Neuroimage 57(3):695–703. doi:10.1016/j.neuroimage.2010.11.003 PubMedCrossRef

Boersma P (2001) Praat: a system for doing phonetics by computer. Glot Int 5(9/10):341–345

Calvert GA, Campbell R, Brammer MJ (2000) Evidence from functional magnetic resonance imaging of crossmodal binding in the human heteromodal cortex. Curr Biol 10(11):649–657PubMedCrossRef

Cappe C, Thut G, Romei V, Murray MM (2010) Auditory–visual multisensory interactions in humans: timing, topography, directionality, and sources. J Neurosci 30(38):12572–12580. doi:10.1523/JNEUROSCI.1099-10.2010 PubMedCrossRef

Debruille JB, Renoult L (2009) Effects of semantic matching and of semantic category on reaction time and N400 that resist numerous repetitions. Neuropsychologia 47:506–517PubMedCrossRef

Duyck W, Desmet T, Verbeke LPC, Brysbaert M (2004) WordGen: a tool for word selection and nonword generation in Dutch, English, German, and French. Behav Res Methods, Intrum Comput 36:488–499CrossRef

Ehri LC (2005) Learning to read words: theory, findings, and issues. Sci Stud Read 9(2):167–188. doi:10.1207/s1532799xssr0902_4 CrossRef

Field A (2009) Discovering statistics using SPSS, 3rd edn. Sage, London

Froyen D, Van Atteveldt N, Bonte M, Blomert L (2008) Cross-modal enhancement of the MMN to speech-sounds indicates early and automatic integration of letters and speech-sounds. Neurosci Lett 430(1):23–28. doi:10.1016/j.neulet.2007.10.014 PubMedCrossRef

Froyen DJ, Bonte ML, van Atteveldt N, Blomert L (2009) The long road to automation: neurocognitive development of letter–speech sound processing. J Cogn Neurosci 21(3):567–580PubMedCrossRef

Froyen D, Willems G, Blomert L (2011) Evidence for a specific cross-modal association deficit in dyslexia: an electrophysiological study of letter-speech sound processing. Dev Sci 14(4):635–648. doi:10.1111/j.1467-7687.2010.01007.x PubMedCrossRef

Giard MH, Peronnet F (1999) Auditory-visual integration during multimodal object recognition in humans: a behavioral and electrophysiological study. J Cogn Neurosci 11(5):473–490. doi:10.1162/089892999563544 PubMedCrossRef

Grill-Spector K, Henson R, Martin A (2006) Repetition and the brain: neural models of stimulus-specific effects. Trends Cogn Neurosci 10(1):14–23. doi:10.1016/j.tics.2005.11.006 CrossRef

Hauk O, Pulvermuller F (2004) Effects of word length and frequency on the human event-related potential. Clin Neurophysiol 115(5):1090–1103. doi:10.1016/j.clinph.2003.12.020 PubMedCrossRef

Herdman AT, Fujioka T, Chau W, Ross B, Pantev C, Picton TW (2006) Cortical oscillations related to processing congruent and incongruent grapheme–phoneme pairs. Neurosci Lett 399(1):61–66. doi:10.1016/j.neulet.2006.01.069 PubMedCrossRef

Hocking J, Price CJ (2009) Dissociating verbal and nonverbal audiovisual object processing. Brain Lang 108(2):89–96. doi:10.1016/j.bandl.2008.10.005 PubMedCrossRefPubMedCentral

Holmes AP, Blair RC, Watson JD, Ford I (1996) Nonparametric analysis of statistic images from functional mapping experiments. J Cereb Blood Flow Metab 16(1):7–22PubMedCrossRef

Jung TP, Makeig S, Westerfield M, Townsend J, Courchesne E, Sejnowski TJ (2000) Removal of eye activity artifacts from visual event-related potentials in normal and clinical subjects. Clin Neurophysiol 111(10):1745–1758. doi:10.1016/S1388-2457(00)00386-2 PubMedCrossRef

Kast M, Elmer S, Jancke L, Meyer M (2010) ERP differences of pre-lexical processing between dyslexic and non-dyslexic children. Int J Psychophysiol 77:59–69. doi:10.1016/j.ijpsycho.2010.04.003 PubMedCrossRef

Klucharev V, Mottonen R, Sams M (2003) Electrophysiological indicators of phonetic and non-phonetic multisensory interactions during audiovisual speech perception. Cogn Brain Res 18(1):65–75. doi:10.1016/j.cogbrainres.2003.09.004 CrossRef

Kutas M, Federmeier KD (2011) Thirty years and counting: finding meaning in the N400 component of the event-related brain potential (ERP). Ann Rev Psychol 62:621–647. doi:10.1146/annurev.psych.093008.131123 CrossRef

Landerl K, Wimmer H, Moser E (2006) SLRT Salzburger Lese- und Rechtschreibtest (Salzburg reading and orthography test). Huber, Bern

Lehmann D, Skrandies W (1980) Reference-free identification of components of checkerboard-evoked multichannel potential fields. Electroencephalogr Clin Neurophysiol 48(6):609–621PubMedCrossRef

Maurer U, Bucher K, Brem S, Brandeis D (2003) Development of the automatic mismatch response: from frontal positivity in kindergarten children to the mismatch negativity. Clin Neurophysiol 114(5):808–817. doi:10.1016/S1388-2457(03)00032-4 PubMedCrossRef

Maurer U, Brem S, Bucher K, Brandeis D (2005) Emerging neurophysiological specialization for letter strings. J Cogn Neurosci 17(10):1532–1552PubMedCrossRef

Maurer U, Brem S, Kranz F, Bucher K, Benz R, Halder P, Steinhausen H-C, Brandeis D (2006) Coarse neural tuning for print peaks when children learn to read. Neuroimage 33(2):749–758. doi:10.1016/j.neuroimage.2006.06.025 PubMedCrossRef

Maurer U, Brem S, Bucher K, Kranz F, Benz R, Steinhausen H-C, Brandeis D (2007) Impaired tuning of a fast occipito-temporal response for print in dyslexic children learning to read. Brain 130:3200–3210. doi:10.1093/brain/awm193 PubMedCrossRef

Maurer U, Bucher K, Brem S, Benz R, Kranz F, Schulz E, van der Mark S, Steinhausen H-C, Brandeis D (2009) Neurophysiology in preschool improves behavioral prediction of reading ability throughout primary school. Biological Psychiatry 66(4):341–348

Maurer U, Rossion B, McCandliss BD (2008) Category specificity in early perception: face and word n170 responses differ in both lateralization and habituation properties. Front Hum Neurosci. doi:10.3389/neuro.09.018.2008 PubMedPubMedCentral

Maurer U, Blau VC, Yoncheva YN, McCandliss BD (2010) Development of visual expertise for reading: rapid emergence of visual familiarity for an artificial script. Dev Neuropsychol 35(4):404–422. doi:10.1080/87565641.2010.480916 PubMedCrossRefPubMedCentral

Mayringer H, Wimmer H (2003) Salzburger Lese-Screening für die Klassenstufen 1-4. Manual. Hans Huber, Bern

Michel CM, Murray MM, Lantz G, Gonzalez S, Spinelli L, Grave de Peralta R (2004) EEG source imaging. Clin Neurophysiol 115(10):2195–2222. doi:10.1016/j.clinph.2004.06.001 PubMedCrossRef

Mittag M, Thesleff P, Laasonen M, Kujala T (2013) The neurophysiological basis of the integration of written and heard syllables in dyslexic adults. Clin Neurophysiol 124:315–326. doi:10.1016/j.clinph.2012.08.003 PubMedCrossRef

Molholm S, Ritter W, Javitt DC, Foxe JJ (2004) Multisensory visual-auditory object recognition in humans: a high-density electrical mapping study. Cereb Cortex 14(4):452–465. doi:10.1093/cercor/bhh007 PubMedCrossRef

Moll K, Landerl K (2010) SLRT-II: Lese- und Rechtschreibtest. Weiterentwicklung des Salzburger Lese- und Rechtschreibtests (SLRT). Verlag Hans Huber, Bern

Murray MM, Spierer L (2009) Auditory spatio-temporal brain dynamics and their consequences for multisensory interactions in humans. Hear Res 258(1):121–133. doi:10.1016/j.heares.2009.04.022 PubMedCrossRef

Murray MM, Michel CM, Grave de Peralta R, Ortigue S, Brunet D, Gonzalez Andino S, Schnider A (2004) Rapid discrimination of visual and multisensory memories revealed by electrical neuroimaging. Neuroimage 21(1):125–135. doi:10.1016/j.neuroimage.2003.09.035 PubMedCrossRef

Petermann F, Petermann U (2010) HAWIK-IV. Hamburg-Wechsler-Intelligenztest für Kinder—IV (Wechsler intelligence scale for children (WISC-IV)-German version). Huber, Bern

Raij T, Uutela K, Hari R (2000) Audiovisual integration of letters in the human brain. Neuron 28(2):617–625PubMedCrossRef

Schulz E, Maurer U, van der Mark S, Bucher K, Brem S, Martin E, Brandeis D (2008) Impaired semantic processing during sentence reading in children with dyslexia: combined fMRI and ERP evidence. Neuroimage 41(1):153–168. doi:10.1016/j.neuroimage.2008.02.012 PubMedCrossRef

Schulz E, Maurer U, van der Mark S, Bucher K, Brem S, Martin E, Brandeis D (2009) Reading for meaning in dyslexic and young children: Distinct neural pathways but common endpoints. Neuropsychologia 47:2544–2557. doi:10.1016/j.neuropsychologia.2009.04.028 PubMedCrossRef

Sereno SC, Rayner K, Posner MI (1998) Establishing a time-line of word recognition: evidence from eye movements and event-related potentials. NeuroReport 9(10):2195–2200PubMedCrossRef

Skrandies W (1998) Evoked potential correlates of semantic meaning—a brain mapping study. Cogn Brain Res 6(3):173–183CrossRef

Spironelli C, Angrilli A (2007) Influence of phonological, semantic and orthographic tasks on the early linguistic components N150 and N350. Int J Psychophysiol 64(2):190–198. doi:10.1016/j.ijpsycho.2007.02.002 PubMedCrossRef

Stein M, Dierks T, Brandeis D, Wirth M, Strik W, Koenig T (2006) Plasticity in the adult language system: a longitudinal electrophysiological study on second language learning. Neuroimage 33(2):774–783. doi:10.1016/j.neuroimage.2006.07.008 PubMedCrossRef

Stock C, Marx P, Schneider W (2003) BAKO 1-4. Basiskompetenzen für Lese-Rechtschreibleistungen, Beltz

Strik WK, Fallgatter AJ, Brandeis D, Pascual-Marqui RD (1998) Three-dimensional tomography of event-related potentials during response inhibition: evidence for phasic frontal lobe activation. Electroencephalogr Clin Neurophysiol 108(4):406–413PubMedCrossRef

Teder-Salejarvi WA, McDonald JJ, Di Russo F, Hillyard SA (2002) An analysis of audio-visual crossmodal integration by means of event-related potential (ERP) recordings. Cogn Brain Res 14(1):106–114CrossRef

van Atteveldt N, Formisano E, Goebel R, Blomert L (2004) Integration of letters and speech sounds in the human brain. Neuron 43(2):271–282PubMedCrossRef

van Atteveldt NM, Formisano E, Blomert L, Goebel R (2007a) The effect of temporal asynchrony on the multisensory integration of letters and speech sounds. Cereb Cortex 17(4):962–974. doi:10.1093/cercor/bhl007 PubMedCrossRef

van Atteveldt NM, Formisano E, Goebel R, Blomert L (2007b) Top-down task effects overrule automatic multisensory responses to letter-sound pairs in auditory association cortex. Neuroimage 36(4):1345–1360. doi:10.1016/j.neuroimage.2007.03.065 PubMedCrossRef

Van Petten C, Luka BJ (2012) Prediction during language comprehension: benefits, costs, and ERP components. Int J Psychophysiol 83(2):176–190. doi:10.1016/j.ijpsycho.2011.09.015 PubMedCrossRef

Wimmer H, Schurz M (2010) Dyslexia in regular orthographies: manifestation and causation. Dyslexia 16(4):283–299. doi:10.1002/dys.411 PubMedCrossRef

Wirth M, Horn H, Koenig T, Stein M, Federspiel A, Meier B, Michel C, Strik W (2007) Sex differences in semantic processing: event-related brain potentials distinguish between lower and higher order semantic analysis during word reading. Cereb Cortex 17(9):1987–1997. doi:10.1093/cercor/bhl121 PubMedCrossRef

Titel: Integration of Spoken and Written Words in Beginning Readers: A Topographic ERP Study
verfasst von: Lea B. Jost
Aleksandra K. Eberhard-Moscicka
Christine Frisch
Volker Dellwo
Urs Maurer
Publikationsdatum: 01.11.2014
Verlag: Springer US
Erschienen in: Brain Topography / Ausgabe 6/2014
Print ISSN: 0896-0267
Elektronische ISSN: 1573-6792
DOI: https://doi.org/10.1007/s10548-013-0336-4

Leitlinien kompakt für die Neurologie

Mit medbee Pocketcards sicher entscheiden.

^{Seit 2022 gehört die medbee GmbH zum Springer Medizin Verlag}

Kostenlos registrieren

Neu im Fachgebiet Neurologie

Hirnblutung unter DOAK und VKA ähnlich bedrohlich

17.05.2024 Direkte orale Antikoagulanzien Nachrichten

Kommt es zu einer nichttraumatischen Hirnblutung, spielt es keine große Rolle, ob die Betroffenen zuvor direkt wirksame orale Antikoagulanzien oder Marcumar bekommen haben: Die Prognose ist ähnlich schlecht.

Thrombektomie auch bei großen Infarkten von Vorteil

16.05.2024 Ischämischer Schlaganfall Nachrichten

Auch ein sehr ausgedehnter ischämischer Schlaganfall scheint an sich kein Grund zu sein, von einer mechanischen Thrombektomie abzusehen. Dafür spricht die LASTE-Studie, an der Patienten und Patientinnen mit einem ASPECTS von maximal 5 beteiligt waren.

Schwindelursache: Massagepistole lässt Otholiten tanzen

14.05.2024 Benigner Lagerungsschwindel Nachrichten

Wenn jüngere Menschen über ständig rezidivierenden Lagerungsschwindel klagen, könnte eine Massagepistole der Auslöser sein. In JAMA Otolaryngology warnt ein Team vor der Anwendung hochpotenter Geräte im Bereich des Nackens.

Schützt Olivenöl vor dem Tod durch Demenz?

10.05.2024 Morbus Alzheimer Nachrichten

Konsumieren Menschen täglich 7 Gramm Olivenöl, ist ihr Risiko, an einer Demenz zu sterben, um mehr als ein Viertel reduziert – und dies weitgehend unabhängig von ihrer sonstigen Ernährung. Dafür sprechen Auswertungen zweier großer US-Studien.

Update Neurologie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.

Newsletter bestellen

Die Highlights vom Kongress des American College of Cardiology 2024

Springer Medizin

Abstract

Bitte loggen Sie sich ein, um Zugang zu diesem Inhalt zu erhalten

Weitere Artikel der Ausgabe 6/2014

Head Motion Parameters in fMRI Differ Between Patients with Mild Cognitive Impairment and Alzheimer Disease Versus Elderly Control Subjects

A Reliability Study on Brain Activation During Active and Passive Arm Movements Supported by an MRI-Compatible Robot

Identifying and Quantifying Multisensory Integration: A Tutorial Review

Probing the Neural Basis of Superstition

Identifying 22q11.2 Deletion Syndrome and Psychosis Using Resting-State Connectivity Patterns