Elsevier

NeuroImage

Volume 135, 15 July 2016, Pages 324-332
NeuroImage

A systems neurophysiology approach to voluntary event coding

https://doi.org/10.1016/j.neuroimage.2016.05.007Get rights and content

Abstract

Mechanisms responsible for the integration of perceptual events and appropriate actions (sensorimotor processes) have been subject to intense research. Different theoretical frameworks have been put forward with the “Theory of Event Coding (TEC)” being one of the most influential. In the current study, we focus on the concept of ‘event files’ within TEC and examine what sub-processes being dissociable by means of cognitive-neurophysiological methods are involved in voluntary event coding. This was combined with EEG source localization. We also introduce reward manipulations to delineate the neurophysiological sub-processes most relevant for performance variations during event coding. The results show that processes involved in voluntary event coding included predominantly stimulus categorization, feature unbinding and response selection, which were reflected by distinct neurophysiological processes (the P1, N2 and P3 ERPs). On a system's neurophysiological level, voluntary event-file coding is thus related to widely distributed parietal-medial frontal networks. Attentional selection processes (N1 ERP) turned out to be less important. Reward modulated stimulus categorization in parietal regions likely reflecting aspects of perceptual decision making but not in other processes. The perceptual categorization stage appears central for voluntary event-file coding.

Introduction

The mechanisms responsible for the integration of perceptual events into appropriate actions (i.e. sensorimotor processes) have been subject to intense research in cognitive psychology and neuroscience for decades. One influential account trying to conceptualize these processes is the “Theory of Event Coding (TEC)” (Hommel et al., 2001). The TEC is a theoretical framework (Hommel, 2011) that provides conceptual tools to explain information processing aiming at integrating perception (stimuli) and action (responses) (Hommel et al., 2001). Briefly, TEC assumes that perceptual processing of an object establishes an ‘object file’ (Hommel, 2004) containing information about the relationship, i.e. the binding, between different object features (e.g. shape, colour, intensity, and location). Action planning similarly involves assembling (binding) of action features (‘action file’). Binding of codes of perceptual events (object files), current task context and actions (action files), is mediated by multi-layered networks to the effect of creating ‘event files’ (Hommel, 2004). Event file coding thus appears to be particularly important for the understanding of goal-directed behavior and is therefore examined in the current study.

Currently event-file coding has been extensively investigated concerning the relevance of specific neurobiological processes including the importance of the dopaminergic system using pharmacological, molecular genetics and substance abuse approaches (Colzato et al., 2012, Colzato et al., 2004, Colzato et al., 2013, Colzato and Hommel, 2008). Using functional brain imaging and brain stimulation it has been shown that event-file coding is mediated via a widely distributed network including the supplementary motor areas, the dorsolateral prefrontal cortex and the hippocampus (Elsner et al., 2002, Kühn et al., 2011, Melcher et al., 2014, Zmigrod et al., 2014) suggesting that the perceptional and/or attentional mechanisms as well as response selection and memory encoding mechanisms are important. However, while TEC in general, and event-file coding in particular, have inspired a wealth of instructive studies in cognitive psychology (Hommel, 2009, Shin et al., 2010), behavioral neuroscience and functional imaging, the underlying cognitive-neurophysiological mechanisms are unclear. Thus, it is largely unknown what temporally segregated stages of information processing are involved during event-file coding, which can be segregated using electrophysiological methods with high temporal solution including EEG and event-related potentials (ERPs) combined with source localization methods. These methods have previously been used to examine attentional processes during event integration (Akyürek et al., 2007), but have not been used to examine further response-selection related processes during event file coding and have not delineated the functional neuroanatomical networks underlying these processes (e.g. using source localization methods). EEG neurofeedback studies have also been conducted to enhance feature binding (Keizer et al., 2010) but the effects of this have not been evaluated on an electrophysiological level during an event file coding task.

While these latter studies suggest that perceptual processes and networks possibly encompassing posterior and frontal brain areas are important for event coding, the precise nature of the modulation of temporally dissociable cognitive-neurophysiological sub-processes from perception to response selection during event file processing, as reflected using ERPs, are unclear. This is particularly the case for “voluntary event-file coding”: In previous studies examining event-file coding specific stimulus features (e.g. shape) are automatically bound to a certain response, whereas other stimulus features (e.g. color or location) are behaviorally irrelevant. In such conditions response selection is relatively straightforward, because only one feature is response relevant. If, however, the other stimulus dimensions become also relevant to some degree, response selection and event-file coding becomes more complicated and needs to be voluntary controlled. We hypothesize that mechanisms of perceptual gating and early stimulus categorization reflected by the P1 ERP (Klimesch, 2011) are important for voluntary event file coding because these processes build the basis for any action to be executed after a sensory event has been processed and are especially demanded because more than one stimulus feature is response relevant. Probably, for these processes parietal networks are particularly relevant, since these have previously been shown to be engaged in encoding of stimulus properties (Donner et al., 2002, Nobre et al., 2003, Pollmann et al., 2014) relating these aspects to appropriate actions (Geng and Vossel, 2013, Zmigrod et al., 2014). In contrast, attentional selection processes, as reflected by the N1 ERP (Herrmann and Knight, 2001), are not expected to be modulated because there is good evidence that a given stimulus is automatically bound to a response largely independent of attentional selection mechanisms (Hommel, 2005). In contrast, electrophysiological correlates of response selection and the “decision” processes between stimulus evaluation and responding (i.e. what response to select) are most likely to be important for event-file coding. These processes are reflected by amplitude modulations of the N2 and P3 ERP, respectively and reflect parietal-medial frontal cortical network activity (Azizian et al., 2006, Di Russo et al., 2006, Falkenstein et al., 1994, Gajewski et al., 2008, Hohnsbein et al., 1998, Mückschel et al., 2014, Ritter et al., 1983, Ritter et al., 1982, Twomey et al., 2015). Similar networks may therefore be of importance for voluntary event file coding in which response selection processes are more demanding.

To better understand what cognitive-neurophysiological sub-processes within the processing cascade are particularly relevant for voluntary event-file coding we introduce a manipulation of rewards. Reward manipulations are well-known to modulate the dopaminergic system (Schultz, 1998), which has already been shown to be relevant for event coding (see above), but not yet for voluntary event coding. We expected that voluntary event coding becomes more efficient during reward anticipation. However, each of the above-mentioned sub-processes may be potentially affected by rewards during voluntary event coding. This is because rewards do not only modulate medial frontal networks important for response selection and cognitive control processes, but also processes of perceptual and attentional gating in parietal networks (Maunsell, 2004, Platt and Glimcher, 1999).

Section snippets

Participants

A sample of 51 young healthy participants between 18 and 31 years of age (M = 23.7; SD = 3.4) was recruited. 26 participants (M = 22.77; SD = 3.3) served as a rewarded group and were complemented by a control group of 25 participants (M = 24.84; SD = 3.16), who were studied without reward. 5 participants (n = 3 rewarded participants) had to be excluded because of poor data quality. In total, the final sample comprised 46 participants (N = 23 in each group). All participants gave written informed consent and

Accuracy

The mixed-effects ANOVA of the percentage of hits on the S2-stimulus using the within-subject factors “feature overlap” and “response” and the between-subject factor “group” revealed a significant main effect for “response” (F1,44 = 8.92; P = 0.005, η2 = .17) with more correct answers for alternated responses (96.68% ± 0.62) than for repeated responses (94.66% ± 0.85). While there was no main effect, “feature overlap” (F3,132 = 2.01; P > 0.1) and “group” (F1,44 = 0.23; P > 0.6), there was a significant

Discussion

In this study we examined the systems neurophysiological mechanisms underlying voluntary event file coding (Hommel et al., 2001) and in which way the integration of visuo-motor features into an event-file during voluntary event file coding is modulated by reward. To the best of our knowledge, the study is the first to approach the question what neurophysiological processes underlie voluntary event file coding processes as conceptualized in the theory of event coding (TEC) (Hommel et al., 2001).

Conclusions

In summary, the study examined the system neurophysiological basis of voluntary event-coding, a major aspect in the “theory of event coding” (TEC), which has been proposed as an influential framework of how perceptions are transformed into the appropriate actions. The results show that neurophysiological correlates of processes of stimulus categorization, as well as feature unbinding and response selection processes are central to voluntary event-file coding. Attentional selection processes do

Acknowledgements

This work was supported by Grants from the Deutsche Forschungsgemeinschaft (DFG) BE4045/10-2 and BE4045/19-1 to C.B. and MU 1692/4-1 to A.M.

References (64)

  • B. Hommel

    Event files: feature binding in and across perception and action

    Trends Cogn. Sci.

    (2004)
  • B. Hommel

    The Simon effect as tool and heuristic

    Acta Psychol.

    (2011)
  • S. Karch et al.

    Separating distinct aspects of the voluntary selection between response alternatives: N2- and P3-related BOLD responses

    NeuroImage

    (2010)
  • A.W. Keizer et al.

    Enhancing cognitive control through neurofeedback: a role of gamma-band activity in managing episodic retrieval

    NeuroImage

    (2010)
  • W. Klimesch

    Evoked alpha and early access to the knowledge system: the P1 inhibition timing hypothesis

    Brain Res.

    (2011)
  • J.H.R. Maunsell

    Neuronal representations of cognitive state: reward or attention?

    Trends Cogn. Sci.

    (2004)
  • A.C. Nobre et al.

    Brain activations during visual search: contributions of search efficiency versus feature binding

    NeuroImage

    (2003)
  • F. Perrin et al.

    Spherical splines for scalp potential and current density mapping

    Electroencephalogr. Clin. Neurophysiol.

    (1989)
  • J. Polich

    Updating P300: an integrative theory of P3a and P3b

    Clin. Neurophysiol.

    (2007)
  • S. Pollmann et al.

    The right temporo-parietal junction contributes to visual feature binding

    NeuroImage

    (2014)
  • K. Sekihara et al.

    Localization bias and spatial resolution of adaptive and non-adaptive spatial filters for MEG source reconstruction

    NeuroImage

    (2005)
  • R. Verleger et al.

    Reduction of P3b in patients with temporo-parietal lesions

    Brain Res. Cogn. Brain Res.

    (1994)
  • S. Zmigrod et al.

    Evidence for a role of the right dorsolateral prefrontal cortex in controlling stimulus–response integration: a transcranial direct current stimulation (tDCS) study

    Brain Stimul.

    (2014)
  • E.G. Akyürek et al.

    Adaptive control of event integration: evidence from event-related potentials

    Psychophysiology

    (2007)
  • A. Azizian et al.

    Beware misleading cues: perceptual similarity modulates the N2/P3 complex

    Psychophysiology

    (2006)
  • C. Beste et al.

    Variations in the TNF-α gene (TNF-α -308G-A) affect attention and action selection mechanisms in a dissociated fashion

    J. Neurophysiol.

    (2010)
  • F. Chersi et al.

    Neuronal chains for actions in the parietal lobe: a computational model

    PLoS One

    (2011)
  • L.S. Colzato et al.

    Priming and binding in and across perception and action: a correlational analysis of the internal structure of event files

    Q. J. Exp. Psychol.

    (2006)
  • L.S. Colzato et al.

    Dopamine, norepinephrine, and the management of sensorimotor bindings: individual differences in updating of stimulus–response episodes are predicted by DAT1, but not DBH5′-ins/del

    Exp. Brain Res.

    (2013)
  • G. Dippel et al.

    A causal role of the right inferior frontal cortex in the strategies of multi-component behaviour

    Nat. Commun.

    (2015)
  • G. Dippel et al.

    Response mode-dependent differences in neurofunctional networks during response inhibition: an EEG-beamforming study

    Brain Struct. Funct.

    (2015)
  • S.M. Fleming et al.

    Effects of category-specific costs on neural systems for perceptual decision-making

    J. Neurophysiol.

    (2010)
  • Cited by (0)

    View full text