Research ReportImagery of motor actions: Differential effects of kinesthetic and visual–motor mode of imagery in single-trial EEG
Introduction
The use of mental imagery of motor behavior plays an important role in motor skill learning [11] and rehabilitation [39]. Aside from these classical applications, motor imagery, defined as mental simulation of a movement [5], [13], has been shown to represent an efficient mental strategy to operate a direct brain–computer interface (BCI) [22]. For the latter application, e.g. the control of an external device based on brain signals (i.e., EEG signals), it is essential that imagery-related brain activity can be detected in real time from the ongoing EEG. The main goal of this research work is to establish an EEG-based communication system that should provide an alternative communication or control channel for patients with severe motor impairment [40].
It has been shown that mental imagery of motor actions can produce replicable EEG patterns over primary sensory and motor areas [2], [21]. As an example, imagery of hand movements results in desynchronization of mu (8–12 Hz) and central beta rhythms (13–28 Hz), very similar to planning and execution of real movements [17]. It is even possible to distinguish between imagined right and left hand movements based on single-trial EEG signals [19], [22], [24]. These data strongly indicate a type of readiness or presetting of neural networks in sensorimotor areas during mental simulation of movement. Further evidence in favor of matching cortical activity in the contralateral hand area during execution and imagination of hand movement comes from DC potential measurements [2] and dipole source analysis of electric and magnetic fields [14].
Even though it has been well documented that imagination of simple movements elicits predictable changes in the sensorimotor mu and beta bands, which are very stable over time (i.e., small intra-subject variability), there are also conflicting results of a portion of participants, who do not show the expected imagery-related EEG changes [22]. Moreover, a diversity of time–frequency patterns (i.e., high inter-subject variability), especially with respect to the reactive frequency components, was found when studying the dynamics of oscillatory activity during movement imagination [17], [25], [38].
The observed individual differences in imagery-related EEG changes may be explained by varieties of motor imagery, as described by Annett [1]. In case that there is no specific instruction, the subject may, for example, either imagine self-performed action with ‘interior view’ or, alternatively, imagine seeing himself or another person performing actions with an exterior view (i.e., ‘mental video’) [4]. Whereas the first type of imagery is supposed to involve kinesthetic experiences [34], the second case may be primarily visual in character. Based on the general idea that imagining is functionally equivalent to and may share some of the brain processes associated with real perception and action [1], [35], the different ways how subjects perform motor imagery are very likely associated with dissimilar electrophysiological activation patterns (i.e., in terms of time, frequency and spatial domains).
In the present study, we investigated the EEG patterns sensitive to different types of motor imagery. In particular, the instruction how to imagine action was varied to create (i) kinesthetic motor imagery (first-person process) and (ii) visual–motor imagery (third-person process). For control purposes, also ‘real conditions’ were examined, i.e., the execution and visual observation of physical hand movements, respectively. The goal of this study was to identify relevant features of the ongoing multi-channel EEG (i.e., electrode locations and reactive frequency components) that represent the specific mental processes. In order to determine the relevant features for recognizing the respective mental states, a neural network classifier, the distinction sensitive learning vector quantization (DSLVQ) [29] algorithm, was used. This method uses a weighted distance function and adjusts the influence of different input features (e.g. frequency components) through supervised learning.
Section snippets
Subjects
Fourteen healthy volunteers, aged 18–53 years (mean = 26.2, SD = 8.3), participated in the study. All were right-handed, without any medical or psychological diseases and/or medication and had normal or corrected to normal vision. The participants gave informed consent after the experimental procedure had been explained to them and received a small fee for their participation.
Experimental tasks and procedure
During the experiment, the participants were sitting in a comfortable armchair in front of a 17ʺ monitor at a distance
Results
Visual inspection of the individual ERD/ERS time–frequency maps revealed event-related EEG changes in alpha and beta frequency bands, which differed dependent on the experimental task; the patterns of desynchronization and synchronization, however, varied considerably across individuals. Fig. 1a illustrates such examples of various ERD/ERS phenomena of 3 selected subjects. All of them show clear differences between kinesthetic (MIK) and visual–motor imagery (MIV): the first example (subject
Discussion
Previous studies suggest that, in motor behavior representation, there is probably some overlap in the utilization of visual imagery and motor imagery [1], [35], [36]. For motor imagery tasks in BCI research, the subjects are usually instructed to imagine themselves performing a specific motor action without overt motor output. However, dependent on the exact manner of how subjects perform this task, the relative contribution of various aspects involved in motor imagery, such as movement
Acknowledgments
This work was supported in part by the European PRESENCIA project (IST-2001-37927) and the ‘Fonds zur Förderung der wissenschaftlichen Forschung’ in Austria (FWF-P-16326-BO2). The authors are grateful to B. Bliem, C. Keinrath and C. Brunner for help in data recording and processing. Furthermore, we thank A. Schlögl and B. Graimann for making generously available their software tools.
References (40)
Motor imagery: perception or action?
Neuropsychologia
(1995)- et al.
Mental representations of movements. Brain potentials associated with imagination of hand movements
Electroencephalogr. Clin. Neurophysiol.
(1995) - et al.
Learning to control brain activity: a review of the production and control of EEG components for driving brain–computer interface (BCI) systems
Brain Cogn.
(2003) - et al.
Brain structures participating in mental simulation of motor behaviour: a neuropsychological interpretation
Acta Psychol.
(1990) - et al.
Is the human primary motor cortex involved in motor imagery?
Cogn. Brain Res.
(2004) - et al.
Cerebral processes related to visuomotor imagery and generation of simple finger movements studied with positron emission tomography
NeuroImage
(1998) - et al.
Visualization of significant ERD/ERS patterns in multichannel EEG and ECoG data
Clin. Neurophysiol.
(2002) - et al.
Mental imaging of motor activity in humans
Curr. Opin. Neurobiol.
(1999) - et al.
Electric and magnetic fields of the brain accompanying internal simulation of movement
Brain Res. Cogn. Brain Res.
(1996) - et al.
Cortical and cerebellar activity of the human brain during imagined and executed unimanual and bimanual action sequences: a functional MRI study
Cogn. Brain Res.
(2003)
Evidence for distinct beta resonance frequencies in human EEG related to specific sensorimotor cortical areas
Clin. Neurophysiol.
Motor imagery activates primary sensorimotor area in humans
Neurosci. Lett.
Event-related desynchronization (ERD) during visual processing
Int. J. Psychophysiol.
Beta rebound after different types of motor imagery in man
Neurosci. Lett.
Automated feature selection with a distinction sensitive learning vector quantizer
Neurocomputing
Interference effects demonstrate distinct roles for visual and motor imagery during the mental representation of human action
Cognition
Classifying EEG-based motor imagery tasks by means of time–frequency synthesized spatial patterns
Clin. Neurophysiol.
Brain—Computer interfaces for communication and control
Clin. Neurophysiol.
Broca's region subserves imagery of motion: a combined cytoarchitectonic and fMRI study
Hum. Brain Mapp.
Mapping motor representations with positron emission tomography
Nature
Cited by (561)
Visual tracking brain-computer interface
2024, iScience