Elsevier

NeuroImage

Volume 30, Issue 2, 1 April 2006, Pages 359-376
NeuroImage

The creation of a brain atlas for image guided neurosurgery using serial histological data

https://doi.org/10.1016/j.neuroimage.2005.09.041Get rights and content

Abstract

Digital and print brain atlases have been used with success to help in the planning of neurosurgical interventions. In this paper, a technique presented for the creation of a brain atlas of the basal ganglia and the thalamus derived from serial histological data. Photographs of coronal histological sections were digitized and anatomical structures were manually segmented. A slice-to-slice nonlinear registration technique was used to correct for spatial distortions introduced into the histological data set at the time of acquisition. Since the histological data were acquired without any anatomical reference (e.g., block-face imaging, post-mortem MRI), this registration technique was optimized to use an error metric which calculates a nonlinear transformation minimizing the mean distance between the segmented contours between adjacent pairs of slices in the data set. A voxel-by-voxel intensity correction field was also estimated for each slice to correct for lighting and staining inhomogeneity. The reconstructed three-dimensional (3D) histological volume can be viewed in transverse and sagittal directions in addition to the original coronal.

Nonlinear transformations used to correct for spatial distortions of the histological data were applied to the segmented structure contours. These contours were then tessellated to create three-dimensional geometric objects representing the different anatomic regions in register with the histological volumes. This yields two alternate representations (one histological and one geometric) of the atlas.

To register the atlas to a standard reference MR volume created from the average of 27 T1-weighted MR volumes, a pseudo-MRI was created by setting the intensity of each anatomical region defined in the geometric atlas to match the intensity of the corresponding region of the reference MR volume. This allowed the estimation of a 3D nonlinear transformation using a correlation based registration scheme to fit the atlas to the reference MRI.

The result of this procedure is a contiguous 3D histological volume, a set of 3D objects defining the basal ganglia and thalamus, both of which are registered to a standard MRI data set, for use for neurosurgical planning.

Introduction

Functional stereotactic neurosurgery is increasingly used for the treatment for movement disorders such as Parkinson's disease (Atkinson et al., 2002, Cohn et al., 1998, Cuny et al., 2002, Gross et al., 1999, Lenz et al., 1995, Lombardi et al., 2000, Samuel et al., 1998). While symptoms associated with Parkinson's disease (such as tremor, rigidity, bradykinesia, and impaired gait) can be treated pharmacologically, intractable cases require surgical intervention. For surgical candidates, this can include the introduction of recording or stimulating probes in deep cerebral structures and the creation of lesions in the thalamus (thalamotomy) (Atkinson et al., 2002, Gross et al., 1999, Lenz et al., 1995) or globus pallidus (pallidotomy) (Cohn et al., 1998, Lombardi et al., 2000, Samuel et al., 1998), or insertion of brain stimulation electrodes in the thalamus, globus pallidus, or subthalamic nucleus. Pre-surgical planning of these procedures requires a detailed analysis of the thalamus and the basal ganglia from pre-operative Computed Tomography (CT) and Magnetic Resonance Imaging (MR) volumes. However, cyto-architectonic boundaries between specific subcortical nuclei are often indistinguishable due to the limited contrast and resolution of these imaging modalities.

While new MR imaging and image processing techniques enable visualization of some nuclei (Deoni et al., 2005, Fujita et al., 2001, Starr et al., 1999), atlases are often used in conjunction with more standard imaging techniques to enhance the visualization of surgical targets for pre-operative planning and to accurately predict the optimal location of surgical targets in sub-cortical nuclei (Atkinson et al., 2002, Bertrand et al., 1973, Nowinski et al., 1997, Nowinski et al., 2000, St-Jean et al., 1998, Xu and Nowinski, 2001). Diffusion tensor imaging has also been used to map thalamo-cortical connections in order to derive probabilistic segmentations of the human thalamic nuclei (Behrens et al., 2003, Johansen-Berg et al., 2005). However, at this time, neither of these in vivo imaging techniques is able to provide the resolution required to accurately identify the subcortical nuclei targeted in functional neurosurgery, and therefore cannot provide the detailed segmentation that we present here.

Print atlases were the first visualization tools used to aid in the identification of anatomical structures for surgical planning (Afshar et al., 1978, Ono et al., 1990, Schaltenbrand and Bailey, 1959, Schaltenbrand and Wahren, 1977, Schnitzlein and Murtagh, 1980, Talairach and Tournoux, 1988, Talairach and Tournoux, 1993, Van Buren and Borke, 1972, Watkins, 1969). Typically, digital atlases are 3D visualizations of the data presented in these atlases. When digital atlases were first used, linear transformations matching the atlas to patient data were used to register an atlas to an individual patient scan (Bertrand et al., 1973, Nowinski et al., 1997, Otsuki et al., 1994). Our group was one of the first to estimate and apply nonlinear transformations to warp a digital atlas to fit pre-operative patient MR data in order to account for local variations in the anatomy (St-Jean et al., 1998).

A number of digital atlases of the human brain, based on print atlases, have been previously published. Nowinski et al. (1997) have developed an integrated digital atlas that incorporated data from three print atlases by Ono et al., 1990, Schaltenbrand and Wahren, 1977, and Talairach and Tournoux (1988). All three atlases are registered together using landmark based linear transformations needed to map the Ono et al. (1990) and Schaltenbrand and Wahren (1977) atlases into Talairach space (Talairach and Tournoux, 1988). In order to register the combined atlas to a subject or patient, a piece-wise linear approach is used to transform the atlas to the MR volume. The Talairach and Tournoux atlas was also used as the foundation for a digital atlas by Ganser et al. (2004). The original plates were scanned and reconstructed in three dimensions by calculating a Delauney tetrahedrization. The surfaces of anatomic structures in the Talairach atlas were reconstructed using the marching cubes algorithm (Lorensen and Cline, 1987). The resulting volume was then intersected at half the slice-to-slice distance to complete the interpolation.

The digital atlas used previously at the Montreal Neurological Institute (MNI) was developed by St-Jean et al. (St-Jean et al., 1998). It is based on a 3D reconstruction of the axial contour data from the Schaltenbrand and Wahren atlas (Schaltenbrand and Wahren, 1977). The digital atlas included 16 structures and has a varying slice thickness of 0.5 to 3mm due to the slice-to-slice distance of the original atlas. The reconstructed data set was interpolated with a Hermite polynomial (Foley et al., 1990) to achieve a 0.5mm isotropic resolution. Slice-to-slice spatial inconsistencies in structure contours were considered to be small, and thus not accounted for. The interpolated digital atlas was warped in 3D to fit a high resolution, high signal-to-noise ratio standard reference volume that is the result of the average of 27 MRI scans of the same subject (Holmes et al., 1998), known as the Colin27 MRI average. The warping was achieved via a thin-plate-spline (TPS) (Bookstein, 1989) transformation based on 250 homologous landmarks manually identified by a neuroanatomist on both volumes. The result is a set of anatomical labels defined in the region of the basal ganglia and thalamus that are aligned with the Colin27 MRI average. In order to customize the digital atlas to patient MRI data, a nonlinear transform between the Colin27 MRI average and a patient's MRI is estimated automatically (Collins and Evans, 1997, Collins et al., 1995). This transformation is applied to the digital atlas to map it onto patient's pre-operative MRI to facilitate surgical planning.

While this atlas has proven very useful (Atkinson et al., 2002), it has limited inherent resolution in the slice direction (0.5 mm), contains a limited number of structures, and contains some small misregistrations between the digital atlas and the Colin27 MRI average that are propagated to patient MRI data during the atlas customization procedure.

In this manuscript, these limitations are addressed. Techniques are developed for the creation of a new and improved atlas for stereotactic neurosurgery. This atlas contains both histological and geometric (i.e., structural anatomical) data and is registered to a MRI reference volume. Preliminary work on this new atlas was presented in (Chakravarty et al., 2003). The new digital atlas is derived from a single set of high-resolution, thin-slice histological data of the region of basal ganglia and thalamus. The atlas contains 105 anatomical structures that were manually delineated by a neuroanatomical expert on the histological data using sources for the gross anatomy (Schaltenbrand and Wahren, 1977), for the temporal lobe (Gloor, 1997) and for the thalamus (Hirai and Jones, 1989). The histology was parcelated three times according to these sources. To reconstruct the histological and geometric data in three dimensions (3D), the structure contours were used in the development of an optimization procedure for slice-to-slice registration and intensity correction of the histological data. These reconstructions were registered to the Colin27 high resolution reference MRI (Holmes et al., 1998), using a novel atlas-to-MRI matching technique. Atlas customization (to any subject scan) can be achieved through a flexible nonlinear atlas-to-subject registration technique.

Our long-term goal is to use this refined atlas to improve pre-operative planning and thereby positively affect the outcome for patients undergoing surgeries for movement disorders. Since this atlas contains a detailed segmentation and classification of subcortical nuclei, it can also be used in post-operative follow-up and in other applications requiring a detailed analysis of the basal ganglia and thalamus.

In this paper, we will discuss the optimization of a slice-to-slice histological data registration technique (Chakravarty et al., 2003) used to minimize morphological misalignment throughout the histological volume. The parameters are optimized based on the minimization of error between the segmented contours of seven pairs of adjacent slices which span the dataset. These parameters are then used to register all consecutive pairs of slices of the histological data. In addition, an improved intensity inhomogeneity correction technique based on previous work (Chakravarty et al., 2003), the creation of a 3D geometric atlas, and an atlas-to-template warping technique are also presented. Since the reconstruction and intensity correction of histological data plays an integral role in this work, the next section will review previous techniques used in these domains.

Section snippets

Previous work: the 3D reconstruction of histological data

The atlas presented in this paper is based on a 3D histological reconstruction technique which was developed for the reconstruction of a fully labeled set of histological data. Serial histological data sets are notoriously difficult to reconstruct due to the unpredictable nature of the artefacts introduced when the brain is sectioned in a microtome. Such artefacts include tearing, stretching, and compression. Intensity inhomogeneities can also occur due to inhomogeneous staining densities and

Histological data acquisition

The brain used to create this histological data set was acquired in 1957 from a male patient who died of non-neurological causes at the Montreal Neurological Institute/Hospital. This data set was chosen because it has been intensively studied and used for teaching over the past 45 years. In addition, it has been manually segmented over the course of 2 years and revised over the past 3 years.

The specimen was fixed in 10% formalin. After fixation, the brain was split along the midline with the

3D reconstruction

As mentioned in the Introduction, artefacts are introduced into the data set during the acquisition of histological data. These may include, tearing, local compression, shearing, or stretching. If these slices of histological data are reconstructed (i.e., stacked) without any additional image processing steps, the resulting volume will be inhomogeneous with respect to intensity and morphometry in the slice direction (the so called “stack of pancakes” or the “banana reconstruction” problem (

Results and discussion of 3D reconstruction

The result of the 3D reconstruction can be seen in Fig. 9. The figure is organized as follows: The left panels show the reconstruction of the raw data, the middle panels show the reconstruction after undergoing the morphological correction, and the panel on the right show the reconstructions of the data after morphological correction and the intensity correction algorithms. The results demonstrate increased slice-to-slice continuity compared to a simple reconstruction of the data without any

Atlas of the basal ganglia and thalamus

The main goal of the atlas creation process is to develop a tool that will facilitate visualization and understanding of the 3D relationships of the structures that make up the basal ganglia and thalamus. This is achieved by building two atlas data sets from the contours manually defined on the original histological data. The first atlas is voxel-based, where structure labels are assigned to each voxel of the reconstructed histological volume. The voxel label atlas facilitates investigation of

Atlas to template warping

Our current atlas-to-patient warping technique (St-Jean et al., 1998) uses the Colin27 MRI average (Holmes et al., 1998) as an intermediate template for registration. To use the reconstructed histological volume, the voxel label atlas and the geometric atlas created here for surgical planning, they must be first aligned with the Colin27 MRI average.

A two step procedure is used to bring the atlas data into the same reference space as the Colin27 template. First, an affine transformation based on

Conclusions and further research

This paper develops the steps used to create an atlas which can be customized to MR volumes. The process begins with serial histological data, stained with Luxol blue and Nissl stains. All of these slices are segmented manually to identify the basal ganglia and the thalamus. A histological volume was created using a nonlinear registration technique to greatly reduce the effect of artefacts that are introduced in the histological acquisition process. Optimal parameters were found to align

References (62)

  • J.D. Atkinson et al.

    Optimal location of thalamotomy lesions for tremor associated with Parkinson disease: a probablisitic analysis based on postoperative magnetic resonance imaging and integrated digital atlas

    J. Neurosurg.

    (2002)
  • E. Bardinet et al.

    Registration of reconstructed post mortem optical data with MR scans of the same patient

  • T.E.J. Behrens et al.

    Non-invasive mapping of connections between human thalamus and cortex using diffusion imaging

    Nat. Neurosci.

    (2003)
  • G. Bertrand et al.

    The computerized brain atlas: its use in stereotaxic surgery

    Trans. Am. Neurol. Ass.

    (1973)
  • F.L. Bookstein

    Principal warps: thin-plate splines and the decompostion of deformations

    IEEE Trans. Pattern Anal. Mach. Intell.

    (1989)
  • M.M. Chakravarty et al.

    The creation of a brain atlas for image guided neurosurgery using serial histological data

  • M.M. Chakravarty et al.

    Anatomical and electrophysiological validation of an atlas for neurosurgical planning

  • M.C. Cohn et al.

    Pre- and postoperative evaluation of stereotactic pallidotomy

    Am. J. Neuroradiol.

    (1998)
  • A.C.F. Colchester et al.

    3-d reconstruction of macroscpic optical brain slice images

  • D.L. Collins et al.

    ANIMAL: validation and application of non-linear registration-based segmentation

    Int. J. Pattern Recogn. Artif. Intell.

    (1997)
  • D.L. Collins et al.

    Automatic 3-D model based neuroanatomical segmentation

    Hum. Brain Mapp.

    (1995)
  • E. Cuny et al.

    Lack of agreement between direct magnetic resonance imaging and statistical determination of a subthalamic target: the role of electrophysiological guidance

    J. Neurosurg.

    (2002)
  • J. Dauguet et al.

    Robust inter-slice intensity normalization using histogram scale-space analysis

  • T. Delzescaux et al.

    Using 3d non rigid ffd-based method to register post mortem 3d histological data and in vivo MRI of a baboon brain

  • S.C.L. Deoni et al.

    High resolution T1 and T2 mapping of the brain in clinically acceptable time with DESPOT1 and DESPOT2

    Magn. Reson. Med.

    (2005)
  • R.O. Duda et al.

    Pattern Classification

    (2000)
  • D.L. Foley et al.

    Computer Graphics, Principles, and Practice

    (1990)
  • N. Fujita et al.

    Lateral geniculate nucleus: anatomic and functional identification by use of MR imaging

    Am. J. Neuroradiol.

    (2001)
  • P. Gloor

    The Temporal Lobe and The Limbic System

    (1997)
  • R.E. Gross et al.

    Relationship of lesion location to clinical outcome following microelectrode-guided pallidotomy for Parkinson's disease

    Brain

    (1999)
  • C.J. Holmes et al.

    Enhancement of MR images using registration for signal averaging

    J. Comput. Assist. Tomogr.

    (1998)
  • Cited by (236)

    View all citing articles on Scopus
    1

    The late Charles Hodge was responsible for the photographic work shown in this manuscript, particularly with respect to the histological data acquisition. We are grateful for his contribution.

    View full text