Resource atlases for multi-atlas brain segmentations with multiple ontology levels based on T1-weighted MRI☆
Introduction
Quantitative analysis of brain MRI data has played a pivotal role in many brain anatomical studies of development, aging, and various pathological conditions. For image-based quantification, the first and the most important step is to define corresponding brain locations across all participants of the study. One of the most common approaches, which is considered the gold standard in neuroanatomy, is the manual delineation of regions of interest (ROIs). However, because it is labor intensive, manual delineation is usually used for hypothesis-driven studies, in which a small number of target structures are preselected based on a hypothesis. Voxel-based analysis (VBA) is a widely used alternative approach, in which every single voxel is considered an ROI, and corresponding voxel locations are identified across all participants automatically using an image normalization method (Ashburner, 2009, Worsley et al., 1999). Whole-brain structural segmentation is an alternative approach, in which the voxels are joined based on a priori anatomical knowledge, e.g., voxels that belong to the caudate should be joined as one structure (Faria et al., 2010, Fischl et al., 2002, Heckemann et al., 2006, Joshi et al., 2004, Mori et al., 2005, Pham and Prince, 1999, Tu et al., 2008, Tustison et al., 2014, Tzourio-Mazoyer et al., 2002, Woolrich et al., 2009). If the entire brain is segmented into multiple structures, both VBA and segmentation-based methods provide the information about the anatomical features of the entire brain, but from very different granularity levels; in the segmentation-based approach, the information from more than 106 voxels in VBA is greatly reduced to the order of 102.
The meaning of “atlas” varies depending on research fields and study purposes and, thus, clarification is needed. The typical brain atlas consists of images (e.g. histology or MRI) and point-and-annotate labels, describing the locations and names of brain structures. For VBA, atlases mean MR images in specific orientations, positions, and matrix coordinates. They usually do not contain structural labels but the x, y, and z coordinates carry the common anatomical meaning. The images could be chosen within a study or external data such as those from International Consortium of Brain Mapping (ICBM). The MNI coordinates are one of the most widely used standard coordinates and the image could be single-subject such as MNI-Colin27 (Collins et al., 1998) or population-averaged such as linear and nonlinear MNI-ICBM152 (Fonov et al., 2011, Mazziotta et al., 2001). For the segmentation-based analysis (and throughout this paper), the atlas means MRI images with structural labels with three-dimensional boundaries, which carry anatomical references to define structures of interest. One of the simplest approaches to accomplish automated brain segmentation is to warp a single-subject atlas to each subject and transfer the structure labels (Fischl et al., 2002).
In recent years, a multiple-atlas approach has gained popularity due to its superior segmentation accuracy (Artaechevarria et al., 2009, Jia et al., 2012, Langerak et al., 2010, Lotjonen et al., 2010b, Sabuncu et al., 2010, van Rikxoort et al., 2010, Wang et al., 2012, Warfield et al., 2004). In this approach, rather than one reference brain atlas, multiple atlases with consistent structural segmentation are prepared, warped to a subject image, and the multiple segmentation results are fused to achieve the best estimation of the structural identification. Numerous publications have reported improved accuracy using this approach. Most of these previous papers have focused on the algorithms used to fuse the multiple segmentation results. The multiple-atlas approach, however, depends on the availability of atlases with accurate and consistent structural definitions, which is not only labor-intensive, but also has several important issues to be addressed.
For example, one of the most frequently asked questions is how many atlases are needed to improve the segmentation accuracy. Aljabar et al. (Aljabar et al., 2009) has shown that the segmentation accuracy reaches maximum with 15–25 atlases depending on the target structures. However, probably, there is no general answer to this question, because it depends on the anatomical variability among the atlases and the anatomical features of the subject. In an extreme case, if the anatomy of the subject is an outlier, with respect to the anatomical ranges covered by the multiple atlases, we cannot expect high accuracy regardless of the number of atlases used. This naturally extends to the notion of atlas pre-selection based on anatomical or non-anatomical features, such as the ventricle size or age-matching. Another important issue is the way in which anatomy is defined. The minimum definable units are determined by the available anatomical features and contrasts; it is difficult to sub-divide, for example, the globus pallidus (GP) into the internal and external portions, unless MRI provides contrasts to define these intra-GP structures. For segmentation-based analysis, the finer definitions may not always be better. For example, if the entire temporal lobe has 10% atrophy, a report of the volume loss of a dozen of sub-structures within the temporal lobe could not only hurt the statistical power but also result in misleading findings about the regional specificity of the abnormality if the atrophy was statistically detected only in a subset of the constituents. Thus, it is important to test regional specificity by examining larger super structures, such as lobes and hemispheres.
The purpose of this study is to establish a shared atlas resource to support multi-atlas segmentation algorithms for quantitative analyses of brain MR images and test the accuracy levels as well as the efficacy of atlas pre-selection approaches such as dynamic age-matching, which is enabled by the availability of the wide range of the age coverage. In this paper, we introduce our atlas inventories (n = 90) with unique hierarchical structural definitions, which cover ages 4–85 years. The atlas set can be combined with various available multi-atlas fusion algorithms. In addition, we tested the impact of age-matching on the accuracy of the segmentation.
Section snippets
Overview of atlas creation strategy
For neuroanatomical studies, the manual delineation of structures by experienced neuroanatomists is considered the gold standard, against which the performance of automated segmentation is measured. However, a recent survey about protocols for the manual delineation of the hippocampus found as much as 250% of volume differences (Boccardi et al., 2011). These differences stem from anatomical definitions; it is not that one is correct and the others are inaccurate. In addition, anatomy often does
Ontology definition, reporting, and visualization system
The current version of the atlases, Version 6.12, defines 286 structures. As we expect the number of the atlases to increase with frequent updates in the future, we adopted a version control system by Git (www.github.com/git), which can be accessed through braingps.mricloud.org/git/gitweb.cgi. Through this system, users can have access to the latest, as well as previous versions of the atlases. The list of the 286 structures are shown in the Appendix. The comprehensive ontological relationship
Overview of the atlas creation
In this paper, we introduced our multiple atlas library of T1-weighted brain MR images. This library was developed to support multi-atlas image segmentation tools, which are currently a target of highly active research. As the atlas library serves as a teaching file for computer algorithms to judge which structures are located where and with what type of anatomical signatures, the availability of atlases with high-quality segmentation is essential. To achieve better segmentation accuracy, the
Conclusion
We present multi-atlas inventories of 90 atlases, ranging from 4 to 82 years of age for T1-weighted brain MRI segmentation, which were established with accurate and consistent structural definition and hierarchical ontology, along with quantification and visualization tools. This large atlas database can be best used if combined with atlas pre-selection principles. Dynamic age-matching was shown to be a simple and efficient pre-selection approach that improved the segmentation accuracy for
References (52)
- et al.
Multi-atlas based segmentation of brain images: atlas selection and its effect on accuracy
NeuroImage
(2009) Computational anatomy with the SPM software
Magn. Reson. Imaging
(2009)- et al.
Tools for multiple granularity analysis of brain MRI data for individualized image analysis
NeuroImage
(2014) - et al.
Atlas-based analysis of neurodevelopment from infancy to adulthood using diffusion tensor imaging and applications for automated abnormality detection
NeuroImage
(2010) - et al.
Content-based image retrieval for brain MRI: an image-searching engine and population-based analysis to utilize past clinical data for future diagnosis
Neuroimage Clin.
(2015) - et al.
Whole brain segmentation: automated labeling of neuroanatomical structures in the human brain
Neuron
(2002) - et al.
Unbiased average age-appropriate atlases for pediatric studies
NeuroImage
(2011) - et al.
A voxel-based morphometric study of ageing in 465 normal adult human brains
NeuroImage
(2001) - et al.
Automatic anatomical brain MRI segmentation combining label propagation and decision fusion
NeuroImage
(2006) - et al.
Improving intersubject image registration using tissue-class information benefits robustness and accuracy of multi-atlas based anatomical segmentation
NeuroImage
(2010)
White and gray matter development in human fetal, newborn and pediatric brains
NeuroImage
Iterative multi-atlas-based multi-image segmentation with tree-based registration
NeuroImage
Unbiased diffeomorphic atlas construction for computational anatomy
NeuroImage
Fast and robust multi-atlas segmentation of brain magnetic resonance images
NeuroImage
Fast and robust multi-atlas segmentation of brain magnetic resonance images
NeuroImage
A probabilistic atlas of the human brain: theory and rationale for its development. The International Consortium For Brain Mapping (ICBM)
NeuroImage
Stereotaxic white matter atlas based on diffusion tensor imaging in an ICBM template
NeuroImage
Human brain white matter atlas: identification and assignment of common anatomical structures in superficial white matter
NeuroImage
Atlas-based whole brain white matter analysis using large deformation diffeomorphic metric mapping: application to normal elderly and Alzheimer's disease participants
NeuroImage
Quantitative evaluation of brain development using anatomical MRI and diffusion tensor imaging
Int. J. Dev. Neurosci.
A developmental ontology for the mammalian brain based on the prosomeric model
Trends Neurosci.
Large-scale evaluation of ANTs and FreeSurfer cortical thickness measurements
NeuroImage
Automated anatomical labeling of activations in SPM using a macroscopic anatomical parcellation of the MNI MRI single-subject brain
NeuroImage
Adaptive local multi-atlas segmentation: application to the heart and the caudate nucleus
Med. Image Anal.
Bayesian analysis of neuroimaging data in FSL
NeuroImage
Combination strategies in multi-atlas image segmentation: application to brain MR data
IEEE Trans. Med. Imaging
Cited by (83)
High-resolution atlasing and segmentation of the subcortex: Review and perspective on challenges and opportunities created by machine learning
2022, NeuroImageCitation Excerpt :Mindboggle-101 consists of a total of 101 subjects with manual delineations for a total of 92 structures, including both cortical and subcortical regions (TH, HP, AM, PU, PA, CAU, NA). Other examples are the LPBA40 atlas (Shattuck et al., 2008), the Adult IXI dataset (Hammers et al., 2003) or the MRICloud atlas (Wu et al., 2016). LPBA40 includes a template with an associated probabilistic atlas built from 40 subjects; it mostly models cortical regions, but also includes four subcortical structures (PU, CAU, HP, lateral ventricle).
Dataset of relationship between longitudinal change in cognitive performance and functional connectivity in cognitively normal older individuals
2022, Data in BriefCitation Excerpt :The multi-atlas label fusion approach was applied to parcellate the MPRAGE image into 283 anatomical structures that included 80 gray matter structures used in this study [9]. The JHU multi-atlas library [10] version 9, containing 30 atlases covering an age-range of 50–90 years, was adopted as the reference library. The label fusion step was performed based on [11], adjusted by the PICSL algorithm [12].
Structural brain and spinal cord damage in symptomatic and pre-symptomatic VAPB-related ALS
2022, Journal of the Neurological SciencesCitation Excerpt :The multi-atlas labeling fusion enabled the identification of brain regions followed by a last step of labelling adjusting with PICSL [15]. Nineteen atlases (JHU adult atlas version 9B) were used to generate 283 structural regions [16]. All analyses were performed in native space.
- ☆
Grant support: This publication was made possible by the following grants: NS084957, EB017638, EB015909, and NS086888.