Skip to main content
Erschienen in: International Journal of Computer Assisted Radiology and Surgery 11/2017

07.08.2017 | Original Article

Spine labeling in MRI via regularized distribution matching

verfasst von: Seyed-Parsa Hojjat, Ismail Ayed, Gregory J. Garvin, Kumaradevan Punithakumar

Erschienen in: International Journal of Computer Assisted Radiology and Surgery | Ausgabe 11/2017

Einloggen, um Zugang zu erhalten

Abstract

Purpose

This study investigates an efficient (nearly real-time) two-stage spine labeling algorithm that removes the need for an external training while being applicable to different types of MRI data and acquisition protocols.

Methods

Based solely on the image being labeled (i.e., we do not use training data), the first stage aims at detecting potential vertebra candidates following the optimization of a functional containing two terms: (i) a distribution-matching term that encodes contextual information about the vertebrae via a density model learned from a very simple user input, which amounts to a point (mouse click) on a predefined vertebra; and (ii) a regularization constraint, which penalizes isolated candidates in the solution. The second stage removes false positives and identifies all vertebrae and discs by optimizing a geometric constraint, which embeds generic anatomical information on the interconnections between neighboring structures. Based on generic knowledge, our geometric constraint does not require external training.

Results

We performed quantitative evaluations of the algorithm over a data set of 90 mid-sagittal MRI images of the lumbar spine acquired from 45 different subjects. To assess the flexibility of the algorithm, we used both T1- and T2-weighted images for each subject. A total of 990 structures were automatically detected/labeled and compared to ground-truth annotations by an expert. On the T2-weighted data, we obtained an accuracy of 91.6% for the vertebrae and 89.2% for the discs. On the T1-weighted data, we obtained an accuracy of 90.7% for the vertebrae and 88.1% for the discs.

Conclusion

Our algorithm removes the need for external training while being applicable to different types of MRI data and acquisition protocols. Based on the current testing data, a subject-specific model density and generic anatomical information, our method can achieve competitive performances when applied to T1- and T2-weighted MRI images.
Fußnoten
1
Typically, spine MRI studies contain more than 100 images.
 
2
Our meta-analysis of accuracy is not a direct comparison between the methods because the used data sets are different, and might have various levels of difficulties. For instance, the CT data set in [29] contains several unusual appearances (e.g., abnormal spine curvature), and undergo large variations in the field of view, image noise and resolutions.
 
Literatur
1.
Zurück zum Zitat Fardon DF, Milette PC (2001) Nomenclature and classification of lumbar disc pathology: recommendations of the combined task forces of the North American Spine Society, American Society of Spine Radiology, and American Society of Neuroradiology. Spine 26(5):E93–E113CrossRefPubMed Fardon DF, Milette PC (2001) Nomenclature and classification of lumbar disc pathology: recommendations of the combined task forces of the North American Spine Society, American Society of Spine Radiology, and American Society of Neuroradiology. Spine 26(5):E93–E113CrossRefPubMed
2.
Zurück zum Zitat Wimmer M, Major D, Novikov AA, Buhler K (2016) Local entropy-optimized texture models for semi-automatic spine labeling in various MRI protocols. In: International symposium on biomedical imaging (ISBI), pp 155–159 Wimmer M, Major D, Novikov AA, Buhler K (2016) Local entropy-optimized texture models for semi-automatic spine labeling in various MRI protocols. In: International symposium on biomedical imaging (ISBI), pp 155–159
3.
Zurück zum Zitat De Leener B, Cohen-Adad J, Kadoury S (2015) Automatic segmentation of the spinal cord and spinal canal coupled with vertebral labeling. IEEE Trans Med Imaging 34(8):1705–1718CrossRefPubMed De Leener B, Cohen-Adad J, Kadoury S (2015) Automatic segmentation of the spinal cord and spinal canal coupled with vertebral labeling. IEEE Trans Med Imaging 34(8):1705–1718CrossRefPubMed
4.
Zurück zum Zitat Ullmann E, Paquette JFP, Thong WE, Cohen-Adad J (2014) Automatic labeling of vertebral levels using a robust template-based approach. Int J Biomed Imaging 719520(1–719520):9 Ullmann E, Paquette JFP, Thong WE, Cohen-Adad J (2014) Automatic labeling of vertebral levels using a robust template-based approach. Int J Biomed Imaging 719520(1–719520):9
5.
Zurück zum Zitat Cai Y, Landis M, Laidley DT, Kornecki A, Lum A, Li S (2016) Multi-modal vertebrae recognition using transformed deep convolution network. Comput Med Imaging Graphics 51:11–19CrossRef Cai Y, Landis M, Laidley DT, Kornecki A, Lum A, Li S (2016) Multi-modal vertebrae recognition using transformed deep convolution network. Comput Med Imaging Graphics 51:11–19CrossRef
6.
Zurück zum Zitat Kelm BM, Wels M, Zhou SK, Seifert S, Sühling M, Zheng Y, Comaniciu D (2013) Spine detection in CT and MR using iterated marginal space learning. Med Image Anal 17(8):1283–1292CrossRef Kelm BM, Wels M, Zhou SK, Seifert S, Sühling M, Zheng Y, Comaniciu D (2013) Spine detection in CT and MR using iterated marginal space learning. Med Image Anal 17(8):1283–1292CrossRef
7.
Zurück zum Zitat Glocker B, Feulner J, Criminisi A, Haynor DR, Konukoglu E (2012) Automatic localization and identification of vertebrae in arbitrary field-of-view CT scans. Med Image Comput Comput Assist Interv MICCAI 3:590–598 Glocker B, Feulner J, Criminisi A, Haynor DR, Konukoglu E (2012) Automatic localization and identification of vertebrae in arbitrary field-of-view CT scans. Med Image Comput Comput Assist Interv MICCAI 3:590–598
8.
Zurück zum Zitat Zhan Y, Dewan M, Harder M, Zhou X S (2012) Robust MR spine detection using hierarchical learning and local articulated model. Med Image Comput Comput Assist Interv MICCAI 1:141–148 Zhan Y, Dewan M, Harder M, Zhou X S (2012) Robust MR spine detection using hierarchical learning and local articulated model. Med Image Comput Comput Assist Interv MICCAI 1:141–148
9.
Zurück zum Zitat Roberts MG, Cootes TF, Adams JE (2012) Automatic location of vertebrae on DXA images using random forest regression. Med Image Comput Comput Assist Interv MICCAI 3:361–368 Roberts MG, Cootes TF, Adams JE (2012) Automatic location of vertebrae on DXA images using random forest regression. Med Image Comput Comput Assist Interv MICCAI 3:361–368
10.
Zurück zum Zitat Alomari RS, Corso JJ, Chaudhary V (2011) Labeling of lumbar discs using both pixel- and object-level features with a two-level probabilistic model. IEEE Trans Med Imaging 30(1):1–10CrossRefPubMed Alomari RS, Corso JJ, Chaudhary V (2011) Labeling of lumbar discs using both pixel- and object-level features with a two-level probabilistic model. IEEE Trans Med Imaging 30(1):1–10CrossRefPubMed
11.
Zurück zum Zitat Oktay AB, Akgul YS (2011) Localization of the lumbar discs using machine learning and exact probabilistic inference. Med Image Comput Comput Assist Interv MICCAI 3:158–165 Oktay AB, Akgul YS (2011) Localization of the lumbar discs using machine learning and exact probabilistic inference. Med Image Comput Comput Assist Interv MICCAI 3:158–165
12.
Zurück zum Zitat Ma J, Lu L, Zhan Y, Zhou XS, Salganicoff M, Krishnan A (2010) Hierarchical segmentation and identification of thoracic vertebra using learning-based edge detection and coarse-to-fine deformable model. Med Image Comput Comput Assist Interv MICCAI 1:19–27 Ma J, Lu L, Zhan Y, Zhou XS, Salganicoff M, Krishnan A (2010) Hierarchical segmentation and identification of thoracic vertebra using learning-based edge detection and coarse-to-fine deformable model. Med Image Comput Comput Assist Interv MICCAI 1:19–27
13.
Zurück zum Zitat Klinder T, Ostermann J, Ehm M, Franz A, Kneser R, Lorenz C (2009) Automated model-based vertebra detection, identification, and segmentation in ct images. Med Image Anal 13(3):471–482CrossRefPubMed Klinder T, Ostermann J, Ehm M, Franz A, Kneser R, Lorenz C (2009) Automated model-based vertebra detection, identification, and segmentation in ct images. Med Image Anal 13(3):471–482CrossRefPubMed
14.
Zurück zum Zitat Huang S, Chu Y, Lai S, Novak C (2009) Learning-based vertebra detection and iterative normalized-cut segmentation for spinal MRI. IEEE Trans Med Imaging 28(10):1595–1605CrossRefPubMed Huang S, Chu Y, Lai S, Novak C (2009) Learning-based vertebra detection and iterative normalized-cut segmentation for spinal MRI. IEEE Trans Med Imaging 28(10):1595–1605CrossRefPubMed
15.
Zurück zum Zitat Miles B, Ayed I, Law MWK, Garvin GJ, Fenster A, Li S (2013) Spine image fusion via graph cuts. IEEE Trans Biomed Eng 60(7):1841–1850CrossRefPubMed Miles B, Ayed I, Law MWK, Garvin GJ, Fenster A, Li S (2013) Spine image fusion via graph cuts. IEEE Trans Biomed Eng 60(7):1841–1850CrossRefPubMed
16.
Zurück zum Zitat Wang Z, Zhen X, Tay K, Osman S, Romano W, Li S (2015) Regression segmentation for \(\text{ m }^{3}\) spinal images. IEEE Trans Med Imaging 34(8):1640–1648CrossRefPubMed Wang Z, Zhen X, Tay K, Osman S, Romano W, Li S (2015) Regression segmentation for \(\text{ m }^{3}\) spinal images. IEEE Trans Med Imaging 34(8):1640–1648CrossRefPubMed
17.
Zurück zum Zitat Schmidt S, Kappes JH, Bergtholdt M, Pekar V, Dries SPM, Bystrov D, Schnörr C (2007) Spine detection and labeling using a parts-based graphical model. In: Information processing in medical imaging (IPMI), pp 122–133 Schmidt S, Kappes JH, Bergtholdt M, Pekar V, Dries SPM, Bystrov D, Schnörr C (2007) Spine detection and labeling using a parts-based graphical model. In: Information processing in medical imaging (IPMI), pp 122–133
18.
Zurück zum Zitat Nikolova M, Esedoglu S, Chan TF (2006) Algorithms for finding global minimizers of image segmentation and denoising models. SIAM J Appl Math 66(5):1632–1648CrossRef Nikolova M, Esedoglu S, Chan TF (2006) Algorithms for finding global minimizers of image segmentation and denoising models. SIAM J Appl Math 66(5):1632–1648CrossRef
19.
Zurück zum Zitat Bertsekas DP (1999) Nonlinear programming. Athena Scientific, Belmont Bertsekas DP (1999) Nonlinear programming. Athena Scientific, Belmont
20.
Zurück zum Zitat Yuan J, Bae E, Tai X-C, Boykov Y (2010) A study on continuous max-flow and min-cut approaches. Part I: binary labeling, technical report CAM-10-61, UCLA Yuan J, Bae E, Tai X-C, Boykov Y (2010) A study on continuous max-flow and min-cut approaches. Part I: binary labeling, technical report CAM-10-61, UCLA
21.
Zurück zum Zitat Yuan J, Bae E, Tai X-C (2010) A study on continuous max-flow and min-cut approaches. In: IEEE conference on computer vision and pattern recognition (CVPR) Yuan J, Bae E, Tai X-C (2010) A study on continuous max-flow and min-cut approaches. In: IEEE conference on computer vision and pattern recognition (CVPR)
22.
Zurück zum Zitat Tang M, Ben Ayed I, Boykov Y (2014) Pseudo-bound optimization for binary energies. Eur Conf Comput Vis ECCV 5:691–707 Tang M, Ben Ayed I, Boykov Y (2014) Pseudo-bound optimization for binary energies. Eur Conf Comput Vis ECCV 5:691–707
23.
Zurück zum Zitat Taniai T, Matsushita Y, Naemura T (2015) Superdifferential cuts for binary energies. In: IEEE conference on computer vision and pattern recognition (CVPR), pp 2030–2038 Taniai T, Matsushita Y, Naemura T (2015) Superdifferential cuts for binary energies. In: IEEE conference on computer vision and pattern recognition (CVPR), pp 2030–2038
24.
Zurück zum Zitat Ben Ayed I, Punithakumar K, Li S (2015) Distribution matching with the bhattacharyya similarity: a bound optimization framework. IEEE Trans Pattern Anal Mach Intell 37(9):1777–1791CrossRefPubMed Ben Ayed I, Punithakumar K, Li S (2015) Distribution matching with the bhattacharyya similarity: a bound optimization framework. IEEE Trans Pattern Anal Mach Intell 37(9):1777–1791CrossRefPubMed
25.
Zurück zum Zitat Punithakumar K, Yuan J, Ayed IB, Li S, Boykov Y (2012) A convex max-flow approach to distribution-based figure-ground separation. SIAM J Imaging Sci 5(4):1333–1354CrossRef Punithakumar K, Yuan J, Ayed IB, Li S, Boykov Y (2012) A convex max-flow approach to distribution-based figure-ground separation. SIAM J Imaging Sci 5(4):1333–1354CrossRef
26.
Zurück zum Zitat Salah MB, Ben Ayed I, Yuan J, Zhang H (2014) Convex-relaxed kernel mapping for image segmentation. IEEE Trans Image Process 23(3):1143–1153CrossRefPubMed Salah MB, Ben Ayed I, Yuan J, Zhang H (2014) Convex-relaxed kernel mapping for image segmentation. IEEE Trans Image Process 23(3):1143–1153CrossRefPubMed
27.
Zurück zum Zitat Chambolle A (2004) An algorithm for total variation minimization and applications. J Math Imaging Vis 20(1–2):89–97 Chambolle A (2004) An algorithm for total variation minimization and applications. J Math Imaging Vis 20(1–2):89–97
28.
Zurück zum Zitat Lootus M, Kadir T, Zisserman A (2013) Computational methods and clinical applications for spine imaging. In: Jianhua Y, Tobias K, Shuo L (eds) Vertebrae detection and labelling in lumbar MR images. Springer, Cham, pp 219–230 Lootus M, Kadir T, Zisserman A (2013) Computational methods and clinical applications for spine imaging. In: Jianhua Y, Tobias K, Shuo L (eds) Vertebrae detection and labelling in lumbar MR images. Springer, Cham, pp 219–230
29.
Zurück zum Zitat Yang D, Xiong T, Xu D, Huang Q, Liu D, Zhou SK, Xu Z, Park J, Chen M, Tran TD, Chin SP, Metaxas D, Comaniciu D (2017) Automatic vertebra labeling in large-scale 3D CT using deep image-to-image network with message passing and sparsity regularization. In: Information processing in medical imaging (IPMI), pp 633–644 Yang D, Xiong T, Xu D, Huang Q, Liu D, Zhou SK, Xu Z, Park J, Chen M, Tran TD, Chin SP, Metaxas D, Comaniciu D (2017) Automatic vertebra labeling in large-scale 3D CT using deep image-to-image network with message passing and sparsity regularization. In: Information processing in medical imaging (IPMI), pp 633–644
30.
Zurück zum Zitat Glocker B, Zikic D, Konukoglu E, Haynor DR, Criminisi A (2013) Vertebrae localization in pathological spine CT via dense classification from sparse annotations. Med Image Comput Comput Assist Interv MICCAI 2:262–270 Glocker B, Zikic D, Konukoglu E, Haynor DR, Criminisi A (2013) Vertebrae localization in pathological spine CT via dense classification from sparse annotations. Med Image Comput Comput Assist Interv MICCAI 2:262–270
31.
Zurück zum Zitat Chen H, Shen C, Qin J, Ni D, Shi L, Cheng JCY, Heng P-A (2015) Automatic localization and identification of vertebrae in spine CT via a joint learning model with deep neural networks. Med Image Comput Comput Assist Interv MICCAI 1:515–522 Chen H, Shen C, Qin J, Ni D, Shi L, Cheng JCY, Heng P-A (2015) Automatic localization and identification of vertebrae in spine CT via a joint learning model with deep neural networks. Med Image Comput Comput Assist Interv MICCAI 1:515–522
Metadaten
Titel
Spine labeling in MRI via regularized distribution matching
verfasst von
Seyed-Parsa Hojjat
Ismail Ayed
Gregory J. Garvin
Kumaradevan Punithakumar
Publikationsdatum
07.08.2017
Verlag
Springer International Publishing
Erschienen in
International Journal of Computer Assisted Radiology and Surgery / Ausgabe 11/2017
Print ISSN: 1861-6410
Elektronische ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-017-1651-0

Weitere Artikel der Ausgabe 11/2017

International Journal of Computer Assisted Radiology and Surgery 11/2017 Zur Ausgabe

Darf man die Behandlung eines Neonazis ablehnen?

08.05.2024 Gesellschaft Nachrichten

In einer Leseranfrage in der Zeitschrift Journal of the American Academy of Dermatology möchte ein anonymer Dermatologe bzw. eine anonyme Dermatologin wissen, ob er oder sie einen Patienten behandeln muss, der eine rassistische Tätowierung trägt.

Ein Drittel der jungen Ärztinnen und Ärzte erwägt abzuwandern

07.05.2024 Klinik aktuell Nachrichten

Extreme Arbeitsverdichtung und kaum Supervision: Dr. Andrea Martini, Sprecherin des Bündnisses Junge Ärztinnen und Ärzte (BJÄ) über den Frust des ärztlichen Nachwuchses und die Vorteile des Rucksack-Modells.

Endlich: Zi zeigt, mit welchen PVS Praxen zufrieden sind

IT für Ärzte Nachrichten

Darauf haben viele Praxen gewartet: Das Zi hat eine Liste von Praxisverwaltungssystemen veröffentlicht, die von Nutzern positiv bewertet werden. Eine gute Grundlage für wechselwillige Ärztinnen und Psychotherapeuten.

Akuter Schwindel: Wann lohnt sich eine MRT?

28.04.2024 Schwindel Nachrichten

Akuter Schwindel stellt oft eine diagnostische Herausforderung dar. Wie nützlich dabei eine MRT ist, hat eine Studie aus Finnland untersucht. Immerhin einer von sechs Patienten wurde mit akutem ischämischem Schlaganfall diagnostiziert.

Update Radiologie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.