Skip to main content
Erschienen in: Journal of Digital Imaging 4/2020

02.06.2020 | Original Paper

Automatic Segmentation of Meniscus in Multispectral MRI Using Regions with Convolutional Neural Network (R-CNN)

verfasst von: Emre ÖLMEZ, Volkan AKDOĞAN, Murat KORKMAZ, Orhan ER

Erschienen in: Journal of Imaging Informatics in Medicine | Ausgabe 4/2020

Einloggen, um Zugang zu erhalten

Abstract

The meniscus has a significant function in human anatomy, and Magnetic Resonance Imaging (MRI) has an essential role in meniscus examination. Due to a variety of MRI data, it is excessively difficult to segment the meniscus with image processing methods. An MRI data sequence contains multiple images, and the region features we are looking for may vary from each image in the sequence. Therefore, feature extraction becomes more difficult, and hence, explicitly programming for segmentation becomes more difficult. Convolutional Neural Network (CNN) extracts features directly from images and thus eliminates the need for manual feature extraction. Regions with Convolutional Neural Network (R-CNN) allow us to use CNN features in object detection problems by combining CNN features with Region Proposals. In this study, we designed and trained an R-CNN for detecting meniscus region in MRI data sequence. We used transfer learning for training R-CNN with a small amount of meniscus data. After detection of the meniscus region by R-CNN, we segmented meniscus by morphological image analysis using two different MRI sequences. Automatic detection of the meniscus region with R-CNN made the meniscus segmentation process easier, and the use of different contrast features of two different image sequences allowed us to differentiate the meniscus from its surroundings.
Literatur
1.
Zurück zum Zitat Makris EA, Hadidi P, Athanasiou KA: The knee meniscus: Structure-function, pathophysiology, current repair techniques, and prospects for regeneration. Biomaterials 32(30):7411–7431, 2011CrossRef Makris EA, Hadidi P, Athanasiou KA: The knee meniscus: Structure-function, pathophysiology, current repair techniques, and prospects for regeneration. Biomaterials 32(30):7411–7431, 2011CrossRef
2.
Zurück zum Zitat Bryceland JK, Powell AJ, Nunn T: Knee Menisci. Cartilage 8(2):99–104, 2017CrossRef Bryceland JK, Powell AJ, Nunn T: Knee Menisci. Cartilage 8(2):99–104, 2017CrossRef
3.
Zurück zum Zitat Liew SC, Liew SW, Zain JM: Tamper localization and lossless recovery watermarking scheme with ROI segmentation and multilevel authentication. Journal of Digital Imaging 26:316–325, 2013CrossRef Liew SC, Liew SW, Zain JM: Tamper localization and lossless recovery watermarking scheme with ROI segmentation and multilevel authentication. Journal of Digital Imaging 26:316–325, 2013CrossRef
4.
Zurück zum Zitat Deepa S: SubbiahBharathi: Efficient ROI segmentation of digital mammogram images using Otsu’s N thresholding method. International Journal of Engineering Research & Technology 2(1):1–6, 2013CrossRef Deepa S: SubbiahBharathi: Efficient ROI segmentation of digital mammogram images using Otsu’s N thresholding method. International Journal of Engineering Research & Technology 2(1):1–6, 2013CrossRef
5.
Zurück zum Zitat Nagi J, Abdul Kareem S, Nagi F, Ahmed SK: Automated Breast Profile Segmentation for ROI Detection Using Digital Mammograms: IEEE EMBS conference on Biomedical Engineering & Sciences. Kuala Lumpur, Malaysia, November–December 2010:87–92, 2010 Nagi J, Abdul Kareem S, Nagi F, Ahmed SK: Automated Breast Profile Segmentation for ROI Detection Using Digital Mammograms: IEEE EMBS conference on Biomedical Engineering & Sciences. Kuala Lumpur, Malaysia, November–December 2010:87–92, 2010
6.
Zurück zum Zitat John NW: Segmentation of radiological images. In: Neri E, Caramella D, Bartolozzi C Eds. Image processing in radiology. Medical radiology (diagnostic imaging). Berlin, Heidelberg: Springer, 2008 John NW: Segmentation of radiological images. In: Neri E, Caramella D, Bartolozzi C Eds. Image processing in radiology. Medical radiology (diagnostic imaging). Berlin, Heidelberg: Springer, 2008
7.
Zurück zum Zitat Samuel AL: Some studies in machine learning using the game of checkers. IBM Journal of Research and Development 3(3):210–229, 1959CrossRef Samuel AL: Some studies in machine learning using the game of checkers. IBM Journal of Research and Development 3(3):210–229, 1959CrossRef
8.
Zurück zum Zitat Ng, A.: Machine learning yearning: Technical strategy for AI engineers, in the era of deep learning, Andrew Ng., Draft Version, 2018 Ng, A.: Machine learning yearning: Technical strategy for AI engineers, in the era of deep learning, Andrew Ng., Draft Version, 2018
9.
Zurück zum Zitat Tajbakhsh N, Shin JY, Gurudu SR, Hurst RT, Kendall CB, Gotway MB, Jianming Liang: Convolutional neural networks for medical image analysis: Full training or fine tuning? IEEE Transactions on Medical Imaging 35(5):1299–1312, 2016CrossRef Tajbakhsh N, Shin JY, Gurudu SR, Hurst RT, Kendall CB, Gotway MB, Jianming Liang: Convolutional neural networks for medical image analysis: Full training or fine tuning? IEEE Transactions on Medical Imaging 35(5):1299–1312, 2016CrossRef
10.
Zurück zum Zitat Akilan T, Wu QJ, Zhang W: Video foreground extraction using multi-view receptive field and encoder-decoder DCNN for traffic and surveillance applications. IEEE Transactions on Vehicular Technology 68(10):9478–9493, 2019CrossRef Akilan T, Wu QJ, Zhang W: Video foreground extraction using multi-view receptive field and encoder-decoder DCNN for traffic and surveillance applications. IEEE Transactions on Vehicular Technology 68(10):9478–9493, 2019CrossRef
11.
Zurück zum Zitat Lu, Le, Zheng, Yefeng, Carneiro, Gustavo, Yang, Lin (2017) ‘Deep learning and convolutional neural networks for medical image computing’: ‘Advances in Computer Vision and Pattern Recognition’ Springer Lu, Le, Zheng, Yefeng, Carneiro, Gustavo, Yang, Lin (2017) ‘Deep learning and convolutional neural networks for medical image computing’: ‘Advances in Computer Vision and Pattern Recognition’ Springer
12.
Zurück zum Zitat Aghdam, H.A., Heravi, E.J. 2017 ‘Guide to convolutional neural networks: A practical application to traffic-sign detection and classification’ (springer, 1st edn. ) Aghdam, H.A., Heravi, E.J. 2017 ‘Guide to convolutional neural networks: A practical application to traffic-sign detection and classification’ (springer, 1st edn. )
13.
Zurück zum Zitat Farabet C, Couprie C, Najman L, LeCun Y: Learning hierarchical features for scene labelling. IEEE Transactions on Pattern Analysis and Machine Intelligence 35(8):1915–1929, 2013CrossRef Farabet C, Couprie C, Najman L, LeCun Y: Learning hierarchical features for scene labelling. IEEE Transactions on Pattern Analysis and Machine Intelligence 35(8):1915–1929, 2013CrossRef
14.
Zurück zum Zitat Krizhevsky A, Sutskever I, Hinton GE: ImageNet classification with deep convolutional neural networks. 25th international conference on neural information processing systems. Nevada: Lake Tahoe, 2012, pp. 1097–1105 Krizhevsky A, Sutskever I, Hinton GE: ImageNet classification with deep convolutional neural networks. 25th international conference on neural information processing systems. Nevada: Lake Tahoe, 2012, pp. 1097–1105
15.
Zurück zum Zitat Girshick R, Donahue J, Darrell T, Malik J: Rich feature hierarchies for accurate object detection and semantic segmentation. Columbus: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2014, pp. 580–587 Girshick R, Donahue J, Darrell T, Malik J: Rich feature hierarchies for accurate object detection and semantic segmentation. Columbus: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2014, pp. 580–587
16.
Zurück zum Zitat Köse C, Gençalioğlu O, Şevik U: An automatic diagnosis method for the knee meniscus tears in MR images. Expert Systems with Applications 36(2):1208–1216, 2009CrossRef Köse C, Gençalioğlu O, Şevik U: An automatic diagnosis method for the knee meniscus tears in MR images. Expert Systems with Applications 36(2):1208–1216, 2009CrossRef
17.
Zurück zum Zitat Fripp J, Bourgeat P, Engstrom C, Ourselin S, Crozier S, Salvado O: Automated segmentation of the menisci from MR images. Boston: IEEE international symposium on biomedical imaging: From nano to macro, 2009, pp. 510–513 Fripp J, Bourgeat P, Engstrom C, Ourselin S, Crozier S, Salvado O: Automated segmentation of the menisci from MR images. Boston: IEEE international symposium on biomedical imaging: From nano to macro, 2009, pp. 510–513
18.
Zurück zum Zitat Paproki A, Engstrom C, Chandra SS, Neubert A, Fripp J, Crozier S: Automated segmentation and analysis of normal and osteoarthritic knee menisci from magnetic resonance images data from the osteoarthritis initiative. Osteoarthritis and Cartilage 2(9):1259–1270, 2014CrossRef Paproki A, Engstrom C, Chandra SS, Neubert A, Fripp J, Crozier S: Automated segmentation and analysis of normal and osteoarthritic knee menisci from magnetic resonance images data from the osteoarthritis initiative. Osteoarthritis and Cartilage 2(9):1259–1270, 2014CrossRef
19.
Zurück zum Zitat Zhang K, Lu W, Marziliano P: The unified extreme learning machines and discriminative random fields for automatic knee cartilage and meniscus segmentation from multi-contrast MR images. Machine Vision and Applications 24(7):1459–1472, 2013CrossRef Zhang K, Lu W, Marziliano P: The unified extreme learning machines and discriminative random fields for automatic knee cartilage and meniscus segmentation from multi-contrast MR images. Machine Vision and Applications 24(7):1459–1472, 2013CrossRef
20.
Zurück zum Zitat Saygılı A, Albayrak S: A new computer-based approach for fully automated segmentation of knee meniscus from magnetic resonance images. Biocybernetics and Biomedical Engineering 37(3):432–442, 2017CrossRef Saygılı A, Albayrak S: A new computer-based approach for fully automated segmentation of knee meniscus from magnetic resonance images. Biocybernetics and Biomedical Engineering 37(3):432–442, 2017CrossRef
21.
Zurück zum Zitat Aldrin F: Automated segmentation of the meniscus. KTH Royal Institute of Technology: Master Thesis, 2017 Aldrin F: Automated segmentation of the meniscus. KTH Royal Institute of Technology: Master Thesis, 2017
22.
Zurück zum Zitat Tack A, Mukhopadhyay A, Zachow S: Knee menisci segmentation using convolutional neural networks: Data from the osteoarthritis initiative. Osteoarthritis and Cartilage 26(5):680–688, 2018CrossRef Tack A, Mukhopadhyay A, Zachow S: Knee menisci segmentation using convolutional neural networks: Data from the osteoarthritis initiative. Osteoarthritis and Cartilage 26(5):680–688, 2018CrossRef
23.
Zurück zum Zitat Uijlings JR, Van De Sande KE, Gevers T, Smeulders AW: Selective search for object recognition. International Journal of Computer Vision 104(2):154–171, 2013CrossRef Uijlings JR, Van De Sande KE, Gevers T, Smeulders AW: Selective search for object recognition. International Journal of Computer Vision 104(2):154–171, 2013CrossRef
24.
Zurück zum Zitat Marcus DS et al.: Human connectome project informatics: Quality control, database services, and data visualization. Neuroimage 80:202–219, 2013CrossRef Marcus DS et al.: Human connectome project informatics: Quality control, database services, and data visualization. Neuroimage 80:202–219, 2013CrossRef
25.
Zurück zum Zitat Huo J, Wang G, Wu QJ, Akilan T: Label fusion for multi-atlas segmentation based on majority voting. Niagara Falls: International Conference on Image Analysis and Recognition, July 2015, pp. 100–106 Huo J, Wang G, Wu QJ, Akilan T: Label fusion for multi-atlas segmentation based on majority voting. Niagara Falls: International Conference on Image Analysis and Recognition, July 2015, pp. 100–106
26.
Zurück zum Zitat Soille P: Morphological image analysis: Principles and Applications, 2nd edition. Germany: Springer, 2002 Soille P: Morphological image analysis: Principles and Applications, 2nd edition. Germany: Springer, 2002
27.
Zurück zum Zitat Gonzalez RC, Woods RE, Eddins SL: Digital Image Processing Using MATLAB, 2nd edn., USA:Gatesmark Publishing, 2009 Gonzalez RC, Woods RE, Eddins SL: Digital Image Processing Using MATLAB, 2nd edn., USA:Gatesmark Publishing, 2009
28.
Zurück zum Zitat Gonzalez RC, Woods RE: Digital Image Processing, 3rd edn., Pearson Prentice Hall, 2008 Gonzalez RC, Woods RE: Digital Image Processing, 3rd edn., Pearson Prentice Hall, 2008
29.
Zurück zum Zitat Sedgewick R: Algorithms in C, 3rd edn., Addison-Wesley, 1998 Sedgewick R: Algorithms in C, 3rd edn., Addison-Wesley, 1998
30.
Zurück zum Zitat Solomon C, Breckon T: Fundamentals of Digital Image Processing: A Practical Approach with Examples in Matlab, 1st edn., Wiley-Blackwell, 2011 Solomon C, Breckon T: Fundamentals of Digital Image Processing: A Practical Approach with Examples in Matlab, 1st edn., Wiley-Blackwell, 2011
Metadaten
Titel
Automatic Segmentation of Meniscus in Multispectral MRI Using Regions with Convolutional Neural Network (R-CNN)
verfasst von
Emre ÖLMEZ
Volkan AKDOĞAN
Murat KORKMAZ
Orhan ER
Publikationsdatum
02.06.2020
Verlag
Springer International Publishing
Erschienen in
Journal of Imaging Informatics in Medicine / Ausgabe 4/2020
Print ISSN: 2948-2925
Elektronische ISSN: 2948-2933
DOI
https://doi.org/10.1007/s10278-020-00329-x

Weitere Artikel der Ausgabe 4/2020

Journal of Digital Imaging 4/2020 Zur Ausgabe

Akuter Schwindel: Wann lohnt sich eine MRT?

28.04.2024 Schwindel Nachrichten

Akuter Schwindel stellt oft eine diagnostische Herausforderung dar. Wie nützlich dabei eine MRT ist, hat eine Studie aus Finnland untersucht. Immerhin einer von sechs Patienten wurde mit akutem ischämischem Schlaganfall diagnostiziert.

Screening-Mammografie offenbart erhöhtes Herz-Kreislauf-Risiko

26.04.2024 Mammografie Nachrichten

Routinemäßige Mammografien helfen, Brustkrebs frühzeitig zu erkennen. Anhand der Röntgenuntersuchung lassen sich aber auch kardiovaskuläre Risikopatientinnen identifizieren. Als zuverlässiger Anhaltspunkt gilt die Verkalkung der Brustarterien.

S3-Leitlinie zu Pankreaskrebs aktualisiert

23.04.2024 Pankreaskarzinom Nachrichten

Die Empfehlungen zur Therapie des Pankreaskarzinoms wurden um zwei Off-Label-Anwendungen erweitert. Und auch im Bereich der Früherkennung gibt es Aktualisierungen.

Fünf Dinge, die im Kindernotfall besser zu unterlassen sind

18.04.2024 Pädiatrische Notfallmedizin Nachrichten

Im Choosing-Wisely-Programm, das für die deutsche Initiative „Klug entscheiden“ Pate gestanden hat, sind erstmals Empfehlungen zum Umgang mit Notfällen von Kindern erschienen. Fünf Dinge gilt es demnach zu vermeiden.

Update Radiologie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.