Skip to main content
Erschienen in: Journal of Digital Imaging 6/2019

06.05.2019

Lung Nodule Detection in CT Images Using a Raw Patch-Based Convolutional Neural Network

verfasst von: Qin Wang, Fengyi Shen, Linyao Shen, Jia Huang, Weiguang Sheng

Erschienen in: Journal of Imaging Informatics in Medicine | Ausgabe 6/2019

Einloggen, um Zugang zu erhalten

Abstract

Remarkable progress has been made in image classification and segmentation, due to the recent study of deep convolutional neural networks (CNNs). To solve the similar problem of diagnostic lung nodule detection in low-dose computed tomography (CT) scans, we propose a new Computer-Aided Detection (CAD) system using CNNs and CT image segmentation techniques. Unlike former studies focusing on the classification of malignant nodule types or relying on prior image processing, in this work, we put raw CT image patches directly in CNNs to reduce the complexity of the system. Specifically, we split each CT image into several patches, which are divided into 6 types consisting of 3 nodule types and 3 non-nodule types. We compare the performance of ResNet with different CNNs architectures on CT images from a publicly available dataset named the Lung Image Database Consortium and Image Database Resource Initiative (LIDC-IDRI). Results show that our best model reaches a high detection sensitivity of 92.8% with 8 false positives per scan (FPs/scan). Compared with related work, our work obtains a state-of-the-art effect.
Anhänge
Nur mit Berechtigung zugänglich
Literatur
1.
Zurück zum Zitat Siegel RL, Miller KD, Jemal A: Cancer statistics, 2015. CA Cancer J Clin 65(1):5–29, 2015CrossRef Siegel RL, Miller KD, Jemal A: Cancer statistics, 2015. CA Cancer J Clin 65(1):5–29, 2015CrossRef
2.
Zurück zum Zitat Ma L, Wang DD, Zou B, Yan H: An eigen-binding site based method for the analysis of anti-EGFR drug resistance in lung cancer treatment. IEEE/ACM Trans Comput Biol Bioinform 14(5):1187–1194, 2017CrossRef Ma L, Wang DD, Zou B, Yan H: An eigen-binding site based method for the analysis of anti-EGFR drug resistance in lung cancer treatment. IEEE/ACM Trans Comput Biol Bioinform 14(5):1187–1194, 2017CrossRef
3.
Zurück zum Zitat Kaneko M, Eguchi K, Ohmatsu H, Kakinuma R, Naruke T, Suemasu K, Moriyama N: Peripheral lung cancer: screening and detection with low-dose spiral CT versus radiography. Radiology 201(3):798–802, 1996CrossRef Kaneko M, Eguchi K, Ohmatsu H, Kakinuma R, Naruke T, Suemasu K, Moriyama N: Peripheral lung cancer: screening and detection with low-dose spiral CT versus radiography. Radiology 201(3):798–802, 1996CrossRef
4.
Zurück zum Zitat Jiang H, Ma H, Qian W et al.: An automatic detection system of lung nodule based on multi-group patch-based deep learning network. IEEE J Biomed Health Inform 22:1227–1237, 2017CrossRef Jiang H, Ma H, Qian W et al.: An automatic detection system of lung nodule based on multi-group patch-based deep learning network. IEEE J Biomed Health Inform 22:1227–1237, 2017CrossRef
5.
Zurück zum Zitat Messay T, Hardie RC, Rogers SK: A new computationally efficient CAD system for pulmonary nodule detection in CT imagery. Med Image Anal 14(3):390–406, 2010CrossRef Messay T, Hardie RC, Rogers SK: A new computationally efficient CAD system for pulmonary nodule detection in CT imagery. Med Image Anal 14(3):390–406, 2010CrossRef
6.
Zurück zum Zitat Gurcan MN, Sahiner B, Petrick N, Chan HP, Kazerooni EA, Cascade PN, Hadjiiski L: Lung nodule detection on thoracic computed tomography images: Preliminary evaluation of a computer-aided diagnosis system. Med Phys 29(11):2552–2558, 2002CrossRef Gurcan MN, Sahiner B, Petrick N, Chan HP, Kazerooni EA, Cascade PN, Hadjiiski L: Lung nodule detection on thoracic computed tomography images: Preliminary evaluation of a computer-aided diagnosis system. Med Phys 29(11):2552–2558, 2002CrossRef
7.
Zurück zum Zitat Aerts HJ, Velazquez ER, Leijenaar RT, Parmar C, Grossmann P, Carvalho S, Bussink J, Monshouwer R, Haibe-Kains B, Rietveld D, Hoebers F: Decoding tumour phenotype by noninvasive imaging using a quantitative radiomics approach. Nat Commun 5:4006, 2014CrossRef Aerts HJ, Velazquez ER, Leijenaar RT, Parmar C, Grossmann P, Carvalho S, Bussink J, Monshouwer R, Haibe-Kains B, Rietveld D, Hoebers F: Decoding tumour phenotype by noninvasive imaging using a quantitative radiomics approach. Nat Commun 5:4006, 2014CrossRef
8.
Zurück zum Zitat Balagurunathan Y, Gu Y, Wang H, Kumar V, Grove O, Hawkins S, Kim J, Goldgof DB, Hall LO, Gatenby RA, Gillies RJ: Reproducibility and prognosis of quantitative features extracted from CT images. Transl Oncol 7(1):72–87, 2014CrossRef Balagurunathan Y, Gu Y, Wang H, Kumar V, Grove O, Hawkins S, Kim J, Goldgof DB, Hall LO, Gatenby RA, Gillies RJ: Reproducibility and prognosis of quantitative features extracted from CT images. Transl Oncol 7(1):72–87, 2014CrossRef
9.
Zurück zum Zitat Rendon-Gonzalez E, Ponomaryov V: Automatic lung nodule segmentation and classification in CT images based on SVM. International Kharkiv Symposium on Physics and Engineering of Microwaves, Millimeter and Submillimeter Waves. IEEE 1–4, 2016 Rendon-Gonzalez E, Ponomaryov V: Automatic lung nodule segmentation and classification in CT images based on SVM. International Kharkiv Symposium on Physics and Engineering of Microwaves, Millimeter and Submillimeter Waves. IEEE 1–4, 2016
10.
Zurück zum Zitat Lee S L A, Kouzani A Z, Hu E J: A random forest for lung nodule identification. TENCON 2008 - 2008 IEEE Region 10 Conference. IEEE:1–5, 2008 Lee S L A, Kouzani A Z, Hu E J: A random forest for lung nodule identification. TENCON 2008 - 2008 IEEE Region 10 Conference. IEEE:1–5, 2008
12.
Zurück zum Zitat Shan C: Learning local binary patterns for gender classification on real-world face images. Pattern Recognit Lett 33(4):431–437, 2012CrossRef Shan C: Learning local binary patterns for gender classification on real-world face images. Pattern Recognit Lett 33(4):431–437, 2012CrossRef
13.
Zurück zum Zitat Orozco HM, Villegas OOV, Sánchez VGC, Domínguez HJO, Alfaro MJN: Automated system for lung nodules classification based on wavelet feature descriptor and support vector machine. Biomed Eng Online 14(1):9, 2015CrossRef Orozco HM, Villegas OOV, Sánchez VGC, Domínguez HJO, Alfaro MJN: Automated system for lung nodules classification based on wavelet feature descriptor and support vector machine. Biomed Eng Online 14(1):9, 2015CrossRef
14.
Zurück zum Zitat Tartar A, Akan A, Kilic N: A novel approach to malignant-benign classification of pulmonary nodules by using ensemble learning classifiers. Conf Proc IEEE Eng Med Biol Soc: 4651–4654, 2014 Tartar A, Akan A, Kilic N: A novel approach to malignant-benign classification of pulmonary nodules by using ensemble learning classifiers. Conf Proc IEEE Eng Med Biol Soc: 4651–4654, 2014
16.
Zurück zum Zitat Han F, Wang H, Zhang G, Han H, Song B, Li L, Moore W, Lu H, Zhao H, Liang Z: Texture feature analysis for computer-aided diagnosis on pulmonary nodules. J Digit Imaging 28(1):99–115, 2015CrossRef Han F, Wang H, Zhang G, Han H, Song B, Li L, Moore W, Lu H, Zhao H, Liang Z: Texture feature analysis for computer-aided diagnosis on pulmonary nodules. J Digit Imaging 28(1):99–115, 2015CrossRef
18.
Zurück zum Zitat Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Erhan D, Vanhoucke V, Rabinovich A: Going deeper with convolutions. Proc IEEE Comput Soc Conf Comput Vis Pattern Recognit, 2015. Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Erhan D, Vanhoucke V, Rabinovich A: Going deeper with convolutions. Proc IEEE Comput Soc Conf Comput Vis Pattern Recognit, 2015.
19.
Zurück zum Zitat Ren S, He K, Girshick R, Sun J: Faster r-cnn: towards real-time object detection with region proposal networks. Adv Neural Inf Process Syst: 91–99, 2015 Ren S, He K, Girshick R, Sun J: Faster r-cnn: towards real-time object detection with region proposal networks. Adv Neural Inf Process Syst: 91–99, 2015
20.
Zurück zum Zitat Liang-Chieh C, Papandreou G, Kokkinos I, Murphy K, Yuille A: Semantic image segmentation with deep convolutional nets and fully connected crfs. International Conference on Learning Representations, 2015 Liang-Chieh C, Papandreou G, Kokkinos I, Murphy K, Yuille A: Semantic image segmentation with deep convolutional nets and fully connected crfs. International Conference on Learning Representations, 2015
21.
Zurück zum Zitat Krizhevsky A, Sutskever I, Hinton GE: Imagenet classification with deep convolutional neural networks. Adv Neural Inf Process Syst:1097–1105, 2012 Krizhevsky A, Sutskever I, Hinton GE: Imagenet classification with deep convolutional neural networks. Adv Neural Inf Process Syst:1097–1105, 2012
22.
Zurück zum Zitat Simonyan K, Zisserman A: Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556, 2014 Simonyan K, Zisserman A: Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556, 2014
23.
Zurück zum Zitat He K, Zhang X, Ren S, Sun J: Deep residual learning for image recognition. Proc IEEE Comput Soc Conf Comput Vis Pattern Recognit 770–778, 2016 He K, Zhang X, Ren S, Sun J: Deep residual learning for image recognition. Proc IEEE Comput Soc Conf Comput Vis Pattern Recognit 770–778, 2016
24.
Zurück zum Zitat Golan R, Jacob C, Denzinger J: Lung nodule detection in CT images using deep convolutional neural networks. International Joint Conference on Neural Networks: 243–250. 2016 Golan R, Jacob C, Denzinger J: Lung nodule detection in CT images using deep convolutional neural networks. International Joint Conference on Neural Networks: 243–250. 2016
25.
Zurück zum Zitat Wang S, Zhou M, Gevaert O, Tang Z, Dong D, Liu Z, Tian J: A multi-view deep convolutional neural networks for lung nodule segmentation. Conf Proc IEEE Eng Med Biol Soc 2017, 1752–1755 Wang S, Zhou M, Gevaert O, Tang Z, Dong D, Liu Z, Tian J: A multi-view deep convolutional neural networks for lung nodule segmentation. Conf Proc IEEE Eng Med Biol Soc 2017, 1752–1755
27.
Zurück zum Zitat Huang X, Shan J, Vaidya V: Lung nodule detection in CT using 3D convolutional neural networks. 2017 IEEE 14th International Symposium on Biomedical Imaging 379–383, 2017 Huang X, Shan J, Vaidya V: Lung nodule detection in CT using 3D convolutional neural networks. 2017 IEEE 14th International Symposium on Biomedical Imaging 379–383, 2017
28.
Zurück zum Zitat Gu Y, Lu X, Yang L, Zhang B, Yu D, Zhao Y, Gao L, Wu L, Zhou T: Automatic lung nodule detection using a 3D deep convolutional neural network combined with a multi-scale prediction strategy in chest CTs. Comput. Biol. Med. 103:220–231, 2018CrossRef Gu Y, Lu X, Yang L, Zhang B, Yu D, Zhao Y, Gao L, Wu L, Zhou T: Automatic lung nodule detection using a 3D deep convolutional neural network combined with a multi-scale prediction strategy in chest CTs. Comput. Biol. Med. 103:220–231, 2018CrossRef
29.
Zurück zum Zitat Zhu W, Liu C, Fan W, Xie X: Deeplung: Deep 3d dual path nets for automated pulmonary nodule detection and classification. 2018 IEEE Winter Conf. Appl. Comput. Vision, WACV: 673-681, 2018 Zhu W, Liu C, Fan W, Xie X: Deeplung: Deep 3d dual path nets for automated pulmonary nodule detection and classification. 2018 IEEE Winter Conf. Appl. Comput. Vision, WACV: 673-681, 2018
30.
Zurück zum Zitat Armato SG, McLennan G, Bidaut L, McNitt-Gray MF, Meyer CR, Reeves AP, Zhao B, Aberle DR, Henschke CI, Hoffman EA, Kazerooni EA: The lung image database consortium (LIDC) and image database resource initiative (IDRI): a completed reference database of lung nodules on CT scans. Med Phys 38(2):915–931, 2011CrossRef Armato SG, McLennan G, Bidaut L, McNitt-Gray MF, Meyer CR, Reeves AP, Zhao B, Aberle DR, Henschke CI, Hoffman EA, Kazerooni EA: The lung image database consortium (LIDC) and image database resource initiative (IDRI): a completed reference database of lung nodules on CT scans. Med Phys 38(2):915–931, 2011CrossRef
31.
Zurück zum Zitat Van Ginneken B, Setio AA, Jacobs C, Ciompi F: Off-the-shelf convolutional neural network features for pulmonary nodule detection in computed tomography scans. IEEE Int. Symp. Biomed. Imaging:286–289, 2015 Van Ginneken B, Setio AA, Jacobs C, Ciompi F: Off-the-shelf convolutional neural network features for pulmonary nodule detection in computed tomography scans. IEEE Int. Symp. Biomed. Imaging:286–289, 2015
32.
Zurück zum Zitat Han F, Zhang G, Wang H, et al: A texture feature analysis for diagnosis of pulmonary nodules using LIDC-IDRI database. IEEE International Conference on Medical Imaging Physics and Engineering, 2014, 14–18. Han F, Zhang G, Wang H, et al: A texture feature analysis for diagnosis of pulmonary nodules using LIDC-IDRI database. IEEE International Conference on Medical Imaging Physics and Engineering, 2014, 14–18.
33.
Zurück zum Zitat Htwe K Z, Yamamori K, Katayama T, Kyi T M: Automated lung nodule classification by artificial neural network and fuzzy inference system. Consumer Electronics, 2016 IEEE, Global Conference on IEEE, 2016 1–2. Htwe K Z, Yamamori K, Katayama T, Kyi T M: Automated lung nodule classification by artificial neural network and fuzzy inference system. Consumer Electronics, 2016 IEEE, Global Conference on IEEE, 2016 1–2.
34.
Zurück zum Zitat Van Ginneken B, Armato SG, de Hoop B, van Amelsvoort-van de Vorst S, Duindam T, Niemeijer M, Murphy K, Schilham A, Retico A, Fantacci ME, Camarlinghi N: Comparing and combining algorithms for computer-aided detection of pulmonary nodules in computed tomography scans: the ANODE09 study. Med Image Anal 14(6):707–722, 2011CrossRef Van Ginneken B, Armato SG, de Hoop B, van Amelsvoort-van de Vorst S, Duindam T, Niemeijer M, Murphy K, Schilham A, Retico A, Fantacci ME, Camarlinghi N: Comparing and combining algorithms for computer-aided detection of pulmonary nodules in computed tomography scans: the ANODE09 study. Med Image Anal 14(6):707–722, 2011CrossRef
35.
Zurück zum Zitat Fawcett T: An introduction to ROC analysis. Pattern Recognit Lett 27(8):861–874, 2006CrossRef Fawcett T: An introduction to ROC analysis. Pattern Recognit Lett 27(8):861–874, 2006CrossRef
36.
Zurück zum Zitat Setio AAA, Ciompi F, Litjens G, Gerke P, Jacobs C, van Riel SJ, Wille MMW, Naqibullah M, Sanchez CI, van Ginneken B: Pulmonary nodule detection in CT images: false positive reduction using multi-view convolutional networks. IEEE Trans Med Imaging 35(5):1160–1169, 2016CrossRef Setio AAA, Ciompi F, Litjens G, Gerke P, Jacobs C, van Riel SJ, Wille MMW, Naqibullah M, Sanchez CI, van Ginneken B: Pulmonary nodule detection in CT images: false positive reduction using multi-view convolutional networks. IEEE Trans Med Imaging 35(5):1160–1169, 2016CrossRef
37.
Zurück zum Zitat Jiang H, Ma H, Qian W, Gao M, Li Y: An automatic detection system of lung nodule based on multi-group patch-based deep learning network. IEEE J Biomed Health Inform (99):1–1, 2017 Jiang H, Ma H, Qian W, Gao M, Li Y: An automatic detection system of lung nodule based on multi-group patch-based deep learning network. IEEE J Biomed Health Inform (99):1–1, 2017
38.
Zurück zum Zitat Khosravan N, Bagci U: S4ND: Single-shot single-scale lung nodule detection. Med Image Comput Comput Assist Interv:794–802, 2018 Khosravan N, Bagci U: S4ND: Single-shot single-scale lung nodule detection. Med Image Comput Comput Assist Interv:794–802, 2018
39.
Zurück zum Zitat Broyelle A: Automated Pulmonary Nodule Detection on Computed Tomography Images with 3D Deep Convolutional Neural Network, School of Computer Science and Communication KTHRoyal Institute of Technology, Stockholm 2018. Broyelle A: Automated Pulmonary Nodule Detection on Computed Tomography Images with 3D Deep Convolutional Neural Network, School of Computer Science and Communication KTHRoyal Institute of Technology, Stockholm 2018.
40.
Zurück zum Zitat Dou Q, Chen H, Jin Y, Lin H, Qin J, Heng PA: Automated pulmonary nodule detection via 3d convnets with online sample filtering and hybrid-loss residual learning. Med Image Comput Comput Assist Interv:630–638, 2017 Dou Q, Chen H, Jin Y, Lin H, Qin J, Heng PA: Automated pulmonary nodule detection via 3d convnets with online sample filtering and hybrid-loss residual learning. Med Image Comput Comput Assist Interv:630–638, 2017
Metadaten
Titel
Lung Nodule Detection in CT Images Using a Raw Patch-Based Convolutional Neural Network
verfasst von
Qin Wang
Fengyi Shen
Linyao Shen
Jia Huang
Weiguang Sheng
Publikationsdatum
06.05.2019
Verlag
Springer International Publishing
Erschienen in
Journal of Imaging Informatics in Medicine / Ausgabe 6/2019
Print ISSN: 2948-2925
Elektronische ISSN: 2948-2933
DOI
https://doi.org/10.1007/s10278-019-00221-3

Weitere Artikel der Ausgabe 6/2019

Journal of Digital Imaging 6/2019 Zur Ausgabe

Update Radiologie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.