Skip to main content
Erschienen in: Journal of Digital Imaging 4/2020

24.04.2020 | Original Paper

Prediction of Non-small Cell Lung Cancer Histology by a Deep Ensemble of Convolutional and Bidirectional Recurrent Neural Network

verfasst von: Dipanjan Moitra, Rakesh Kumar Mandal

Erschienen in: Journal of Imaging Informatics in Medicine | Ausgabe 4/2020

Einloggen, um Zugang zu erhalten

Abstract

Histology subtype prediction is a major task for grading non-small cell lung cancer (NSCLC) tumors. Invasive methods such as biopsy often lack in tumor sample, and as a result radiologists or oncologists find it difficult to detect proper histology of NSCLC tumors. The non-invasive methods such as machine learning may play a useful role to predict NSCLC histology by using medical image biomarkers. Few attempts have so far been made to predict NSCLC histology by considering all the major subtypes. The present study aimed to develop a more accurate deep learning model by clubbing convolutional and bidirectional recurrent neural networks. The NSCLC Radiogenomics dataset having 211 subjects was used in the study. Ten best models found during experimentation were averaged to form an ensemble. The model ensemble was executed with 10-fold repeated stratified cross-validation, and the results got were tested with metrics like accuracy, recall, precision, F1-score, Cohen’s kappa, and ROC-AUC score. The accuracy of the ensemble model showed considerable improvement over the best model found with the single model. The proposed model may help significantly in the automated prognosis of NSCLC and other types of cancers.
Literatur
1.
Zurück zum Zitat K. M. Kerr, L. Bubendorf, M. J. Edelman, A. Marchetti, T. Mok, S. Novello, K. O'Byrne, R. Stahel, S. Peters, E. Felip, Panel Members, Rolf Stahel, Enriqueta Felip, Solange Peters, Keith Kerr, Benjamin Besse, Johan Vansteenkiste, Wilfried Eberhardt, Martin Edelman, Tony Mok, Ken O'Byrne, Silvia Novello, Lukas Bubendorf, Antonio Marchetti, Paul Baas, Martin Reck, Konstantinos Syrigos, Luis Paz-Ares, Egbert F. Smit, Peter Meldgaard, Alex Adjei, Marianne Nicolson, Lucio Crinò, Paul Van Schil, Suresh Senan, Corinne Faivre-Finn, Gaetano Rocco, Giulia Veronesi, Jean-Yves Douillard, Eric Lim, Christophe Dooms, Walter Weder, Dirk De Ruysscher, Cecile De Pechoux, Paul De Leyn, Virginie Westeel, Second ESMO consensus conference on lung cancer: pathology and molecular biomarkers for non-small-cell lung cancer, Annals of Oncology, Volume 25, Issue 9, 2014, 1681–1690, https://doi.org/10.1093/annonc/mdu145CrossRefPubMed K. M. Kerr, L. Bubendorf, M. J. Edelman, A. Marchetti, T. Mok, S. Novello, K. O'Byrne, R. Stahel, S. Peters, E. Felip, Panel Members, Rolf Stahel, Enriqueta Felip, Solange Peters, Keith Kerr, Benjamin Besse, Johan Vansteenkiste, Wilfried Eberhardt, Martin Edelman, Tony Mok, Ken O'Byrne, Silvia Novello, Lukas Bubendorf, Antonio Marchetti, Paul Baas, Martin Reck, Konstantinos Syrigos, Luis Paz-Ares, Egbert F. Smit, Peter Meldgaard, Alex Adjei, Marianne Nicolson, Lucio Crinò, Paul Van Schil, Suresh Senan, Corinne Faivre-Finn, Gaetano Rocco, Giulia Veronesi, Jean-Yves Douillard, Eric Lim, Christophe Dooms, Walter Weder, Dirk De Ruysscher, Cecile De Pechoux, Paul De Leyn, Virginie Westeel, Second ESMO consensus conference on lung cancer: pathology and molecular biomarkers for non-small-cell lung cancer, Annals of Oncology, Volume 25, Issue 9, 2014, 1681–1690, https://​doi.​org/​10.​1093/​annonc/​mdu145CrossRefPubMed
2.
Zurück zum Zitat Wu Weimiao, Parmar Chintan, Grossmann Patrick, Quackenbush John, Lambin Philippe, Bussink Johan, Mak Raymond, Aerts Hugo J. W. L., Exploratory study to identify radiomics classifiers for lung cancer histology, Frontiers in Oncology, Volume 6, 2016, https://doi.org/10.3389/fonc.2016.00071 Wu Weimiao, Parmar Chintan, Grossmann Patrick, Quackenbush John, Lambin Philippe, Bussink Johan, Mak Raymond, Aerts Hugo J. W. L., Exploratory study to identify radiomics classifiers for lung cancer histology, Frontiers in Oncology, Volume 6, 2016, https://​doi.​org/​10.​3389/​fonc.​2016.​00071
3.
Zurück zum Zitat Matthew D. Wilkerson, Jason M. Schallheim, D. Neil Hayes, Patrick J. Roberts, Roy R.L. Bastien, Michael Mullins, Xiaoying Yin, C. Ryan Miller, Leigh B. Thorne, Katherine B. Geiersbach, Kenneth L. Muldrew, William K. Funkhouser, Cheng Fan, Michele C. Hayward, Steven Bayer, Charles M. Perou, Philip S. Bernard, Prediction of lung cancer histological types by RT-qPCR gene expression in FFPE specimens, The Journal of Molecular Diagnostics, Volume 15, Issue 4, 2013, Pages 485–497, ISSN 1525–1578, https://doi.org/10.1016/j.jmoldx.2013.03.007CrossRefPubMed Matthew D. Wilkerson, Jason M. Schallheim, D. Neil Hayes, Patrick J. Roberts, Roy R.L. Bastien, Michael Mullins, Xiaoying Yin, C. Ryan Miller, Leigh B. Thorne, Katherine B. Geiersbach, Kenneth L. Muldrew, William K. Funkhouser, Cheng Fan, Michele C. Hayward, Steven Bayer, Charles M. Perou, Philip S. Bernard, Prediction of lung cancer histological types by RT-qPCR gene expression in FFPE specimens, The Journal of Molecular Diagnostics, Volume 15, Issue 4, 2013, Pages 485–497, ISSN 1525–1578, https://​doi.​org/​10.​1016/​j.​jmoldx.​2013.​03.​007CrossRefPubMed
4.
Zurück zum Zitat A. Karlsson, H. Cirenajwis, K. Ericson-Lindqvist, C. Reuterswärd, M. Jönsson, A. Patthey, A.F. Behndig, M. Johansson, M. Planck, J. Staaf, 19P Single sample predictor of non-small cell lung cancer histology based on gene expression analysis of archival tissue, Journal of Thoracic Oncology, Volume 13, Issue 4 A. Karlsson, H. Cirenajwis, K. Ericson-Lindqvist, C. Reuterswärd, M. Jönsson, A. Patthey, A.F. Behndig, M. Johansson, M. Planck, J. Staaf, 19P Single sample predictor of non-small cell lung cancer histology based on gene expression analysis of archival tissue, Journal of Thoracic Oncology, Volume 13, Issue 4
5.
Zurück zum Zitat Travis W.D., Brambilla E., Geisinger K.R., Histological grading in lung cancer: One system for all or separate systems for each histological type?, European Respiratory Journal, 2016, 47 (3), pp. 720–723CrossRef Travis W.D., Brambilla E., Geisinger K.R., Histological grading in lung cancer: One system for all or separate systems for each histological type?, European Respiratory Journal, 2016, 47 (3), pp. 720–723CrossRef
8.
Zurück zum Zitat Pooya Mobadersany, Safoora Yousefi, Mohamed Amgad, David A. Gutman, Jill S. Barnholtz-Sloan, José E. Velázquez Vega, Daniel J. Brat, Lee A. D. Cooper, Predicting cancer outcomes from histology and genomics using convolutional networks, Proceedings of the National Academy of Sciences Mar 2018, 115 (13) E2970-E2979; DOI: https://doi.org/10.1073/pnas.1717139115CrossRef Pooya Mobadersany, Safoora Yousefi, Mohamed Amgad, David A. Gutman, Jill S. Barnholtz-Sloan, José E. Velázquez Vega, Daniel J. Brat, Lee A. D. Cooper, Predicting cancer outcomes from histology and genomics using convolutional networks, Proceedings of the National Academy of Sciences Mar 2018, 115 (13) E2970-E2979; DOI: https://​doi.​org/​10.​1073/​pnas.​1717139115CrossRef
9.
Zurück zum Zitat N. Zhang, J. Wu, M. Yang, J. Yu, R. Li, A composite model integrating imaging, histological, and genetic features to predict tumor mutation burden in non-small cell lung cancer patients, International Journal of Radiation Oncology Biology Physics, Volume 105, Issue 1, 2019 N. Zhang, J. Wu, M. Yang, J. Yu, R. Li, A composite model integrating imaging, histological, and genetic features to predict tumor mutation burden in non-small cell lung cancer patients, International Journal of Radiation Oncology Biology Physics, Volume 105, Issue 1, 2019
11.
Zurück zum Zitat Anna Karlsson, Helena Cirenajwis, Kajsa Ericson-Lindquist, Hans Brunnström, Christel Reuterswärd, Mats Jönsson, Cristian Ortiz-Villalón, Aziz Hussein, Bengt Bergman, Anders Vikström, Nastaran Monsef, Eva Branden, Hirsh Koyi, Luigi de Petris, Patrick Micke, Annika Patthey, Annelie F. Behndig, Mikael Johansson, Maria Planck & Johan Staaf. A combined gene expression tool for parallel histological prediction and gene fusion detection in non-small cell lung cancer. Scientific Reports 9, 5207 (2019) doi:https://doi.org/10.1038/s41598-019-41585-4CrossRefPubMedPubMedCentral Anna Karlsson, Helena Cirenajwis, Kajsa Ericson-Lindquist, Hans Brunnström, Christel Reuterswärd, Mats Jönsson, Cristian Ortiz-Villalón, Aziz Hussein, Bengt Bergman, Anders Vikström, Nastaran Monsef, Eva Branden, Hirsh Koyi, Luigi de Petris, Patrick Micke, Annika Patthey, Annelie F. Behndig, Mikael Johansson, Maria Planck & Johan Staaf. A combined gene expression tool for parallel histological prediction and gene fusion detection in non-small cell lung cancer. Scientific Reports 9, 5207 (2019) doi:https://​doi.​org/​10.​1038/​s41598-019-41585-4CrossRefPubMedPubMedCentral
13.
Zurück zum Zitat Wu Weimiao, Parmar Chintan, Grossmann Patrick, Quackenbush John, Lambin Philippe, Bussink Johan, Mak Raymond, Aerts Hugo J. W. L., Exploratory study to identify radiomics classifiers for lung cancer histology, Frontiers in Oncology, Vol. 6, 2016, DOI=https://doi.org/10.3389/fonc.2016.00071 Wu Weimiao, Parmar Chintan, Grossmann Patrick, Quackenbush John, Lambin Philippe, Bussink Johan, Mak Raymond, Aerts Hugo J. W. L., Exploratory study to identify radiomics classifiers for lung cancer histology, Frontiers in Oncology, Vol. 6, 2016, DOI=https://​doi.​org/​10.​3389/​fonc.​2016.​00071
15.
Zurück zum Zitat Nicolas Coudray, Paolo Santiago Ocampo, Theodore Sakellaropoulos, Navneet Narula, Matija Snuderl, David Fenyö, Andre L. Moreira, Narges Razavian & Aristotelis Tsirigos, Classification and mutation prediction from non–small cell lung cancer histopathology images using deep learning. Nat Med 24, 1559–1567 (2018) doi:https://doi.org/10.1038/s41591-018-0177-5CrossRefPubMed Nicolas Coudray, Paolo Santiago Ocampo, Theodore Sakellaropoulos, Navneet Narula, Matija Snuderl, David Fenyö, Andre L. Moreira, Narges Razavian & Aristotelis Tsirigos, Classification and mutation prediction from non–small cell lung cancer histopathology images using deep learning. Nat Med 24, 1559–1567 (2018) doi:https://​doi.​org/​10.​1038/​s41591-018-0177-5CrossRefPubMed
17.
Zurück zum Zitat Clark K, Vendt B, Smith K, Freymann J, Kirby J, Koppel P, Moore S, Phillips S, Maffitt D, Pringle M, Tarbox L, Prior F. The Cancer Imaging Archive (TCIA): maintaining and operating a public information repository, Journal of Digital Imaging, Volume 26, Number 6, 2013, pp 1045–1057CrossRef Clark K, Vendt B, Smith K, Freymann J, Kirby J, Koppel P, Moore S, Phillips S, Maffitt D, Pringle M, Tarbox L, Prior F. The Cancer Imaging Archive (TCIA): maintaining and operating a public information repository, Journal of Digital Imaging, Volume 26, Number 6, 2013, pp 1045–1057CrossRef
18.
Zurück zum Zitat Olivier Gevaert, Jiajing Xu, Chuong D. Hoang, Ann N. Leung, Yue Xu, Andrew Quon, Daniel L. Rubin, Sandy Napel, Sylvia K. Plevritis (2012). Non–small cell lung cancer: identifying prognostic imaging biomarkers by leveraging public gene expression microarray data—methods and preliminary results. Radiology. Radiological Society of North America (RSNA). https://doi.org/10.1148/radiol.12111607, 264, 387, 396CrossRef Olivier Gevaert, Jiajing Xu, Chuong D. Hoang, Ann N. Leung, Yue Xu, Andrew Quon, Daniel L. Rubin, Sandy Napel, Sylvia K. Plevritis (2012). Non–small cell lung cancer: identifying prognostic imaging biomarkers by leveraging public gene expression microarray data—methods and preliminary results. Radiology. Radiological Society of North America (RSNA). https://​doi.​org/​10.​1148/​radiol.​12111607, 264, 387, 396CrossRef
20.
Zurück zum Zitat Zhiyong Cui, Ruimin Ke, Yinhai Wang. Deep bidirectional and unidirectional LSTM recurrent neural network for network-wide traffic speed prediction. arXiv:1801.02143 Zhiyong Cui, Ruimin Ke, Yinhai Wang. Deep bidirectional and unidirectional LSTM recurrent neural network for network-wide traffic speed prediction. arXiv:1801.02143
21.
Zurück zum Zitat Xingjian Shi, Zhourong Chen, Hao Wang, Dit-Yan Yeung, Wai-kin Wong, Wang-chun Woo. Convolutional LSTM network: a machine learning approach for precipitation nowcasting. arXiv:1506.04214 Xingjian Shi, Zhourong Chen, Hao Wang, Dit-Yan Yeung, Wai-kin Wong, Wang-chun Woo. Convolutional LSTM network: a machine learning approach for precipitation nowcasting. arXiv:1506.04214
22.
Zurück zum Zitat Jeff Donahue, Lisa Anne Hendricks, Marcus Rohrbach, Subhashini Venugopalan, Sergio Guadarrama, Kate Saenko, Trevor Darrell. Long-term recurrent convolutional networks for visual recognition and description. arXiv:1411.4389 Jeff Donahue, Lisa Anne Hendricks, Marcus Rohrbach, Subhashini Venugopalan, Sergio Guadarrama, Kate Saenko, Trevor Darrell. Long-term recurrent convolutional networks for visual recognition and description. arXiv:1411.4389
24.
Zurück zum Zitat Bakr, Shaimaa; Gevaert, Olivier; Echegaray, Sebastian; Ayers, Kelsey; Zhou, Mu; Shafiq, Majid; Zheng, Hong; Zhang, Weiruo; Leung, Ann; Kadoch, Michael; Shrager, Joseph; Quon, Andrew; Rubin, Daniel; Plevritis, Sylvia; Napel, Sandy. (2017). Data for NSCLC Radiogenomics collection. The Cancer Imaging Archive. https://doi.org/10.7937/K9/TCIA.2017.7hs46erv Bakr, Shaimaa; Gevaert, Olivier; Echegaray, Sebastian; Ayers, Kelsey; Zhou, Mu; Shafiq, Majid; Zheng, Hong; Zhang, Weiruo; Leung, Ann; Kadoch, Michael; Shrager, Joseph; Quon, Andrew; Rubin, Daniel; Plevritis, Sylvia; Napel, Sandy. (2017). Data for NSCLC Radiogenomics collection. The Cancer Imaging Archive. https://​doi.​org/​10.​7937/​K9/​TCIA.​2017.​7hs46erv
25.
Zurück zum Zitat D. Moitra, R. Mandal, Review of brain tumor detection using pattern recognition techniques, International Journal of Computer Sciences and Engineering, Vol. 5, Issue 2, pp. 121–123, 2017 D. Moitra, R. Mandal, Review of brain tumor detection using pattern recognition techniques, International Journal of Computer Sciences and Engineering, Vol. 5, Issue 2, pp. 121–123, 2017
27.
Zurück zum Zitat D. Moitra, R. Mandal, Segmentation strategy of PET brain tumor image, Indian Journal of Computer Science and Engineering, Vol. 8 No. 5 2017, e-ISSN:0976–5166 D. Moitra, R. Mandal, Segmentation strategy of PET brain tumor image, Indian Journal of Computer Science and Engineering, Vol. 8 No. 5 2017, e-ISSN:0976–5166
28.
Zurück zum Zitat H. M. Nguyen, E. W. Cooper, K. Kamei, Borderline over-sampling for imbalanced data classification, International Journal of Knowledge Engineering and Soft Data Paradigms, 3(1), pp.4–21, 2009 H. M. Nguyen, E. W. Cooper, K. Kamei, Borderline over-sampling for imbalanced data classification, International Journal of Knowledge Engineering and Soft Data Paradigms, 3(1), pp.4–21, 2009
29.
Zurück zum Zitat François Chollet, Deep learning with Python, Manning Publications Co., 2018, ISBN 9781617294433 François Chollet, Deep learning with Python, Manning Publications Co., 2018, ISBN 9781617294433
30.
Zurück zum Zitat Powers, David M W (2011) [2007], Evaluation: from precision, recall and F-measure to ROC, informedness, markedness & correlation, Journal of Machine Learning Technologies. 2 (1): 37–63 Powers, David M W (2011) [2007], Evaluation: from precision, recall and F-measure to ROC, informedness, markedness & correlation, Journal of Machine Learning Technologies. 2 (1): 37–63
32.
Zurück zum Zitat Dipanjan Moitra, Classification of malignant tumors: a practical approach, LAP LAMBERT Academic Publishing, 2019, ISBN: 978-613-9-47500-1 Dipanjan Moitra, Classification of malignant tumors: a practical approach, LAP LAMBERT Academic Publishing, 2019, ISBN: 978-613-9-47500-1
33.
Zurück zum Zitat Dipanjan Moitra, R. K. Samanta, Performance evaluation of BioPerl, Biojava, BioPython, BioRuby and BioSmalltalk for executing bioinformatics tasks, International Journal of Computer Sciences and Engineering, Vol.03, Issue.01, pp.157–164, 2015 Dipanjan Moitra, R. K. Samanta, Performance evaluation of BioPerl, Biojava, BioPython, BioRuby and BioSmalltalk for executing bioinformatics tasks, International Journal of Computer Sciences and Engineering, Vol.03, Issue.01, pp.157–164, 2015
34.
Zurück zum Zitat AJCC Cancer Stating Manual 7th Edition, American Joint Committee on Cancer, ISBN 978-0-387-88440-0, Springer New York AJCC Cancer Stating Manual 7th Edition, American Joint Committee on Cancer, ISBN 978-0-387-88440-0, Springer New York
Metadaten
Titel
Prediction of Non-small Cell Lung Cancer Histology by a Deep Ensemble of Convolutional and Bidirectional Recurrent Neural Network
verfasst von
Dipanjan Moitra
Rakesh Kumar Mandal
Publikationsdatum
24.04.2020
Verlag
Springer International Publishing
Erschienen in
Journal of Imaging Informatics in Medicine / Ausgabe 4/2020
Print ISSN: 2948-2925
Elektronische ISSN: 2948-2933
DOI
https://doi.org/10.1007/s10278-020-00337-x

Weitere Artikel der Ausgabe 4/2020

Journal of Digital Imaging 4/2020 Zur Ausgabe

Akuter Schwindel: Wann lohnt sich eine MRT?

28.04.2024 Schwindel Nachrichten

Akuter Schwindel stellt oft eine diagnostische Herausforderung dar. Wie nützlich dabei eine MRT ist, hat eine Studie aus Finnland untersucht. Immerhin einer von sechs Patienten wurde mit akutem ischämischem Schlaganfall diagnostiziert.

Screening-Mammografie offenbart erhöhtes Herz-Kreislauf-Risiko

26.04.2024 Mammografie Nachrichten

Routinemäßige Mammografien helfen, Brustkrebs frühzeitig zu erkennen. Anhand der Röntgenuntersuchung lassen sich aber auch kardiovaskuläre Risikopatientinnen identifizieren. Als zuverlässiger Anhaltspunkt gilt die Verkalkung der Brustarterien.

S3-Leitlinie zu Pankreaskrebs aktualisiert

23.04.2024 Pankreaskarzinom Nachrichten

Die Empfehlungen zur Therapie des Pankreaskarzinoms wurden um zwei Off-Label-Anwendungen erweitert. Und auch im Bereich der Früherkennung gibt es Aktualisierungen.

Fünf Dinge, die im Kindernotfall besser zu unterlassen sind

18.04.2024 Pädiatrische Notfallmedizin Nachrichten

Im Choosing-Wisely-Programm, das für die deutsche Initiative „Klug entscheiden“ Pate gestanden hat, sind erstmals Empfehlungen zum Umgang mit Notfällen von Kindern erschienen. Fünf Dinge gilt es demnach zu vermeiden.

Update Radiologie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.