Skip to main content
Erschienen in: Abdominal Radiology 1/2021

04.06.2020 | Technical

Automated detection and delineation of hepatocellular carcinoma on multiphasic contrast-enhanced MRI using deep learning

verfasst von: Khaled Bousabarah, Brian Letzen, Jonathan Tefera, Lynn Savic, Isabel Schobert, Todd Schlachter, Lawrence H. Staib, Martin Kocher, Julius Chapiro, MingDe Lin

Erschienen in: Abdominal Radiology | Ausgabe 1/2021

Einloggen, um Zugang zu erhalten

Abstract

Purpose

Liver Imaging Reporting and Data System (LI-RADS) uses multiphasic contrast-enhanced imaging for hepatocellular carcinoma (HCC) diagnosis. The goal of this feasibility study was to establish a proof-of-principle concept towards automating the application of LI-RADS, using a deep learning algorithm trained to segment the liver and delineate HCCs on MRI automatically.

Methods

In this retrospective single-center study, multiphasic contrast-enhanced MRIs using T1-weighted breath-hold sequences acquired from 2010 to 2018 were used to train a deep convolutional neural network (DCNN) with a U-Net architecture. The U-Net was trained (using 70% of all data), validated (15%) and tested (15%) on 174 patients with 231 lesions. Manual 3D segmentations of the liver and HCC were ground truth. The dice similarity coefficient (DSC) was measured between manual and DCNN methods. Postprocessing using a random forest (RF) classifier employing radiomic features and thresholding (TR) of the mean neural activation was used to reduce the average false positive rate (AFPR).

Results

73 and 75% of HCCs were detected on validation and test sets, respectively, using > 0.2 DSC criterion between individual lesions and their corresponding segmentations. Validation set AFPRs were 2.81, 0.77, 0.85 for U-Net, U-Net + RF, and U-Net + TR, respectively. Combining both RF and TR with the U-Net improved the AFPR to 0.62 and 0.75 for the validation and test sets, respectively. Mean DSC between automatically detected lesions using the DCNN + RF + TR and corresponding manual segmentations was 0.64/0.68 (validation/test), and 0.91/0.91 for liver segmentations.

Conclusion

Our DCNN approach can segment the liver and HCCs automatically. This could enable a more workflow efficient and clinically realistic implementation of LI-RADS.
Literatur
1.
Zurück zum Zitat Bray F, Ferlay J, Soerjomataram I, Siegel RL, Torre LA, Jemal AJCacjfc (2018) Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. 68:394-424 Bray F, Ferlay J, Soerjomataram I, Siegel RL, Torre LA, Jemal AJCacjfc (2018) Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. 68:394-424
2.
Zurück zum Zitat El-Serag HB, Rudolph KL (2007) Hepatocellular carcinoma: epidemiology and molecular carcinogenesis. Gastroenterology 132:2557-2576CrossRef El-Serag HB, Rudolph KL (2007) Hepatocellular carcinoma: epidemiology and molecular carcinogenesis. Gastroenterology 132:2557-2576CrossRef
3.
Zurück zum Zitat White DL, Thrift AP, Kanwal F, Davila J, El-Serag HB (2017) Incidence of Hepatocellular Carcinoma in All 50 United States, From 2000 Through 2012. Gastroenterology 152:812-820 e815 White DL, Thrift AP, Kanwal F, Davila J, El-Serag HB (2017) Incidence of Hepatocellular Carcinoma in All 50 United States, From 2000 Through 2012. Gastroenterology 152:812-820 e815
4.
Zurück zum Zitat Eisenhauer EA, Therasse P, Bogaerts J et al (2009) New response evaluation criteria in solid tumours: revised RECIST guideline (version 1.1). Eur J Cancer 45:228-247CrossRef Eisenhauer EA, Therasse P, Bogaerts J et al (2009) New response evaluation criteria in solid tumours: revised RECIST guideline (version 1.1). Eur J Cancer 45:228-247CrossRef
5.
Zurück zum Zitat Ding Y, Rao S-x, Wang W-t, Chen C-z, Li R-c, Zeng M (2018) Comparison of gadoxetic acid versus gadopentetate dimeglumine for the detection of hepatocellular carcinoma at 1.5 T using the liver imaging reporting and data system (LI-RADS v.2017). Cancer Imaging 18:48 Ding Y, Rao S-x, Wang W-t, Chen C-z, Li R-c, Zeng M (2018) Comparison of gadoxetic acid versus gadopentetate dimeglumine for the detection of hepatocellular carcinoma at 1.5 T using the liver imaging reporting and data system (LI-RADS v.2017). Cancer Imaging 18:48
6.
Zurück zum Zitat Chernyak V, Fowler KJ, Kamaya A et al (2018) Liver Imaging Reporting and Data System (LI-RADS) Version 2018: Imaging of Hepatocellular Carcinoma in At-Risk Patients. Radiology. 10.1148/radiol.2018181494:181494CrossRefPubMedPubMedCentral Chernyak V, Fowler KJ, Kamaya A et al (2018) Liver Imaging Reporting and Data System (LI-RADS) Version 2018: Imaging of Hepatocellular Carcinoma in At-Risk Patients. Radiology. 10.1148/radiol.2018181494:181494CrossRefPubMedPubMedCentral
7.
Zurück zum Zitat Han X (2017) Automatic Liver Lesion Segmentation Using A Deep Convolutional Neural Network Method. CoRR abs/1704.07239 Han X (2017) Automatic Liver Lesion Segmentation Using A Deep Convolutional Neural Network Method. CoRR abs/1704.07239
9.
Zurück zum Zitat Sun C, Guo S, Zhang H et al (2017) Automatic segmentation of liver tumors from multiphase contrast-enhanced CT images based on FCNs. Artif Intell Med 83:58-66CrossRef Sun C, Guo S, Zhang H et al (2017) Automatic segmentation of liver tumors from multiphase contrast-enhanced CT images based on FCNs. Artif Intell Med 83:58-66CrossRef
10.
Zurück zum Zitat Nayak A, Kayal EB, Arya M et al (2019) Computer-aided diagnosis of cirrhosis and hepatocellular carcinoma using multi-phase abdomen CT. International journal of computer assisted radiology and surgery 14:1341-1352CrossRef Nayak A, Kayal EB, Arya M et al (2019) Computer-aided diagnosis of cirrhosis and hepatocellular carcinoma using multi-phase abdomen CT. International journal of computer assisted radiology and surgery 14:1341-1352CrossRef
11.
Zurück zum Zitat Roberts LR, Sirlin CB, Zaiem F et al (2018) Imaging for the diagnosis of hepatocellular carcinoma: A systematic review and meta-analysis. Hepatology 67:401-421CrossRef Roberts LR, Sirlin CB, Zaiem F et al (2018) Imaging for the diagnosis of hepatocellular carcinoma: A systematic review and meta-analysis. Hepatology 67:401-421CrossRef
12.
Zurück zum Zitat Hanna RF, Miloushev VZ, Tang A et al (2016) Comparative 13-year meta-analysis of the sensitivity and positive predictive value of ultrasound, CT, and MRI for detecting hepatocellular carcinoma. Abdom Radiol (NY) 41:71-90CrossRef Hanna RF, Miloushev VZ, Tang A et al (2016) Comparative 13-year meta-analysis of the sensitivity and positive predictive value of ultrasound, CT, and MRI for detecting hepatocellular carcinoma. Abdom Radiol (NY) 41:71-90CrossRef
13.
Zurück zum Zitat Zhang YD, Zhu FP, Xu X et al (2016) Liver Imaging Reporting and Data System:: Substantial Discordance Between CT and MR for Imaging Classification of Hepatic Nodules. Acad Radiol 23:344-352CrossRef Zhang YD, Zhu FP, Xu X et al (2016) Liver Imaging Reporting and Data System:: Substantial Discordance Between CT and MR for Imaging Classification of Hepatic Nodules. Acad Radiol 23:344-352CrossRef
14.
Zurück zum Zitat Ronneberger O, Fischer P, Brox T (2015) U-Net: Convolutional Networks for Biomedical Image Segmentation, pp 234-241 Ronneberger O, Fischer P, Brox T (2015) U-Net: Convolutional Networks for Biomedical Image Segmentation, pp 234-241
15.
Zurück zum Zitat Christ PF, Ettlinger F, Grün F et al (2017) Automatic Liver and Tumor Segmentation of CT and MRI Volumes using Cascaded Fully Convolutional Neural Networks. CoRR abs/1702.05970 Christ PF, Ettlinger F, Grün F et al (2017) Automatic Liver and Tumor Segmentation of CT and MRI Volumes using Cascaded Fully Convolutional Neural Networks. CoRR abs/1702.05970
16.
Zurück zum Zitat Sahiner B, Pezeshk A, Hadjiiski LM et al (2019) Deep learning in medical imaging and radiation therapy. 46:e1-e36 Sahiner B, Pezeshk A, Hadjiiski LM et al (2019) Deep learning in medical imaging and radiation therapy. 46:e1-e36
17.
Zurück zum Zitat Milletari F, Navab N, Ahmadi S-A (2016) V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation. CoRR abs/1606.04797 Milletari F, Navab N, Ahmadi S-A (2016) V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation. CoRR abs/1606.04797
18.
Zurück zum Zitat He K, Zhang X, Ren S, Sun J (2016) Identity Mappings in Deep Residual Networks. CoRR abs/1603.05027 He K, Zhang X, Ren S, Sun J (2016) Identity Mappings in Deep Residual Networks. CoRR abs/1603.05027
19.
Zurück zum Zitat Bilic P, Christ PF, Vorontsov E et al (2019) The Liver Tumor Segmentation Benchmark (LiTS). Bilic P, Christ PF, Vorontsov E et al (2019) The Liver Tumor Segmentation Benchmark (LiTS).
20.
Zurück zum Zitat Isensee F, Kickingereder P, Wick W, Bendszus M, Maier-Hein KH (2018) No New-Net. CoRR abs/1809.10483 Isensee F, Kickingereder P, Wick W, Bendszus M, Maier-Hein KH (2018) No New-Net. CoRR abs/1809.10483
21.
Zurück zum Zitat Ulyanov D, Vedaldi A, Lempitsky V Instance normalization: the missing ingredient for fast stylization. CoRR abs/1607.0 (2016), Ulyanov D, Vedaldi A, Lempitsky V Instance normalization: the missing ingredient for fast stylization. CoRR abs/1607.0 (2016),
22.
Zurück zum Zitat Abadi M, Barham P, Chen J et al (2016) Tensorflow: a system for large-scale machine learningOSDI, pp 265-283 Abadi M, Barham P, Chen J et al (2016) Tensorflow: a system for large-scale machine learningOSDI, pp 265-283
23.
Zurück zum Zitat Avants BB, Tustison N, Song G (2009) Advanced normalization tools (ANTS). Insight j 2:1-35 Avants BB, Tustison N, Song G (2009) Advanced normalization tools (ANTS). Insight j 2:1-35
24.
Zurück zum Zitat Simard PY, Steinkraus D, Platt JC (2003) Best practices for convolutional neural networks applied to visual document analysisSeventh International Conference on Document Analysis and Recognition, 2003 Proceedings, pp 958-963 Simard PY, Steinkraus D, Platt JC (2003) Best practices for convolutional neural networks applied to visual document analysisSeventh International Conference on Document Analysis and Recognition, 2003 Proceedings, pp 958-963
25.
Zurück zum Zitat Dice LR (1945) Measures of the amount of ecologic association between species. Ecology 26:297-302CrossRef Dice LR (1945) Measures of the amount of ecologic association between species. Ecology 26:297-302CrossRef
26.
Zurück zum Zitat Janowczyk A, Madabhushi A (2016) Deep learning for digital pathology image analysis: A comprehensive tutorial with selected use cases. Journal of pathology informatics 7 Janowczyk A, Madabhushi A (2016) Deep learning for digital pathology image analysis: A comprehensive tutorial with selected use cases. Journal of pathology informatics 7
27.
Zurück zum Zitat van Griethuysen JJM, Fedorov A, Parmar C et al (2017) Computational Radiomics System to Decode the Radiographic Phenotype. 77:e104-e107 van Griethuysen JJM, Fedorov A, Parmar C et al (2017) Computational Radiomics System to Decode the Radiographic Phenotype. 77:e104-e107
28.
Zurück zum Zitat Bandos AI, Rockette HE, Song T, Gur D (2009) Area under the free-response ROC curve (FROC) and a related summary index. Biometrics 65:247-256CrossRef Bandos AI, Rockette HE, Song T, Gur D (2009) Area under the free-response ROC curve (FROC) and a related summary index. Biometrics 65:247-256CrossRef
29.
Zurück zum Zitat Lin LI (1989) A concordance correlation coefficient to evaluate reproducibility. Biometrics 45:255-268CrossRef Lin LI (1989) A concordance correlation coefficient to evaluate reproducibility. Biometrics 45:255-268CrossRef
30.
Zurück zum Zitat Vorontsov E, Tang A, Pal C, Kadoury S (2018) Liver lesion segmentation informed by joint liver segmentation2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018), pp 1332-1335 Vorontsov E, Tang A, Pal C, Kadoury S (2018) Liver lesion segmentation informed by joint liver segmentation2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018), pp 1332-1335
31.
Zurück zum Zitat Chlebus G, Schenk A, Moltz JH, van Ginneken B, Hahn HK, Meine H (2018) Automatic liver tumor segmentation in CT with fully convolutional neural networks and object-based postprocessing. Sci Rep 8:15497CrossRef Chlebus G, Schenk A, Moltz JH, van Ginneken B, Hahn HK, Meine H (2018) Automatic liver tumor segmentation in CT with fully convolutional neural networks and object-based postprocessing. Sci Rep 8:15497CrossRef
32.
Zurück zum Zitat Bousabarah K, Ruge M, Brand J-S et al (2020) Deep convolutional neural networks for automated segmentation of brain metastases trained on clinical data. Radiation Oncology 15:1-9CrossRef Bousabarah K, Ruge M, Brand J-S et al (2020) Deep convolutional neural networks for automated segmentation of brain metastases trained on clinical data. Radiation Oncology 15:1-9CrossRef
33.
Zurück zum Zitat Kickingereder P, Isensee F, Tursunova I et al (2019) Automated quantitative tumour response assessment of MRI in neuro-oncology with artificial neural networks: a multicentre, retrospective study. The Lancet Oncology 20:728-740CrossRef Kickingereder P, Isensee F, Tursunova I et al (2019) Automated quantitative tumour response assessment of MRI in neuro-oncology with artificial neural networks: a multicentre, retrospective study. The Lancet Oncology 20:728-740CrossRef
34.
Zurück zum Zitat Azer SA (2019) Deep learning with convolutional neural networks for identification of liver masses and hepatocellular carcinoma: A systematic review. World Journal of Gastrointestinal Oncology 11:1218CrossRef Azer SA (2019) Deep learning with convolutional neural networks for identification of liver masses and hepatocellular carcinoma: A systematic review. World Journal of Gastrointestinal Oncology 11:1218CrossRef
35.
Zurück zum Zitat Hamm CA, Wang CJ, Savic LJ et al (2019) Deep learning for liver tumor diagnosis part I: development of a convolutional neural network classifier for multi-phasic MRI. European Radiology. 10.1007/s00330-019-06205-9CrossRefPubMedPubMedCentral Hamm CA, Wang CJ, Savic LJ et al (2019) Deep learning for liver tumor diagnosis part I: development of a convolutional neural network classifier for multi-phasic MRI. European Radiology. 10.1007/s00330-019-06205-9CrossRefPubMedPubMedCentral
36.
Zurück zum Zitat Wang CJ, Hamm CA, Savic LJ et al (2019) Deep learning for liver tumor diagnosis part II: convolutional neural network interpretation using radiologic imaging features. European Radiology. 10.1007/s00330-019-06214-8CrossRefPubMedPubMedCentral Wang CJ, Hamm CA, Savic LJ et al (2019) Deep learning for liver tumor diagnosis part II: convolutional neural network interpretation using radiologic imaging features. European Radiology. 10.1007/s00330-019-06214-8CrossRefPubMedPubMedCentral
37.
Zurück zum Zitat Shi W, Kuang S, Cao S et al (2020) Deep learning assisted differentiation of hepatocellular carcinoma from focal liver lesions: choice of four-phase and three-phase CT imaging protocol. Abdominal Radiology (New York) Shi W, Kuang S, Cao S et al (2020) Deep learning assisted differentiation of hepatocellular carcinoma from focal liver lesions: choice of four-phase and three-phase CT imaging protocol. Abdominal Radiology (New York)
Metadaten
Titel
Automated detection and delineation of hepatocellular carcinoma on multiphasic contrast-enhanced MRI using deep learning
verfasst von
Khaled Bousabarah
Brian Letzen
Jonathan Tefera
Lynn Savic
Isabel Schobert
Todd Schlachter
Lawrence H. Staib
Martin Kocher
Julius Chapiro
MingDe Lin
Publikationsdatum
04.06.2020
Verlag
Springer US
Erschienen in
Abdominal Radiology / Ausgabe 1/2021
Print ISSN: 2366-004X
Elektronische ISSN: 2366-0058
DOI
https://doi.org/10.1007/s00261-020-02604-5

Weitere Artikel der Ausgabe 1/2021

Abdominal Radiology 1/2021 Zur Ausgabe

Special Section: Liver Transplantation

Liver transplantation: current and future

Special Section: Liver Transplantation

Sonography of liver transplantation

Darf man die Behandlung eines Neonazis ablehnen?

08.05.2024 Gesellschaft Nachrichten

In einer Leseranfrage in der Zeitschrift Journal of the American Academy of Dermatology möchte ein anonymer Dermatologe bzw. eine anonyme Dermatologin wissen, ob er oder sie einen Patienten behandeln muss, der eine rassistische Tätowierung trägt.

Ein Drittel der jungen Ärztinnen und Ärzte erwägt abzuwandern

07.05.2024 Klinik aktuell Nachrichten

Extreme Arbeitsverdichtung und kaum Supervision: Dr. Andrea Martini, Sprecherin des Bündnisses Junge Ärztinnen und Ärzte (BJÄ) über den Frust des ärztlichen Nachwuchses und die Vorteile des Rucksack-Modells.

Endlich: Zi zeigt, mit welchen PVS Praxen zufrieden sind

IT für Ärzte Nachrichten

Darauf haben viele Praxen gewartet: Das Zi hat eine Liste von Praxisverwaltungssystemen veröffentlicht, die von Nutzern positiv bewertet werden. Eine gute Grundlage für wechselwillige Ärztinnen und Psychotherapeuten.

Akuter Schwindel: Wann lohnt sich eine MRT?

28.04.2024 Schwindel Nachrichten

Akuter Schwindel stellt oft eine diagnostische Herausforderung dar. Wie nützlich dabei eine MRT ist, hat eine Studie aus Finnland untersucht. Immerhin einer von sechs Patienten wurde mit akutem ischämischem Schlaganfall diagnostiziert.

Update Radiologie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.