Skip to main content
Erschienen in: European Radiology 2/2020

02.09.2019 | Imaging Informatics and Artificial Intelligence

Deep learning with ultrasonography: automated classification of liver fibrosis using a deep convolutional neural network

verfasst von: Jeong Hyun Lee, Ijin Joo, Tae Wook Kang, Yong Han Paik, Dong Hyun Sinn, Sang Yun Ha, Kyunga Kim, Choonghwan Choi, Gunwoo Lee, Jonghyon Yi, Won-Chul Bang

Erschienen in: European Radiology | Ausgabe 2/2020

Einloggen, um Zugang zu erhalten

Abstract

Objectives

The aim of this study was to develop a deep convolutional neural network (DCNN) for the prediction of the METAVIR score using B-mode ultrasonography images.

Methods

Datasets from two tertiary academic referral centers were used. A total of 13,608 ultrasonography images from 3446 patients who underwent surgical resection, biopsy, or transient elastography were used for training a DCNN for the prediction of the METAVIR score. Pathological specimens or estimated METAVIR scores derived from transient elastography were used as a reference standard. A four-class model (F0 vs. F1 vs. F23 vs. F4) was developed. Diagnostic performance of the algorithm was validated on a separate internal test set of 266 patients with 300 images and external test set of 572 patients with 1232 images. Performance in classification of cirrhosis was compared between the DCNN and five radiologists.

Results

The accuracy of the four-class model was 83.5% and 76.4% on the internal and external test set, respectively. The area under the receiver operating characteristic curve (AUC) for classification of cirrhosis (F4) was 0.901 (95% confidence interval [CI], 0.865–0.937) on the internal test set and 0.857 (95% CI, 0.825–0.889) on the external test set, respectively. The AUC of the DCNN for classification of cirrhosis (0.857) was significantly higher than that of all five radiologists (AUC range, 0.656–0.816; p value < 0.05) using the external test set.

Conclusions

The DCNN showed high accuracy for determining METAVIR score using ultrasonography images and achieved better performance than that of radiologists in the diagnosis of cirrhosis.

Key Points

DCNN accurately classified the ultrasonography images according to the METAVIR score.
The AUROC of this algorithm for cirrhosis assessment was significantly higher than that of radiologists.
DCNN using US images may offer an alternative tool for monitoring liver fibrosis.
Anhänge
Nur mit Berechtigung zugänglich
Literatur
1.
Zurück zum Zitat GBD 2013 Mortality and Causes of Death Collaborators (2015) Global, regional, and national age-sex specific all-cause and cause-specific mortality for 240 causes of death, 1990-2013: a systematic analysis for the Global Burden of Disease Study 2013. Lancet 385:117–171 GBD 2013 Mortality and Causes of Death Collaborators (2015) Global, regional, and national age-sex specific all-cause and cause-specific mortality for 240 causes of death, 1990-2013: a systematic analysis for the Global Burden of Disease Study 2013. Lancet 385:117–171
2.
Zurück zum Zitat Manning DS, Afdhal NH (2008) Diagnosis and quantitation of fibrosis. Gastroenterology 134:1670–1681CrossRef Manning DS, Afdhal NH (2008) Diagnosis and quantitation of fibrosis. Gastroenterology 134:1670–1681CrossRef
3.
Zurück zum Zitat Vergniol J, Foucher J, Terrebonne E et al (2011) Noninvasive tests for fibrosis and liver stiffness predict 5-year outcomes of patients with chronic hepatitis C. Gastroenterology 140:1970–1979 1979 e1971–1973CrossRef Vergniol J, Foucher J, Terrebonne E et al (2011) Noninvasive tests for fibrosis and liver stiffness predict 5-year outcomes of patients with chronic hepatitis C. Gastroenterology 140:1970–1979 1979 e1971–1973CrossRef
4.
Zurück zum Zitat Seeff LB, Everson GT, Morgan TR et al (2010) Complication rate of percutaneous liver biopsies among persons with advanced chronic liver disease in the HALT-C trial. Clin Gastroenterol Hepatol 8:877–883CrossRef Seeff LB, Everson GT, Morgan TR et al (2010) Complication rate of percutaneous liver biopsies among persons with advanced chronic liver disease in the HALT-C trial. Clin Gastroenterol Hepatol 8:877–883CrossRef
5.
Zurück zum Zitat Stotland BR, Lichtenstein GR (1996) Liver biopsy complications and routine ultrasound. Am J Gastroenterol 91:1295–1296PubMed Stotland BR, Lichtenstein GR (1996) Liver biopsy complications and routine ultrasound. Am J Gastroenterol 91:1295–1296PubMed
6.
Zurück zum Zitat Guido M, Rugge M (2004) Liver biopsy sampling in chronic viral hepatitis. Semin Liver Dis 24:89–97PubMed Guido M, Rugge M (2004) Liver biopsy sampling in chronic viral hepatitis. Semin Liver Dis 24:89–97PubMed
7.
Zurück zum Zitat European Association for Study of Liver; Asociacion Latinoamericana para el Estudio del Higado (2015) EASL-ALEH clinical practice guidelines: non-invasive tests for evaluation of liver disease severity and prognosis. J Hepatol 63:237–264 European Association for Study of Liver; Asociacion Latinoamericana para el Estudio del Higado (2015) EASL-ALEH clinical practice guidelines: non-invasive tests for evaluation of liver disease severity and prognosis. J Hepatol 63:237–264
8.
Zurück zum Zitat Dietrich CF, Bamber J, Berzigotti A et al (2017) EFSUMB guidelines and recommendations on the clinical use of liver ultrasound elastography, update 2017 (long version). Ultraschall Med 38:e48PubMed Dietrich CF, Bamber J, Berzigotti A et al (2017) EFSUMB guidelines and recommendations on the clinical use of liver ultrasound elastography, update 2017 (long version). Ultraschall Med 38:e48PubMed
9.
Zurück zum Zitat Ravaioli F, Montagnani M, Lisotti A, Festi D, Mazzella G, Azzaroli F (2018) Noninvasive assessment of portal hypertension in advanced chronic liver disease: an update. Gastroenterol Res Pract 2018:4202091CrossRef Ravaioli F, Montagnani M, Lisotti A, Festi D, Mazzella G, Azzaroli F (2018) Noninvasive assessment of portal hypertension in advanced chronic liver disease: an update. Gastroenterol Res Pract 2018:4202091CrossRef
10.
Zurück zum Zitat Cainelli F (2012) Liver diseases in developing countries. World J Hepatol 4:66–67CrossRef Cainelli F (2012) Liver diseases in developing countries. World J Hepatol 4:66–67CrossRef
11.
Zurück zum Zitat Tsochatzis EA, Bosch J, Burroughs AK (2014) Liver cirrhosis. Lancet 383:1749–1761CrossRef Tsochatzis EA, Bosch J, Burroughs AK (2014) Liver cirrhosis. Lancet 383:1749–1761CrossRef
12.
Zurück zum Zitat Choi KJ, Jang JK, Lee SS et al (2018) Development and validation of a deep learning system for staging liver fibrosis by using contrast agent-enhanced CT images in the liver. Radiology 289:688–697CrossRef Choi KJ, Jang JK, Lee SS et al (2018) Development and validation of a deep learning system for staging liver fibrosis by using contrast agent-enhanced CT images in the liver. Radiology 289:688–697CrossRef
13.
Zurück zum Zitat Yasaka K, Akai H, Kunimatsu A, Abe O, Kiryu S (2018) Deep learning for staging liver fibrosis on CT: a pilot study. Eur Radiol 28:4578–4585CrossRef Yasaka K, Akai H, Kunimatsu A, Abe O, Kiryu S (2018) Deep learning for staging liver fibrosis on CT: a pilot study. Eur Radiol 28:4578–4585CrossRef
14.
Zurück zum Zitat Yasaka K, Akai H, Kunimatsu A, Abe O, Kiryu S (2018) Liver fibrosis: deep convolutional neural network for staging by using gadoxetic acid-enhanced hepatobiliary phase MR images. Radiology 287:146–155CrossRef Yasaka K, Akai H, Kunimatsu A, Abe O, Kiryu S (2018) Liver fibrosis: deep convolutional neural network for staging by using gadoxetic acid-enhanced hepatobiliary phase MR images. Radiology 287:146–155CrossRef
15.
Zurück zum Zitat Forner A, Reig M, Bruix J (2018) Hepatocellular carcinoma. Lancet 391:1301–1314 Forner A, Reig M, Bruix J (2018) Hepatocellular carcinoma. Lancet 391:1301–1314
16.
Zurück zum Zitat Tang A, Cloutier G, Szeverenyi NM, Sirlin CB (2015) Ultrasound elastography and MR elastography for assessing liver fibrosis: part 2, diagnostic performance, confounders, and future directions. AJR Am J Roentgenol 205:33–40CrossRef Tang A, Cloutier G, Szeverenyi NM, Sirlin CB (2015) Ultrasound elastography and MR elastography for assessing liver fibrosis: part 2, diagnostic performance, confounders, and future directions. AJR Am J Roentgenol 205:33–40CrossRef
17.
Zurück zum Zitat Castéra L, Vergniol J, Foucher J et al (2005) Prospective comparison of transient elastography, fibrotest, APRI, and liver biopsy for the assessment of fibrosis in chronic hepatitis C. Gastroenterology 128:343–350CrossRef Castéra L, Vergniol J, Foucher J et al (2005) Prospective comparison of transient elastography, fibrotest, APRI, and liver biopsy for the assessment of fibrosis in chronic hepatitis C. Gastroenterology 128:343–350CrossRef
18.
Zurück zum Zitat Rousselet MC, Michalak S, Dupré F et al (2005) Sources of variability in histological scoring of chronic viral hepatitis. Hepatology 41:257–264CrossRef Rousselet MC, Michalak S, Dupré F et al (2005) Sources of variability in histological scoring of chronic viral hepatitis. Hepatology 41:257–264CrossRef
19.
Zurück zum Zitat Cardoso AC, Carvalho-Filho RJ, Stern C et al (2012) Direct comparison of diagnostic performance of transient elastography in patients with chronic hepatitis B and chronic hepatitis C. Liver Int 32:612–621CrossRef Cardoso AC, Carvalho-Filho RJ, Stern C et al (2012) Direct comparison of diagnostic performance of transient elastography in patients with chronic hepatitis B and chronic hepatitis C. Liver Int 32:612–621CrossRef
20.
Zurück zum Zitat Singh S, Muir AJ, Dieterich DT, Falck-Ytter YT (2017) American Gastroenterological Association Institute technical review on the role of elastography in chronic liver diseases. Gastroenterology 152:1544–1577CrossRef Singh S, Muir AJ, Dieterich DT, Falck-Ytter YT (2017) American Gastroenterological Association Institute technical review on the role of elastography in chronic liver diseases. Gastroenterology 152:1544–1577CrossRef
21.
Zurück zum Zitat Simonyan K, Vedaldi A, Zisserman A (2014) Deep inside convolutional networks: visualising image classification models and saliency maps. arXiv:1312.6034 Simonyan K, Vedaldi A, Zisserman A (2014) Deep inside convolutional networks: visualising image classification models and saliency maps. arXiv:1312.6034
22.
Zurück zum Zitat LeCun Y, Bengio Y, Hinton G (2015) Deep learning. Nature 521:436–444CrossRef LeCun Y, Bengio Y, Hinton G (2015) Deep learning. Nature 521:436–444CrossRef
23.
Zurück zum Zitat Yeom SK, Lee CH, Cha SH, Park CM (2015) Prediction of liver cirrhosis, using diagnostic imaging tools. World J Hepatol 7:2069–2079CrossRef Yeom SK, Lee CH, Cha SH, Park CM (2015) Prediction of liver cirrhosis, using diagnostic imaging tools. World J Hepatol 7:2069–2079CrossRef
24.
Zurück zum Zitat Huber A, Ebner L, Heverhagen JT, Christe A (2015) State-of-the-art imaging of liver fibrosis and cirrhosis: a comprehensive review of current applications and future perspectives. Eur J Radiol Open 2:90–100CrossRef Huber A, Ebner L, Heverhagen JT, Christe A (2015) State-of-the-art imaging of liver fibrosis and cirrhosis: a comprehensive review of current applications and future perspectives. Eur J Radiol Open 2:90–100CrossRef
25.
Zurück zum Zitat Lim JK, Flamm SL, Singh S, Falck-Ytter YT, Clinical Guidelines Committee of the American Gastroenterological Association (2017) American Gastroenterological Association Institute guideline on the role of elastography in the evaluation of liver fibrosis. Gastroenterology 152:1536–1543 Lim JK, Flamm SL, Singh S, Falck-Ytter YT, Clinical Guidelines Committee of the American Gastroenterological Association (2017) American Gastroenterological Association Institute guideline on the role of elastography in the evaluation of liver fibrosis. Gastroenterology 152:1536–1543
26.
Zurück zum Zitat Lee JG, Jun S, Cho YW et al (2017) Deep learning in medical imaging: general overview. Korean J Radiol 18:570–584CrossRef Lee JG, Jun S, Cho YW et al (2017) Deep learning in medical imaging: general overview. Korean J Radiol 18:570–584CrossRef
27.
Zurück zum Zitat Esteva A, Kuprel B, Novoa RA et al (2017) Dermatologist-level classification of skin cancer with deep neural networks. Nature 542:115–118CrossRef Esteva A, Kuprel B, Novoa RA et al (2017) Dermatologist-level classification of skin cancer with deep neural networks. Nature 542:115–118CrossRef
28.
Zurück zum Zitat Lakhani P, Sundaram B (2017) Deep learning at chest radiography: automated classification of pulmonary tuberculosis by using convolutional neural networks. Radiology 284:574–582CrossRef Lakhani P, Sundaram B (2017) Deep learning at chest radiography: automated classification of pulmonary tuberculosis by using convolutional neural networks. Radiology 284:574–582CrossRef
29.
Zurück zum Zitat Ting DSW, Cheung CY, Lim G et al (2017) Development and validation of a deep learning system for diabetic retinopathy and related eye diseases using retinal images from multiethnic populations with diabetes. JAMA 318:2211–2223CrossRef Ting DSW, Cheung CY, Lim G et al (2017) Development and validation of a deep learning system for diabetic retinopathy and related eye diseases using retinal images from multiethnic populations with diabetes. JAMA 318:2211–2223CrossRef
30.
Zurück zum Zitat Hu P, Wu F, Peng J, Liang P, Kong D (2016) Automatic 3D liver segmentation based on deep learning and globally optimized surface evolution. Phys Med Biol 61:8676–8698CrossRef Hu P, Wu F, Peng J, Liang P, Kong D (2016) Automatic 3D liver segmentation based on deep learning and globally optimized surface evolution. Phys Med Biol 61:8676–8698CrossRef
31.
Zurück zum Zitat Hamm CA, Wang CJ, Savic LJ et al (2019) Deep learning for liver tumor diagnosis part I: development of a convolutional neural network classifier for multi-phasic MRI. Eur Radiol 29:3338–3347CrossRef Hamm CA, Wang CJ, Savic LJ et al (2019) Deep learning for liver tumor diagnosis part I: development of a convolutional neural network classifier for multi-phasic MRI. Eur Radiol 29:3338–3347CrossRef
32.
Zurück zum Zitat Vigano M, Visentin S, Aghemo A, Rumi MG, Ronchi G (2005) US features of liver surface nodularity as a predictor of severe fibrosis in chronic hepatitis C. Radiology 234:641 author reply 641CrossRef Vigano M, Visentin S, Aghemo A, Rumi MG, Ronchi G (2005) US features of liver surface nodularity as a predictor of severe fibrosis in chronic hepatitis C. Radiology 234:641 author reply 641CrossRef
33.
Zurück zum Zitat Lee CH, Choi JW, Kim KA, Seo TS, Lee JM, Park CM (2006) Usefulness of standard deviation on the histogram of ultrasound as a quantitative value for hepatic parenchymal echo texture; preliminary study. Ultrasound Med Biol 32:1817–1826CrossRef Lee CH, Choi JW, Kim KA, Seo TS, Lee JM, Park CM (2006) Usefulness of standard deviation on the histogram of ultrasound as a quantitative value for hepatic parenchymal echo texture; preliminary study. Ultrasound Med Biol 32:1817–1826CrossRef
34.
Zurück zum Zitat Colli A, Fraquelli M, Andreoletti M, Marino B, Zuccoli E, Conte D (2003) Severe liver fibrosis or cirrhosis: accuracy of US for detection--analysis of 300 cases. Radiology 227:89–94CrossRef Colli A, Fraquelli M, Andreoletti M, Marino B, Zuccoli E, Conte D (2003) Severe liver fibrosis or cirrhosis: accuracy of US for detection--analysis of 300 cases. Radiology 227:89–94CrossRef
35.
Zurück zum Zitat Soresi M, Giannitrapani L, Cervello M, Licata A, Montalto G (2014) Non invasive tools for the diagnosis of liver cirrhosis. World J Gastroenterol 20:18131–18150CrossRef Soresi M, Giannitrapani L, Cervello M, Licata A, Montalto G (2014) Non invasive tools for the diagnosis of liver cirrhosis. World J Gastroenterol 20:18131–18150CrossRef
36.
Zurück zum Zitat Berzigotti A, Abraldes JG, Tandon P et al (2010) Ultrasonographic evaluation of liver surface and transient elastography in clinically doubtful cirrhosis. J Hepatol 52:846–853CrossRef Berzigotti A, Abraldes JG, Tandon P et al (2010) Ultrasonographic evaluation of liver surface and transient elastography in clinically doubtful cirrhosis. J Hepatol 52:846–853CrossRef
37.
Zurück zum Zitat Li R, Hua X, Guo Y, Zhang P, Guo A (2006) Neighborhood-pixels algorithm combined with Sono-CT in the diagnosis of cirrhosis: an experimental study. Ultrasound Med Biol 32:1515–1520CrossRef Li R, Hua X, Guo Y, Zhang P, Guo A (2006) Neighborhood-pixels algorithm combined with Sono-CT in the diagnosis of cirrhosis: an experimental study. Ultrasound Med Biol 32:1515–1520CrossRef
38.
Zurück zum Zitat Castelvecchi D (2016) Can we open the black box of AI? Nature 538:20–23CrossRef Castelvecchi D (2016) Can we open the black box of AI? Nature 538:20–23CrossRef
39.
Zurück zum Zitat Park SH, Han K (2018) Methodologic guide for evaluating clinical performance and effect of artificial intelligence technology for medical diagnosis and prediction. Radiology 286:800–809CrossRef Park SH, Han K (2018) Methodologic guide for evaluating clinical performance and effect of artificial intelligence technology for medical diagnosis and prediction. Radiology 286:800–809CrossRef
Metadaten
Titel
Deep learning with ultrasonography: automated classification of liver fibrosis using a deep convolutional neural network
verfasst von
Jeong Hyun Lee
Ijin Joo
Tae Wook Kang
Yong Han Paik
Dong Hyun Sinn
Sang Yun Ha
Kyunga Kim
Choonghwan Choi
Gunwoo Lee
Jonghyon Yi
Won-Chul Bang
Publikationsdatum
02.09.2019
Verlag
Springer Berlin Heidelberg
Erschienen in
European Radiology / Ausgabe 2/2020
Print ISSN: 0938-7994
Elektronische ISSN: 1432-1084
DOI
https://doi.org/10.1007/s00330-019-06407-1

Weitere Artikel der Ausgabe 2/2020

European Radiology 2/2020 Zur Ausgabe

Darf man die Behandlung eines Neonazis ablehnen?

08.05.2024 Gesellschaft Nachrichten

In einer Leseranfrage in der Zeitschrift Journal of the American Academy of Dermatology möchte ein anonymer Dermatologe bzw. eine anonyme Dermatologin wissen, ob er oder sie einen Patienten behandeln muss, der eine rassistische Tätowierung trägt.

Ein Drittel der jungen Ärztinnen und Ärzte erwägt abzuwandern

07.05.2024 Klinik aktuell Nachrichten

Extreme Arbeitsverdichtung und kaum Supervision: Dr. Andrea Martini, Sprecherin des Bündnisses Junge Ärztinnen und Ärzte (BJÄ) über den Frust des ärztlichen Nachwuchses und die Vorteile des Rucksack-Modells.

Endlich: Zi zeigt, mit welchen PVS Praxen zufrieden sind

IT für Ärzte Nachrichten

Darauf haben viele Praxen gewartet: Das Zi hat eine Liste von Praxisverwaltungssystemen veröffentlicht, die von Nutzern positiv bewertet werden. Eine gute Grundlage für wechselwillige Ärztinnen und Psychotherapeuten.

Akuter Schwindel: Wann lohnt sich eine MRT?

28.04.2024 Schwindel Nachrichten

Akuter Schwindel stellt oft eine diagnostische Herausforderung dar. Wie nützlich dabei eine MRT ist, hat eine Studie aus Finnland untersucht. Immerhin einer von sechs Patienten wurde mit akutem ischämischem Schlaganfall diagnostiziert.

Update Radiologie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.