Skip to main content
Erschienen in: European Radiology 3/2022

18.10.2021 | Ultrasound

An integrated AI model to improve diagnostic accuracy of ultrasound and output known risk features in suspicious thyroid nodules

verfasst von: Juan Wang, Jue Jiang, Dong Zhang, Yao-zhong Zhang, Long Guo, Yusheng Jiang, Shaoyi Du, Qi Zhou

Erschienen in: European Radiology | Ausgabe 3/2022

Einloggen, um Zugang zu erhalten

Abstract

Objectives

From the viewpoint of ultrasound (US) physicians, an ideal thyroid US computer-assisted diagnostic (CAD) system for thyroid cancer should perform well in suspicious thyroid nodules with atypical risk features and be able to output explainable results. This study aims to develop an explainable US CAD model for suspicious thyroid nodules.

Methods

A total of 2992 solid or almost-solid thyroid nodules were analyzed retrospectively. All nodules had pathological results (1070 malignancies and 1992 benignities) confirmed by ultrasound-guided fine-needle aspiration cytology and histopathology after thyroidectomy. A deep learning model (ResNet50) and a multiple risk features learning ensemble model (XGBoost) were used to train the US images of 2794 thyroid nodules. Then, an integrated AI model was generated by combining both models. The diagnostic accuracies of the three AI models (ResNet50, XGBoost, and the integrated model) were predicted in a testing set including 198 thyroid nodules and compared to the diagnostic efficacy of five ultrasonographers.

Results

The accuracy of the integrated model was 76.77%, while the mean accuracy of the ultrasonographers was 68.38%. Of the risk features, microcalcifications showed the highest contribution to the diagnosis of malignant nodules.

Conclusions

The integrated AI model in our study can improve the diagnostic accuracy of suspicious thyroid nodules and output the known risk features simultaneously, thus aiding in training young ultrasonographers by linking the explainable results to their clinical experience and advancing the acceptance of AI diagnosis for thyroid cancer in clinical practice.

Key Points

• We developed an artificial intelligence (AI) diagnosis model based on both deep learning and multiple risk feature ensemble learning methods.
• The AI diagnosis model showed higher diagnostic accuracy for suspicious thyroid nodules than ultrasonographers.
• The AI diagnosis model showed partial explainability by outputting the known risk features, thus aiding young ultrasonic doctors in increasing the diagnostic level for thyroid cancer.
Anhänge
Nur mit Berechtigung zugänglich
Literatur
1.
Zurück zum Zitat Sung H, Ferlay J, Siegel RL et al (2021) Global cancer statistics 2020: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA Cancer J Clin 71(3):209–249 Sung H, Ferlay J, Siegel RL et al (2021) Global cancer statistics 2020: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA Cancer J Clin 71(3):209–249
2.
Zurück zum Zitat Li M, Dal Maso L, Vaccarella S (2020) Global trends in thyroid cancer incidence and the impact of overdiagnosis. Lancet Diabetes Endocrinol 8(6):468–470CrossRef Li M, Dal Maso L, Vaccarella S (2020) Global trends in thyroid cancer incidence and the impact of overdiagnosis. Lancet Diabetes Endocrinol 8(6):468–470CrossRef
3.
Zurück zum Zitat Durante C, Grani G, Lamartina L, Filetti S, Mandel SJ, Cooper DS (2018) The diagnosis and management of thyroid nodules: a review. JAMA 319(9):914–924CrossRef Durante C, Grani G, Lamartina L, Filetti S, Mandel SJ, Cooper DS (2018) The diagnosis and management of thyroid nodules: a review. JAMA 319(9):914–924CrossRef
4.
Zurück zum Zitat Itani M, Assaker R, Moshiri M, Dubinsky TJ, Dighe MK (2019) Inter-observer variability in the American College of Radiology Thyroid Imaging Reporting and Data System: in-depth analysis and areas for improvement. Ultrasound Med Biol 45(2):461–470CrossRef Itani M, Assaker R, Moshiri M, Dubinsky TJ, Dighe MK (2019) Inter-observer variability in the American College of Radiology Thyroid Imaging Reporting and Data System: in-depth analysis and areas for improvement. Ultrasound Med Biol 45(2):461–470CrossRef
5.
Zurück zum Zitat Vaccarella S, Franceschi S, Bray F, Wild CP, Plummer M, Dal Maso L (2016) Worldwide thyroid-cancer epidemic? The increasing impact of overdiagnosis. N Engl J Med 375(7):614–617CrossRef Vaccarella S, Franceschi S, Bray F, Wild CP, Plummer M, Dal Maso L (2016) Worldwide thyroid-cancer epidemic? The increasing impact of overdiagnosis. N Engl J Med 375(7):614–617CrossRef
6.
Zurück zum Zitat Tessler FN, Middleton WD, Grant EG et al (2017) ACR Thyroid Imaging, Reporting and Data System (TI-RADS): white paper of the ACR TI-RADS Committee. J Am Coll Radiol 14(5):587–595CrossRef Tessler FN, Middleton WD, Grant EG et al (2017) ACR Thyroid Imaging, Reporting and Data System (TI-RADS): white paper of the ACR TI-RADS Committee. J Am Coll Radiol 14(5):587–595CrossRef
7.
Zurück zum Zitat Hoang JK, Middleton WD, Farjat AE et al (2018) Reduction in thyroid nodule biopsies and improved accuracy with American College of Radiology Thyroid Imaging Reporting and Data System. Radiology 287(1):185–193CrossRef Hoang JK, Middleton WD, Farjat AE et al (2018) Reduction in thyroid nodule biopsies and improved accuracy with American College of Radiology Thyroid Imaging Reporting and Data System. Radiology 287(1):185–193CrossRef
8.
Zurück zum Zitat Buda M, Wildman-Tobriner B, Hoang JK et al (2019) Management of thyroid nodules seen on US images: deep learning may match performance of radiologists. Radiology 292(3):695–701CrossRef Buda M, Wildman-Tobriner B, Hoang JK et al (2019) Management of thyroid nodules seen on US images: deep learning may match performance of radiologists. Radiology 292(3):695–701CrossRef
9.
Zurück zum Zitat Thomas J, Ledger GA, Mamillapalli CK (2020) Use of artificial intelligence and machine learning for estimating malignancy risk of thyroid nodules. Curr Opin Endocrinol Diabetes Obes 27(5):345–350CrossRef Thomas J, Ledger GA, Mamillapalli CK (2020) Use of artificial intelligence and machine learning for estimating malignancy risk of thyroid nodules. Curr Opin Endocrinol Diabetes Obes 27(5):345–350CrossRef
10.
Zurück zum Zitat Thomas J, Haertling T (2020) AIBx, Artificial intelligence model to risk stratify thyroid nodules. Thyroid 30(6):878–884CrossRef Thomas J, Haertling T (2020) AIBx, Artificial intelligence model to risk stratify thyroid nodules. Thyroid 30(6):878–884CrossRef
11.
Zurück zum Zitat Ye FY, Lyu GR, Li SQ et al (2021) Diagnostic performance of ultrasound computer-aided diagnosis software compared with that of radiologists with different levels of expertise for thyroid malignancy: a multicenter prospective study. Ultrasound Med Biol 47(1):114–124CrossRef Ye FY, Lyu GR, Li SQ et al (2021) Diagnostic performance of ultrasound computer-aided diagnosis software compared with that of radiologists with different levels of expertise for thyroid malignancy: a multicenter prospective study. Ultrasound Med Biol 47(1):114–124CrossRef
12.
Zurück zum Zitat Morid MA, Borjali A, Del Fiol G (2021) A scoping review of transfer learning research on medical image analysis using ImageNet. Comput Biol Med 128:104115CrossRef Morid MA, Borjali A, Del Fiol G (2021) A scoping review of transfer learning research on medical image analysis using ImageNet. Comput Biol Med 128:104115CrossRef
13.
Zurück zum Zitat Liu SF, Wang Y, Yang X (2019) Deep learning in medical ultrasound analysis: a review. Engineering 5:261–275CrossRef Liu SF, Wang Y, Yang X (2019) Deep learning in medical ultrasound analysis: a review. Engineering 5:261–275CrossRef
15.
Zurück zum Zitat Krizhevsky A, Sutskever I, Hinton G (2017) ImageNet classification with deep convolutional neural networks. Commun ACM 60(6):84–90CrossRef Krizhevsky A, Sutskever I, Hinton G (2017) ImageNet classification with deep convolutional neural networks. Commun ACM 60(6):84–90CrossRef
16.
Zurück zum Zitat Shin JH, Baek JH, Chung J et al (2016) Ultrasonography diagnosis and imaging-based management of thyroid nodules: revised Korean Society of Thyroid Radiology Consensus Statement and Recommendations. Korean J Radiol 17(3):370–395PubMedCentralCrossRef Shin JH, Baek JH, Chung J et al (2016) Ultrasonography diagnosis and imaging-based management of thyroid nodules: revised Korean Society of Thyroid Radiology Consensus Statement and Recommendations. Korean J Radiol 17(3):370–395PubMedCentralCrossRef
17.
Zurück zum Zitat Torlay L, Perrone-Bertolotti M, Thomas E, Baciu M (2017) Machine learning-XGBoost analysis of language networks to classify patients with epilepsy. Brain Inform 4(3):159–169PubMedCentralCrossRef Torlay L, Perrone-Bertolotti M, Thomas E, Baciu M (2017) Machine learning-XGBoost analysis of language networks to classify patients with epilepsy. Brain Inform 4(3):159–169PubMedCentralCrossRef
18.
Zurück zum Zitat Szczepanek-Parulska E, Wolinski K, Dobruch-Sobczak K et al (2020) S-Detect software vs. EU-TIRADS classification: a dual-center validation of diagnostic performance in differentiation of thyroid nodules. J Clin Med 9(8):2495PubMedCentralCrossRef Szczepanek-Parulska E, Wolinski K, Dobruch-Sobczak K et al (2020) S-Detect software vs. EU-TIRADS classification: a dual-center validation of diagnostic performance in differentiation of thyroid nodules. J Clin Med 9(8):2495PubMedCentralCrossRef
19.
Zurück zum Zitat Remonti LR, Kramer CK, Leitão CB, Pinto LC, Gross JL (2015) Thyroid ultrasound features and risk of carcinoma: a systematic review and meta-analysis of observational studies. Thyroid 25(5):538–550PubMedCentralCrossRef Remonti LR, Kramer CK, Leitão CB, Pinto LC, Gross JL (2015) Thyroid ultrasound features and risk of carcinoma: a systematic review and meta-analysis of observational studies. Thyroid 25(5):538–550PubMedCentralCrossRef
20.
Zurück zum Zitat Rosario PW, Mourão GF (2019) Noninvasive follicular thyroid neoplasm with papillary-like nuclear features (NIFTP): a review for clinicians. Endocr Relat Cancer 26(5):R259–R266CrossRef Rosario PW, Mourão GF (2019) Noninvasive follicular thyroid neoplasm with papillary-like nuclear features (NIFTP): a review for clinicians. Endocr Relat Cancer 26(5):R259–R266CrossRef
Metadaten
Titel
An integrated AI model to improve diagnostic accuracy of ultrasound and output known risk features in suspicious thyroid nodules
verfasst von
Juan Wang
Jue Jiang
Dong Zhang
Yao-zhong Zhang
Long Guo
Yusheng Jiang
Shaoyi Du
Qi Zhou
Publikationsdatum
18.10.2021
Verlag
Springer Berlin Heidelberg
Erschienen in
European Radiology / Ausgabe 3/2022
Print ISSN: 0938-7994
Elektronische ISSN: 1432-1084
DOI
https://doi.org/10.1007/s00330-021-08298-7

Weitere Artikel der Ausgabe 3/2022

European Radiology 3/2022 Zur Ausgabe

Mammakarzinom: Brustdichte beeinflusst rezidivfreies Überleben

26.05.2024 Mammakarzinom Nachrichten

Frauen, die zum Zeitpunkt der Brustkrebsdiagnose eine hohe mammografische Brustdichte aufweisen, haben ein erhöhtes Risiko für ein baldiges Rezidiv, legen neue Daten nahe.

„Übersichtlicher Wegweiser“: Lauterbachs umstrittener Klinik-Atlas ist online

17.05.2024 Klinik aktuell Nachrichten

Sie sei „ethisch geboten“, meint Gesundheitsminister Karl Lauterbach: mehr Transparenz über die Qualität von Klinikbehandlungen. Um sie abzubilden, lässt er gegen den Widerstand vieler Länder einen virtuellen Klinik-Atlas freischalten.

Klinikreform soll zehntausende Menschenleben retten

15.05.2024 Klinik aktuell Nachrichten

Gesundheitsminister Lauterbach hat die vom Bundeskabinett beschlossene Klinikreform verteidigt. Kritik an den Plänen kommt vom Marburger Bund. Und in den Ländern wird über den Gang zum Vermittlungsausschuss spekuliert.

Darf man die Behandlung eines Neonazis ablehnen?

08.05.2024 Gesellschaft Nachrichten

In einer Leseranfrage in der Zeitschrift Journal of the American Academy of Dermatology möchte ein anonymer Dermatologe bzw. eine anonyme Dermatologin wissen, ob er oder sie einen Patienten behandeln muss, der eine rassistische Tätowierung trägt.

Update Radiologie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.