Skip to main content
Erschienen in: Endocrine 1/2023

03.12.2022 | Original Article

Clinical evaluation of malignancy diagnosis of rare thyroid carcinomas by an artificial intelligent automatic diagnosis system

verfasst von: Yuan Wang, Lei Xu, Wenliang Lu, Xiangkai Kong, Kaiyuan Shi, Liping Wang, Dexing Kong

Erschienen in: Endocrine | Ausgabe 1/2023

Einloggen, um Zugang zu erhalten

Abstract

Purpose

To evaluate the application value of a generally trained artificial intelligence (AI) automatic diagnosis system in the malignancy diagnosis of rare thyroid carcinomas, such as follicular thyroid carcinoma, medullary thyroid carcinoma, primary thyroid lymphoma and anaplastic thyroid carcinoma and compare the diagnostic performance with radiologists of different experience levels.

Methods

We retrospectively studied 342 patients with 378 thyroid nodules that included 196 rare malignant nodules by using postoperative pathology as the gold standard, and compared the diagnostic performances of three radiologists (one junior, one mid-level, one senior) and that of AI automatic diagnosis system.

Results

The accuracy of the AI system in malignancy diagnosis was 0.825, which was significantly higher than that of all three radiologists and higher than the best radiologist in this study by a margin of 0.097 with P-value of 2.252 × 10−16. The mid-level radiologist and senior radiologist had higher sensitivity (0.857 and 0.959) than that of the AI system (0.847) at the cost of having much lower specificity (0.533, 0.478 versus 0.802). The junior radiologist showed relatively balanced sensitivity and specificity (0.816 and 0.549) but both were lower than that of the AI system.

Conclusions

The generally trained AI automatic diagnosis system showed high accuracy in the differential diagnosis of begin nodules and rare malignancy nodules. It may assist radiologists for screening of rare malignancy nodules that even senior radiologists are not acquainted with.
Literatur
1.
Zurück zum Zitat H.S. Ahn, H.G. Welch, South Korea’s thyroid cancer “Epidemic”-Turning the tide. N. Engl. J. Med. 373, 2389–2390 (2015)CrossRefPubMed H.S. Ahn, H.G. Welch, South Korea’s thyroid cancer “Epidemic”-Turning the tide. N. Engl. J. Med. 373, 2389–2390 (2015)CrossRefPubMed
2.
Zurück zum Zitat F. Bray, J. Ferlay, I. Soerjomataram, R.L. Siegel, L.A. Torre, A. Jemal, Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA Cancer J. Clin. 68, 394–424 (2018)CrossRefPubMed F. Bray, J. Ferlay, I. Soerjomataram, R.L. Siegel, L.A. Torre, A. Jemal, Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA Cancer J. Clin. 68, 394–424 (2018)CrossRefPubMed
3.
Zurück zum Zitat H. Lim, S.S. Devesa, J.A. Sosa, D. Check, C.M. Kitahara, Trends in thyroid cancer incidence and mortality in the United States, 1974-2013. JAMA 317(13), 1338–1348 (2017)CrossRefPubMedPubMedCentral H. Lim, S.S. Devesa, J.A. Sosa, D. Check, C.M. Kitahara, Trends in thyroid cancer incidence and mortality in the United States, 1974-2013. JAMA 317(13), 1338–1348 (2017)CrossRefPubMedPubMedCentral
4.
Zurück zum Zitat B.R. Haugen, E.K. Alexander, K.C. Bible et al. 2015 American Thyroid Association Management Guidelines for adult patients with thyroid nodules and differentiated thyroid cancer: the American Thyroid Association Guidelines Task Force on Thyroid Nodules and Differentiated Thyroid Cancer. Thyroid 26, 1–133 (2016)CrossRefPubMedPubMedCentral B.R. Haugen, E.K. Alexander, K.C. Bible et al. 2015 American Thyroid Association Management Guidelines for adult patients with thyroid nodules and differentiated thyroid cancer: the American Thyroid Association Guidelines Task Force on Thyroid Nodules and Differentiated Thyroid Cancer. Thyroid 26, 1–133 (2016)CrossRefPubMedPubMedCentral
5.
Zurück zum Zitat M. Sobrinho-Simoes, C. Eloy, J. Magalhaes, C. Lobo, T. Amaro, Follicular thyroid carcinoma. Mod. Pathol. 24, S10–S18 (2011)CrossRefPubMed M. Sobrinho-Simoes, C. Eloy, J. Magalhaes, C. Lobo, T. Amaro, Follicular thyroid carcinoma. Mod. Pathol. 24, S10–S18 (2011)CrossRefPubMed
6.
Zurück zum Zitat R.V. Lloyd, R.Y. Osamura, G. Kloppel, J. Rosai. WHO classification of tumours of endocrine organs 4th. (IARC Press, Lyon), 2017) R.V. Lloyd, R.Y. Osamura, G. Kloppel, J. Rosai. WHO classification of tumours of endocrine organs 4th. (IARC Press, Lyon), 2017)
7.
Zurück zum Zitat M.G. Chiofalo, R. D’Anna, F. Di Gennaro, S.V. Setola, V. Marotta, Great veins invasion in follicular thyroid cancer: single-centre study assessing prevalence and clinical outcome. Endocrine 62(1), 71–75 (2018)CrossRefPubMed M.G. Chiofalo, R. D’Anna, F. Di Gennaro, S.V. Setola, V. Marotta, Great veins invasion in follicular thyroid cancer: single-centre study assessing prevalence and clinical outcome. Endocrine 62(1), 71–75 (2018)CrossRefPubMed
8.
Zurück zum Zitat S.A. Wells Jr, S.L. Asa, H. Dralle et al. Revised American Thyroid Association guidelines for the management of medullary thyroid carcinoma. Thyroid 25(6), 567–610 (2015)CrossRefPubMedPubMedCentral S.A. Wells Jr, S.L. Asa, H. Dralle et al. Revised American Thyroid Association guidelines for the management of medullary thyroid carcinoma. Thyroid 25(6), 567–610 (2015)CrossRefPubMedPubMedCentral
9.
Zurück zum Zitat D. Viola, R. Elisei, Management of medullary thyroid cancern. Endocrinol. Metab. Clin. North Am. 48, 285–301 (2019)CrossRefPubMed D. Viola, R. Elisei, Management of medullary thyroid cancern. Endocrinol. Metab. Clin. North Am. 48, 285–301 (2019)CrossRefPubMed
10.
Zurück zum Zitat S.S. Aleskow, W. Leonard, Primary thyroid lymphoma: a clinical review. J. Clin. Endocrinol. Metab. 98, 3131–3138 (2013)CrossRef S.S. Aleskow, W. Leonard, Primary thyroid lymphoma: a clinical review. J. Clin. Endocrinol. Metab. 98, 3131–3138 (2013)CrossRef
11.
Zurück zum Zitat G. Russ, S.J. Bonnema, M.F. Erdogan, C. Durante, R. Ngu, L. Leenhardt, European Thyroid Association Guidelines for ultrasound malignancy risk stratification of thyroid nodules in adults: the EU-TIRADS. Eur. Thyroid J. 6, 225–237 (2017)CrossRefPubMedPubMedCentral G. Russ, S.J. Bonnema, M.F. Erdogan, C. Durante, R. Ngu, L. Leenhardt, European Thyroid Association Guidelines for ultrasound malignancy risk stratification of thyroid nodules in adults: the EU-TIRADS. Eur. Thyroid J. 6, 225–237 (2017)CrossRefPubMedPubMedCentral
12.
Zurück zum Zitat F.N. Tessler, W.D. Middleton, E.G. Grant et al. ACR thyroid imaging, reporting and data system (TI-RADS): white paper of the ACR TIRADS Committee. J. Am. Coll. Radio. 14, 587–595 (2017)CrossRef F.N. Tessler, W.D. Middleton, E.G. Grant et al. ACR thyroid imaging, reporting and data system (TI-RADS): white paper of the ACR TIRADS Committee. J. Am. Coll. Radio. 14, 587–595 (2017)CrossRef
13.
Zurück zum Zitat V. Marotta, M. Bifulco, M. Vitale, Significance of RAS mutations in thyroid benign nodules and non-medullary thyroid cancer. Cancers 13(15), 3785 (2021)CrossRefPubMedPubMedCentral V. Marotta, M. Bifulco, M. Vitale, Significance of RAS mutations in thyroid benign nodules and non-medullary thyroid cancer. Cancers 13(15), 3785 (2021)CrossRefPubMedPubMedCentral
14.
Zurück zum Zitat A. Guerra, V. Di Stasi, P. Zeppa, A. Faggiano, V. Marotta, M. Vitale, BRAF (V600E) assessment by pyrosequencing in fine needle aspirates of thyroid nodules with concurrent Hashimoto’s thyroiditis is a reliable assay. Endocrine 45(2), 249–255 (2014)CrossRefPubMed A. Guerra, V. Di Stasi, P. Zeppa, A. Faggiano, V. Marotta, M. Vitale, BRAF (V600E) assessment by pyrosequencing in fine needle aspirates of thyroid nodules with concurrent Hashimoto’s thyroiditis is a reliable assay. Endocrine 45(2), 249–255 (2014)CrossRefPubMed
15.
Zurück zum Zitat V. Marotta, M.R. Sapio, A. Guerra, M. Vitale, BRAF mutation in cytology samples as a diagnostic tool for papillary thyroid carcinoma. Expert Opin. Med Diagn. 5(4), 277–290 (2011)CrossRefPubMed V. Marotta, M.R. Sapio, A. Guerra, M. Vitale, BRAF mutation in cytology samples as a diagnostic tool for papillary thyroid carcinoma. Expert Opin. Med Diagn. 5(4), 277–290 (2011)CrossRefPubMed
17.
Zurück zum Zitat T. Syeda-Mahmood, Role of big data and machine learning in diagnostic decision support in radiology. J. Am. Coll. Radio. 15, 569–576 (2018)CrossRef T. Syeda-Mahmood, Role of big data and machine learning in diagnostic decision support in radiology. J. Am. Coll. Radio. 15, 569–576 (2018)CrossRef
18.
Zurück zum Zitat J. Ma, F. Wu, T. Jiang, J. Zhu, D. Xu, D. Kong, A pre-trained convolutional neural network based method for thyroid nodule diagnosis. Ultrasonics 73, 221–230 (2017)CrossRefPubMed J. Ma, F. Wu, T. Jiang, J. Zhu, D. Xu, D. Kong, A pre-trained convolutional neural network based method for thyroid nodule diagnosis. Ultrasonics 73, 221–230 (2017)CrossRefPubMed
19.
Zurück zum Zitat Z. Jin, Y. Zhu, S. Zhang et al. Ultrasound computer-aided diagnosis (CAD) based on the thyroid imaging reporting and data system (TI-RADS) to distinguish benign from malignant thyroid nodules and the diagnostic performance of radiologists with different diagnostic experience. Med Sci. Monit. 26, e918452 (2020)CrossRefPubMedPubMedCentral Z. Jin, Y. Zhu, S. Zhang et al. Ultrasound computer-aided diagnosis (CAD) based on the thyroid imaging reporting and data system (TI-RADS) to distinguish benign from malignant thyroid nodules and the diagnostic performance of radiologists with different diagnostic experience. Med Sci. Monit. 26, e918452 (2020)CrossRefPubMedPubMedCentral
20.
Zurück zum Zitat Z. Akkus, J. Cai, A. Boonrod, A. Zeinoddini, B. Erickson, A survey of deep-learning applications in ultrasound: artificial intelligence-powered ultrasound for improving clinical workflow. J. Am. Coll. Radiol. 16, 1318–1328 (2019)CrossRefPubMed Z. Akkus, J. Cai, A. Boonrod, A. Zeinoddini, B. Erickson, A survey of deep-learning applications in ultrasound: artificial intelligence-powered ultrasound for improving clinical workflow. J. Am. Coll. Radiol. 16, 1318–1328 (2019)CrossRefPubMed
21.
Zurück zum Zitat F.N. Tessler, W.D. Middleton, E.G. Grant et al. ACR thyroid imaging, reporting and data system (TI-RADS): White paper of the ACR TI-RADS Committee. J Am Coll Radiol 2017 paper of the ACR Thyroid Imaging, Reporting and Data System (TIRADS) Committee. J. Am. Coll. Radio. 12, 1272–1279 (2015) F.N. Tessler, W.D. Middleton, E.G. Grant et al. ACR thyroid imaging, reporting and data system (TI-RADS): White paper of the ACR TI-RADS Committee. J Am Coll Radiol 2017 paper of the ACR Thyroid Imaging, Reporting and Data System (TIRADS) Committee. J. Am. Coll. Radio. 12, 1272–1279 (2015)
22.
Zurück zum Zitat M. Tan, Q.V. Le, Efficientnet: rethinking model scaling for convolutional neural networks. Int. Conf. Mach. Learn. 97, 6105–6114 (2019) M. Tan, Q.V. Le, Efficientnet: rethinking model scaling for convolutional neural networks. Int. Conf. Mach. Learn. 97, 6105–6114 (2019)
24.
Zurück zum Zitat P. Sui et al. Deep learning-based artificial intelligence model to assist thyroid nodule diagnosis and management: a multicentre diagnostic study. Lancet Digit Health 3(4), e250–e259 (2021)CrossRef P. Sui et al. Deep learning-based artificial intelligence model to assist thyroid nodule diagnosis and management: a multicentre diagnostic study. Lancet Digit Health 3(4), e250–e259 (2021)CrossRef
25.
Zurück zum Zitat W. Mai, M. Zhou, J. Li, W. Yi, S. Li, Y. Hu et al. The value of the Demetics ultrasound-assisted diagnosis system in the differential diagnosis of benign from malignant thyroid nodules and analysis of the influencing factors. Eur. Radio. 31(10), 7936–7944 (2021)CrossRef W. Mai, M. Zhou, J. Li, W. Yi, S. Li, Y. Hu et al. The value of the Demetics ultrasound-assisted diagnosis system in the differential diagnosis of benign from malignant thyroid nodules and analysis of the influencing factors. Eur. Radio. 31(10), 7936–7944 (2021)CrossRef
Metadaten
Titel
Clinical evaluation of malignancy diagnosis of rare thyroid carcinomas by an artificial intelligent automatic diagnosis system
verfasst von
Yuan Wang
Lei Xu
Wenliang Lu
Xiangkai Kong
Kaiyuan Shi
Liping Wang
Dexing Kong
Publikationsdatum
03.12.2022
Verlag
Springer US
Erschienen in
Endocrine / Ausgabe 1/2023
Print ISSN: 1355-008X
Elektronische ISSN: 1559-0100
DOI
https://doi.org/10.1007/s12020-022-03269-4

Weitere Artikel der Ausgabe 1/2023

Endocrine 1/2023 Zur Ausgabe

Leitlinien kompakt für die Innere Medizin

Mit medbee Pocketcards sicher entscheiden.

Seit 2022 gehört die medbee GmbH zum Springer Medizin Verlag

Erhebliches Risiko für Kehlkopfkrebs bei mäßiger Dysplasie

29.05.2024 Larynxkarzinom Nachrichten

Fast ein Viertel der Personen mit mäßig dysplastischen Stimmlippenläsionen entwickelt einen Kehlkopftumor. Solche Personen benötigen daher eine besonders enge ärztliche Überwachung.

Nach Herzinfarkt mit Typ-1-Diabetes schlechtere Karten als mit Typ 2?

29.05.2024 Herzinfarkt Nachrichten

Bei Menschen mit Typ-2-Diabetes sind die Chancen, einen Myokardinfarkt zu überleben, in den letzten 15 Jahren deutlich gestiegen – nicht jedoch bei Betroffenen mit Typ 1.

15% bedauern gewählte Blasenkrebs-Therapie

29.05.2024 Urothelkarzinom Nachrichten

Ob Patienten und Patientinnen mit neu diagnostiziertem Blasenkrebs ein Jahr später Bedauern über die Therapieentscheidung empfinden, wird einer Studie aus England zufolge von der Radikalität und dem Erfolg des Eingriffs beeinflusst.

Costims – das nächste heiße Ding in der Krebstherapie?

28.05.2024 Onkologische Immuntherapie Nachrichten

„Kalte“ Tumoren werden heiß – CD28-kostimulatorische Antikörper sollen dies ermöglichen. Am besten könnten diese in Kombination mit BiTEs und Checkpointhemmern wirken. Erste klinische Studien laufen bereits.

Update Innere Medizin

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.