Skip to main content

02.05.2024 | Scientific Article

Artificial intelligence improves resident detection of pediatric and young adult upper extremity fractures

verfasst von: John R. Zech, Chimere O. Ezuma, Shreya Patel, Collin R. Edwards, Russell Posner, Erin Hannon, Faith Williams, Sonali V. Lala, Zohaib Y. Ahmad, Matthew P. Moy, Tony T. Wong

Erschienen in: Skeletal Radiology

Einloggen, um Zugang zu erhalten

Abstract

Purpose

We wished to evaluate if an open-source artificial intelligence (AI) algorithm (https://​www.​childfx.​com) could improve performance of (1) subspecialized musculoskeletal radiologists, (2) radiology residents, and (3) pediatric residents in detecting pediatric and young adult upper extremity fractures.

Materials and methods

A set of evaluation radiographs drawn from throughout the upper extremity (elbow, hand/finger, humerus/shoulder/clavicle, wrist/forearm, and clavicle) from 240 unique patients at a single hospital was constructed (mean age 11.3 years, range 0–22 years, 37.9% female). Two fellowship-trained musculoskeletal radiologists, three radiology residents, and two pediatric residents were recruited as readers. Each reader interpreted each case initially without and then subsequently 3–4 weeks later with AI assistance and recorded if/where fracture was present.

Results

Access to AI significantly improved area under the receiver operator curve (AUC) of radiology residents (0.768 [0.730–0.806] without AI to 0.876 [0.845–0.908] with AI, P < 0.001) and pediatric residents (0.706 [0.659–0.753] without AI to 0.844 [0.805–0.883] with AI, P < 0.001) in identifying fracture, respectively. There was no evidence of improvement for subspecialized musculoskeletal radiology attendings in identifying fracture (AUC 0.867 [0.832–0.902] to 0.890 [0.856–0.924], P = 0.093). There was no evidence of difference between overall resident AUC with AI and subspecialist AUC without AI (resident with AI 0.863, attending without AI AUC 0.867, P = 0.856). Overall physician radiograph interpretation time was significantly lower with AI (38.9 s with AI vs. 52.1 s without AI, P = 0.030).

Conclusion

An openly accessible AI model significantly improved radiology and pediatric resident accuracy in detecting pediatric upper extremity fractures.
Literatur
1.
Zurück zum Zitat Hallas P, Ellingsen T. Errors in fracture diagnoses in the emergency department–characteristics of patients and diurnal variation. BMC Emerg Med. 2006;6:4.CrossRefPubMedPubMedCentral Hallas P, Ellingsen T. Errors in fracture diagnoses in the emergency department–characteristics of patients and diurnal variation. BMC Emerg Med. 2006;6:4.CrossRefPubMedPubMedCentral
2.
Zurück zum Zitat Whang JS, Baker SR, Patel R, Luk L, Castro A 3rd. The causes of medical malpractice suits against radiologists in the United States. Radiology. 2013;266:548–54.CrossRefPubMed Whang JS, Baker SR, Patel R, Luk L, Castro A 3rd. The causes of medical malpractice suits against radiologists in the United States. Radiology. 2013;266:548–54.CrossRefPubMed
3.
Zurück zum Zitat George MP, Bixby S. Frequently missed fractures in pediatric trauma: a pictorial review of plain film radiography. Radiol Clin North Am. 2019;57:843–55.CrossRefPubMed George MP, Bixby S. Frequently missed fractures in pediatric trauma: a pictorial review of plain film radiography. Radiol Clin North Am. 2019;57:843–55.CrossRefPubMed
4.
Zurück zum Zitat Baig MN. A review of epidemiological distribution of different types of fractures in paediatric age. Cureus. 2017;9:e1624.PubMedPubMedCentral Baig MN. A review of epidemiological distribution of different types of fractures in paediatric age. Cureus. 2017;9:e1624.PubMedPubMedCentral
5.
Zurück zum Zitat Kitamura G, Chung CY, Moore BE 2nd. Ankle fracture detection utilizing a convolutional neural network ensemble implemented with a small sample, de novo training, and multiview incorporation. J Digit Imaging. 2019;32:672–7.CrossRefPubMedPubMedCentral Kitamura G, Chung CY, Moore BE 2nd. Ankle fracture detection utilizing a convolutional neural network ensemble implemented with a small sample, de novo training, and multiview incorporation. J Digit Imaging. 2019;32:672–7.CrossRefPubMedPubMedCentral
7.
Zurück zum Zitat Gale W, Oakden-Rayner L, Carneiro G, Bradley AP, Palmer LJ. Detecting hip fractures with radiologist-level performance using deep neural networks [Internet]. arXiv [cs.CV]. 2017. Available from: http://arxiv.org/abs/1711.06504 Gale W, Oakden-Rayner L, Carneiro G, Bradley AP, Palmer LJ. Detecting hip fractures with radiologist-level performance using deep neural networks [Internet]. arXiv [cs.CV]. 2017. Available from: http://​arxiv.​org/​abs/​1711.​06504
8.
Zurück zum Zitat Guermazi A, Tannoury C, Kompel AJ, Murakami AM, Ducarouge A, Gillibert A, et al. Improving radiographic fracture recognition performance and efficiency using artificial intelligence. Radiology. 2022;302:627–36.CrossRefPubMed Guermazi A, Tannoury C, Kompel AJ, Murakami AM, Ducarouge A, Gillibert A, et al. Improving radiographic fracture recognition performance and efficiency using artificial intelligence. Radiology. 2022;302:627–36.CrossRefPubMed
9.
Zurück zum Zitat Jones RM, Sharma A, Hotchkiss R, Sperling JW, Hamburger J, Ledig C, et al. Assessment of a deep-learning system for fracture detection in musculoskeletal radiographs. NPJ Digit Med. 2020;3:144.CrossRefPubMedPubMedCentral Jones RM, Sharma A, Hotchkiss R, Sperling JW, Hamburger J, Ledig C, et al. Assessment of a deep-learning system for fracture detection in musculoskeletal radiographs. NPJ Digit Med. 2020;3:144.CrossRefPubMedPubMedCentral
10.
Zurück zum Zitat Zech JR, Jaramillo D, Altosaar J, Popkin CA, Wong TT. Artificial intelligence to identify fractures on pediatric and young adult upper extremity radiographs. Pediatr Radiol. 2023;53(12):2386–97.CrossRefPubMed Zech JR, Jaramillo D, Altosaar J, Popkin CA, Wong TT. Artificial intelligence to identify fractures on pediatric and young adult upper extremity radiographs. Pediatr Radiol. 2023;53(12):2386–97.CrossRefPubMed
11.
Zurück zum Zitat Rosenkrantz AB, Wang W, Hughes DR, Duszak R Jr. Generalist versus subspecialist characteristics of the U.S. radiologist workforce. Radiology. 2018;286:929–37.CrossRefPubMed Rosenkrantz AB, Wang W, Hughes DR, Duszak R Jr. Generalist versus subspecialist characteristics of the U.S. radiologist workforce. Radiology. 2018;286:929–37.CrossRefPubMed
12.
Zurück zum Zitat Lysack JT, Hoy M, Hudon ME, Nakoneshny SC, Chandarana SP, Matthews TW, et al. Impact of neuroradiologist second opinion on staging and management of head and neck cancer. J Otolaryngol Head Neck Surg. 2013;42:39.CrossRefPubMedPubMedCentral Lysack JT, Hoy M, Hudon ME, Nakoneshny SC, Chandarana SP, Matthews TW, et al. Impact of neuroradiologist second opinion on staging and management of head and neck cancer. J Otolaryngol Head Neck Surg. 2013;42:39.CrossRefPubMedPubMedCentral
13.
Zurück zum Zitat Hansen NL, Koo BC, Gallagher FA, Warren AY, Doble A, Gnanapragasam V, et al. Comparison of initial and tertiary centre second opinion reads of multiparametric magnetic resonance imaging of the prostate prior to repeat biopsy. Eur Radiol. 2017;27:2259–66.CrossRefPubMed Hansen NL, Koo BC, Gallagher FA, Warren AY, Doble A, Gnanapragasam V, et al. Comparison of initial and tertiary centre second opinion reads of multiparametric magnetic resonance imaging of the prostate prior to repeat biopsy. Eur Radiol. 2017;27:2259–66.CrossRefPubMed
14.
Zurück zum Zitat Yesilagac H, Arer IM, Gulalp B, Yabanoglu H, Karagun O, Karadeli E. Generalist versus abdominal subspecialist radiologist interpretations of abdominopelvic computed tomography performed on patients with abdominal pain and its impact on the therapeutic approach. Adv J Emerg Med. 2020;4:e21.PubMedPubMedCentral Yesilagac H, Arer IM, Gulalp B, Yabanoglu H, Karagun O, Karadeli E. Generalist versus abdominal subspecialist radiologist interpretations of abdominopelvic computed tomography performed on patients with abdominal pain and its impact on the therapeutic approach. Adv J Emerg Med. 2020;4:e21.PubMedPubMedCentral
15.
Zurück zum Zitat Mollura DJ, Culp MP, Pollack E, Battino G, Scheel JR, Mango VL, et al. Artificial intelligence in low- and middle-income countries: innovating global health radiology. Radiology. 2020;297:513–20.CrossRefPubMed Mollura DJ, Culp MP, Pollack E, Battino G, Scheel JR, Mango VL, et al. Artificial intelligence in low- and middle-income countries: innovating global health radiology. Radiology. 2020;297:513–20.CrossRefPubMed
17.
Zurück zum Zitat Ren S, He K, Girshick R, Sun J. Faster R-CNN: towards real-time object detection with region proposal networks. IEEE Trans Pattern Anal Mach Intell. 2017;39:1137–49.CrossRefPubMed Ren S, He K, Girshick R, Sun J. Faster R-CNN: towards real-time object detection with region proposal networks. IEEE Trans Pattern Anal Mach Intell. 2017;39:1137–49.CrossRefPubMed
18.
Zurück zum Zitat Pizer SM, Johnston RE, Ericksen JP, Yankaskas BC, Muller KE. Contrast-limited adaptive histogram equalization: speed and effectiveness. [1990] Proceedings of the First Conference on Visualization in Biomedical Computing. 1990 p. 337–45 Pizer SM, Johnston RE, Ericksen JP, Yankaskas BC, Muller KE. Contrast-limited adaptive histogram equalization: speed and effectiveness. [1990] Proceedings of the First Conference on Visualization in Biomedical Computing. 1990 p. 337–45
19.
Zurück zum Zitat Irvin J, Rajpurkar P, Ko M, Yu Y, Ciurea-Ilcus S, Chute C, et al. CheXpert: a large chest radiograph dataset with uncertainty labels and expert comparison [Internet]. arXiv [cs.CV]. 2019. Available from: http://arxiv.org/abs/1901.07031 Irvin J, Rajpurkar P, Ko M, Yu Y, Ciurea-Ilcus S, Chute C, et al. CheXpert: a large chest radiograph dataset with uncertainty labels and expert comparison [Internet]. arXiv [cs.CV]. 2019. Available from: http://​arxiv.​org/​abs/​1901.​07031
20.
Zurück zum Zitat Duron L, Ducarouge A, Gillibert A, Lainé J, Allouche C, Cherel N, et al. Assessment of an AI aid in detection of adult appendicular skeletal fractures by emergency physicians and radiologists: a multicenter cross-sectional diagnostic study. Radiology. 2021;300:120–9.CrossRefPubMed Duron L, Ducarouge A, Gillibert A, Lainé J, Allouche C, Cherel N, et al. Assessment of an AI aid in detection of adult appendicular skeletal fractures by emergency physicians and radiologists: a multicenter cross-sectional diagnostic study. Radiology. 2021;300:120–9.CrossRefPubMed
22.
Zurück zum Zitat Gaube S, Suresh H, Raue M, Lermer E, Koch TK, Hudecek MFC, et al. Non-task expert physicians benefit from correct explainable AI advice when reviewing X-rays. Sci Rep. 2023;13:1383.CrossRefPubMedPubMedCentral Gaube S, Suresh H, Raue M, Lermer E, Koch TK, Hudecek MFC, et al. Non-task expert physicians benefit from correct explainable AI advice when reviewing X-rays. Sci Rep. 2023;13:1383.CrossRefPubMedPubMedCentral
24.
Zurück zum Zitat Shelmerdine SC, White RD, Liu H, Arthurs OJ, Sebire NJ. Artificial intelligence for radiological paediatric fracture assessment: a systematic review. Insights Imaging. 2022;13:94.CrossRefPubMedPubMedCentral Shelmerdine SC, White RD, Liu H, Arthurs OJ, Sebire NJ. Artificial intelligence for radiological paediatric fracture assessment: a systematic review. Insights Imaging. 2022;13:94.CrossRefPubMedPubMedCentral
25.
Zurück zum Zitat Dupuis M, Delbos L, Veil R, Adamsbaum C. External validation of a commercially available deep learning algorithm for fracture detection in children. Diagn Interv Imaging. 2022;103:151–9.CrossRefPubMed Dupuis M, Delbos L, Veil R, Adamsbaum C. External validation of a commercially available deep learning algorithm for fracture detection in children. Diagn Interv Imaging. 2022;103:151–9.CrossRefPubMed
26.
Zurück zum Zitat Oakden-Rayner L, Dunnmon J, Carneiro G, Ré C. Hidden stratification causes clinically meaningful failures in machine learning for medical imaging [Internet]. arXiv [cs.LG]. 2019. Available from: http://arxiv.org/abs/1909.12475 Oakden-Rayner L, Dunnmon J, Carneiro G, Ré C. Hidden stratification causes clinically meaningful failures in machine learning for medical imaging [Internet]. arXiv [cs.LG]. 2019. Available from: http://​arxiv.​org/​abs/​1909.​12475
27.
Zurück zum Zitat Dratsch T, Chen X, RezazadeMehrizi M, Kloeckner R, Mähringer-Kunz A, Püsken M, et al. Automation bias in mammography: the impact of artificial intelligence BI-RADS suggestions on reader performance. Radiology. 2023;307:e222176.CrossRefPubMed Dratsch T, Chen X, RezazadeMehrizi M, Kloeckner R, Mähringer-Kunz A, Püsken M, et al. Automation bias in mammography: the impact of artificial intelligence BI-RADS suggestions on reader performance. Radiology. 2023;307:e222176.CrossRefPubMed
Metadaten
Titel
Artificial intelligence improves resident detection of pediatric and young adult upper extremity fractures
verfasst von
John R. Zech
Chimere O. Ezuma
Shreya Patel
Collin R. Edwards
Russell Posner
Erin Hannon
Faith Williams
Sonali V. Lala
Zohaib Y. Ahmad
Matthew P. Moy
Tony T. Wong
Publikationsdatum
02.05.2024
Verlag
Springer Berlin Heidelberg
Erschienen in
Skeletal Radiology
Print ISSN: 0364-2348
Elektronische ISSN: 1432-2161
DOI
https://doi.org/10.1007/s00256-024-04698-0

Darf man die Behandlung eines Neonazis ablehnen?

08.05.2024 Gesellschaft Nachrichten

In einer Leseranfrage in der Zeitschrift Journal of the American Academy of Dermatology möchte ein anonymer Dermatologe bzw. eine anonyme Dermatologin wissen, ob er oder sie einen Patienten behandeln muss, der eine rassistische Tätowierung trägt.

Ein Drittel der jungen Ärztinnen und Ärzte erwägt abzuwandern

07.05.2024 Klinik aktuell Nachrichten

Extreme Arbeitsverdichtung und kaum Supervision: Dr. Andrea Martini, Sprecherin des Bündnisses Junge Ärztinnen und Ärzte (BJÄ) über den Frust des ärztlichen Nachwuchses und die Vorteile des Rucksack-Modells.

Endlich: Zi zeigt, mit welchen PVS Praxen zufrieden sind

IT für Ärzte Nachrichten

Darauf haben viele Praxen gewartet: Das Zi hat eine Liste von Praxisverwaltungssystemen veröffentlicht, die von Nutzern positiv bewertet werden. Eine gute Grundlage für wechselwillige Ärztinnen und Psychotherapeuten.

Akuter Schwindel: Wann lohnt sich eine MRT?

28.04.2024 Schwindel Nachrichten

Akuter Schwindel stellt oft eine diagnostische Herausforderung dar. Wie nützlich dabei eine MRT ist, hat eine Studie aus Finnland untersucht. Immerhin einer von sechs Patienten wurde mit akutem ischämischem Schlaganfall diagnostiziert.

Update Radiologie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.