Skip to main content
Erschienen in: European Journal of Trauma and Emergency Surgery 1/2022

30.08.2020 | Original Article

Evaluation of an artificial intelligence system for diagnosing scaphoid fracture on direct radiography

verfasst von: Emre Ozkaya, Fatih Esad Topal, Tugrul Bulut, Merve Gursoy, Mustafa Ozuysal, Zeynep Karakaya

Erschienen in: European Journal of Trauma and Emergency Surgery | Ausgabe 1/2022

Einloggen, um Zugang zu erhalten

Abstract

Purpose

The aim of this study is to determine the diagnostic performance of artificial intelligence with the use of convolutional neural networks (CNN) for detecting scaphoid fractures on anteroposterior wrist radiographs. The performance of the deep learning algorithm was also compared with that of the emergency department (ED) physician and two orthopaedic specialists (less experienced and experienced in the hand surgery).

Methods

A total 390 patients with AP wrist radiographs were included in the study. The presence/absence of the fracture on radiographs was confirmed via CT. The diagnostic performance of the CNN, ED physician and two orthopaedic specialists (less experienced and experienced) as measured by AUC, sensitivity, specificity, F-Score and Youden index, to detect scaphoid fractures was evaluated and compared between the groups.

Results

The CNN had 76% sensitivity and 92% specificity, 0.840 AUC, 0.680 Youden index and 0.826 F score values in identifying scaphoid fractures. The experienced orthopaedic specialist had the best diagnostic performance according to AUC. While CNN's performance was similar to a less experienced orthopaedic specialist, it was better than the ED physician.

Conclusion

The deep learning algorithm has the potential to be used for diagnosing scaphoid fractures on radiographs. Artificial intelligence can be useful for scaphoid fracture diagnosis particularly in the absence of an experienced orthopedist or hand surgeon.
Literatur
1.
Zurück zum Zitat Angermann P, Lohmann M. Injuries to the hand and wrist. A study of 50.272 injuries. J Hand Surg Br. 1993;18:642–4.CrossRef Angermann P, Lohmann M. Injuries to the hand and wrist. A study of 50.272 injuries. J Hand Surg Br. 1993;18:642–4.CrossRef
2.
Zurück zum Zitat Gaebler C, McQueen MM. Carpus fractures and dislocations. In: Bucholz RW, Heckman JD, Court-Brown CM, Tornetta P, editors. Fractures in adults. Philadelphia: Lippincott WW; 2009. p. 782–828. Gaebler C, McQueen MM. Carpus fractures and dislocations. In: Bucholz RW, Heckman JD, Court-Brown CM, Tornetta P, editors. Fractures in adults. Philadelphia: Lippincott WW; 2009. p. 782–828.
3.
Zurück zum Zitat Carpenter CR, Pines JM, Schuur JD, et al. Adult scaphoid fracture. Acad Emerg Med. 2014;21:101–21.CrossRef Carpenter CR, Pines JM, Schuur JD, et al. Adult scaphoid fracture. Acad Emerg Med. 2014;21:101–21.CrossRef
4.
Zurück zum Zitat Gäbler C, Kukla C, Breitenseher MJ, et al. Diagnosis of occult scaphoid fractures and other wrist injuries. Are repeated clinical examinations and plain radiographs still state of the art? Langenbecks Arch Surg. 2001;386:150–4.CrossRef Gäbler C, Kukla C, Breitenseher MJ, et al. Diagnosis of occult scaphoid fractures and other wrist injuries. Are repeated clinical examinations and plain radiographs still state of the art? Langenbecks Arch Surg. 2001;386:150–4.CrossRef
5.
Zurück zum Zitat Sabbagh MD, Morsy M, Moran SL. Diagnosis and management of acute scaphoid fractures. Hand Clin. 2019;35:259–69.CrossRef Sabbagh MD, Morsy M, Moran SL. Diagnosis and management of acute scaphoid fractures. Hand Clin. 2019;35:259–69.CrossRef
6.
Zurück zum Zitat Shetty S, Sidharthan S, Jacob J, et al. Clinical scaphoid fracture: is it time to abolish this phrase? Ann R Coll Surg Engl. 2011;93:146–8.CrossRef Shetty S, Sidharthan S, Jacob J, et al. Clinical scaphoid fracture: is it time to abolish this phrase? Ann R Coll Surg Engl. 2011;93:146–8.CrossRef
7.
Zurück zum Zitat Cheng CT, Ho TY, Lee TY, et al. Application of a deep learning algorithm for detection and visualization of hip fractures on plain pelvic radiographs. Eur Radiol. 2019;29:5469–77.CrossRef Cheng CT, Ho TY, Lee TY, et al. Application of a deep learning algorithm for detection and visualization of hip fractures on plain pelvic radiographs. Eur Radiol. 2019;29:5469–77.CrossRef
8.
Zurück zum Zitat Chung SW, Han SS, Lee JW, et al. Automated detection and classification of the proximal humerus fracture by using deep learning algorithm. Acta Orthop. 2018;89:468–73.CrossRef Chung SW, Han SS, Lee JW, et al. Automated detection and classification of the proximal humerus fracture by using deep learning algorithm. Acta Orthop. 2018;89:468–73.CrossRef
9.
Zurück zum Zitat Olczak J, Fahlberg N, Maki A, et al. Artificial intelligence for analyzing orthopedic trauma radiographs. Acta Orthop. 2017;88:581–6.CrossRef Olczak J, Fahlberg N, Maki A, et al. Artificial intelligence for analyzing orthopedic trauma radiographs. Acta Orthop. 2017;88:581–6.CrossRef
10.
Zurück zum Zitat Cooney WP, Dobyns JH, Linscheid RL. Fractures of the scaphoid: a rational approach to management. Clin Orthop Relat Res. 1980;149:90–7.CrossRef Cooney WP, Dobyns JH, Linscheid RL. Fractures of the scaphoid: a rational approach to management. Clin Orthop Relat Res. 1980;149:90–7.CrossRef
11.
Zurück zum Zitat Bhat M, McCarthy M, Davis TR, et al. MRI and plain radiography in the assessment of displaced fractures of the waist of the carpal scaphoid. J Bone Jt Surg Br. 2004;86:705–13.CrossRef Bhat M, McCarthy M, Davis TR, et al. MRI and plain radiography in the assessment of displaced fractures of the waist of the carpal scaphoid. J Bone Jt Surg Br. 2004;86:705–13.CrossRef
12.
Zurück zum Zitat Clementson M, Björkman A, Thomsen NOB. Acute scaphoid fractures: guidelines for diagnosis and treatment. EFORT Open Rev. 2020;5:96–103.CrossRef Clementson M, Björkman A, Thomsen NOB. Acute scaphoid fractures: guidelines for diagnosis and treatment. EFORT Open Rev. 2020;5:96–103.CrossRef
13.
Zurück zum Zitat Tang JB, Giddins G. Why and how to report surgeons’ levels of expertise. J Hand Surg Eur. 2016;41:365–6.CrossRef Tang JB, Giddins G. Why and how to report surgeons’ levels of expertise. J Hand Surg Eur. 2016;41:365–6.CrossRef
14.
Zurück zum Zitat England JR, Cheng PM. Artificial intelligence for medical image analysis: a guide for authors and reviewers. Am J Roentgenol. 2019;212:513–9.CrossRef England JR, Cheng PM. Artificial intelligence for medical image analysis: a guide for authors and reviewers. Am J Roentgenol. 2019;212:513–9.CrossRef
15.
Zurück zum Zitat Li DL, Shen F, Yin Y, et al. Weighted youden index and its two-independent-sample comparison based on weighted sensitivity and specificity. Chin Med J (Engl). 2013;126:1150–4. Li DL, Shen F, Yin Y, et al. Weighted youden index and its two-independent-sample comparison based on weighted sensitivity and specificity. Chin Med J (Engl). 2013;126:1150–4.
16.
Zurück zum Zitat Wijetunga AR, Tsang VH, Giuffre B. The utility of cross-sectional imaging in the management of suspected scaphoid fractures. J Med Radiat Sci. 2019;66:30–7.CrossRef Wijetunga AR, Tsang VH, Giuffre B. The utility of cross-sectional imaging in the management of suspected scaphoid fractures. J Med Radiat Sci. 2019;66:30–7.CrossRef
17.
Zurück zum Zitat Smith M, Bain GI, Turner PC, et al. Review of imaging of scaphoid fractures. Aust N Z J Surg. 2010;80:82–90.CrossRef Smith M, Bain GI, Turner PC, et al. Review of imaging of scaphoid fractures. Aust N Z J Surg. 2010;80:82–90.CrossRef
18.
Zurück zum Zitat De Zwart AD, Beeres FJ, Ring D, et al. MRI as a reference standard for suspected scaphoid fractures. Br J Radiol. 2012;85:1098–101.CrossRef De Zwart AD, Beeres FJ, Ring D, et al. MRI as a reference standard for suspected scaphoid fractures. Br J Radiol. 2012;85:1098–101.CrossRef
19.
Zurück zum Zitat Platon A, Poletti PA, Van Aaken J, et al. Occult fractures of the scaphoid: the role of ultrasonography in the emergency department. Skelet Radiol. 2011;40:869–75.CrossRef Platon A, Poletti PA, Van Aaken J, et al. Occult fractures of the scaphoid: the role of ultrasonography in the emergency department. Skelet Radiol. 2011;40:869–75.CrossRef
20.
Zurück zum Zitat Yin ZG, Zhang JB, Gong KT. Cost-effectiveness of diagnostic strategies for suspected scaphoid fractures. J Orthop Trauma. 2015;29:e245–e252252.CrossRef Yin ZG, Zhang JB, Gong KT. Cost-effectiveness of diagnostic strategies for suspected scaphoid fractures. J Orthop Trauma. 2015;29:e245–e252252.CrossRef
21.
Zurück zum Zitat Ndow J, Ndow K, Maffulli N, et al. The suspected scaphoid fracture. How useful is a unit policy? Bull Hosp J Dis. 1998;57:93–5. Ndow J, Ndow K, Maffulli N, et al. The suspected scaphoid fracture. How useful is a unit policy? Bull Hosp J Dis. 1998;57:93–5.
22.
Zurück zum Zitat Harrison W, Newton AW, Cheung G. The litigation cost of negligent scaphoid fracture management. Eur J Emerg Med. 2015;22:142–3.CrossRef Harrison W, Newton AW, Cheung G. The litigation cost of negligent scaphoid fracture management. Eur J Emerg Med. 2015;22:142–3.CrossRef
23.
Zurück zum Zitat Jamjoom BA, Davis TRC. Why scaphoid fractures are missed. A review of 52 medical negligence cases. Injury. 2019;50:1306–8.CrossRef Jamjoom BA, Davis TRC. Why scaphoid fractures are missed. A review of 52 medical negligence cases. Injury. 2019;50:1306–8.CrossRef
24.
Zurück zum Zitat Ring J, Talbot C, Price J, et al. Wrist and scaphoid fractures: a 17 year review of NHSLA litigation data. Injury. 2015;46:682–6.CrossRef Ring J, Talbot C, Price J, et al. Wrist and scaphoid fractures: a 17 year review of NHSLA litigation data. Injury. 2015;46:682–6.CrossRef
25.
Zurück zum Zitat Tibrewal S, Jayakumar P, Vaidya S, et al. Role of MRI in the diagnosis and management of patients with clinical scaphoid fracture. Int Orthop. 2012;36:107–10.CrossRef Tibrewal S, Jayakumar P, Vaidya S, et al. Role of MRI in the diagnosis and management of patients with clinical scaphoid fracture. Int Orthop. 2012;36:107–10.CrossRef
26.
Zurück zum Zitat Bethel J. Scaphoid fracture: diagnosis and management. Emerg Nurse. 2009;17:24–9.CrossRef Bethel J. Scaphoid fracture: diagnosis and management. Emerg Nurse. 2009;17:24–9.CrossRef
27.
Zurück zum Zitat Amrami KK, Frick MA, Matsumoto JM. Imaging for acute and chronic scaphoid fractures. Hand Clin. 2019;35:241–57.CrossRef Amrami KK, Frick MA, Matsumoto JM. Imaging for acute and chronic scaphoid fractures. Hand Clin. 2019;35:241–57.CrossRef
Metadaten
Titel
Evaluation of an artificial intelligence system for diagnosing scaphoid fracture on direct radiography
verfasst von
Emre Ozkaya
Fatih Esad Topal
Tugrul Bulut
Merve Gursoy
Mustafa Ozuysal
Zeynep Karakaya
Publikationsdatum
30.08.2020
Verlag
Springer Berlin Heidelberg
Erschienen in
European Journal of Trauma and Emergency Surgery / Ausgabe 1/2022
Print ISSN: 1863-9933
Elektronische ISSN: 1863-9941
DOI
https://doi.org/10.1007/s00068-020-01468-0

Weitere Artikel der Ausgabe 1/2022

European Journal of Trauma and Emergency Surgery 1/2022 Zur Ausgabe

Arthropedia

Grundlagenwissen der Arthroskopie und Gelenkchirurgie. Erweitert durch Fallbeispiele, Videos und Abbildungen. 
» Jetzt entdecken

Update Orthopädie und Unfallchirurgie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.