Skip to main content
Erschienen in: Skeletal Radiology 12/2022

09.06.2022 | Scientific Article

Ensemble deep learning model for predicting anterior cruciate ligament tear from lateral knee radiograph

verfasst von: Dong Hyun Kim, Jee Won Chai, Ji Hee Kang, Ji Hyun Lee, Hyo Jin Kim, Jiwoon Seo, Jae Won Choi

Erschienen in: Skeletal Radiology | Ausgabe 12/2022

Einloggen, um Zugang zu erhalten

Abstract

Objective

To develop an ensemble deep learning model (DLM) predicting anterior cruciate ligament (ACL) tears from lateral knee radiographs and to evaluate its diagnostic performance.

Materials and methods

In this study, 1433 lateral knee radiographs (661 with ACL tear confirmed on MRI, 772 normal) from two medical centers were split into training (n = 1146) and test sets (n = 287). Three single DLMs respectively classifying radiographs with ACL tears, abnormal lateral femoral notches, and joint effusion were developed. An ensemble DLM predicting ACL tears was developed by combining the three DLMs via stacking method. The sensitivities, specificities, and area under the receiver operating characteristic curves (AUCs) of the DLMs and three radiologists were compared using McNemar test and Delong test. Subgroup analysis was performed to identify the radiologic features associated with the sensitivity.

Results

The sensitivity, specificity, and AUC of the ensemble DLM were 86.8% (95% confidence interval [CI], 79.9–92.0%), 89.4% (95% CI, 83.4–93.8%), and 0.927 (95% CI, 0.891–0.954), achieving diagnostic performance comparable with that of a musculoskeletal radiologist (P = 0.193, McNemar test; P = 0.131, Delong test). The AUC of the ensemble DLM was significantly higher than those of non-musculoskeletal radiologists (P = 0.043, P < 0.001). The sensitivity of the DLM was higher than that of the radiologists in the absence of an abnormal lateral femoral notch or joint effusion.

Conclusion

The diagnostic performance of the ensemble DLM in predicting lateral knee radiographs with ACL tears was comparable to that of a musculoskeletal radiologist.
Anhänge
Nur mit Berechtigung zugänglich
Literatur
1.
Zurück zum Zitat Murrell GA, Maddali S, Horovitz L, Oakley SP, Warren RF. The effects of time course after anterior cruciate ligament injury in correlation with meniscal and cartilage loss. Am J Sports Med. 2001;29(1):9–14.CrossRef Murrell GA, Maddali S, Horovitz L, Oakley SP, Warren RF. The effects of time course after anterior cruciate ligament injury in correlation with meniscal and cartilage loss. Am J Sports Med. 2001;29(1):9–14.CrossRef
2.
Zurück zum Zitat Granan L-P, Bahr R, Lie SA, Engebretsen L. Timing of anterior cruciate ligament reconstructive surgery and risk of cartilage lesions and meniscal tears: a cohort study based on the Norwegian National Knee Ligament Registry. Am J Sports Med. 2009;37(5):955–61.CrossRef Granan L-P, Bahr R, Lie SA, Engebretsen L. Timing of anterior cruciate ligament reconstructive surgery and risk of cartilage lesions and meniscal tears: a cohort study based on the Norwegian National Knee Ligament Registry. Am J Sports Med. 2009;37(5):955–61.CrossRef
3.
Zurück zum Zitat Lubowitz JH, Bernardini BJ, Reid JB III. Current concepts review: comprehensive physical examination for instability of the knee. Am J Sports Med. 2008;36(3):577–94.CrossRef Lubowitz JH, Bernardini BJ, Reid JB III. Current concepts review: comprehensive physical examination for instability of the knee. Am J Sports Med. 2008;36(3):577–94.CrossRef
4.
Zurück zum Zitat Pao DG. The lateral femoral notch sign. Radiology. 2001;219(3):800–1.CrossRef Pao DG. The lateral femoral notch sign. Radiology. 2001;219(3):800–1.CrossRef
5.
Zurück zum Zitat Grimberg A, Shirazian H, Torshizy H, Smitaman E, Chang EY, Resnick D. Deep lateral notch sign and double notch sign in complete tears of the anterior cruciate ligament: MR imaging evaluation. Skeletal Radiol. 2015;44(3):385–91.CrossRef Grimberg A, Shirazian H, Torshizy H, Smitaman E, Chang EY, Resnick D. Deep lateral notch sign and double notch sign in complete tears of the anterior cruciate ligament: MR imaging evaluation. Skeletal Radiol. 2015;44(3):385–91.CrossRef
6.
Zurück zum Zitat Nakauchi M, Kurosawa H, Kawakami AJ. Abnormal lateral notch in knees with anterior cruciate ligament injury. J Orthop Sci. 2000;5(2):92–5.CrossRef Nakauchi M, Kurosawa H, Kawakami AJ. Abnormal lateral notch in knees with anterior cruciate ligament injury. J Orthop Sci. 2000;5(2):92–5.CrossRef
7.
Zurück zum Zitat Frobell R, Le Graverand M-P, Buck R, et al. The acutely ACL injured knee assessed by MRI: changes in joint fluid, bone marrow lesions, and cartilage during the first year. Osteoarthr Cartil. 2009;17(2):161–7.CrossRef Frobell R, Le Graverand M-P, Buck R, et al. The acutely ACL injured knee assessed by MRI: changes in joint fluid, bone marrow lesions, and cartilage during the first year. Osteoarthr Cartil. 2009;17(2):161–7.CrossRef
8.
Zurück zum Zitat Yoon AP, Lee Y-L, Kane RL, Kuo C-F, Lin C, Chung KC. Development and Validation of a Deep Learning Model Using Convolutional Neural Networks to Identify Scaphoid Fractures in Radiographs. JAMA Netw Open. 2021;4(5):e216096–e216096.CrossRef Yoon AP, Lee Y-L, Kane RL, Kuo C-F, Lin C, Chung KC. Development and Validation of a Deep Learning Model Using Convolutional Neural Networks to Identify Scaphoid Fractures in Radiographs. JAMA Netw Open. 2021;4(5):e216096–e216096.CrossRef
9.
Zurück zum Zitat Park HS, Jeon K, Cho YJ, et al. Diagnostic Performance of a New Convolutional Neural Network Algorithm for Detecting Developmental Dysplasia of the Hip on Anteroposterior Radiographs. Korean J Radiol. 2021;22(4):612.CrossRef Park HS, Jeon K, Cho YJ, et al. Diagnostic Performance of a New Convolutional Neural Network Algorithm for Detecting Developmental Dysplasia of the Hip on Anteroposterior Radiographs. Korean J Radiol. 2021;22(4):612.CrossRef
10.
Zurück zum Zitat Nam JG, Park S, Hwang EJ, et al. Development and validation of deep learning–based automatic detection algorithm for malignant pulmonary nodules on chest radiographs. Radiology. 2019;290(1):218–28.CrossRef Nam JG, Park S, Hwang EJ, et al. Development and validation of deep learning–based automatic detection algorithm for malignant pulmonary nodules on chest radiographs. Radiology. 2019;290(1):218–28.CrossRef
12.
Zurück zum Zitat Sanders TL, Maradit Kremers H, Bryan AJ, et al. Incidence of anterior cruciate ligament tears and reconstruction: a 21-year population-based study. Am J Sports Med. 2016;44(6):1502–7.CrossRef Sanders TL, Maradit Kremers H, Bryan AJ, et al. Incidence of anterior cruciate ligament tears and reconstruction: a 21-year population-based study. Am J Sports Med. 2016;44(6):1502–7.CrossRef
13.
Zurück zum Zitat Yoon JP, Chang CB, Yoo JH, et al. Correlation of magnetic resonance imaging findings with the chronicity of an anterior cruciate ligament tear. J Bone Joint Surg Am. 2010;92(2):353–60.CrossRef Yoon JP, Chang CB, Yoo JH, et al. Correlation of magnetic resonance imaging findings with the chronicity of an anterior cruciate ligament tear. J Bone Joint Surg Am. 2010;92(2):353–60.CrossRef
14.
Zurück zum Zitat Yoon JP, Yoo JH, Chang CB, et al. Prediction of chronicity of anterior cruciate ligament tear using MRI findings. Clin Orthop Surg. 2013;5(1):19–25.CrossRef Yoon JP, Yoo JH, Chang CB, et al. Prediction of chronicity of anterior cruciate ligament tear using MRI findings. Clin Orthop Surg. 2013;5(1):19–25.CrossRef
15.
Zurück zum Zitat Hall FM. Radiographic diagnosis and accuracy in knee joint effusions. Radiology. 1975;115(1):49–54.CrossRef Hall FM. Radiographic diagnosis and accuracy in knee joint effusions. Radiology. 1975;115(1):49–54.CrossRef
18.
Zurück zum Zitat Zhou Y, Chen H, Li Y, et al. Multi-task learning for segmentation and classification of tumors in 3D automated breast ultrasound images. Med Image Anal. 2021;70:101918.CrossRef Zhou Y, Chen H, Li Y, et al. Multi-task learning for segmentation and classification of tumors in 3D automated breast ultrasound images. Med Image Anal. 2021;70:101918.CrossRef
21.
Zurück zum Zitat Xing J, Chen C, Lu Q, et al. Using BI-RADS stratifications as auxiliary information for breast masses classification in ultrasound images. IEEE J Biomed Health Inform. 2020;25(6):2058–70.CrossRef Xing J, Chen C, Lu Q, et al. Using BI-RADS stratifications as auxiliary information for breast masses classification in ultrasound images. IEEE J Biomed Health Inform. 2020;25(6):2058–70.CrossRef
22.
Zurück zum Zitat Herbst E, Hoser C, Tecklenburg K, et al. The lateral femoral notch sign following ACL injury: frequency, morphology and relation to meniscal injury and sports activity. Knee Surg Sports Traumatol Arthrosc. 2015;23(8):2250–8.CrossRef Herbst E, Hoser C, Tecklenburg K, et al. The lateral femoral notch sign following ACL injury: frequency, morphology and relation to meniscal injury and sports activity. Knee Surg Sports Traumatol Arthrosc. 2015;23(8):2250–8.CrossRef
23.
Zurück zum Zitat Abreu MR, Chung CB, Trudell D, Resnick D. Hoffa’s fat pad injuries and their relationship with anterior cruciate ligament tears: new observations based on MR imaging in patients and MR imaging and anatomic correlation in cadavers. Skeletal Radiol. 2008;37(4):301–6.CrossRef Abreu MR, Chung CB, Trudell D, Resnick D. Hoffa’s fat pad injuries and their relationship with anterior cruciate ligament tears: new observations based on MR imaging in patients and MR imaging and anatomic correlation in cadavers. Skeletal Radiol. 2008;37(4):301–6.CrossRef
24.
Zurück zum Zitat Guenoun D, Le Corroller T, Amous Z, et al. The contribution of MRI to the diagnosis of traumatic tears of the anterior cruciate ligament. Diagn Interv Imaging. 2012;93(5):331–41.CrossRef Guenoun D, Le Corroller T, Amous Z, et al. The contribution of MRI to the diagnosis of traumatic tears of the anterior cruciate ligament. Diagn Interv Imaging. 2012;93(5):331–41.CrossRef
25.
Zurück zum Zitat Calmbach WL, Hutchens M. Evaluation of patients presenting with knee pain: Part I. History, physical examination, radiographs, and laboratory tests. Am Fam Physician. 2003;68(5):907–12.PubMed Calmbach WL, Hutchens M. Evaluation of patients presenting with knee pain: Part I. History, physical examination, radiographs, and laboratory tests. Am Fam Physician. 2003;68(5):907–12.PubMed
26.
Zurück zum Zitat Sternbach GL. Evaluation of the knee. J Emerg Med. 1986;4(2):133–43.CrossRef Sternbach GL. Evaluation of the knee. J Emerg Med. 1986;4(2):133–43.CrossRef
Metadaten
Titel
Ensemble deep learning model for predicting anterior cruciate ligament tear from lateral knee radiograph
verfasst von
Dong Hyun Kim
Jee Won Chai
Ji Hee Kang
Ji Hyun Lee
Hyo Jin Kim
Jiwoon Seo
Jae Won Choi
Publikationsdatum
09.06.2022
Verlag
Springer Berlin Heidelberg
Erschienen in
Skeletal Radiology / Ausgabe 12/2022
Print ISSN: 0364-2348
Elektronische ISSN: 1432-2161
DOI
https://doi.org/10.1007/s00256-022-04081-x

Weitere Artikel der Ausgabe 12/2022

Skeletal Radiology 12/2022 Zur Ausgabe

Mammakarzinom: Brustdichte beeinflusst rezidivfreies Überleben

26.05.2024 Mammakarzinom Nachrichten

Frauen, die zum Zeitpunkt der Brustkrebsdiagnose eine hohe mammografische Brustdichte aufweisen, haben ein erhöhtes Risiko für ein baldiges Rezidiv, legen neue Daten nahe.

„Übersichtlicher Wegweiser“: Lauterbachs umstrittener Klinik-Atlas ist online

17.05.2024 Klinik aktuell Nachrichten

Sie sei „ethisch geboten“, meint Gesundheitsminister Karl Lauterbach: mehr Transparenz über die Qualität von Klinikbehandlungen. Um sie abzubilden, lässt er gegen den Widerstand vieler Länder einen virtuellen Klinik-Atlas freischalten.

Klinikreform soll zehntausende Menschenleben retten

15.05.2024 Klinik aktuell Nachrichten

Gesundheitsminister Lauterbach hat die vom Bundeskabinett beschlossene Klinikreform verteidigt. Kritik an den Plänen kommt vom Marburger Bund. Und in den Ländern wird über den Gang zum Vermittlungsausschuss spekuliert.

Darf man die Behandlung eines Neonazis ablehnen?

08.05.2024 Gesellschaft Nachrichten

In einer Leseranfrage in der Zeitschrift Journal of the American Academy of Dermatology möchte ein anonymer Dermatologe bzw. eine anonyme Dermatologin wissen, ob er oder sie einen Patienten behandeln muss, der eine rassistische Tätowierung trägt.

Update Radiologie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.