Skip to main content
Erschienen in: CardioVascular and Interventional Radiology 5/2022

23.03.2022 | Clinical Investigation

Interpretable Machine Learning for the Prediction of Amputation Risk Following Lower Extremity Infrainguinal Endovascular Interventions for Peripheral Arterial Disease

verfasst von: Meredith Cox, Nicholas Reid, J. C. Panagides, John Di Capua, Charles DeCarlo, Anahita Dua, Sanjeeva Kalva, Jayashree Kalpathy-Cramer, Dania Daye

Erschienen in: CardioVascular and Interventional Radiology | Ausgabe 5/2022

Einloggen, um Zugang zu erhalten

Abstract

Purpose

Severe peripheral artery disease (PAD) may result in lower extremity amputation or require multiple procedures to achieve limb salvage. Current prediction models for major amputation risk have had limited performance at the individual level. We developed an interpretable machine learning model that will allow clinicians to identify patients at risk of amputation and optimize treatment decisions for PAD patients.

Methods

We utilized the American College of Surgeons National Surgical Quality Improvement Program database to collect preoperative clinical and laboratory information on 14,444 patients who underwent lower extremity endovascular procedures for PAD from 2011 to 2018. Using data from 2011 to 2017 for training and data from 2018 for testing, we developed a machine learning model to predict 30 day amputation in this patient population. We present performance metrics overall and stratified by race, sex, and age. We also demonstrate model interpretability using Gini importance and SHapley Additive exPlanations.

Results

A random forest machine learning model achieved an area under the receiver-operator curve (AU-ROC) of 0.81. The most important features of the model were elective surgery designation, claudication, open wound/wound infection, white blood cell count, and albumin. The model performed equally well on white and non-white patients (Delong p-value = 0.189), males and females (Delong p-value = 0.572), and patients under age 65 and patients age 65 and older (Delong p-value = 0.704).

Conclusion

We present a machine learning model that predicts 30 day major amputation events in PAD patients undergoing lower extremity endovascular procedures. This model can optimize clinical decision-making for patients with PAD.
Literatur
1.
Zurück zum Zitat Nehler MR, Duval S, Diao L, Annex BH, Hiatt WR, Rogers K, et al. Epidemiology of peripheral arterial disease and critical limb ischemia in an insured national population. J Vasc Surg. 2014;60:686–95.CrossRefPubMed Nehler MR, Duval S, Diao L, Annex BH, Hiatt WR, Rogers K, et al. Epidemiology of peripheral arterial disease and critical limb ischemia in an insured national population. J Vasc Surg. 2014;60:686–95.CrossRefPubMed
2.
Zurück zum Zitat Patel MR, Conte MS, Cutlip DE, Dib N, Geraghty P, Gray W, et al. Evaluation and treatment of patients with lower extremity peripheral artery disease: consensus definitions from peripheral academic research consortium (PARC). J Am Coll Cardiol. 2015;65:931–41.CrossRefPubMedPubMedCentral Patel MR, Conte MS, Cutlip DE, Dib N, Geraghty P, Gray W, et al. Evaluation and treatment of patients with lower extremity peripheral artery disease: consensus definitions from peripheral academic research consortium (PARC). J Am Coll Cardiol. 2015;65:931–41.CrossRefPubMedPubMedCentral
3.
Zurück zum Zitat Thorud JC, Plemmons B, Buckley CJ, Shibuya N, Jupiter DC. Mortality after nontraumatic major amputation among patients with diabetes and peripheral vascular disease: a systematic review. J Foot Ankle Surg. 2016;55:591–9.CrossRefPubMed Thorud JC, Plemmons B, Buckley CJ, Shibuya N, Jupiter DC. Mortality after nontraumatic major amputation among patients with diabetes and peripheral vascular disease: a systematic review. J Foot Ankle Surg. 2016;55:591–9.CrossRefPubMed
4.
Zurück zum Zitat Kohn CG, Alberts MJ, Peacock WF, Bunz TJ, Coleman CI. Cost and inpatient burden of peripheral artery disease: findings from the national inpatient sample. Atherosclerosis. 2019;286:142–6.CrossRefPubMed Kohn CG, Alberts MJ, Peacock WF, Bunz TJ, Coleman CI. Cost and inpatient burden of peripheral artery disease: findings from the national inpatient sample. Atherosclerosis. 2019;286:142–6.CrossRefPubMed
5.
Zurück zum Zitat Hardman RL, Jazaeri O, Yi J, Smith M, Gupta R. Overview of classification systems in peripheral artery disease. Semin Interv Radiol. 2014;31:378–88.CrossRef Hardman RL, Jazaeri O, Yi J, Smith M, Gupta R. Overview of classification systems in peripheral artery disease. Semin Interv Radiol. 2014;31:378–88.CrossRef
6.
Zurück zum Zitat Rutherford RB, Baker JD, Ernst C, Johnston KW, Porter JM, Ahn S, et al. Recommended standards for reports dealing with lower extremity ischemia: revised version. J Vasc Surg. 1997;26:517–38.CrossRefPubMed Rutherford RB, Baker JD, Ernst C, Johnston KW, Porter JM, Ahn S, et al. Recommended standards for reports dealing with lower extremity ischemia: revised version. J Vasc Surg. 1997;26:517–38.CrossRefPubMed
7.
Zurück zum Zitat Norgren L, Hiatt WR, Dormandy JA, Nehler MR, Harris KA, Fowkes FGR. Inter-society consensus for the management of peripheral arterial disease (TASC II). J Vasc Surg. 2007;45:S5-67.CrossRefPubMed Norgren L, Hiatt WR, Dormandy JA, Nehler MR, Harris KA, Fowkes FGR. Inter-society consensus for the management of peripheral arterial disease (TASC II). J Vasc Surg. 2007;45:S5-67.CrossRefPubMed
8.
Zurück zum Zitat Fortington LV, Geertzen JHB, van Netten JJ, Postema K, Rommers GM, Dijkstra PU. Short and long term mortality rates after a lower limb amputation. Eur J Vasc Endovasc Surg. 2013;46:124–31.CrossRefPubMed Fortington LV, Geertzen JHB, van Netten JJ, Postema K, Rommers GM, Dijkstra PU. Short and long term mortality rates after a lower limb amputation. Eur J Vasc Endovasc Surg. 2013;46:124–31.CrossRefPubMed
10.
Zurück zum Zitat Wiens J, Shenoy ES. Machine learning for healthcare: on the verge of a major shift in healthcare epidemiology. Clin Infect Dis. 2018;66:149–53.CrossRefPubMed Wiens J, Shenoy ES. Machine learning for healthcare: on the verge of a major shift in healthcare epidemiology. Clin Infect Dis. 2018;66:149–53.CrossRefPubMed
11.
Zurück zum Zitat Bertismas DS, Pawlowski C, Zhuo YD. From predictive methods to missing data imputation: an optimization approach. J Mach Learn Res. 2018;18:1–39. Bertismas DS, Pawlowski C, Zhuo YD. From predictive methods to missing data imputation: an optimization approach. J Mach Learn Res. 2018;18:1–39.
12.
Zurück zum Zitat He H, Bai Y, Garcia EA, Li S. ADASYN: Adaptive synthetic sampling approach for imbalanced learning. In: 2008 IEEE Int Jt Conf Neural Netw IEEE World Congr Comput Intell. 2008. p. 1322–8. He H, Bai Y, Garcia EA, Li S. ADASYN: Adaptive synthetic sampling approach for imbalanced learning. In: 2008 IEEE Int Jt Conf Neural Netw IEEE World Congr Comput Intell. 2008. p. 1322–8.
13.
Zurück zum Zitat Kaur P, Gosain A. Comparing the behavior of oversampling and undersampling approach of class imbalance learning by combining class imbalance problem with noise. In: Saini AK, Nayak AK, Vyas RK, editors. ICT Based Innov. Singapore: Springer; 2018. p. 23–30.CrossRef Kaur P, Gosain A. Comparing the behavior of oversampling and undersampling approach of class imbalance learning by combining class imbalance problem with noise. In: Saini AK, Nayak AK, Vyas RK, editors. ICT Based Innov. Singapore: Springer; 2018. p. 23–30.CrossRef
14.
Zurück zum Zitat Mohammed R, Rawashdeh J, Abdullah M. Machine learning with oversampling and undersampling techniques: overview study and experimental results. In: 2020 11th Int Conf Inf Commun Syst ICICS. 2020. p. 243–8. Mohammed R, Rawashdeh J, Abdullah M. Machine learning with oversampling and undersampling techniques: overview study and experimental results. In: 2020 11th Int Conf Inf Commun Syst ICICS. 2020. p. 243–8.
15.
Zurück zum Zitat Raschka S. An overview of general performance metrics of binary classifier systems. ArXiv Prepr ArXiv14105330. 2014. Raschka S. An overview of general performance metrics of binary classifier systems. ArXiv Prepr ArXiv14105330. 2014.
17.
Zurück zum Zitat Fontaine R, Kim M, Kieny R. Surgical treatment of peripheral circulation disorders. Helv Chir Acta. 1954;21:499–533.PubMed Fontaine R, Kim M, Kieny R. Surgical treatment of peripheral circulation disorders. Helv Chir Acta. 1954;21:499–533.PubMed
19.
Zurück zum Zitat Mills JL, Conte MS, Armstrong DG, Pomposelli FB, Schanzer A, Sidawy AN, et al. The society for vascular surgery lower extremity threatened limb classification system: risk stratification based on wound, ischemia, and foot infection (WIfI). J Vasc Surg. 2014;59:220-234.e2.CrossRefPubMed Mills JL, Conte MS, Armstrong DG, Pomposelli FB, Schanzer A, Sidawy AN, et al. The society for vascular surgery lower extremity threatened limb classification system: risk stratification based on wound, ischemia, and foot infection (WIfI). J Vasc Surg. 2014;59:220-234.e2.CrossRefPubMed
20.
Zurück zum Zitat American Medical Association, Genovese E, Brigham CR, American Medical Association Staff. Guides to the evaluation of permanent impairment. American Medical Association. 2007. American Medical Association, Genovese E, Brigham CR, American Medical Association Staff. Guides to the evaluation of permanent impairment. American Medical Association. 2007.
21.
Zurück zum Zitat Hippisley-Cox J, Coupland C. Development and validation of risk prediction equations to estimate future risk of blindness and lower limb amputation in patients with diabetes: cohort study. BMJ [Internet]. British Medical Journal Publishing Group. 2015 [cited 2020 Aug 8]; 351. Available from: https://www.bmj.com/content/351/bmj.h5441. Hippisley-Cox J, Coupland C. Development and validation of risk prediction equations to estimate future risk of blindness and lower limb amputation in patients with diabetes: cohort study. BMJ [Internet]. British Medical Journal Publishing Group. 2015 [cited 2020 Aug 8]; 351. Available from: https://​www.​bmj.​com/​content/​351/​bmj.​h5441.
22.
Zurück zum Zitat Darling JD, McCallum JC, Soden PA, Guzman RJ, Wyers MC, Hamdan AD, et al. Predictive ability of the SVS WIfI classification system following first-time lower extremity revascularizations. J Vasc Surg. 2017;65:695–704.CrossRefPubMedPubMedCentral Darling JD, McCallum JC, Soden PA, Guzman RJ, Wyers MC, Hamdan AD, et al. Predictive ability of the SVS WIfI classification system following first-time lower extremity revascularizations. J Vasc Surg. 2017;65:695–704.CrossRefPubMedPubMedCentral
23.
Zurück zum Zitat Bertsimas D, Dunn J, Velmahos GC, Kaafarani HMA. Surgical risk is not linear: derivation and validation of a novel, user-friendly, and machine-learning-based predictive optimal trees in emergency surgery risk (POTTER) calculator. Ann Surg. 2018;268:574–83.CrossRefPubMed Bertsimas D, Dunn J, Velmahos GC, Kaafarani HMA. Surgical risk is not linear: derivation and validation of a novel, user-friendly, and machine-learning-based predictive optimal trees in emergency surgery risk (POTTER) calculator. Ann Surg. 2018;268:574–83.CrossRefPubMed
24.
Zurück zum Zitat Gordon L, Austin P, Rudzicz F, Grantcharov T. My surgery risk and machine learning: a promising start to real-time clinical decision support. Ann Surg. 2019;269:e14–5.CrossRefPubMed Gordon L, Austin P, Rudzicz F, Grantcharov T. My surgery risk and machine learning: a promising start to real-time clinical decision support. Ann Surg. 2019;269:e14–5.CrossRefPubMed
25.
Zurück zum Zitat Desai RJ, Wang SV, Vaduganathan M, Evers T, Schneeweiss S. Comparison of machine learning methods with traditional models for use of administrative claims with electronic medical records to predict heart failure outcomes. JAMA Netw Open Am Med Assoc. 2020;3:e1918962–e1918962.CrossRef Desai RJ, Wang SV, Vaduganathan M, Evers T, Schneeweiss S. Comparison of machine learning methods with traditional models for use of administrative claims with electronic medical records to predict heart failure outcomes. JAMA Netw Open Am Med Assoc. 2020;3:e1918962–e1918962.CrossRef
26.
Zurück zum Zitat Cabrerizo S, Cuadras D, Gomez-Busto F, Artaza-Artabe I, Marín-Ciancas F, Malafarina V. Serum albumin and health in older people: review and meta analysis. Maturitas. 2015;81:17–27.CrossRefPubMed Cabrerizo S, Cuadras D, Gomez-Busto F, Artaza-Artabe I, Marín-Ciancas F, Malafarina V. Serum albumin and health in older people: review and meta analysis. Maturitas. 2015;81:17–27.CrossRefPubMed
27.
Zurück zum Zitat Gau B-R, Chen H-Y, Hung S-Y, Yang H-M, Yeh J-T, Huang C-H, et al. The impact of nutritional status on treatment outcomes of patients with limb-threatening diabetic foot ulcers. J Diabetes Complicat. 2016;30:138–42.CrossRef Gau B-R, Chen H-Y, Hung S-Y, Yang H-M, Yeh J-T, Huang C-H, et al. The impact of nutritional status on treatment outcomes of patients with limb-threatening diabetic foot ulcers. J Diabetes Complicat. 2016;30:138–42.CrossRef
28.
Zurück zum Zitat Valkenet K, van de Port IG, Dronkers JJ, de Vries WR, Lindeman E, Backx FJ. The effects of preoperative exercise therapy on postoperative outcome: a systematic review. Clin Rehabil. 2011;25:99–111.CrossRefPubMed Valkenet K, van de Port IG, Dronkers JJ, de Vries WR, Lindeman E, Backx FJ. The effects of preoperative exercise therapy on postoperative outcome: a systematic review. Clin Rehabil. 2011;25:99–111.CrossRefPubMed
29.
Zurück zum Zitat Arthur HM, Daniels C, McKelvie R, Hirsh J, Rush B. Effect of a preoperative intervention on preoperative and postoperative outcomes in low-risk patients awaiting elective coronary artery bypass graft surgery. a randomized, controlled trial. Ann Intern Med. 2000;133:253–62.CrossRefPubMed Arthur HM, Daniels C, McKelvie R, Hirsh J, Rush B. Effect of a preoperative intervention on preoperative and postoperative outcomes in low-risk patients awaiting elective coronary artery bypass graft surgery. a randomized, controlled trial. Ann Intern Med. 2000;133:253–62.CrossRefPubMed
30.
Zurück zum Zitat Bäck M, Wennerblom B, Wittboldt S, Cider Å. Effects of high frequency exercise in patients before and after elective percutaneous coronary intervention. Eur J Cardiovasc Nurs. 2008;7:307–13.CrossRefPubMed Bäck M, Wennerblom B, Wittboldt S, Cider Å. Effects of high frequency exercise in patients before and after elective percutaneous coronary intervention. Eur J Cardiovasc Nurs. 2008;7:307–13.CrossRefPubMed
31.
Metadaten
Titel
Interpretable Machine Learning for the Prediction of Amputation Risk Following Lower Extremity Infrainguinal Endovascular Interventions for Peripheral Arterial Disease
verfasst von
Meredith Cox
Nicholas Reid
J. C. Panagides
John Di Capua
Charles DeCarlo
Anahita Dua
Sanjeeva Kalva
Jayashree Kalpathy-Cramer
Dania Daye
Publikationsdatum
23.03.2022
Verlag
Springer US
Erschienen in
CardioVascular and Interventional Radiology / Ausgabe 5/2022
Print ISSN: 0174-1551
Elektronische ISSN: 1432-086X
DOI
https://doi.org/10.1007/s00270-022-03111-4

Weitere Artikel der Ausgabe 5/2022

CardioVascular and Interventional Radiology 5/2022 Zur Ausgabe

Darf man die Behandlung eines Neonazis ablehnen?

08.05.2024 Gesellschaft Nachrichten

In einer Leseranfrage in der Zeitschrift Journal of the American Academy of Dermatology möchte ein anonymer Dermatologe bzw. eine anonyme Dermatologin wissen, ob er oder sie einen Patienten behandeln muss, der eine rassistische Tätowierung trägt.

Ein Drittel der jungen Ärztinnen und Ärzte erwägt abzuwandern

07.05.2024 Klinik aktuell Nachrichten

Extreme Arbeitsverdichtung und kaum Supervision: Dr. Andrea Martini, Sprecherin des Bündnisses Junge Ärztinnen und Ärzte (BJÄ) über den Frust des ärztlichen Nachwuchses und die Vorteile des Rucksack-Modells.

Endlich: Zi zeigt, mit welchen PVS Praxen zufrieden sind

IT für Ärzte Nachrichten

Darauf haben viele Praxen gewartet: Das Zi hat eine Liste von Praxisverwaltungssystemen veröffentlicht, die von Nutzern positiv bewertet werden. Eine gute Grundlage für wechselwillige Ärztinnen und Psychotherapeuten.

Akuter Schwindel: Wann lohnt sich eine MRT?

28.04.2024 Schwindel Nachrichten

Akuter Schwindel stellt oft eine diagnostische Herausforderung dar. Wie nützlich dabei eine MRT ist, hat eine Studie aus Finnland untersucht. Immerhin einer von sechs Patienten wurde mit akutem ischämischem Schlaganfall diagnostiziert.

Update Radiologie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.