Skip to main content
Erschienen in: European Journal of Nuclear Medicine and Molecular Imaging 2/2023

04.10.2022 | Original Article

Mitigating bias in deep learning for diagnosis of coronary artery disease from myocardial perfusion SPECT images

verfasst von: Robert J. H. Miller, Ananya Singh, Yuka Otaki, Balaji K. Tamarappoo, Paul Kavanagh, Tejas Parekh, Lien-Hsin Hu, Heidi Gransar, Tali Sharir, Andrew J. Einstein, Mathews B. Fish, Terrence D. Ruddy, Philipp A. Kaufmann, Albert J. Sinusas, Edward J. Miller, Timothy M. Bateman, Sharmila Dorbala, Marcelo F. Di Carli, Joanna X. Liang, Damini Dey, Daniel S. Berman, Piotr J. Slomka

Erschienen in: European Journal of Nuclear Medicine and Molecular Imaging | Ausgabe 2/2023

Einloggen, um Zugang zu erhalten

Abstract

Purpose

Artificial intelligence (AI) has high diagnostic accuracy for coronary artery disease (CAD) from myocardial perfusion imaging (MPI). However, when trained using high-risk populations (such as patients with correlating invasive testing), the disease probability can be overestimated due to selection bias. We evaluated different strategies for training AI models to improve the calibration (accurate estimate of disease probability), using external testing.

Methods

Deep learning was trained using 828 patients from 3 sites, with MPI and invasive angiography within 6 months. Perfusion was assessed using upright (U-TPD) and supine total perfusion deficit (S-TPD). AI training without data augmentation (model 1) was compared to training with augmentation (increased sampling) of patients without obstructive CAD (model 2), and patients without CAD and TPD < 2% (model 3). All models were tested in an external population of patients with invasive angiography within 6 months (n = 332) or low likelihood of CAD (n = 179).

Results

Model 3 achieved the best calibration (Brier score 0.104 vs 0.121, p < 0.01). Improvement in calibration was particularly evident in women (Brier score 0.084 vs 0.124, p < 0.01). In external testing (n = 511), the area under the receiver operating characteristic curve (AUC) was higher for model 3 (0.930), compared to U-TPD (AUC 0.897) and S-TPD (AUC 0.900, p < 0.01 for both).

Conclusion

Training AI models with augmentation of low-risk patients can improve calibration of AI models developed to identify patients with CAD, allowing more accurate assignment of disease probability. This is particularly important in lower-risk populations and in women, where overestimation of disease probability could significantly influence down-stream patient management.
Anhänge
Nur mit Berechtigung zugänglich
Literatur
4.
7.
Zurück zum Zitat Selvaraju RR, Cogswell M, Das A, Vedantam R, Parikh D, Batra D. Grad-CAM: visual explanations from deep networks via gradient-based localization. IEEE Int Conf Comput Vis. 2017;1:618–26. Selvaraju RR, Cogswell M, Das A, Vedantam R, Parikh D, Batra D. Grad-CAM: visual explanations from deep networks via gradient-based localization. IEEE Int Conf Comput Vis. 2017;1:618–26.
10.
Zurück zum Zitat Slomka PJ, Betancur J, Liang JX, Otaki Y, Hu L, Sharir T, et al. Rationale and design of the REgistry of Fast Myocardial Perfusion Imaging with NExt generation SPECT (REFINE SPECT). J Nucl Cardiol. 2020;27:1010–21.CrossRef Slomka PJ, Betancur J, Liang JX, Otaki Y, Hu L, Sharir T, et al. Rationale and design of the REgistry of Fast Myocardial Perfusion Imaging with NExt generation SPECT (REFINE SPECT). J Nucl Cardiol. 2020;27:1010–21.CrossRef
11.
Zurück zum Zitat Hu L-H, Sharir T, Miller RJH, Einstein AJ, Fish MB, Ruddy TD, et al. Upper reference limits of transient ischemic dilation ratio for different protocols on new-generation cadmium zinc telluride cameras: a report from REFINE SPECT registry. J Nucl Cardiol. 2020;27:1180–9. https://doi.org/10.1007/s12350-019-01730-y.CrossRef Hu L-H, Sharir T, Miller RJH, Einstein AJ, Fish MB, Ruddy TD, et al. Upper reference limits of transient ischemic dilation ratio for different protocols on new-generation cadmium zinc telluride cameras: a report from REFINE SPECT registry. J Nucl Cardiol. 2020;27:1180–9. https://​doi.​org/​10.​1007/​s12350-019-01730-y.CrossRef
12.
Zurück zum Zitat Diamond GA, Forrester JS. Analysis of probability as an aid in the clinical diagnosis of coronary-artery disease. N Engl J Med. 1979;300:1350–8.CrossRef Diamond GA, Forrester JS. Analysis of probability as an aid in the clinical diagnosis of coronary-artery disease. N Engl J Med. 1979;300:1350–8.CrossRef
13.
Zurück zum Zitat Miller RJ, Klein E, Gransar H, Slomka PJ, Friedman JD, Hayes S, et al. Prognostic significance of previous myocardial infarction and previous revascularization in patients undergoing SPECT MPI. Int J Cardiol. 2020;313:9–15.CrossRef Miller RJ, Klein E, Gransar H, Slomka PJ, Friedman JD, Hayes S, et al. Prognostic significance of previous myocardial infarction and previous revascularization in patients undergoing SPECT MPI. Int J Cardiol. 2020;313:9–15.CrossRef
15.
Zurück zum Zitat Dorbala S, Ananthasubramaniam K, Armstrong IS, Chareonthaitawee P, DePuey EG, Einstein AJ, et al. Single photon emission computed tomography (SPECT) myocardial perfusion imaging guidelines: instrumentation, acquisition, processing, and interpretation. J Nucl Cardiol. 2018;25:1784–846. https://doi.org/10.1007/s12350-018-1283-y.CrossRef Dorbala S, Ananthasubramaniam K, Armstrong IS, Chareonthaitawee P, DePuey EG, Einstein AJ, et al. Single photon emission computed tomography (SPECT) myocardial perfusion imaging guidelines: instrumentation, acquisition, processing, and interpretation. J Nucl Cardiol. 2018;25:1784–846. https://​doi.​org/​10.​1007/​s12350-018-1283-y.CrossRef
16.
Zurück zum Zitat Cerqueira MD, Weissman NJ, Dilsizian V, Jacobs AK, Kaul S, Laskey WK, et al. Standardized myocardial segmentation and nomenclature for tomographic imaging of the heart. A statement for healthcare professionals from the Cardiac Imaging Committee of the Council on Clinical Cardiology of the American Heart Association. Int J Cardiovasc Imaging. 2002;18:539–42. Cerqueira MD, Weissman NJ, Dilsizian V, Jacobs AK, Kaul S, Laskey WK, et al. Standardized myocardial segmentation and nomenclature for tomographic imaging of the heart. A statement for healthcare professionals from the Cardiac Imaging Committee of the Council on Clinical Cardiology of the American Heart Association. Int J Cardiovasc Imaging. 2002;18:539–42.
24.
Metadaten
Titel
Mitigating bias in deep learning for diagnosis of coronary artery disease from myocardial perfusion SPECT images
verfasst von
Robert J. H. Miller
Ananya Singh
Yuka Otaki
Balaji K. Tamarappoo
Paul Kavanagh
Tejas Parekh
Lien-Hsin Hu
Heidi Gransar
Tali Sharir
Andrew J. Einstein
Mathews B. Fish
Terrence D. Ruddy
Philipp A. Kaufmann
Albert J. Sinusas
Edward J. Miller
Timothy M. Bateman
Sharmila Dorbala
Marcelo F. Di Carli
Joanna X. Liang
Damini Dey
Daniel S. Berman
Piotr J. Slomka
Publikationsdatum
04.10.2022
Verlag
Springer Berlin Heidelberg
Erschienen in
European Journal of Nuclear Medicine and Molecular Imaging / Ausgabe 2/2023
Print ISSN: 1619-7070
Elektronische ISSN: 1619-7089
DOI
https://doi.org/10.1007/s00259-022-05972-w

Weitere Artikel der Ausgabe 2/2023

European Journal of Nuclear Medicine and Molecular Imaging 2/2023 Zur Ausgabe