Skip to main content
Erschienen in: European Radiology 9/2018

23.03.2018 | Cardiac

Automated estimation of image quality for coronary computed tomographic angiography using machine learning

verfasst von: Rine Nakanishi, Sethuraman Sankaran, Leo Grady, Jenifer Malpeso, Razik Yousfi, Kazuhiro Osawa, Indre Ceponiene, Negin Nazarat, Sina Rahmani, Kendall Kissel, Eranthi Jayawardena, Christopher Dailing, Christopher Zarins, Bon-Kwon Koo, James K. Min, Charles A. Taylor, Matthew J. Budoff

Erschienen in: European Radiology | Ausgabe 9/2018

Einloggen, um Zugang zu erhalten

Abstract

Objectives

Our goal was to evaluate the efficacy of a fully automated method for assessing the image quality (IQ) of coronary computed tomography angiography (CCTA).

Methods

The machine learning method was trained using 75 CCTA studies by mapping features (noise, contrast, misregistration scores, and un-interpretability index) to an IQ score based on manual ground truth data. The automated method was validated on a set of 50 CCTA studies and subsequently tested on a new set of 172 CCTA studies against visual IQ scores on a 5-point Likert scale.

Results

The area under the curve in the validation set was 0.96. In the 172 CCTA studies, our method yielded a Cohen’s kappa statistic for the agreement between automated and visual IQ assessment of 0.67 (p < 0.01). In the group where good to excellent (n = 163), fair (n = 6), and poor visual IQ scores (n = 3) were graded, 155, 5, and 2 of the patients received an automated IQ score > 50 %, respectively.

Conclusion

Fully automated assessment of the IQ of CCTA data sets by machine learning was reproducible and provided similar results compared with visual analysis within the limits of inter-operator variability.

Key points

The proposed method enables automated and reproducible image quality assessment.
Machine learning and visual assessments yielded comparable estimates of image quality.
Automated assessment potentially allows for more standardised image quality.
Image quality assessment enables standardization of clinical trial results across different datasets.
Literatur
1.
Zurück zum Zitat Budoff MJ, Dowe D, Jollis JG et al (2008) Diagnostic performance of 64-multidetector row coronary computed tomographic angiography for evaluation of coronary artery stenosis in individuals without known coronary artery disease: results from the prospective multicenter ACCURACY (Assessment by Coronary Computed Tomographic Angiography of Individuals Undergoing Invasive Coronary Angiography) trial. J Am Coll Cardiol 52(21):1724–1732CrossRefPubMed Budoff MJ, Dowe D, Jollis JG et al (2008) Diagnostic performance of 64-multidetector row coronary computed tomographic angiography for evaluation of coronary artery stenosis in individuals without known coronary artery disease: results from the prospective multicenter ACCURACY (Assessment by Coronary Computed Tomographic Angiography of Individuals Undergoing Invasive Coronary Angiography) trial. J Am Coll Cardiol 52(21):1724–1732CrossRefPubMed
2.
Zurück zum Zitat Achenbach S, Moselewski F, Ropers D et al (2004) Detection of calcified and noncalcified coronary atherosclerotic plaque by contrast-enhanced, submillimeter multidetector spiral computed tomography: a segment-based comparison with intravascular ultrasound. Circulation. 109(1):14–17CrossRefPubMed Achenbach S, Moselewski F, Ropers D et al (2004) Detection of calcified and noncalcified coronary atherosclerotic plaque by contrast-enhanced, submillimeter multidetector spiral computed tomography: a segment-based comparison with intravascular ultrasound. Circulation. 109(1):14–17CrossRefPubMed
3.
Zurück zum Zitat Min JK, Leipsic J, Pencina MJ et al (2012a) Diagnostic accuracy of fractional flow reserve from anatomic CT angiography. JAMA. 308(12):1237–1245CrossRefPubMedPubMedCentral Min JK, Leipsic J, Pencina MJ et al (2012a) Diagnostic accuracy of fractional flow reserve from anatomic CT angiography. JAMA. 308(12):1237–1245CrossRefPubMedPubMedCentral
4.
Zurück zum Zitat Douglas PS, Hoffmann U, Patel MR et al (2015) Outcomes of anatomical versus functional testing for coronary artery disease. N Engl J Med. 372(14):1291–1300CrossRefPubMedPubMedCentral Douglas PS, Hoffmann U, Patel MR et al (2015) Outcomes of anatomical versus functional testing for coronary artery disease. N Engl J Med. 372(14):1291–1300CrossRefPubMedPubMedCentral
5.
Zurück zum Zitat SCOT-HEART investigators (2015) CT coronary angiography in patients with suspected angina due to coronary heart disease (SCOT-HEART): an open-label, parallel-group, multicentre trial. Lancet 385(9985):2383–91. SCOT-HEART investigators (2015) CT coronary angiography in patients with suspected angina due to coronary heart disease (SCOT-HEART): an open-label, parallel-group, multicentre trial. Lancet 385(9985):2383–91.
6.
Zurück zum Zitat Leipsic J, Abbara S, Achenbach S et al (2014) SCCT guidelines for the interpretation and reporting of coronary CT angiography: a report of the Society of Cardiovascular Computed Tomography Guidelines Committee. J Cardiovasc Comput Tomogr. 8(5):342–358CrossRefPubMed Leipsic J, Abbara S, Achenbach S et al (2014) SCCT guidelines for the interpretation and reporting of coronary CT angiography: a report of the Society of Cardiovascular Computed Tomography Guidelines Committee. J Cardiovasc Comput Tomogr. 8(5):342–358CrossRefPubMed
7.
Zurück zum Zitat Naeemi MDRJ, Hollcroft N, Alessio AM, Roychowdhury S (2016) Application of big data analytics for automated estimation of CT image quality. Big Data (Big Data). IEEE International Conference on. IEEE 2016:3422–3431 Naeemi MDRJ, Hollcroft N, Alessio AM, Roychowdhury S (2016) Application of big data analytics for automated estimation of CT image quality. Big Data (Big Data). IEEE International Conference on. IEEE 2016:3422–3431
8.
Zurück zum Zitat Fronthaler HKK, Bigun J, Fierrez J, Alonso-Fernandez F, Ortega-Garcia J, Gonzalez-Rodriguez J (2008) Fingerprint image-quality estimation and its application to multialgorithm verification. IEEE Transactions on Information Forensics and Security. 3(2):331–338CrossRef Fronthaler HKK, Bigun J, Fierrez J, Alonso-Fernandez F, Ortega-Garcia J, Gonzalez-Rodriguez J (2008) Fingerprint image-quality estimation and its application to multialgorithm verification. IEEE Transactions on Information Forensics and Security. 3(2):331–338CrossRef
9.
Zurück zum Zitat Marin TKM, Hendrik PP, Wernick MN, Yang Y, Brankov JG (2011) Numerical observer for cardiac motion assessment using machine learning. In Proc. of SPIE. 7966:79660G–796601CrossRef Marin TKM, Hendrik PP, Wernick MN, Yang Y, Brankov JG (2011) Numerical observer for cardiac motion assessment using machine learning. In Proc. of SPIE. 7966:79660G–796601CrossRef
10.
Zurück zum Zitat Koo BK, Erglis A, Doh JH et al (2011) Diagnosis of ischemia-causing coronary stenoses by noninvasive fractional flow reserve computed from coronary computed tomographic angiograms. Results from the prospective multicenter DISCOVER-FLOW (Diagnosis of Ischemia-Causing Stenoses Obtained Via Noninvasive Fractional Flow Reserve) study. J Am Coll Cardiol. 58(19):1989–1997CrossRefPubMed Koo BK, Erglis A, Doh JH et al (2011) Diagnosis of ischemia-causing coronary stenoses by noninvasive fractional flow reserve computed from coronary computed tomographic angiograms. Results from the prospective multicenter DISCOVER-FLOW (Diagnosis of Ischemia-Causing Stenoses Obtained Via Noninvasive Fractional Flow Reserve) study. J Am Coll Cardiol. 58(19):1989–1997CrossRefPubMed
11.
Zurück zum Zitat Min JK, Berman DS, Budoff MJ et al (2011) Rationale and design of the DeFACTO (Determination of Fractional Flow Reserve by Anatomic Computed Tomographic AngiOgraphy) study. J Cardiovasc Comput Tomogr. 5(5):301–309CrossRefPubMed Min JK, Berman DS, Budoff MJ et al (2011) Rationale and design of the DeFACTO (Determination of Fractional Flow Reserve by Anatomic Computed Tomographic AngiOgraphy) study. J Cardiovasc Comput Tomogr. 5(5):301–309CrossRefPubMed
12.
Zurück zum Zitat Leipsic J, Labounty TM, Heilbron B et al (2010) Adaptive statistical iterative reconstruction: assessment of image noise and image quality in coronary CT angiography. AJR Am J Roentgenol. 195(3):649–654CrossRefPubMed Leipsic J, Labounty TM, Heilbron B et al (2010) Adaptive statistical iterative reconstruction: assessment of image noise and image quality in coronary CT angiography. AJR Am J Roentgenol. 195(3):649–654CrossRefPubMed
13.
Zurück zum Zitat Min JK, Koo BK, Erglis A et al (2012b) Effect of image quality on diagnostic accuracy of noninvasive fractional flow reserve: results from the prospective multicenter international DISCOVER-FLOW study. J Cardiovasc Comput Tomogr. 6(3):191–199CrossRefPubMed Min JK, Koo BK, Erglis A et al (2012b) Effect of image quality on diagnostic accuracy of noninvasive fractional flow reserve: results from the prospective multicenter international DISCOVER-FLOW study. J Cardiovasc Comput Tomogr. 6(3):191–199CrossRefPubMed
14.
Zurück zum Zitat Abbara S, Blanke P, Maroules CD et al (2016) SCCT guidelines for the performance and acquisition of coronary computed tomographic angiography: A report of the society of Cardiovascular Computed Tomography Guidelines Committee: Endorsed by the North American Society for Cardiovascular Imaging (NASCI). J Cardiovasc Comput Tomogr. 10(6):435–449CrossRefPubMed Abbara S, Blanke P, Maroules CD et al (2016) SCCT guidelines for the performance and acquisition of coronary computed tomographic angiography: A report of the society of Cardiovascular Computed Tomography Guidelines Committee: Endorsed by the North American Society for Cardiovascular Imaging (NASCI). J Cardiovasc Comput Tomogr. 10(6):435–449CrossRefPubMed
15.
Zurück zum Zitat Sun K, Li K, Han R et al (2015) Evaluation of high-pitch dual-source CT angiography for evaluation of coronary and carotid-cerebrovascular arteries. Eur J Radiol. 84(3):398–406CrossRefPubMed Sun K, Li K, Han R et al (2015) Evaluation of high-pitch dual-source CT angiography for evaluation of coronary and carotid-cerebrovascular arteries. Eur J Radiol. 84(3):398–406CrossRefPubMed
16.
Zurück zum Zitat Zir LM, Miller SW, Dinsmore RE, Gilbert JP, Harthorne JW (1976) Interobserver variability in coronary angiography. Circulation. 53(4):627–632CrossRefPubMed Zir LM, Miller SW, Dinsmore RE, Gilbert JP, Harthorne JW (1976) Interobserver variability in coronary angiography. Circulation. 53(4):627–632CrossRefPubMed
17.
Zurück zum Zitat Cury RC, Abbara S, Achenbach S et al (2016) CAD-RADS(TM) Coronary Artery Disease - Reporting and Data System. An expert consensus document of the Society of Cardiovascular Computed Tomography (SCCT), the American College of Radiology (ACR) and the North American Society for Cardiovascular Imaging (NASCI). Endorsed by the American College of Cardiology. J Cardiovasc Comput Tomogr. 10(4):269–281CrossRefPubMed Cury RC, Abbara S, Achenbach S et al (2016) CAD-RADS(TM) Coronary Artery Disease - Reporting and Data System. An expert consensus document of the Society of Cardiovascular Computed Tomography (SCCT), the American College of Radiology (ACR) and the North American Society for Cardiovascular Imaging (NASCI). Endorsed by the American College of Cardiology. J Cardiovasc Comput Tomogr. 10(4):269–281CrossRefPubMed
18.
Zurück zum Zitat Hamon M, Biondi-Zoccai GG, Malagutti P et al (2006) Diagnostic performance of multislice spiral computed tomography of coronary arteries as compared with conventional invasive coronary angiography: a meta-analysis. J Am Coll Cardiol. 48(9):1896–1910CrossRefPubMed Hamon M, Biondi-Zoccai GG, Malagutti P et al (2006) Diagnostic performance of multislice spiral computed tomography of coronary arteries as compared with conventional invasive coronary angiography: a meta-analysis. J Am Coll Cardiol. 48(9):1896–1910CrossRefPubMed
19.
Zurück zum Zitat Puchner SB, Liu T, Mayrhofer T et al (2014) High-risk plaque detected on coronary CT angiography predicts acute coronary syndromes independent of significant stenosis in acute chest pain: results from the ROMICAT-II trial. J Am Coll Cardiol. 64(7):684–692CrossRefPubMedPubMedCentral Puchner SB, Liu T, Mayrhofer T et al (2014) High-risk plaque detected on coronary CT angiography predicts acute coronary syndromes independent of significant stenosis in acute chest pain: results from the ROMICAT-II trial. J Am Coll Cardiol. 64(7):684–692CrossRefPubMedPubMedCentral
Metadaten
Titel
Automated estimation of image quality for coronary computed tomographic angiography using machine learning
verfasst von
Rine Nakanishi
Sethuraman Sankaran
Leo Grady
Jenifer Malpeso
Razik Yousfi
Kazuhiro Osawa
Indre Ceponiene
Negin Nazarat
Sina Rahmani
Kendall Kissel
Eranthi Jayawardena
Christopher Dailing
Christopher Zarins
Bon-Kwon Koo
James K. Min
Charles A. Taylor
Matthew J. Budoff
Publikationsdatum
23.03.2018
Verlag
Springer Berlin Heidelberg
Erschienen in
European Radiology / Ausgabe 9/2018
Print ISSN: 0938-7994
Elektronische ISSN: 1432-1084
DOI
https://doi.org/10.1007/s00330-018-5348-8

Weitere Artikel der Ausgabe 9/2018

European Radiology 9/2018 Zur Ausgabe

Update Radiologie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.