Skip to main content
Erschienen in: European Radiology 7/2014

01.07.2014 | Gastrointestinal

CT colonography: effect of computer-aided detection of colonic polyps as a second and concurrent reader for general radiologists with moderate experience in CT colonography

verfasst von: Thomas Mang, Luca Bogoni, Vikram X. Anand, Dass Chandra, Andrew J. Curtin, Anna S. Lev-Toaff, Gerardo Hermosillo, Ralph Noah, Vikas Raykar, Marcos Salganicoff, Robert Shaw, Susan Summerton, Rafel F.R. Tappouni, Helmut Ringel, Michael Weber, Matthias Wolf, Nancy A. Obuchowski

Erschienen in: European Radiology | Ausgabe 7/2014

Einloggen, um Zugang zu erhalten

Abstract

Objectives

To assess the effectiveness of computer-aided detection (CAD) as a second reader or concurrent reader in helping radiologists who are moderately experienced in computed tomographic colonography (CTC) to detect colorectal polyps.

Methods

Seventy CTC datasets (34 patients: 66 polyps ≥6 mm; 36 patients: no abnormalities) were retrospectively reviewed by seven radiologists with moderate CTC experience. After primary unassisted evaluation, a CAD second read and, after a time interval of ≥4 weeks, a CAD concurrent read were performed. Areas under the receiver operating characteristic (ROC) curve (AUC), along with per-segment, per-polyp and per-patient sensitivities, and also reading times, were calculated for each reader with and without CAD.

Results

Of seven readers, 86 % and 71 % achieved a higher accuracy (segment-level AUC) when using CAD as second and concurrent reader respectively. Average segment-level AUCs with second and concurrent CAD (0.853 and 0.864) were significantly greater (p < 0.0001) than average AUC in the unaided evaluation (0.781). Per-segment, per-polyp, and per-patient sensitivities for polyps ≥6 mm were significantly higher in both CAD reading paradigms compared with unaided evaluation. Second-read CAD reduced readers’ average segment and patient specificity by 0.007 and 0.036 (p = 0.005 and 0.011), respectively.

Conclusions

CAD significantly improves the sensitivities of radiologists moderately experienced in CTC for polyp detection, both as second reader and concurrent reader.

Key Points

• CAD helps radiologists with moderate CTC experience to detect polyps ≥6 mm.
• Second and concurrent read CAD increase the radiologist’s sensitivity for detecting polyps ≥6 mm.
• Second read CAD slightly decreases specificity compared with an unassisted read.
• Concurrent read CAD is significantly more time-efficient than second read CAD.
Literatur
1.
Zurück zum Zitat Pickhardt PJ, Choi JR, Hwang I et al (2003) Computed tomographic virtual colonoscopy to screen for colorectal neoplasia in asymptomatic adults. N Engl J Med 349:2191–2200PubMedCrossRef Pickhardt PJ, Choi JR, Hwang I et al (2003) Computed tomographic virtual colonoscopy to screen for colorectal neoplasia in asymptomatic adults. N Engl J Med 349:2191–2200PubMedCrossRef
2.
Zurück zum Zitat Johnson CD, Chen MH, Toledano AY et al (2008) Accuracy of CT colonography for detection of large adenomas and cancers. N Engl J Med 359:1207–1217PubMedCentralPubMedCrossRef Johnson CD, Chen MH, Toledano AY et al (2008) Accuracy of CT colonography for detection of large adenomas and cancers. N Engl J Med 359:1207–1217PubMedCentralPubMedCrossRef
3.
Zurück zum Zitat Graser A, Stieber P, Nagel D et al (2009) Comparison of CT colonography, colonoscopy, sigmoidoscopy and faecal occult blood tests for the detection of advanced adenoma in an average risk population. Gut 58:241–248PubMedCrossRef Graser A, Stieber P, Nagel D et al (2009) Comparison of CT colonography, colonoscopy, sigmoidoscopy and faecal occult blood tests for the detection of advanced adenoma in an average risk population. Gut 58:241–248PubMedCrossRef
4.
Zurück zum Zitat Regge D, Laudi C, Galatola G et al (2009) Diagnostic accuracy of computed tomographic colonography for the detection of advanced neoplasia in individuals at increased risk of colorectal cancer. JAMA 301:2453–2461PubMedCrossRef Regge D, Laudi C, Galatola G et al (2009) Diagnostic accuracy of computed tomographic colonography for the detection of advanced neoplasia in individuals at increased risk of colorectal cancer. JAMA 301:2453–2461PubMedCrossRef
5.
Zurück zum Zitat Atkin W, Dadswell E, Wooldrage K et al (2013) Computed tomographic colonography versus colonoscopy for investigation of patients with symptoms suggestive of colorectal cancer (SIGGAR): a multicentre randomised trial. Lancet 381:1194–1202PubMedCrossRef Atkin W, Dadswell E, Wooldrage K et al (2013) Computed tomographic colonography versus colonoscopy for investigation of patients with symptoms suggestive of colorectal cancer (SIGGAR): a multicentre randomised trial. Lancet 381:1194–1202PubMedCrossRef
6.
Zurück zum Zitat Doshi T, Rusinak D, Halvorsen RA et al (2007) CT colonography: false-negative interpretations. Radiology 244:165–173PubMedCrossRef Doshi T, Rusinak D, Halvorsen RA et al (2007) CT colonography: false-negative interpretations. Radiology 244:165–173PubMedCrossRef
7.
Zurück zum Zitat Fletcher JG, Chen MH, Herman BA et al (2010) Can radiologist training and testing ensure high performance in CT colonography? Lessons From the National CT Colonography Trial. AJR Am J Roentgenol 195:117–125PubMedCentralPubMedCrossRef Fletcher JG, Chen MH, Herman BA et al (2010) Can radiologist training and testing ensure high performance in CT colonography? Lessons From the National CT Colonography Trial. AJR Am J Roentgenol 195:117–125PubMedCentralPubMedCrossRef
8.
Zurück zum Zitat Liedenbaum MH, Bipat S, Bossuyt PM et al (2011) Evaluation of a standardized CT colonography training program for novice readers. Radiology 258:477–487PubMedCrossRef Liedenbaum MH, Bipat S, Bossuyt PM et al (2011) Evaluation of a standardized CT colonography training program for novice readers. Radiology 258:477–487PubMedCrossRef
9.
Zurück zum Zitat Dachman AH, Kelly KB, Zintsmaster MP et al (2008) Formative evaluation of standardized training for CT colonographic image interpretation by novice readers. Radiology 249:167–177PubMedCrossRef Dachman AH, Kelly KB, Zintsmaster MP et al (2008) Formative evaluation of standardized training for CT colonographic image interpretation by novice readers. Radiology 249:167–177PubMedCrossRef
10.
Zurück zum Zitat Boone D, Halligan S, Frost R et al (2011) CT colonography: who attends training? A survey of participants at educational workshops. Clin Radiol 66:510–516PubMedCrossRef Boone D, Halligan S, Frost R et al (2011) CT colonography: who attends training? A survey of participants at educational workshops. Clin Radiol 66:510–516PubMedCrossRef
11.
Zurück zum Zitat Regge D, Halligan S (2013) CAD: how it works, how to use it, performance. Eur J Radiol 82:1171–1176PubMedCrossRef Regge D, Halligan S (2013) CAD: how it works, how to use it, performance. Eur J Radiol 82:1171–1176PubMedCrossRef
12.
Zurück zum Zitat Mang T, Peloschek P, Plank C et al (2007) Effect of computer-aided detection as a second reader in multidetector-row CT colonography. Eur Radiol 17:2598–2607PubMedCrossRef Mang T, Peloschek P, Plank C et al (2007) Effect of computer-aided detection as a second reader in multidetector-row CT colonography. Eur Radiol 17:2598–2607PubMedCrossRef
13.
Zurück zum Zitat Dachman AH, Obuchowski NA, Hoffmeister JW et al (2010) Effect of computer-aided detection for CT colonography in a multireader, multicase trial. Radiology 256:827–835PubMedCentralPubMedCrossRef Dachman AH, Obuchowski NA, Hoffmeister JW et al (2010) Effect of computer-aided detection for CT colonography in a multireader, multicase trial. Radiology 256:827–835PubMedCentralPubMedCrossRef
14.
Zurück zum Zitat Halligan S, Mallett S, Altman DG et al (2011) Incremental benefit of computer-aided detection when used as a second and concurrent reader of CT colonographic data: multiobserver study. Radiology 258:469–476PubMedCrossRef Halligan S, Mallett S, Altman DG et al (2011) Incremental benefit of computer-aided detection when used as a second and concurrent reader of CT colonographic data: multiobserver study. Radiology 258:469–476PubMedCrossRef
15.
Zurück zum Zitat Graser A, Kolligs FT, Mang T et al (2007) Computer-aided detection in CT colonography: initial clinical experience using a prototype system. Eur Radiol 17:2608–2615PubMedCrossRef Graser A, Kolligs FT, Mang T et al (2007) Computer-aided detection in CT colonography: initial clinical experience using a prototype system. Eur Radiol 17:2608–2615PubMedCrossRef
16.
Zurück zum Zitat Plumb AA, Halligan S, Taylor SA et al (2013) CT colonography in the English Bowel Cancer Screening Programme: national survey of current practice. Clin Radiol 68:479–487PubMedCrossRef Plumb AA, Halligan S, Taylor SA et al (2013) CT colonography in the English Bowel Cancer Screening Programme: national survey of current practice. Clin Radiol 68:479–487PubMedCrossRef
17.
Zurück zum Zitat Halligan S, Altman DG, Mallett S et al (2006) Computed tomographic colonography: assessment of radiologist performance with and without computer-aided detection. Gastroenterology 131:1690–1699PubMedCrossRef Halligan S, Altman DG, Mallett S et al (2006) Computed tomographic colonography: assessment of radiologist performance with and without computer-aided detection. Gastroenterology 131:1690–1699PubMedCrossRef
18.
Zurück zum Zitat Taylor SA, Charman SC, Lefere P et al (2008) CT colonography: investigation of the optimum reader paradigm by using computer-aided detection software. Radiology 246:463–471PubMedCrossRef Taylor SA, Charman SC, Lefere P et al (2008) CT colonography: investigation of the optimum reader paradigm by using computer-aided detection software. Radiology 246:463–471PubMedCrossRef
19.
Zurück zum Zitat Petrick N, Haider M, Summers RM et al (2008) CT colonography with computer-aided detection as a second reader: observer performance study. Radiology 246:148–156PubMedCrossRef Petrick N, Haider M, Summers RM et al (2008) CT colonography with computer-aided detection as a second reader: observer performance study. Radiology 246:148–156PubMedCrossRef
20.
Zurück zum Zitat Baker ME, Bogoni L, Obuchowski NA et al (2007) Computer-aided detection of colorectal polyps: can it improve sensitivity of less-experienced readers? Preliminary findings. Radiology 245:140–149PubMedCrossRef Baker ME, Bogoni L, Obuchowski NA et al (2007) Computer-aided detection of colorectal polyps: can it improve sensitivity of less-experienced readers? Preliminary findings. Radiology 245:140–149PubMedCrossRef
21.
Zurück zum Zitat Regge D, Della Monica P, Galatola G et al (2013) Efficacy of computer-aided detection as a second reader for 6-9-mm lesions at CT colonography: multicenter prospective trial. Radiology 266:168–176PubMedCrossRef Regge D, Della Monica P, Galatola G et al (2013) Efficacy of computer-aided detection as a second reader for 6-9-mm lesions at CT colonography: multicenter prospective trial. Radiology 266:168–176PubMedCrossRef
25.
Zurück zum Zitat American College of Radiology (2009) ACR practice guideline for the performance of computed tomography (CT) colonography in adults. ACR, Reston American College of Radiology (2009) ACR practice guideline for the performance of computed tomography (CT) colonography in adults. ACR, Reston
26.
Zurück zum Zitat Zalis ME, Barish MA, Choi JR et al (2005) CT colonography reporting and data system: a consensus proposal. Radiology 236:3–9PubMedCrossRef Zalis ME, Barish MA, Choi JR et al (2005) CT colonography reporting and data system: a consensus proposal. Radiology 236:3–9PubMedCrossRef
27.
Zurück zum Zitat Bogoni L, Cathier P, Dundar M et al (2005) Computer-aided detection (CAD) for CT colonography: a tool to address a growing need. Br J Radiol 78(Spec No 1):S57–S62PubMedCrossRef Bogoni L, Cathier P, Dundar M et al (2005) Computer-aided detection (CAD) for CT colonography: a tool to address a growing need. Br J Radiol 78(Spec No 1):S57–S62PubMedCrossRef
28.
Zurück zum Zitat Obuchowski NA (2007) New methodological tools for multiple-reader ROC studies. Radiology 243:10–12PubMedCrossRef Obuchowski NA (2007) New methodological tools for multiple-reader ROC studies. Radiology 243:10–12PubMedCrossRef
30.
Zurück zum Zitat Obuchowski NA (1998) On the comparison of correlated proportions for clustered data. Stat Med 17:1495–1507PubMedCrossRef Obuchowski NA (1998) On the comparison of correlated proportions for clustered data. Stat Med 17:1495–1507PubMedCrossRef
31.
Zurück zum Zitat Mang T, Bogoni L, Salganicoff M et al (2012) Computer-aided detection of colorectal polyps in CT colonography with and without fecal tagging: a stand-alone evaluation. Invest Radiol 47:99–108PubMedCrossRef Mang T, Bogoni L, Salganicoff M et al (2012) Computer-aided detection of colorectal polyps in CT colonography with and without fecal tagging: a stand-alone evaluation. Invest Radiol 47:99–108PubMedCrossRef
32.
Zurück zum Zitat Lawrence EM, Pickhardt PJ, Kim DH et al (2010) Colorectal polyps: stand-alone performance of computer-aided detection in a large asymptomatic screening population. Radiology 256:791–798PubMedCrossRef Lawrence EM, Pickhardt PJ, Kim DH et al (2010) Colorectal polyps: stand-alone performance of computer-aided detection in a large asymptomatic screening population. Radiology 256:791–798PubMedCrossRef
33.
Zurück zum Zitat Mang T, Gryspeerdt S, Schima W et al (2013) Evaluation of colonic lesions and pitfalls in CT colonography: a systematic approach based on morphology, attenuation and mobility. Eur J Radiol 82:1177–1186PubMedCrossRef Mang T, Gryspeerdt S, Schima W et al (2013) Evaluation of colonic lesions and pitfalls in CT colonography: a systematic approach based on morphology, attenuation and mobility. Eur J Radiol 82:1177–1186PubMedCrossRef
34.
Zurück zum Zitat De Vries AH, Jensch S, Liedenbaum MH et al (2009) Does a computer-aided detection algorithm in a second read paradigm enhance the performance of experienced computed tomography colonography readers in a population of increased risk? Eur Radiol 19:941–950PubMedCrossRef De Vries AH, Jensch S, Liedenbaum MH et al (2009) Does a computer-aided detection algorithm in a second read paradigm enhance the performance of experienced computed tomography colonography readers in a population of increased risk? Eur Radiol 19:941–950PubMedCrossRef
35.
Zurück zum Zitat Neri E, Faggioni L, Regge D et al (2011) CT colonography: role of a second reader CAD paradigm in the initial training of radiologists. Eur J Radiol 80:303–309PubMedCrossRef Neri E, Faggioni L, Regge D et al (2011) CT colonography: role of a second reader CAD paradigm in the initial training of radiologists. Eur J Radiol 80:303–309PubMedCrossRef
36.
Zurück zum Zitat Mang T, Hermosillo G, Wolf M et al (2012) Time-efficient CT colonography interpretation using an advanced image-gallery-based, computer-aided "first-reader" workflow for the detection of colorectal adenomas. Eur Radiol 22:2768–2779PubMedCrossRef Mang T, Hermosillo G, Wolf M et al (2012) Time-efficient CT colonography interpretation using an advanced image-gallery-based, computer-aided "first-reader" workflow for the detection of colorectal adenomas. Eur Radiol 22:2768–2779PubMedCrossRef
37.
Zurück zum Zitat Iussich G, Correale L, Senore C et al (2013) CT colonography: preliminary assessment of a double-read paradigm that uses computer-aided detection as the first reader. Radiology 268:743–751PubMedCrossRef Iussich G, Correale L, Senore C et al (2013) CT colonography: preliminary assessment of a double-read paradigm that uses computer-aided detection as the first reader. Radiology 268:743–751PubMedCrossRef
38.
Zurück zum Zitat Ryan JT, Haygood TM, Yamal JM et al (2011) The "memory effect" for repeated radiologic observations. AJR Am J Roentgenol 197:W985–W991PubMedCrossRef Ryan JT, Haygood TM, Yamal JM et al (2011) The "memory effect" for repeated radiologic observations. AJR Am J Roentgenol 197:W985–W991PubMedCrossRef
Metadaten
Titel
CT colonography: effect of computer-aided detection of colonic polyps as a second and concurrent reader for general radiologists with moderate experience in CT colonography
verfasst von
Thomas Mang
Luca Bogoni
Vikram X. Anand
Dass Chandra
Andrew J. Curtin
Anna S. Lev-Toaff
Gerardo Hermosillo
Ralph Noah
Vikas Raykar
Marcos Salganicoff
Robert Shaw
Susan Summerton
Rafel F.R. Tappouni
Helmut Ringel
Michael Weber
Matthias Wolf
Nancy A. Obuchowski
Publikationsdatum
01.07.2014
Verlag
Springer Berlin Heidelberg
Erschienen in
European Radiology / Ausgabe 7/2014
Print ISSN: 0938-7994
Elektronische ISSN: 1432-1084
DOI
https://doi.org/10.1007/s00330-014-3158-1

Weitere Artikel der Ausgabe 7/2014

European Radiology 7/2014 Zur Ausgabe

Update Radiologie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.