Skip to main content
Erschienen in: European Radiology 10/2006

01.10.2006 | Gastrointestinal

Reader error during CT colonography: causes and implications for training

verfasst von: Andrew Slater, Stuart A. Taylor, Emily Tam, Louise Gartner, Julia Scarth, Chand Peiris, Arun Gupta, Michele Marshall, David Burling, Steve Halligan

Erschienen in: European Radiology | Ausgabe 10/2006

Einloggen, um Zugang zu erhalten

Abstract

This study investigated the variability in baseline computed tomography colonography (CTC) performance using untrained readers by documenting sources of error to guide future training requirements. Twenty CTC endoscopically validated data sets containing 32 polyps were consensus read by three unblinded radiologists experienced in CTC, creating a reference standard. Six readers without prior CTC training [four residents and two board-certified subspecialty gastrointestinal (GI) radiologists] read the 20 cases. Readers drew a region of interest (ROI) around every area they considered a potential colonic lesion, even if subsequently dismissed, before creating a final report. Using this final report, reader ROIs were classified as true positive detections, true negatives correctly dismissed, true detections incorrectly dismissed (i.e., classification error), or perceptual errors. Detection of polyps 1–5 mm, 6–9 mm, and ≥10 mm ranged from 7.1% to 28.6%, 16.7% to 41.7%, and 16.7% to 83.3%, respectively. There was no significant difference between polyp detection or false positives for the GI radiologists compared with residents (p=0.67, p=0.4 respectively). Most missed polyps were due to failure of detection rather than characterization (range 82–95%). Untrained reader performance is variable but generally poor. Most missed polyps are due perceptual error rather than characterization, suggesting basic training should focus heavily on lesion detection.
Literatur
1.
Zurück zum Zitat Fenlon HM, Nunes DP, Schroy PC III, Barish MA, Clarke PD, Ferrucci JT (1999) A comparison of virtual and conventional colonoscopy for the detection of colorectal polyps. N Engl J Med 341:1496–1503PubMedCrossRef Fenlon HM, Nunes DP, Schroy PC III, Barish MA, Clarke PD, Ferrucci JT (1999) A comparison of virtual and conventional colonoscopy for the detection of colorectal polyps. N Engl J Med 341:1496–1503PubMedCrossRef
2.
Zurück zum Zitat Yee J, Akerkar GA, Hung RK, Steinauer-Gebauer AM, Wall SD, McQuaid KR (2001) Colorectal neoplasia: performance characteristics of CT colonography for detection in 300 patients. Radiology 219:685–692PubMed Yee J, Akerkar GA, Hung RK, Steinauer-Gebauer AM, Wall SD, McQuaid KR (2001) Colorectal neoplasia: performance characteristics of CT colonography for detection in 300 patients. Radiology 219:685–692PubMed
3.
Zurück zum Zitat Macari M, Bini EJ, Jacobs SL, Naik S, Lui YW, Milano A, Rajapaksa R, Megibow AJ, Babb J (2004) Colorectal polyps and cancers in asymptomatic average-risk patients: evaluation with CT colonography. Radiology 230:629–636PubMedCrossRef Macari M, Bini EJ, Jacobs SL, Naik S, Lui YW, Milano A, Rajapaksa R, Megibow AJ, Babb J (2004) Colorectal polyps and cancers in asymptomatic average-risk patients: evaluation with CT colonography. Radiology 230:629–636PubMedCrossRef
4.
Zurück zum Zitat Dachman AH, Kuniyoshi JK, Boyle CM, Samara Y, Hoffmann KR, Rubin DT, Hanan I (1998) CT colonography with three-dimensional problem solving for detection of colonic polyps. AJR Am J Roentgenol 171:989–995PubMed Dachman AH, Kuniyoshi JK, Boyle CM, Samara Y, Hoffmann KR, Rubin DT, Hanan I (1998) CT colonography with three-dimensional problem solving for detection of colonic polyps. AJR Am J Roentgenol 171:989–995PubMed
5.
Zurück zum Zitat Iannaccone R, Laghi A, Catalano C, Brink JA, Mangiapane F, Trenna S, Piacentini F, Passariello R (2003) Detection of colorectal lesions: lower-dose multi-detector row helical CT colonography compared with conventional colonoscopy. Radiology 229:775–781PubMedCrossRef Iannaccone R, Laghi A, Catalano C, Brink JA, Mangiapane F, Trenna S, Piacentini F, Passariello R (2003) Detection of colorectal lesions: lower-dose multi-detector row helical CT colonography compared with conventional colonoscopy. Radiology 229:775–781PubMedCrossRef
6.
Zurück zum Zitat Pickhardt PJ, Choi JR, Hwang I, Butler JA, Puckett ML, Hildebrandt HA, Wong RK, Nugent PA, Mysliwiec PA, Schindler WR (2003) Computed tomographic virtual colonoscopy to screen for colorectal neoplasia in asymptomatic adults. N Engl J Med 349:2191–2200PubMedCrossRef Pickhardt PJ, Choi JR, Hwang I, Butler JA, Puckett ML, Hildebrandt HA, Wong RK, Nugent PA, Mysliwiec PA, Schindler WR (2003) Computed tomographic virtual colonoscopy to screen for colorectal neoplasia in asymptomatic adults. N Engl J Med 349:2191–2200PubMedCrossRef
7.
Zurück zum Zitat Johnson CD, Harmsen WS, Wilson LA, MacCarty RL, Welch TJ, Ilstrup DM, Ahlquist DA (2003) Prospective blinded evaluation of computed tomographic colonography for screen detection of colorectal polyps. Gastroenterology 125:311–319PubMedCrossRef Johnson CD, Harmsen WS, Wilson LA, MacCarty RL, Welch TJ, Ilstrup DM, Ahlquist DA (2003) Prospective blinded evaluation of computed tomographic colonography for screen detection of colorectal polyps. Gastroenterology 125:311–319PubMedCrossRef
8.
Zurück zum Zitat Rockey DC, Paulson E, Niedzwiecki D, Davis W, Bosworth HB, Sanders L, Yee J, Henderson J, Hatten P, Burdick S, Sanyal A, Rubin DT, Sterling M, Akerkar G, Bhutani MS, Binmoeller K, Garvie J, Bini EJ, McQuaid K, Foster WL, Thompson WM, Dachman A, Halvorsen R (2005) Analysis of air contrast barium enema, computed tomographic colonography, and colonoscopy: prospective comparison. Lancet 365:305–311PubMed Rockey DC, Paulson E, Niedzwiecki D, Davis W, Bosworth HB, Sanders L, Yee J, Henderson J, Hatten P, Burdick S, Sanyal A, Rubin DT, Sterling M, Akerkar G, Bhutani MS, Binmoeller K, Garvie J, Bini EJ, McQuaid K, Foster WL, Thompson WM, Dachman A, Halvorsen R (2005) Analysis of air contrast barium enema, computed tomographic colonography, and colonoscopy: prospective comparison. Lancet 365:305–311PubMed
9.
Zurück zum Zitat Cotton PB, Durkalski VL, Pineau BC, Palesch YY, Mauldin PD, Hoffman B, Vining DJ, Small WC, Affronti J, Rex D, Kopecky KK, Ackerman S, Burdick JS, Brewington C, Turner MA, Zfass A, Wright AR, Iyer RB, Lynch P, Sivak MV, Butler H (2004) Computed tomographic colonography (virtual colonoscopy): a multicenter comparison with standard colonoscopy for detection of colorectal neoplasia. JAMA 291:1713–1719PubMedCrossRef Cotton PB, Durkalski VL, Pineau BC, Palesch YY, Mauldin PD, Hoffman B, Vining DJ, Small WC, Affronti J, Rex D, Kopecky KK, Ackerman S, Burdick JS, Brewington C, Turner MA, Zfass A, Wright AR, Iyer RB, Lynch P, Sivak MV, Butler H (2004) Computed tomographic colonography (virtual colonoscopy): a multicenter comparison with standard colonoscopy for detection of colorectal neoplasia. JAMA 291:1713–1719PubMedCrossRef
11.
Zurück zum Zitat Ferrucci JT (2005) Colonoscopy: virtual and optical-another look, another view. Radiology 235:13–16PubMedCrossRef Ferrucci JT (2005) Colonoscopy: virtual and optical-another look, another view. Radiology 235:13–16PubMedCrossRef
12.
Zurück zum Zitat Spinzi G, Belloni G, Martegani A, Sangiovanni A, Del Favero C, Minoli G (2001) Computed tomographic colonography and conventional colonoscopy for colon diseases: a prospective, blinded study. Am J Gastroenterol 96:394–400PubMedCrossRef Spinzi G, Belloni G, Martegani A, Sangiovanni A, Del Favero C, Minoli G (2001) Computed tomographic colonography and conventional colonoscopy for colon diseases: a prospective, blinded study. Am J Gastroenterol 96:394–400PubMedCrossRef
13.
Zurück zum Zitat Burling D, Halligan S, Atchley J, Dhingsa R, Maskell G, Guest P,Haywood S, Higginson A, Jobling C (2005) CT colonography Interpretative performance outside a research environment. Eur Radiol 13(Suppl 3):15 Burling D, Halligan S, Atchley J, Dhingsa R, Maskell G, Guest P,Haywood S, Higginson A, Jobling C (2005) CT colonography Interpretative performance outside a research environment. Eur Radiol 13(Suppl 3):15
14.
Zurück zum Zitat Johnson CD, Toledano AY, Herman BA, Dachman AH, McFarland EG, Barish MA, Brink JA, Ernst RD, Fletcher JG, Halvorsen RA Jr, Hara AK, Hopper KD, Koehler RE, Lu DS, Macari M, MacCarty RL, Miller FH, Morrin M, Paulson EK, Yee J, Zalis M (2003) Computerized tomographic colonography: performance evaluation in a retrospective multicenter setting. Gastroenterology 125:688–695PubMedCrossRef Johnson CD, Toledano AY, Herman BA, Dachman AH, McFarland EG, Barish MA, Brink JA, Ernst RD, Fletcher JG, Halvorsen RA Jr, Hara AK, Hopper KD, Koehler RE, Lu DS, Macari M, MacCarty RL, Miller FH, Morrin M, Paulson EK, Yee J, Zalis M (2003) Computerized tomographic colonography: performance evaluation in a retrospective multicenter setting. Gastroenterology 125:688–695PubMedCrossRef
15.
Zurück zum Zitat Soto JA, Barish MA, Yee J (2005) Reader training in CT colonography: how much is enough? Radiology 237:26–27PubMedCrossRef Soto JA, Barish MA, Yee J (2005) Reader training in CT colonography: how much is enough? Radiology 237:26–27PubMedCrossRef
16.
Zurück zum Zitat Soto J, Barish M, Ferrucci J. CT Colonography Interpretation: Guidelines for Training Courses (2004) Radiological Society of North America scientific assembly and annual meeting program. Oak Brook, Ill: Radiological Society of North America 618 Soto J, Barish M, Ferrucci J. CT Colonography Interpretation: Guidelines for Training Courses (2004) Radiological Society of North America scientific assembly and annual meeting program. Oak Brook, Ill: Radiological Society of North America 618
17.
Zurück zum Zitat Taylor SA, Halligan S, Burling D, Morley S, Bassett P, Atkin W, Bartram CI (2004) CT colonography: effect of experience and training on reader performance. Eur Radiol 14:1025–1033PubMedCrossRef Taylor SA, Halligan S, Burling D, Morley S, Bassett P, Atkin W, Bartram CI (2004) CT colonography: effect of experience and training on reader performance. Eur Radiol 14:1025–1033PubMedCrossRef
18.
Zurück zum Zitat Fidler JL, Fletcher JG, Johnson CD, Huprich JE, Barlow JM, Earnest F, Bartholmai BJ (2004) Understanding interpretive errors in radiologists learning computed tomography colonography. Acad Radiol 11:750–756PubMedCrossRef Fidler JL, Fletcher JG, Johnson CD, Huprich JE, Barlow JM, Earnest F, Bartholmai BJ (2004) Understanding interpretive errors in radiologists learning computed tomography colonography. Acad Radiol 11:750–756PubMedCrossRef
19.
Zurück zum Zitat Macari M, Bini EJ, Jacobs SL, Lange N, Lui YW (2003) Filling defects at CT colonography: pseudo- and diminutive lesions (the good), polyps (the bad), flat lesions, masses, and carcinomas (the ugly). Radiographics 23:1073–1091PubMedCrossRef Macari M, Bini EJ, Jacobs SL, Lange N, Lui YW (2003) Filling defects at CT colonography: pseudo- and diminutive lesions (the good), polyps (the bad), flat lesions, masses, and carcinomas (the ugly). Radiographics 23:1073–1091PubMedCrossRef
20.
Zurück zum Zitat Carney E, Kempf J, DeCarvalho V, Yudd A, Nosher J (2003) Preliminary interpretations of after-hours CT and sonography by radiology residents versus final interpretations by body imaging radiologists at a level 1 trauma center. AJR Am J Roentgenol 181:367–373PubMed Carney E, Kempf J, DeCarvalho V, Yudd A, Nosher J (2003) Preliminary interpretations of after-hours CT and sonography by radiology residents versus final interpretations by body imaging radiologists at a level 1 trauma center. AJR Am J Roentgenol 181:367–373PubMed
21.
Zurück zum Zitat Albano MC, Ross GW, Ditchek JJ, Duke GL, Teeger S, Sostman HD, Flomenbaum N, Seifert C, Brill PW (2001) Resident interpretation of emergency CT scans in the evaluation of acute appendicitis. Acad Radiol 8:915–918PubMedCrossRef Albano MC, Ross GW, Ditchek JJ, Duke GL, Teeger S, Sostman HD, Flomenbaum N, Seifert C, Brill PW (2001) Resident interpretation of emergency CT scans in the evaluation of acute appendicitis. Acad Radiol 8:915–918PubMedCrossRef
22.
Zurück zum Zitat Ginsberg MS, King V, Panicek DM (2004) Comparison of interpretations of CT angiograms in the evaluation of suspected pulmonary embolism by on-call radiology fellows and subsequently by radiology faculty. AJR Am J Roentgenol 182:61–66PubMed Ginsberg MS, King V, Panicek DM (2004) Comparison of interpretations of CT angiograms in the evaluation of suspected pulmonary embolism by on-call radiology fellows and subsequently by radiology faculty. AJR Am J Roentgenol 182:61–66PubMed
23.
Zurück zum Zitat Pickhardt PJ (2003) Three-dimensional endoluminal CT colonography (virtual colonoscopy): comparison of three commercially available systems. AJR Am J Roentgenol 181:1599–1606PubMed Pickhardt PJ (2003) Three-dimensional endoluminal CT colonography (virtual colonoscopy): comparison of three commercially available systems. AJR Am J Roentgenol 181:1599–1606PubMed
24.
Zurück zum Zitat Iannaccone R, Catalano C, Marin D, Guerrisi A, De Filippis G, Passariello R (2005) Primary two-dimensional (2D) versus primary three-dimensional (3D) reading: performance of abdominal radiologists with limited training in CT colonography. In: Radiological Society of North America scientific assembly and annual meeting program. Oak Brook, Ill: Radiological Society of North America: 186 Iannaccone R, Catalano C, Marin D, Guerrisi A, De Filippis G, Passariello R (2005) Primary two-dimensional (2D) versus primary three-dimensional (3D) reading: performance of abdominal radiologists with limited training in CT colonography. In: Radiological Society of North America scientific assembly and annual meeting program. Oak Brook, Ill: Radiological Society of North America: 186
25.
Zurück zum Zitat Lefere P, Gryspeerdt S, Marrannes J, Baekelandt M, Van HB (2005) CT colonography after fecal tagging with a reduced cathartic cleansing and a reduced volume of barium. AJR Am J Roentgenol 184:1836–1842PubMed Lefere P, Gryspeerdt S, Marrannes J, Baekelandt M, Van HB (2005) CT colonography after fecal tagging with a reduced cathartic cleansing and a reduced volume of barium. AJR Am J Roentgenol 184:1836–1842PubMed
26.
Zurück zum Zitat Lefere PA, Gryspeerdt SS, Dewyspelaere J, Baekelandt M, Van Holsbeeck BG (2002) Dietary fecal tagging as a cleansing method before CT colonography: initial results polyp detection and patient acceptance. Radiology 224:393–403PubMedCrossRef Lefere PA, Gryspeerdt SS, Dewyspelaere J, Baekelandt M, Van Holsbeeck BG (2002) Dietary fecal tagging as a cleansing method before CT colonography: initial results polyp detection and patient acceptance. Radiology 224:393–403PubMedCrossRef
27.
Zurück zum Zitat Iannaccone R, Laghi A, Catalano C, Mangiapane F, Lamazza A, Schillaci A, Sinibaldi G, Murakami T, Sammartino P, Hori M, Piacentini F, Nofroni I, Stipa V, Passariello R (2004) Computed tomographic colonography without cathartic preparation for the detection of colorectal polyps. Gastroenterology 127:1300–1311PubMedCrossRef Iannaccone R, Laghi A, Catalano C, Mangiapane F, Lamazza A, Schillaci A, Sinibaldi G, Murakami T, Sammartino P, Hori M, Piacentini F, Nofroni I, Stipa V, Passariello R (2004) Computed tomographic colonography without cathartic preparation for the detection of colorectal polyps. Gastroenterology 127:1300–1311PubMedCrossRef
28.
Zurück zum Zitat Bodily KD, Fletcher JG, Engelby T, Percival M, Christensen JA, Young B, Krych AJ, Vander K, Rodysill D, Fidler JL, Johnson CD (2005) Nonradiologists as second readers for intraluminal findings at CT colonography. Acad Radiol 12:67–73PubMedCrossRef Bodily KD, Fletcher JG, Engelby T, Percival M, Christensen JA, Young B, Krych AJ, Vander K, Rodysill D, Fidler JL, Johnson CD (2005) Nonradiologists as second readers for intraluminal findings at CT colonography. Acad Radiol 12:67–73PubMedCrossRef
29.
Zurück zum Zitat Taylor SA, Halligan S, Burling D, Roddie ME, Honeyfield L, McQuillan J, Amin H, Dehmeshki J (2006) Computer-assisted reader software versus expert reviewers for polyp detection on CT colonography. AJR Am J Roentgenol 186:696–702PubMedCrossRef Taylor SA, Halligan S, Burling D, Roddie ME, Honeyfield L, McQuillan J, Amin H, Dehmeshki J (2006) Computer-assisted reader software versus expert reviewers for polyp detection on CT colonography. AJR Am J Roentgenol 186:696–702PubMedCrossRef
30.
Zurück zum Zitat Summers RM, Yao J, Pickhardt PJ, Franaszek M, Bitter I, Brickman D, Krishna V, Choi R (2005) Computed tomographic virtual colonoscopy computer-aided polyp detection in a screening population. Gastroenterology 129:1832–1844PubMedCrossRef Summers RM, Yao J, Pickhardt PJ, Franaszek M, Bitter I, Brickman D, Krishna V, Choi R (2005) Computed tomographic virtual colonoscopy computer-aided polyp detection in a screening population. Gastroenterology 129:1832–1844PubMedCrossRef
31.
Zurück zum Zitat Graser A, Bogoni L, Becker CR, Reiser M (2005) Computer-aided detection (CAD) in MDCT colonography: evaluation of the performance of a prototype system in more than 100 cases. In: Radiological Society of North America scientific assembly and annual meeting program. Oak Brook, Ill: Radiological Society of North America: 336 Graser A, Bogoni L, Becker CR, Reiser M (2005) Computer-aided detection (CAD) in MDCT colonography: evaluation of the performance of a prototype system in more than 100 cases. In: Radiological Society of North America scientific assembly and annual meeting program. Oak Brook, Ill: Radiological Society of North America: 336
32.
Zurück zum Zitat Halligan S, Dehmeshki J, Taylor SA, Amin H, Xujiong Y, Tsang J (2005) External validation of computer-assisted reading for CT colonography. In: Radiological Society of North America scientific assembly and annual meeting program. Oak Brook, Ill: Radiological Society of North America:336 Halligan S, Dehmeshki J, Taylor SA, Amin H, Xujiong Y, Tsang J (2005) External validation of computer-assisted reading for CT colonography. In: Radiological Society of North America scientific assembly and annual meeting program. Oak Brook, Ill: Radiological Society of North America:336
33.
Zurück zum Zitat Luboldt W, Mann C, Tryon CL, Vonthein R, Stueker D, Kroll M, Luz O, Claussen CD, Vogl TJ (2002) Computer-aided diagnosis in contrast-enhanced CT colonography: an approach based on contrast. Eur Radiol 12:2236–2241PubMed Luboldt W, Mann C, Tryon CL, Vonthein R, Stueker D, Kroll M, Luz O, Claussen CD, Vogl TJ (2002) Computer-aided diagnosis in contrast-enhanced CT colonography: an approach based on contrast. Eur Radiol 12:2236–2241PubMed
34.
Zurück zum Zitat Taylor SA, Halligan S, Slater A, Goh V, Burling D, Roddie ME, Honeyfield L, McQuillan J, Amin H, Dehmeshki J (2006) Polyp detection using CT colonography: comparison of primary 3D endoluminal analysis with primary 2D axial read supplemented by computer assisted reader (CAR) software. Radiology (in press) Taylor SA, Halligan S, Slater A, Goh V, Burling D, Roddie ME, Honeyfield L, McQuillan J, Amin H, Dehmeshki J (2006) Polyp detection using CT colonography: comparison of primary 3D endoluminal analysis with primary 2D axial read supplemented by computer assisted reader (CAR) software. Radiology (in press)
35.
Zurück zum Zitat Gluecker TM, Fletcher JG, Welch TJ, MacCarty RL, Harmsen WS, Harrington JR, Ilstrup D, Wilson LA, Corcoran KE, Johnson CD (2004) Characterization of lesions missed on interpretation of CT colonography using a 2D search method. AJR Am J Roentgenol 182:881–889PubMed Gluecker TM, Fletcher JG, Welch TJ, MacCarty RL, Harmsen WS, Harrington JR, Ilstrup D, Wilson LA, Corcoran KE, Johnson CD (2004) Characterization of lesions missed on interpretation of CT colonography using a 2D search method. AJR Am J Roentgenol 182:881–889PubMed
Metadaten
Titel
Reader error during CT colonography: causes and implications for training
verfasst von
Andrew Slater
Stuart A. Taylor
Emily Tam
Louise Gartner
Julia Scarth
Chand Peiris
Arun Gupta
Michele Marshall
David Burling
Steve Halligan
Publikationsdatum
01.10.2006
Verlag
Springer-Verlag
Erschienen in
European Radiology / Ausgabe 10/2006
Print ISSN: 0938-7994
Elektronische ISSN: 1432-1084
DOI
https://doi.org/10.1007/s00330-006-0299-x

Weitere Artikel der Ausgabe 10/2006

European Radiology 10/2006 Zur Ausgabe

Darf man die Behandlung eines Neonazis ablehnen?

08.05.2024 Gesellschaft Nachrichten

In einer Leseranfrage in der Zeitschrift Journal of the American Academy of Dermatology möchte ein anonymer Dermatologe bzw. eine anonyme Dermatologin wissen, ob er oder sie einen Patienten behandeln muss, der eine rassistische Tätowierung trägt.

Ein Drittel der jungen Ärztinnen und Ärzte erwägt abzuwandern

07.05.2024 Klinik aktuell Nachrichten

Extreme Arbeitsverdichtung und kaum Supervision: Dr. Andrea Martini, Sprecherin des Bündnisses Junge Ärztinnen und Ärzte (BJÄ) über den Frust des ärztlichen Nachwuchses und die Vorteile des Rucksack-Modells.

Endlich: Zi zeigt, mit welchen PVS Praxen zufrieden sind

IT für Ärzte Nachrichten

Darauf haben viele Praxen gewartet: Das Zi hat eine Liste von Praxisverwaltungssystemen veröffentlicht, die von Nutzern positiv bewertet werden. Eine gute Grundlage für wechselwillige Ärztinnen und Psychotherapeuten.

Akuter Schwindel: Wann lohnt sich eine MRT?

28.04.2024 Schwindel Nachrichten

Akuter Schwindel stellt oft eine diagnostische Herausforderung dar. Wie nützlich dabei eine MRT ist, hat eine Studie aus Finnland untersucht. Immerhin einer von sechs Patienten wurde mit akutem ischämischem Schlaganfall diagnostiziert.

Update Radiologie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.