Skip to main content
Erschienen in: European Radiology 11/2018

23.05.2018 | Gastrointestinal

Computer-based self-training for CT colonography with and without CAD

verfasst von: Lapo Sali, Silvia Delsanto, Daniela Sacchetto, Loredana Correale, Massimo Falchini, Andrea Ferraris, Giovanni Gandini, Giulia Grazzini, Franco Iafrate, Gabriella Iussich, Lia Morra, Andrea Laghi, Mario Mascalchi, Daniele Regge

Erschienen in: European Radiology | Ausgabe 11/2018

Einloggen, um Zugang zu erhalten

Abstract

Objectives

To determine whether (1) computer-based self-training for CT colonography (CTC) improves interpretation performance of novice readers; (2) computer-aided detection (CAD) use during training affects learning.

Methods

Institutional review board approval and patients’ informed consent were obtained for all cases included in this study. Twenty readers (17 radiology residents, 3 radiologists) with no experience in CTC interpretation were recruited in three centres. After an introductory course, readers performed a baseline assessment test (37 cases) using CAD as second reader. Then they were randomized (1:1) to perform either a computer-based self-training (150 cases verified at colonoscopy) with CAD as second reader or the same training without CAD. The same assessment test was repeated after completion of the training programs. Main outcome was per lesion sensitivity (≥ 6 mm). A generalized estimating equation model was applied to evaluate readers’ performance and the impact of CAD use during training.

Results

After training, there was a significant improvement in average per lesion sensitivity in the unassisted phase, from 74% (356/480) to 83% (396/480) (p < 0.001), and in the CAD-assisted phase, from 83% (399/480) to 87% (417/480) (p = 0.021), but not in average per patient sensitivity, from 93% (390/420) to 94% (395/420) (p = 0.41), and specificity, from 81% (260/320) to 86% (276/320) (p = 0.15). No significant effect of CAD use during training was observed on per patient sensitivity and specificity, nor on per lesion sensitivity.

Conclusions

A computer-based self-training program for CTC improves readers’ per lesion sensitivity. CAD as second reader does not have a significant impact on learning if used during training.

Key Points

• Computer-based self-training for CT colonography improves per lesion sensitivity of novice readers.
• Self-training program does not increase per patient specificity of novice readers.
• CAD used during training does not have significant impact on learning.
Anhänge
Nur mit Berechtigung zugänglich
Literatur
1.
Zurück zum Zitat Fletcher JG, Chen M-H, Herman BA et al (2010) Can radiologist training and testing ensure high performance in CT colonography? Lessons from the National CT Colonography Trial. AJR Am J Roentgenol 195:117–125CrossRef Fletcher JG, Chen M-H, Herman BA et al (2010) Can radiologist training and testing ensure high performance in CT colonography? Lessons from the National CT Colonography Trial. AJR Am J Roentgenol 195:117–125CrossRef
2.
Zurück zum Zitat Taylor SA, Halligan S, Burling D et al (2004) CT colonography: effect of experience and training on reader performance. Eur Radiol 14:1025–1033CrossRef Taylor SA, Halligan S, Burling D et al (2004) CT colonography: effect of experience and training on reader performance. Eur Radiol 14:1025–1033CrossRef
3.
Zurück zum Zitat European Society of Gastrointestinal and Abdominal Radiology CT Colonography Group Investigators (2007) Effect of directed training on reader performance for CT colonography: multicenter study. Radiology 242:152–161CrossRef European Society of Gastrointestinal and Abdominal Radiology CT Colonography Group Investigators (2007) Effect of directed training on reader performance for CT colonography: multicenter study. Radiology 242:152–161CrossRef
4.
Zurück zum Zitat Taylor PM (2007) A review of research into the development of radiologic expertise: implications for computer-based training. Acad Radiol 14:1252–1263CrossRef Taylor PM (2007) A review of research into the development of radiologic expertise: implications for computer-based training. Acad Radiol 14:1252–1263CrossRef
5.
Zurück zum Zitat Dachman AH, Kelly KB, Zintsmaster MP et al (2008) Formative evaluation of standardized training for CT colonographic image interpretation by novice readers. Radiology 249:167–177CrossRef Dachman AH, Kelly KB, Zintsmaster MP et al (2008) Formative evaluation of standardized training for CT colonographic image interpretation by novice readers. Radiology 249:167–177CrossRef
6.
Zurück zum Zitat Liedenbaum MH, Bipat S, Bossuyt PMM et al (2011) Evaluation of a standardized CT colonography training program for novice readers. Radiology 258:477–487CrossRef Liedenbaum MH, Bipat S, Bossuyt PMM et al (2011) Evaluation of a standardized CT colonography training program for novice readers. Radiology 258:477–487CrossRef
7.
Zurück zum Zitat Regge D, Della Monica P, Galatola G et al (2013) Efficacy of computer-aided detection as a second reader for 6–9-mm lesions at CT colonography: multicenter prospective trial. Radiology 266:168–176CrossRef Regge D, Della Monica P, Galatola G et al (2013) Efficacy of computer-aided detection as a second reader for 6–9-mm lesions at CT colonography: multicenter prospective trial. Radiology 266:168–176CrossRef
8.
Zurück zum Zitat Mang T, Bogoni L, Anand VX et al (2014) CT colonography: effect of computer-aided detection of colonic polyps as a second and concurrent reader for general radiologists with moderate experience in CT colonography. Eur Radiol 24:1466–1476CrossRef Mang T, Bogoni L, Anand VX et al (2014) CT colonography: effect of computer-aided detection of colonic polyps as a second and concurrent reader for general radiologists with moderate experience in CT colonography. Eur Radiol 24:1466–1476CrossRef
9.
Zurück zum Zitat Neri E, Halligan S, Hellström M et al (2013) The second ESGAR consensus statement on CT colonography. Eur Radiol 23:720–729CrossRef Neri E, Halligan S, Hellström M et al (2013) The second ESGAR consensus statement on CT colonography. Eur Radiol 23:720–729CrossRef
10.
Zurück zum Zitat Neri E, Faggioni L, Regge D et al (2011) CT colonography: role of a second reader CAD paradigm in the initial training of radiologists. Eur J Radiol 80:303–809CrossRef Neri E, Faggioni L, Regge D et al (2011) CT colonography: role of a second reader CAD paradigm in the initial training of radiologists. Eur J Radiol 80:303–809CrossRef
11.
Zurück zum Zitat Boone D, Mallett S, McQuillan J et al (2015) Assessment of the incremental benefit of computer-aided detection (CAD) for interpretation of CT colonography by experienced and inexperienced readers. PLoS One 10:e0136624CrossRef Boone D, Mallett S, McQuillan J et al (2015) Assessment of the incremental benefit of computer-aided detection (CAD) for interpretation of CT colonography by experienced and inexperienced readers. PLoS One 10:e0136624CrossRef
12.
Zurück zum Zitat Fisichella VA, Jäderling F, Horvath S et al (2009) Computer-aided detection (CAD) as a second reader using perspective filet view at CT colonography: effect on performance of inexperienced readers. Clin Radiol 64:972–982CrossRef Fisichella VA, Jäderling F, Horvath S et al (2009) Computer-aided detection (CAD) as a second reader using perspective filet view at CT colonography: effect on performance of inexperienced readers. Clin Radiol 64:972–982CrossRef
13.
Zurück zum Zitat Baker ME, Bogoni L, Obuchowski NA et al (2007) Computer-aided detection of colorectal polyps: can it improve sensitivity of less-experienced readers? Preliminary findings. Radiology 245:140–149CrossRef Baker ME, Bogoni L, Obuchowski NA et al (2007) Computer-aided detection of colorectal polyps: can it improve sensitivity of less-experienced readers? Preliminary findings. Radiology 245:140–149CrossRef
14.
Zurück zum Zitat Pickhardt PJ (2004) Differential diagnosis of polypoid lesions \n at CT colonography (virtual colonoscopy). Radiographics 24:1535–1556CrossRef Pickhardt PJ (2004) Differential diagnosis of polypoid lesions \n at CT colonography (virtual colonoscopy). Radiographics 24:1535–1556CrossRef
15.
Zurück zum Zitat Mang T, Maier A, Plank C et al (2007) Pitfalls in multi-detector row CT colonography: a systematic approach. Radiographics 27:431–454CrossRef Mang T, Maier A, Plank C et al (2007) Pitfalls in multi-detector row CT colonography: a systematic approach. Radiographics 27:431–454CrossRef
16.
Zurück zum Zitat Delsanto, S, Morra, L, Campanella et al (2008) Computer aided detection of polyps in virtual colonoscopy with sameday fecal tagging. Medical Imaging, San Diego, California, 16–21 Feb 2008 Delsanto, S, Morra, L, Campanella et al (2008) Computer aided detection of polyps in virtual colonoscopy with sameday fecal tagging. Medical Imaging, San Diego, California, 16–21 Feb 2008
17.
Zurück zum Zitat Iussich G, Correale L, Senore C et al (2013) CT colonography: preliminary assessment of a double-read paradigm that uses computer-aided detection as the first reader. Radiology 268:743–751CrossRef Iussich G, Correale L, Senore C et al (2013) CT colonography: preliminary assessment of a double-read paradigm that uses computer-aided detection as the first reader. Radiology 268:743–751CrossRef
18.
Zurück zum Zitat Yan J (2002) geepack: yet another package for generalized estimating equations. R-News 2:12–14 Yan J (2002) geepack: yet another package for generalized estimating equations. R-News 2:12–14
19.
Zurück zum Zitat Yan J, Fine J (2004) Estimating equations for association structures. Stat Med 23:859–874CrossRef Yan J, Fine J (2004) Estimating equations for association structures. Stat Med 23:859–874CrossRef
20.
Zurück zum Zitat Gallas BD, Bandos A, Samuelson FW, Wagner RF (2009) A framework for random-effects ROC analysis: biases with the bootstrap and other variance estimators. Commun Stat - Theory Methods 38:2586–2603CrossRef Gallas BD, Bandos A, Samuelson FW, Wagner RF (2009) A framework for random-effects ROC analysis: biases with the bootstrap and other variance estimators. Commun Stat - Theory Methods 38:2586–2603CrossRef
21.
Zurück zum Zitat Obuchowski NA, Gallas BD, Hillis SL (2012) Multi-reader ROC studies with split-plot designs. Acad Radiol 19:1508–1517CrossRef Obuchowski NA, Gallas BD, Hillis SL (2012) Multi-reader ROC studies with split-plot designs. Acad Radiol 19:1508–1517CrossRef
22.
Zurück zum Zitat Tonidandel S, Overall JE, Smith F (2004) Use of resampling to select among alternative error structure specifications for GLMM analyses of repeated measurements. Int J Methods Psychiatr Res 13:24–33CrossRef Tonidandel S, Overall JE, Smith F (2004) Use of resampling to select among alternative error structure specifications for GLMM analyses of repeated measurements. Int J Methods Psychiatr Res 13:24–33CrossRef
23.
Zurück zum Zitat Obuchowski NA, Hillis SL (2011) Sample size tables for computer-aided detection studies. AJR Am J Roentgenol 197:W821–W828CrossRef Obuchowski NA, Hillis SL (2011) Sample size tables for computer-aided detection studies. AJR Am J Roentgenol 197:W821–W828CrossRef
24.
Zurück zum Zitat Auffermann WF, Henry TS, Little BP, Tigges S, Tridandapani S (2015) Simulation for teaching and assessment of nodule perception on chest radiography in nonradiology health care trainees. J Am Coll Radiol 12:1215–1222CrossRef Auffermann WF, Henry TS, Little BP, Tigges S, Tridandapani S (2015) Simulation for teaching and assessment of nodule perception on chest radiography in nonradiology health care trainees. J Am Coll Radiol 12:1215–1222CrossRef
25.
Zurück zum Zitat Zafar S, Safdar S, Zafar AN (2014) Evaluation of use of e-Learning in undergraduate radiology education: a review. Eur J Radiol 83:2277–2287CrossRef Zafar S, Safdar S, Zafar AN (2014) Evaluation of use of e-Learning in undergraduate radiology education: a review. Eur J Radiol 83:2277–2287CrossRef
Metadaten
Titel
Computer-based self-training for CT colonography with and without CAD
verfasst von
Lapo Sali
Silvia Delsanto
Daniela Sacchetto
Loredana Correale
Massimo Falchini
Andrea Ferraris
Giovanni Gandini
Giulia Grazzini
Franco Iafrate
Gabriella Iussich
Lia Morra
Andrea Laghi
Mario Mascalchi
Daniele Regge
Publikationsdatum
23.05.2018
Verlag
Springer Berlin Heidelberg
Erschienen in
European Radiology / Ausgabe 11/2018
Print ISSN: 0938-7994
Elektronische ISSN: 1432-1084
DOI
https://doi.org/10.1007/s00330-018-5480-5

Weitere Artikel der Ausgabe 11/2018

European Radiology 11/2018 Zur Ausgabe

Update Radiologie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.