Skip to main content
Erschienen in: Abdominal Radiology 12/2020

16.09.2020 | COVID-19 | Pancreas Zur Zeit gratis

Development of a volumetric pancreas segmentation CT dataset for AI applications through trained technologists: a study during the COVID 19 containment phase

verfasst von: Garima Suman, Ananya Panda, Panagiotis Korfiatis, Marie E. Edwards, Sushil Garg, Daniel J. Blezek, Suresh T. Chari, Ajit H. Goenka

Erschienen in: Abdominal Radiology | Ausgabe 12/2020

Einloggen, um Zugang zu erhalten

Abstract

Purpose

To evaluate the performance of trained technologists vis-à-vis radiologists for volumetric pancreas segmentation and to assess the impact of supplementary training on their performance.

Methods

In this IRB-approved study, 22 technologists were trained in pancreas segmentation on portal venous phase CT through radiologist-led interactive videoconferencing sessions based on an image-rich curriculum. Technologists segmented pancreas in 188 CTs using freehand tools on custom image-viewing software. Subsequent supplementary training included multimedia videos focused on common errors, which were followed by second batch of 159 segmentations. Two radiologists reviewed all cases and corrected inaccurate segmentations. Technologists’ segmentations were compared against radiologists’ segmentations using Dice-Sorenson coefficient (DSC), Jaccard coefficient (JC), and Bland–Altman analysis.

Results

Corrections were made in 71 (38%) cases from first batch [26 (37%) oversegmentations and 45 (63%) undersegmentations] and in 77 (48%) cases from second batch [12 (16%) oversegmentations and 65 (84%) undersegmentations]. DSC, JC, false positive (FP), and false negative (FN) [mean (SD)] in first versus second batches were 0.63 (0.15) versus 0.63 (0.16), 0.48 (0.15) versus 0.48 (0.15), 0.29 (0.21) versus 0.21 (0.10), and 0.36 (0.20) versus 0.43 (0.19), respectively. Differences were not significant (p > 0.05). However, range of mean pancreatic volume difference reduced in the second batch [− 2.74 cc (min − 92.96 cc, max 87.47 cc) versus − 23.57 cc (min − 77.32, max 30.19)].

Conclusion

Trained technologists could perform volumetric pancreas segmentation with reasonable accuracy despite its complexity. Supplementary training further reduced range of volume difference in segmentations. Investment into training technologists could augment and accelerate development of body imaging datasets for AI applications.
Literatur
4.
Zurück zum Zitat Chu LC, Park S, Kawamoto S, Wang Y, Zhou Y, Shen W, Zhu Z, Xia Y, Xie L, Liu F, Yu Q, Fouladi DF, Shayesteh S, Zinreich E, Graves JS, Horton KM, Yuille AL, Hruban RH, Kinzler KW, Vogelstein B, Fishman EK (2019) Application of Deep Learning to Pancreatic Cancer Detection: Lessons Learned From Our Initial Experience. J Am Coll Radiol 16 (9 Pt B):1338-1342. https://doi.org/10.1016/j.jacr.2019.05.034 Chu LC, Park S, Kawamoto S, Wang Y, Zhou Y, Shen W, Zhu Z, Xia Y, Xie L, Liu F, Yu Q, Fouladi DF, Shayesteh S, Zinreich E, Graves JS, Horton KM, Yuille AL, Hruban RH, Kinzler KW, Vogelstein B, Fishman EK (2019) Application of Deep Learning to Pancreatic Cancer Detection: Lessons Learned From Our Initial Experience. J Am Coll Radiol 16 (9 Pt B):1338-1342. https://​doi.​org/​10.​1016/​j.​jacr.​2019.​05.​034
6.
Zurück zum Zitat Oda M, Shimizu N, Karasawa K, Nimura Y, Kitasaka T, Misawa K, Fujiwara M, Rueckert D, Mori K (2016) Regression Forest-Based Atlas Localization and Direction Specific Atlas Generation for Pancreas Segmentation. Lecture Notes in Computer Science abs/2005.03345:556–563 Oda M, Shimizu N, Karasawa K, Nimura Y, Kitasaka T, Misawa K, Fujiwara M, Rueckert D, Mori K (2016) Regression Forest-Based Atlas Localization and Direction Specific Atlas Generation for Pancreas Segmentation. Lecture Notes in Computer Science abs/2005.03345:556–563
10.
13.
Zurück zum Zitat Sammer MBK, Sher AC, Huisman T, Seghers VJ (2020) Response to the COVID-19 Pandemic: Practical Guide to Rapidly Deploying Home Workstations to Guarantee Radiology Services During Quarantine, Social Distancing, and Stay Home Orders. AJR Am J Roentgenol:1-4. https://doi.org/10.2214/ajr.20.23297 Sammer MBK, Sher AC, Huisman T, Seghers VJ (2020) Response to the COVID-19 Pandemic: Practical Guide to Rapidly Deploying Home Workstations to Guarantee Radiology Services During Quarantine, Social Distancing, and Stay Home Orders. AJR Am J Roentgenol:1-4. https://​doi.​org/​10.​2214/​ajr.​20.​23297
16.
Zurück zum Zitat Pedregosa F, Varoquaux G, Gramfort A, Michel V, Thirion B, Grisel O, Blondel M, Prettenhofer P, Weiss R, Dubourg V, Vanderplas J, Passos A, Cournapeau D, Brucher M, Perrot M, Duchesnay E (2011) Scikit-learn: Machine Learning in Python. Journal of Machine Learning Research 12:2825–2830 Pedregosa F, Varoquaux G, Gramfort A, Michel V, Thirion B, Grisel O, Blondel M, Prettenhofer P, Weiss R, Dubourg V, Vanderplas J, Passos A, Cournapeau D, Brucher M, Perrot M, Duchesnay E (2011) Scikit-learn: Machine Learning in Python. Journal of Machine Learning Research 12:2825–2830
18.
Zurück zum Zitat Cheplygina V, Perez-Rovira A, Kuo W, Tiddens HAWM, de Bruijne M Early Experiences with Crowdsourcing Airway Annotations in Chest CT. In, Cham, 2016. Deep Learning and Data Labeling for Medical Applications. Springer International Publishing, pp 209-218 Cheplygina V, Perez-Rovira A, Kuo W, Tiddens HAWM, de Bruijne M Early Experiences with Crowdsourcing Airway Annotations in Chest CT. In, Cham, 2016. Deep Learning and Data Labeling for Medical Applications. Springer International Publishing, pp 209-218
19.
Zurück zum Zitat Boorboor S, Nadeem S, Park JH, Baker K, Kaufman A (2018) Crowdsourcing lung nodules detection and annotation, vol 10579. SPIE Medical Imaging. SPIE, Boorboor S, Nadeem S, Park JH, Baker K, Kaufman A (2018) Crowdsourcing lung nodules detection and annotation, vol 10579. SPIE Medical Imaging. SPIE,
20.
23.
Zurück zum Zitat Balducci F, Buono P (2018) Building a qualified annotation dataset for skin lesion analysis trough gamification. Proceedings of the 2018 International Conference on Advanced Visual Interfaces Balducci F, Buono P (2018) Building a qualified annotation dataset for skin lesion analysis trough gamification. Proceedings of the 2018 International Conference on Advanced Visual Interfaces
26.
Zurück zum Zitat Zhou Z-H (2018) A brief introduction to weakly supervised learning. National Science Review 5:44-53CrossRef Zhou Z-H (2018) A brief introduction to weakly supervised learning. National Science Review 5:44-53CrossRef
Metadaten
Titel
Development of a volumetric pancreas segmentation CT dataset for AI applications through trained technologists: a study during the COVID 19 containment phase
verfasst von
Garima Suman
Ananya Panda
Panagiotis Korfiatis
Marie E. Edwards
Sushil Garg
Daniel J. Blezek
Suresh T. Chari
Ajit H. Goenka
Publikationsdatum
16.09.2020
Verlag
Springer US
Schlagwort
COVID-19
Erschienen in
Abdominal Radiology / Ausgabe 12/2020
Print ISSN: 2366-004X
Elektronische ISSN: 2366-0058
DOI
https://doi.org/10.1007/s00261-020-02741-x

Weitere Artikel der Ausgabe 12/2020

Abdominal Radiology 12/2020 Zur Ausgabe

Update Radiologie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.