Skip to main content
Erschienen in: International Journal of Computer Assisted Radiology and Surgery 2/2019

27.11.2018 | Original Article

Deep-learned placental vessel segmentation for intraoperative video enhancement in fetoscopic surgery

verfasst von: Praneeth Sadda, Metehan Imamoglu, Michael Dombrowski, Xenophon Papademetris, Mert O. Bahtiyar, John Onofrey

Erschienen in: International Journal of Computer Assisted Radiology and Surgery | Ausgabe 2/2019

Einloggen, um Zugang zu erhalten

Abstract

Introduction

Twin-to-twin transfusion syndrome (TTTS) is a potentially lethal condition that affects pregnancies in which twins share a single placenta. The definitive treatment for TTTS is fetoscopic laser photocoagulation, a procedure in which placental blood vessels are selectively cauterized. Challenges in this procedure include difficulty in quickly identifying placental blood vessels due to the many artifacts in the endoscopic video that the surgeon uses for navigation. We propose using deep-learned segmentations of blood vessels to create masks that can be recombined with the original fetoscopic video frame in such a way that the location of placental blood vessels is discernable at a glance.

Methods

In a process approved by an institutional review board, intraoperative videos were acquired from ten fetoscopic laser photocoagulation surgeries performed at Yale New Haven Hospital. A total of 345 video frames were selected from these videos at regularly spaced time intervals. The video frames were segmented once by an expert human rater (a clinician) and once by a novice, but trained human rater (an undergraduate student). The segmentations were used to train a fully convolutional neural network of 25 layers.

Results

The neural network was able to produce segmentations with a high similarity to ground truth segmentations produced by an expert human rater (sensitivity = 92.15% ± 10.69%) and produced segmentations that were significantly more accurate than those produced by a novice human rater (sensitivity = 56.87% ± 21.64%; p < 0.01).

Conclusion

A convolutional neural network can be trained to segment placental blood vessels with near-human accuracy and can exceed the accuracy of novice human raters. Recombining these segmentations with the original fetoscopic video frames can produced enhanced frames in which blood vessels are easily detectable. This has significant implications for aiding fetoscopic surgeons—especially trainees who are not yet at an expert level.
Anhänge
Nur mit Berechtigung zugänglich
Literatur
3.
Zurück zum Zitat Faye-Petersen M, Crombleholme M (2008) Twin-to-twin transfusion syndrome. NeoReviews 9:370–379 Faye-Petersen M, Crombleholme M (2008) Twin-to-twin transfusion syndrome. NeoReviews 9:370–379
5.
Zurück zum Zitat Luks F (2009) Schematic illustration of endoscopic fetal surgery for twin-to-twin trans-fusion syndrome Luks F (2009) Schematic illustration of endoscopic fetal surgery for twin-to-twin trans-fusion syndrome
7.
Zurück zum Zitat Miller R, Novotny J, Laidlaw H, Luks F, Merck D, Collins S (2016) Virtually visualizing vessels: a study of the annotation of placental vasculature from MRI in large-scale virtual reality for surgical planning. Brown University, Providence Miller R, Novotny J, Laidlaw H, Luks F, Merck D, Collins S (2016) Virtually visualizing vessels: a study of the annotation of placental vasculature from MRI in large-scale virtual reality for surgical planning. Brown University, Providence
8.
Zurück zum Zitat Tella-Amo M, Daga P, Chadebecq F, Thompson S, Shakir I, Dwyer G, Wimalasundera R, Deprest J, Stoyanov D, Vercauteren T, Ourselin S (2016) A combined EM and visual tracking probabilistic model for robust mosaicking: application to fetoscopy. In: Proceedings of IEEE CVPR workshops, vol 31, pp 84–92. https://doi.org/10.1515/10.1109/cvprw.2016.72 Tella-Amo M, Daga P, Chadebecq F, Thompson S, Shakir I, Dwyer G, Wimalasundera R, Deprest J, Stoyanov D, Vercauteren T, Ourselin S (2016) A combined EM and visual tracking probabilistic model for robust mosaicking: application to fetoscopy. In: Proceedings of IEEE CVPR workshops, vol 31, pp 84–92. https://​doi.​org/​10.​1515/​10.​1109/​cvprw.​2016.​72
11.
12.
Zurück zum Zitat Yang L, Wang J, Ando T, Kubota A, Yamashita H, Sakuma I, Chiba T, Kobayashi E (2016) Towards scene adaptive image correspondence for placental vasculature mosaic in computer assisted fetoscopic procedures. Int J Med Robot Comput Assist Surg 12:375–386. https://doi.org/10.1002/rcs.1700 CrossRef Yang L, Wang J, Ando T, Kubota A, Yamashita H, Sakuma I, Chiba T, Kobayashi E (2016) Towards scene adaptive image correspondence for placental vasculature mosaic in computer assisted fetoscopic procedures. Int J Med Robot Comput Assist Surg 12:375–386. https://​doi.​org/​10.​1002/​rcs.​1700 CrossRef
14.
Zurück zum Zitat Almoussa N, Dutra B, Lampe B, Getreuer P, Wittman T, Salafia C, Vese L (2011) Automated vasculature extraction from placenta images. In: Medical imaging 2011: image processing, vol 7962. International Society for Optics and Photonics Almoussa N, Dutra B, Lampe B, Getreuer P, Wittman T, Salafia C, Vese L (2011) Automated vasculature extraction from placenta images. In: Medical imaging 2011: image processing, vol 7962. International Society for Optics and Photonics
15.
Zurück zum Zitat Park M, Yampolsky M, Shlakhter O, VanHorn S, Dygulska B, Kiryankova N, Salafia C (2013) Vessel enhancement with multiscale and curvilinear filter matching for placenta images. Placenta 34:A12 Park M, Yampolsky M, Shlakhter O, VanHorn S, Dygulska B, Kiryankova N, Salafia C (2013) Vessel enhancement with multiscale and curvilinear filter matching for placenta images. Placenta 34:A12
16.
Zurück zum Zitat Chang JM, Huynh N, Vazquez M, Salafia C. (2013) Vessel enhancement with multiscale and curvilinear filter matching for placenta images. In: 2013 20th international conference on systems, signals and image processing (IWSSIP), pp 125–128 Chang JM, Huynh N, Vazquez M, Salafia C. (2013) Vessel enhancement with multiscale and curvilinear filter matching for placenta images. In: 2013 20th international conference on systems, signals and image processing (IWSSIP), pp 125–128
21.
Zurück zum Zitat Frangi F, Niessen J, Vincken L, Viergever A (1998) Multiscale vessel enhancement filtering. MICCAI 1496:130–137 Frangi F, Niessen J, Vincken L, Viergever A (1998) Multiscale vessel enhancement filtering. MICCAI 1496:130–137
23.
Zurück zum Zitat Jiang Y, Zhuang W, Sinusas J, Staib H, Papademetris X (2011) Vessel connectivity using Murray’s hypothesis. MICCAI 14:528–536PubMed Jiang Y, Zhuang W, Sinusas J, Staib H, Papademetris X (2011) Vessel connectivity using Murray’s hypothesis. MICCAI 14:528–536PubMed
Metadaten
Titel
Deep-learned placental vessel segmentation for intraoperative video enhancement in fetoscopic surgery
verfasst von
Praneeth Sadda
Metehan Imamoglu
Michael Dombrowski
Xenophon Papademetris
Mert O. Bahtiyar
John Onofrey
Publikationsdatum
27.11.2018
Verlag
Springer International Publishing
Erschienen in
International Journal of Computer Assisted Radiology and Surgery / Ausgabe 2/2019
Print ISSN: 1861-6410
Elektronische ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-018-1886-4

Weitere Artikel der Ausgabe 2/2019

International Journal of Computer Assisted Radiology and Surgery 2/2019 Zur Ausgabe

Update Radiologie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.