Skip to main content
Erschienen in: Gastric Cancer 5/2020

30.04.2020 | Original Article

A deep learning method for delineating early gastric cancer resection margin under chromoendoscopy and white light endoscopy

verfasst von: Ping An, Dongmei Yang, Jing Wang, Lianlian Wu, Jie Zhou, Zhi Zeng, Xu Huang, Yong Xiao, Shan Hu, Yiyun Chen, Fang Yao, Mingwen Guo, Qi Wu, Yanning Yang, Honggang Yu

Erschienen in: Gastric Cancer | Ausgabe 5/2020

Einloggen, um Zugang zu erhalten

Abstract

Background

Accurate delineation of cancer margins is critical for endoscopic curative resection. This study aimed to train and validate real-time fully convolutional networks for delineating the resection margin of early gastric cancer (EGC) under indigo carmine chromoendoscopy (CE) or white light endoscopy (WLE), and evaluated its performance and that of magnifying endoscopy with narrow-band imaging (ME-NBI).

Methods

We collected CE and WLE images of EGC lesions to train fully convolutional networks ENDOANGEL. ENDOANGEL was tested both on stationary images and endoscopic submucosal dissection (ESD) videos. The accuracy and reliability of ENDOANGEL and NBI-dependent delineation were further evaluated by a novel endoscopy–pathology point-to-point marking.

Results

ENDOANGEL had an accuracy of 85.7% in the CE images and 88.9% in the WLE images under an overlap ratio threshold of 0.60 in comparison with the manual markers labeled by the experts. In the ESD videos, the resection margins predicted by ENDOANGEL covered all areas of high-grade intraepithelial neoplasia and cancers. The minimum distance between the margins predicted by ENDOANGEL and the histological cancer boundary was 3.44 ± 1.45 mm which outperformed the resection margin based on ME-NBI.

Conclusions

ENDOANGEL has the potential to assist endoscopists in delineating the resection extent of EGC under CE or WLE during ESD.
Anhänge
Nur mit Berechtigung zugänglich
Literatur
1.
Zurück zum Zitat Bray F, Ferlay J, Soerjomataram I, Siegel RL, Torre LA, Jemal A. Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA Cancer J Clin. 2018;68:394–424.CrossRef Bray F, Ferlay J, Soerjomataram I, Siegel RL, Torre LA, Jemal A. Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA Cancer J Clin. 2018;68:394–424.CrossRef
2.
Zurück zum Zitat Isomoto H, Shikuwa S, Yamaguchi N, Fukuda E, Ikeda K, Nishiyama H, et al. Endoscopic submucosal dissection for early gastric cancer: a large-scale feasibility study. Gut. 2009;58:331–6.CrossRef Isomoto H, Shikuwa S, Yamaguchi N, Fukuda E, Ikeda K, Nishiyama H, et al. Endoscopic submucosal dissection for early gastric cancer: a large-scale feasibility study. Gut. 2009;58:331–6.CrossRef
3.
Zurück zum Zitat Lee S, Choi KD, Han M, Na HK, Ahn JY, Jung KW, et al. Long-term outcomes of endoscopic submucosal dissection versus surgery in early gastric cancer meeting expanded indication including undifferentiated-type tumors: a criteria-based analysis. Gastric Cancer. 2018;21:490–9.CrossRef Lee S, Choi KD, Han M, Na HK, Ahn JY, Jung KW, et al. Long-term outcomes of endoscopic submucosal dissection versus surgery in early gastric cancer meeting expanded indication including undifferentiated-type tumors: a criteria-based analysis. Gastric Cancer. 2018;21:490–9.CrossRef
4.
Zurück zum Zitat Pimentel-Nunes P, Dinis-Ribeiro M, Ponchon T, Repici A, Vieth M, De CA, et al. Endoscopic submucosal dissection: European Society of Gastrointestinal Endoscopy (ESGE) guideline. Endoscopy. 2015;47:829–54.CrossRef Pimentel-Nunes P, Dinis-Ribeiro M, Ponchon T, Repici A, Vieth M, De CA, et al. Endoscopic submucosal dissection: European Society of Gastrointestinal Endoscopy (ESGE) guideline. Endoscopy. 2015;47:829–54.CrossRef
5.
Zurück zum Zitat Bourke MJ, Neuhaus H, Bergman JJ. Endoscopic submucosal dissection: indications and application in western endoscopy practice. Gastroenterology. 2018;154:1887–900.CrossRef Bourke MJ, Neuhaus H, Bergman JJ. Endoscopic submucosal dissection: indications and application in western endoscopy practice. Gastroenterology. 2018;154:1887–900.CrossRef
6.
Zurück zum Zitat Zhao Z, Yin Z, Wang S, Wang J, Bai B, Qiu Z, et al. Meta-analysis: the diagnostic efficacy of chromoendoscopy for early gastric cancer and premalignant gastric lesions. J Gastroenterol Hepatol. 2016;31:1539–45.CrossRef Zhao Z, Yin Z, Wang S, Wang J, Bai B, Qiu Z, et al. Meta-analysis: the diagnostic efficacy of chromoendoscopy for early gastric cancer and premalignant gastric lesions. J Gastroenterol Hepatol. 2016;31:1539–45.CrossRef
7.
Zurück zum Zitat Yamashita H, Kitayama J, Ishigami H, Yamada J, Miyato H, Kaisaki S, et al. Endoscopic instillation of indigo carmine dye with acetic acid enables the visualization of distinct margin of superficial gastric lesion; usefulness in endoscopic treatment and diagnosis of gastric cancer. Dig Liver Dis. 2007;39:389–91.CrossRef Yamashita H, Kitayama J, Ishigami H, Yamada J, Miyato H, Kaisaki S, et al. Endoscopic instillation of indigo carmine dye with acetic acid enables the visualization of distinct margin of superficial gastric lesion; usefulness in endoscopic treatment and diagnosis of gastric cancer. Dig Liver Dis. 2007;39:389–91.CrossRef
8.
Zurück zum Zitat Nagahama T, Yao K, Uedo N, Doyama H, Ueo T, Uchita K, et al. Delineation of the extent of early gastric cancer by magnifying narrow-band imaging and chromoendoscopy: a multicenter randomized controlled trial. Endoscopy. 2018;50:566–76.CrossRef Nagahama T, Yao K, Uedo N, Doyama H, Ueo T, Uchita K, et al. Delineation of the extent of early gastric cancer by magnifying narrow-band imaging and chromoendoscopy: a multicenter randomized controlled trial. Endoscopy. 2018;50:566–76.CrossRef
9.
Zurück zum Zitat Nagahama T, Yao K, Maki S, Yasaka M, Takaki Y, Matsui T, et al. Usefulness of magnifying endoscopy with narrow-band imaging for determining the horizontal extent of early gastric cancer when there is an unclear margin by chromoendoscopy (with video). Gastrointest Endosc. 2011;74:1259–67.CrossRef Nagahama T, Yao K, Maki S, Yasaka M, Takaki Y, Matsui T, et al. Usefulness of magnifying endoscopy with narrow-band imaging for determining the horizontal extent of early gastric cancer when there is an unclear margin by chromoendoscopy (with video). Gastrointest Endosc. 2011;74:1259–67.CrossRef
10.
Zurück zum Zitat Nonaka K, Namoto M, Kitada H, Shimizu M, Ochiai Y, Togawa O, et al. Usefulness of the DL in ME with NBI for determining the expanded area of early-stage differentiated gastric carcinoma. World J Gastrointest Endosc. 2012;4:362–7.CrossRef Nonaka K, Namoto M, Kitada H, Shimizu M, Ochiai Y, Togawa O, et al. Usefulness of the DL in ME with NBI for determining the expanded area of early-stage differentiated gastric carcinoma. World J Gastrointest Endosc. 2012;4:362–7.CrossRef
11.
Zurück zum Zitat Asada-Hirayama I, Kodashima S, Sakaguchi Y, Ono S, Niimi K, Mochizuki S, et al. Magnifying endoscopy with narrow-band imaging is more accurate for determination of horizontal extent of early gastric cancers than chromoendoscopy. Endosc Int Open. 2016;4:E690–E698698.CrossRef Asada-Hirayama I, Kodashima S, Sakaguchi Y, Ono S, Niimi K, Mochizuki S, et al. Magnifying endoscopy with narrow-band imaging is more accurate for determination of horizontal extent of early gastric cancers than chromoendoscopy. Endosc Int Open. 2016;4:E690–E698698.CrossRef
12.
Zurück zum Zitat Simonyan K, Zisserman A. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv. 2014. pp. 1409–556. Simonyan K, Zisserman A. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv. 2014. pp. 1409–556.
13.
Zurück zum Zitat Krizhevsky A, Sutskever I, Hinton G. Imagenet classification with deep convolutional neural networks. Adv Neural Inf Process Syst 2012. pp. 1097–105. Krizhevsky A, Sutskever I, Hinton G. Imagenet classification with deep convolutional neural networks. Adv Neural Inf Process Syst 2012. pp. 1097–105.
14.
Zurück zum Zitat Byrne MF, Chapados N, Soudan F, Oertel C, Linares MP, et al. Real-time differentiation of adenomatous and hyperplastic diminutive colorectal polyps during analysis of unaltered videos of standard colonoscopy using a deep learning model. Gut. 2019;68:94–100.CrossRef Byrne MF, Chapados N, Soudan F, Oertel C, Linares MP, et al. Real-time differentiation of adenomatous and hyperplastic diminutive colorectal polyps during analysis of unaltered videos of standard colonoscopy using a deep learning model. Gut. 2019;68:94–100.CrossRef
15.
Zurück zum Zitat Esteva A, Kuprel B, Novoa RA, Ko J, Swetter SM, Blau HM, et al. Dermatologist-level classification of skin cancer with deep neural networks. Nature. 2017;542:115.CrossRef Esteva A, Kuprel B, Novoa RA, Ko J, Swetter SM, Blau HM, et al. Dermatologist-level classification of skin cancer with deep neural networks. Nature. 2017;542:115.CrossRef
16.
Zurück zum Zitat Wu LL, Zhou W, Wan XY, Zhang J, Shen L, Hu S, et al. A deep neural network improves endoscopic detection of early gastric cancer without blind spots. Endoscopy. 2019;51:522–31.CrossRef Wu LL, Zhou W, Wan XY, Zhang J, Shen L, Hu S, et al. A deep neural network improves endoscopic detection of early gastric cancer without blind spots. Endoscopy. 2019;51:522–31.CrossRef
18.
Zurück zum Zitat Long J, Shelhamer E, Darrell T. Fully convolutional networks for semantic segmentation. IEEE Trans Pattern Anal Mach Intell. 2015;2015:645–51. Long J, Shelhamer E, Darrell T. Fully convolutional networks for semantic segmentation. IEEE Trans Pattern Anal Mach Intell. 2015;2015:645–51.
19.
Zurück zum Zitat Zhou Z, Siddiquee MMR, Tajbakhsh N, Liang J. UNet++: A Nested U-Net Architecture for Medical Image Segmentation. In: Stoyanov D. et al. (eds.) Deep learning in medical image analysis and multimodal learning for clinical decision support. DLMIA 2018, ML-CDS 2018. Lecture notes in computer science, vol 11045. Cham: Springer. Zhou Z, Siddiquee MMR, Tajbakhsh N, Liang J. UNet++: A Nested U-Net Architecture for Medical Image Segmentation. In: Stoyanov D. et al. (eds.) Deep learning in medical image analysis and multimodal learning for clinical decision support. DLMIA 2018, ML-CDS 2018. Lecture notes in computer science, vol 11045. Cham: Springer.
20.
Zurück zum Zitat Kikuchi D, Iizuka T, Hoteya S, Nomura K, Kuribayashi Y, Toba T, et al. Vascular density of superficial esophageal squamous cell carcinoma determined by direct observation of resected specimen using narrow band imaging with magnifying endoscopy. Dis Esophagus. 2017;30:1–5.CrossRef Kikuchi D, Iizuka T, Hoteya S, Nomura K, Kuribayashi Y, Toba T, et al. Vascular density of superficial esophageal squamous cell carcinoma determined by direct observation of resected specimen using narrow band imaging with magnifying endoscopy. Dis Esophagus. 2017;30:1–5.CrossRef
21.
Zurück zum Zitat Schlemper RJ, Riddell RH, Kato Y, Borchard F, Cooper HS, Dawsey SM, et al. The Vienna classification of gastrointestinal epithelial neoplasia. Gut. 2000;47:251–5.CrossRef Schlemper RJ, Riddell RH, Kato Y, Borchard F, Cooper HS, Dawsey SM, et al. The Vienna classification of gastrointestinal epithelial neoplasia. Gut. 2000;47:251–5.CrossRef
22.
Zurück zum Zitat ERDAS. ERDAS field guide: Erdas, 1997. ERDAS. ERDAS field guide: Erdas, 1997.
23.
Zurück zum Zitat Geosystems L. ERDAS imagine. Atlanta, 2004. Geosystems L. ERDAS imagine. Atlanta, 2004.
24.
Zurück zum Zitat Huaizu J, Erik LM. Face Detection with the faster R-CNN. In: 2017 12th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2017); 2017. pp. 650–657. Huaizu J, Erik LM. Face Detection with the faster R-CNN. In: 2017 12th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2017); 2017. pp. 650–657.
25.
Zurück zum Zitat Sakai Y, Eto R, Kasanuki J, Kondo F, Kato K, Arai M, et al. Chromoendoscopy with indigo carmine dye added to acetic acid in the diagnosis of gastric neoplasia: a prospective comparative study. Gastrointest Endosc. 2008;68:635–41.CrossRef Sakai Y, Eto R, Kasanuki J, Kondo F, Kato K, Arai M, et al. Chromoendoscopy with indigo carmine dye added to acetic acid in the diagnosis of gastric neoplasia: a prospective comparative study. Gastrointest Endosc. 2008;68:635–41.CrossRef
26.
Zurück zum Zitat Numata N, Oka S, Tanaka S, Yoshifuku Y, Miwat T, Sanomura Y, et al. Useful condition of chromoendoscopy with indigo carmine and acetic acid for identifying a demarcation line prior to endoscopic submucosal dissection for early gastric cancer. BMC Gastroenterol. 2016;16:72.CrossRef Numata N, Oka S, Tanaka S, Yoshifuku Y, Miwat T, Sanomura Y, et al. Useful condition of chromoendoscopy with indigo carmine and acetic acid for identifying a demarcation line prior to endoscopic submucosal dissection for early gastric cancer. BMC Gastroenterol. 2016;16:72.CrossRef
27.
Zurück zum Zitat Makazu M, Hirasawa K, Sato C, Ikeda R, Fukuchi T, Ishii Y, et al. Histological verification of the usefulness of magnifying endoscopy with narrow-band imaging for horizontal margin diagnosis of differentiated-type early gastric cancers. Gastric Cancer. 2018;21:258–66.CrossRef Makazu M, Hirasawa K, Sato C, Ikeda R, Fukuchi T, Ishii Y, et al. Histological verification of the usefulness of magnifying endoscopy with narrow-band imaging for horizontal margin diagnosis of differentiated-type early gastric cancers. Gastric Cancer. 2018;21:258–66.CrossRef
28.
Zurück zum Zitat Yao K, Anagnostopoulos G, Ragunath K. Magnifying endoscopy for diagnosing and delineating early gastric cancer. Endoscopy. 2009;41:462–7.CrossRef Yao K, Anagnostopoulos G, Ragunath K. Magnifying endoscopy for diagnosing and delineating early gastric cancer. Endoscopy. 2009;41:462–7.CrossRef
29.
Zurück zum Zitat Kanesaka T, Lee TC, Uedo N, Lin KP, Chen HZ, Lee JY, et al. Computer-aided diagnosis for identifying and delineating early gastric cancers in magnifying narrow-band imaging. Gastrointest Endosc. 2018;87:1339–444.CrossRef Kanesaka T, Lee TC, Uedo N, Lin KP, Chen HZ, Lee JY, et al. Computer-aided diagnosis for identifying and delineating early gastric cancers in magnifying narrow-band imaging. Gastrointest Endosc. 2018;87:1339–444.CrossRef
30.
Zurück zum Zitat Sumiyama K. Past and current trends in endoscopic diagnosis for early stage gastric cancer in Japan. Gastric Cancer. 2017;20:20–7.CrossRef Sumiyama K. Past and current trends in endoscopic diagnosis for early stage gastric cancer in Japan. Gastric Cancer. 2017;20:20–7.CrossRef
Metadaten
Titel
A deep learning method for delineating early gastric cancer resection margin under chromoendoscopy and white light endoscopy
verfasst von
Ping An
Dongmei Yang
Jing Wang
Lianlian Wu
Jie Zhou
Zhi Zeng
Xu Huang
Yong Xiao
Shan Hu
Yiyun Chen
Fang Yao
Mingwen Guo
Qi Wu
Yanning Yang
Honggang Yu
Publikationsdatum
30.04.2020
Verlag
Springer Singapore
Erschienen in
Gastric Cancer / Ausgabe 5/2020
Print ISSN: 1436-3291
Elektronische ISSN: 1436-3305
DOI
https://doi.org/10.1007/s10120-020-01071-7

Weitere Artikel der Ausgabe 5/2020

Gastric Cancer 5/2020 Zur Ausgabe

Update Chirurgie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.

S3-Leitlinie „Diagnostik und Therapie des Karpaltunnelsyndroms“

Karpaltunnelsyndrom BDC Leitlinien Webinare
CME: 2 Punkte

Das Karpaltunnelsyndrom ist die häufigste Kompressionsneuropathie peripherer Nerven. Obwohl die Anamnese mit dem nächtlichen Einschlafen der Hand (Brachialgia parästhetica nocturna) sehr typisch ist, ist eine klinisch-neurologische Untersuchung und Elektroneurografie in manchen Fällen auch eine Neurosonografie erforderlich. Im Anfangsstadium sind konservative Maßnahmen (Handgelenksschiene, Ergotherapie) empfehlenswert. Bei nicht Ansprechen der konservativen Therapie oder Auftreten von neurologischen Ausfällen ist eine Dekompression des N. medianus am Karpaltunnel indiziert.

Prof. Dr. med. Gregor Antoniadis
Berufsverband der Deutschen Chirurgie e.V.

S2e-Leitlinie „Distale Radiusfraktur“

Radiusfraktur BDC Leitlinien Webinare
CME: 2 Punkte

Das Webinar beschäftigt sich mit Fragen und Antworten zu Diagnostik und Klassifikation sowie Möglichkeiten des Ausschlusses von Zusatzverletzungen. Die Referenten erläutern, welche Frakturen konservativ behandelt werden können und wie. Das Webinar beantwortet die Frage nach aktuellen operativen Therapiekonzepten: Welcher Zugang, welches Osteosynthesematerial? Auf was muss bei der Nachbehandlung der distalen Radiusfraktur geachtet werden?

PD Dr. med. Oliver Pieske
Dr. med. Benjamin Meyknecht
Berufsverband der Deutschen Chirurgie e.V.

S1-Leitlinie „Empfehlungen zur Therapie der akuten Appendizitis bei Erwachsenen“

Appendizitis BDC Leitlinien Webinare
CME: 2 Punkte

Inhalte des Webinars zur S1-Leitlinie „Empfehlungen zur Therapie der akuten Appendizitis bei Erwachsenen“ sind die Darstellung des Projektes und des Erstellungswegs zur S1-Leitlinie, die Erläuterung der klinischen Relevanz der Klassifikation EAES 2015, die wissenschaftliche Begründung der wichtigsten Empfehlungen und die Darstellung stadiengerechter Therapieoptionen.

Dr. med. Mihailo Andric
Berufsverband der Deutschen Chirurgie e.V.