Skip to main content
Erschienen in: Journal of Gastroenterology 11/2020

10.08.2020 | Original Article―Alimentary Tract

Real-time assessment of video images for esophageal squamous cell carcinoma invasion depth using artificial intelligence

verfasst von: Yusaku Shimamoto, Ryu Ishihara, Yusuke Kato, Ayaka Shoji, Takahiro Inoue, Katsunori Matsueda, Muneaki Miyake, Kotaro Waki, Mitsuhiro Kono, Hiromu Fukuda, Noriko Matsuura, Koji Nagaike, Kenji Aoi, Katsumi Yamamoto, Takuya Inoue, Masanori Nakahara, Akihiro Nishihara, Tomohiro Tada

Erschienen in: Journal of Gastroenterology | Ausgabe 11/2020

Einloggen, um Zugang zu erhalten

Abstract

Background

Although optimal treatment of superficial esophageal squamous cell carcinoma (SCC) requires accurate evaluation of cancer invasion depth, the current process is rather subjective and may vary by observer. We, therefore, aimed to develop an AI system to calculate cancer invasion depth.

Methods

We gathered and selected 23,977 images (6857 WLI and 17,120 NBI/BLI images) of pathologically proven superficial esophageal SCC from endoscopic videos and still images of superficial esophageal SCC taken in our facility, to use as a learning dataset. We annotated the images with information [such as magnified endoscopy (ME) or non-ME, pEP-LPM, pMM, pSM1, and pSM2-3 cancers] based on pathologic diagnosis of the resected specimens. We created a model using a convolutional neural network. Performance of the AI system was compared with that of invited experts who used the same validation video set, independent of the learning dataset.

Results

Accuracy, sensitivity, and specificity with non-magnified endoscopy (ME) were 87%, 50%, and 99% for the AI system and 85%, 45%, 97% for the experts. Accuracy, sensitivity, and specificity with ME were 89%, 71%, and 95% for the AI system and 84%, 42%, 97% for the experts.

Conclusions

Most diagnostic parameters were higher when done by the AI system than by the experts. These results suggest that our AI system could potentially provide useful support during endoscopies.
Literatur
1.
Zurück zum Zitat Ferlay J, Colombet M, Soerjomataram I, et al. Estimating the global cancer incidence and mortality in 2018: GLOBOCAN sources and methods. Int J Cancer. 2019;144:1941–53.CrossRef Ferlay J, Colombet M, Soerjomataram I, et al. Estimating the global cancer incidence and mortality in 2018: GLOBOCAN sources and methods. Int J Cancer. 2019;144:1941–53.CrossRef
2.
Zurück zum Zitat Tachimori Y, Ozawa S, Numasaki H, et al. Comprehensive registry of esophageal cancer in Japan, 2012. Esophagus. 2019;16:221–45.CrossRef Tachimori Y, Ozawa S, Numasaki H, et al. Comprehensive registry of esophageal cancer in Japan, 2012. Esophagus. 2019;16:221–45.CrossRef
3.
Zurück zum Zitat Kodama M, Kakegawa T. Treatment of superficial cancer of the esophagus: a summary of responses to a questionnaire on superficial cancer of the esophagus in Japan. Surgery. 1998;123:432–9.CrossRef Kodama M, Kakegawa T. Treatment of superficial cancer of the esophagus: a summary of responses to a questionnaire on superficial cancer of the esophagus in Japan. Surgery. 1998;123:432–9.CrossRef
4.
Zurück zum Zitat Igaki H, Kato H, Tachimori Y, et al. Clinicopathologic characteristics and survival of patients with clinical Stage I squamous cell carcinomas of the thoracic esophagus treated with three-field lymph node dissection. Eur J Cardiothorac Surg. 2001;20:1089–94.CrossRef Igaki H, Kato H, Tachimori Y, et al. Clinicopathologic characteristics and survival of patients with clinical Stage I squamous cell carcinomas of the thoracic esophagus treated with three-field lymph node dissection. Eur J Cardiothorac Surg. 2001;20:1089–94.CrossRef
5.
Zurück zum Zitat Yamamoto S, Ishihara R, Motoori M, et al. Comparison between definitive chemoradiotherapy and esophagectomy in patients with clinical stage I esophageal squamous cell carcinoma. Am J Gastroenterol. 2011;106:1048–54.CrossRef Yamamoto S, Ishihara R, Motoori M, et al. Comparison between definitive chemoradiotherapy and esophagectomy in patients with clinical stage I esophageal squamous cell carcinoma. Am J Gastroenterol. 2011;106:1048–54.CrossRef
6.
Zurück zum Zitat Birkmeyer JD, Siewers AE, Finlayson EV, et al. Hospital volume and surgical mortality in the United States. N Engl J Med. 2002;346:1128–37.CrossRef Birkmeyer JD, Siewers AE, Finlayson EV, et al. Hospital volume and surgical mortality in the United States. N Engl J Med. 2002;346:1128–37.CrossRef
7.
Zurück zum Zitat Chang AC, Ji H, Birkmeyer NJ, et al. Outcomes after transhiatal and transthoracic esophagectomy for cancer. Ann Thorac Surg. 2008;85:424–9.CrossRef Chang AC, Ji H, Birkmeyer NJ, et al. Outcomes after transhiatal and transthoracic esophagectomy for cancer. Ann Thorac Surg. 2008;85:424–9.CrossRef
8.
Zurück zum Zitat Swisher SG, Deford L, Merriman KW, et al. Effect of operative volume on morbidity, mortality, and hospital use after esophagectomy for cancer. J Thorac Cardiovasc Surg. 2000;119:1126–32.CrossRef Swisher SG, Deford L, Merriman KW, et al. Effect of operative volume on morbidity, mortality, and hospital use after esophagectomy for cancer. J Thorac Cardiovasc Surg. 2000;119:1126–32.CrossRef
9.
Zurück zum Zitat Begg CB, Cramer LD, Hoskins WJ, et al. Impact of hospital volume on operative mortality for major cancer surgery. JAMA. 1998;280:1747–51.CrossRef Begg CB, Cramer LD, Hoskins WJ, et al. Impact of hospital volume on operative mortality for major cancer surgery. JAMA. 1998;280:1747–51.CrossRef
10.
Zurück zum Zitat Zhang Y. Epidemiology of esophageal cancer. World J Gastroenterol. 2013;19:5598–606.CrossRef Zhang Y. Epidemiology of esophageal cancer. World J Gastroenterol. 2013;19:5598–606.CrossRef
11.
Zurück zum Zitat Shimizu Y, Tsukagoshi H, Fujita M, et al. Long-term outcome after endoscopic mucosal resection in patients with esophageal squamous cell carcinoma invading the muscularis mucosae or deeper. Gastrointest Endosc. 2002;56:387–90.CrossRef Shimizu Y, Tsukagoshi H, Fujita M, et al. Long-term outcome after endoscopic mucosal resection in patients with esophageal squamous cell carcinoma invading the muscularis mucosae or deeper. Gastrointest Endosc. 2002;56:387–90.CrossRef
12.
Zurück zum Zitat Katada C, Muto M, Momma K, et al. Clinical outcome after endoscopic mucosal resection for esophageal squamous cell carcinoma invading the muscularis mucosae–a multicenter retrospective cohort study. Endoscopy. 2007;39:779–83.CrossRef Katada C, Muto M, Momma K, et al. Clinical outcome after endoscopic mucosal resection for esophageal squamous cell carcinoma invading the muscularis mucosae–a multicenter retrospective cohort study. Endoscopy. 2007;39:779–83.CrossRef
13.
Zurück zum Zitat Yamashina T, Ishihara R, Nagai K, et al. Long-term outcome and metastatic risk after endoscopic resection of superficial esophageal squamous cell carcinoma. Am J Gastroenterol. 2013;108:544–51.CrossRef Yamashina T, Ishihara R, Nagai K, et al. Long-term outcome and metastatic risk after endoscopic resection of superficial esophageal squamous cell carcinoma. Am J Gastroenterol. 2013;108:544–51.CrossRef
14.
Zurück zum Zitat Akutsu Y, Uesato M, Shuto K, et al. The overall prevalence of metastasis in T1 esophageal squamous cell carcinoma: a retrospective analysis of 295 patients. Ann Surg. 2013;257:1032–8.CrossRef Akutsu Y, Uesato M, Shuto K, et al. The overall prevalence of metastasis in T1 esophageal squamous cell carcinoma: a retrospective analysis of 295 patients. Ann Surg. 2013;257:1032–8.CrossRef
15.
Zurück zum Zitat Holscher AH, Bollschweiler E, Schroder W, et al. Prognostic impact of upper, middle, and lower third mucosal or submucosal infiltration in early esophageal cancer. Ann Surg. 2011;254:802–7 (discussion 7-8).CrossRef Holscher AH, Bollschweiler E, Schroder W, et al. Prognostic impact of upper, middle, and lower third mucosal or submucosal infiltration in early esophageal cancer. Ann Surg. 2011;254:802–7 (discussion 7-8).CrossRef
16.
Zurück zum Zitat Kitagawa Y, Uno T, Oyama T, et al. Esophageal cancer practice guidelines 2017 edited by the Japan Esophageal Society: part 1. Esophagus. 2019;16:1–24.CrossRef Kitagawa Y, Uno T, Oyama T, et al. Esophageal cancer practice guidelines 2017 edited by the Japan Esophageal Society: part 1. Esophagus. 2019;16:1–24.CrossRef
17.
Zurück zum Zitat Pimentel-Nunes P, Dinis-Ribeiro M, Ponchon T, et al. Endoscopic submucosal dissection: European Society of Gastrointestinal Endoscopy (ESGE) Guideline. Endoscopy. 2015;47:829–54.CrossRef Pimentel-Nunes P, Dinis-Ribeiro M, Ponchon T, et al. Endoscopic submucosal dissection: European Society of Gastrointestinal Endoscopy (ESGE) Guideline. Endoscopy. 2015;47:829–54.CrossRef
18.
Zurück zum Zitat Yoshida M, Momma K, Hanashi T. Endoscopic evaluation of depth of cancer invasion in cases with superficial esophageal cancer. Stomach Intestine. 2001;36:295–306. Yoshida M, Momma K, Hanashi T. Endoscopic evaluation of depth of cancer invasion in cases with superficial esophageal cancer. Stomach Intestine. 2001;36:295–306.
19.
Zurück zum Zitat Hirasawa T, Aoyama K, Tanimoto T, et al. Application of artificial intelligence using a convolutional neural network for detecting gastric cancer in endoscopic images. Gastric Cancer. 2018;21:653–60.CrossRef Hirasawa T, Aoyama K, Tanimoto T, et al. Application of artificial intelligence using a convolutional neural network for detecting gastric cancer in endoscopic images. Gastric Cancer. 2018;21:653–60.CrossRef
20.
Zurück zum Zitat Horie Y, Yoshio T, Aoyama K, et al. Diagnostic outcomes of esophageal cancer by artificial intelligence using convolutional neural networks. Gastrointest Endosc. 2019;89:25–322.CrossRef Horie Y, Yoshio T, Aoyama K, et al. Diagnostic outcomes of esophageal cancer by artificial intelligence using convolutional neural networks. Gastrointest Endosc. 2019;89:25–322.CrossRef
21.
Zurück zum Zitat Luo H, Xu G, Li C, et al. Real-time artificial intelligence for detection of upper gastrointestinal cancer by endoscopy: a multicentre, case-control, diagnostic study. Lancet Oncol. 2019;20:1645–54.CrossRef Luo H, Xu G, Li C, et al. Real-time artificial intelligence for detection of upper gastrointestinal cancer by endoscopy: a multicentre, case-control, diagnostic study. Lancet Oncol. 2019;20:1645–54.CrossRef
22.
Zurück zum Zitat Ohmori M, Ishihara R, Aoyama K, et al. Endoscopic detection and differentiation of esophageal lesions using a deep neural network. Gastrointest Endosc. 2019;91(301–309):e1. Ohmori M, Ishihara R, Aoyama K, et al. Endoscopic detection and differentiation of esophageal lesions using a deep neural network. Gastrointest Endosc. 2019;91(301–309):e1.
23.
Zurück zum Zitat Nakagawa K, Ishihara R, Aoyama K, et al. Classification for invasion depth of esophageal squamous cell carcinoma using a deep neural network compared with experienced endoscopists. Gastrointest Endosc. 2019;90:407–14.CrossRef Nakagawa K, Ishihara R, Aoyama K, et al. Classification for invasion depth of esophageal squamous cell carcinoma using a deep neural network compared with experienced endoscopists. Gastrointest Endosc. 2019;90:407–14.CrossRef
24.
Zurück zum Zitat Japanese Classification of Esophageal Cancer, 11th edition: part I. Esophagus. 2017;14:1–36. Japanese Classification of Esophageal Cancer, 11th edition: part I. Esophagus. 2017;14:1–36.
25.
Zurück zum Zitat Japanese Classification of Esophageal Cancer, 11th edition: part II and III. Esophagus. 2017;14:37–65. Japanese Classification of Esophageal Cancer, 11th edition: part II and III. Esophagus. 2017;14:37–65.
26.
Zurück zum Zitat Oyama T, Inoue H, Arima M, et al. Prediction of the invasion depth of superficial squamous cell carcinoma based on microvessel morphology: magnifying endoscopic classification of the Japan Esophageal Society. Esophagus. 2017;14:105–12.CrossRef Oyama T, Inoue H, Arima M, et al. Prediction of the invasion depth of superficial squamous cell carcinoma based on microvessel morphology: magnifying endoscopic classification of the Japan Esophageal Society. Esophagus. 2017;14:105–12.CrossRef
Metadaten
Titel
Real-time assessment of video images for esophageal squamous cell carcinoma invasion depth using artificial intelligence
verfasst von
Yusaku Shimamoto
Ryu Ishihara
Yusuke Kato
Ayaka Shoji
Takahiro Inoue
Katsunori Matsueda
Muneaki Miyake
Kotaro Waki
Mitsuhiro Kono
Hiromu Fukuda
Noriko Matsuura
Koji Nagaike
Kenji Aoi
Katsumi Yamamoto
Takuya Inoue
Masanori Nakahara
Akihiro Nishihara
Tomohiro Tada
Publikationsdatum
10.08.2020
Verlag
Springer Singapore
Erschienen in
Journal of Gastroenterology / Ausgabe 11/2020
Print ISSN: 0944-1174
Elektronische ISSN: 1435-5922
DOI
https://doi.org/10.1007/s00535-020-01716-5

Weitere Artikel der Ausgabe 11/2020

Journal of Gastroenterology 11/2020 Zur Ausgabe

Leitlinien kompakt für die Innere Medizin

Mit medbee Pocketcards sicher entscheiden.

Seit 2022 gehört die medbee GmbH zum Springer Medizin Verlag

Update Innere Medizin

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.