Skip to main content
Erschienen in: International Journal of Computer Assisted Radiology and Surgery 10/2023

11.04.2023 | Original Article

Self-supervised learning for gastritis detection with gastric X-ray images

verfasst von: Guang Li, Ren Togo, Takahiro Ogawa, Miki Haseyama

Erschienen in: International Journal of Computer Assisted Radiology and Surgery | Ausgabe 10/2023

Einloggen, um Zugang zu erhalten

Abstract

Purpose

Manual annotation of gastric X-ray images by doctors for gastritis detection is time-consuming and expensive. To solve this, a self-supervised learning method is developed in this study. The effectiveness of the proposed self-supervised learning method in gastritis detection is verified using a few annotated gastric X-ray images.

Methods

In this study, we develop a novel method that can perform explicit self-supervised learning and learn discriminative representations from gastric X-ray images. Models trained based on the proposed method were fine-tuned on datasets comprising a few annotated gastric X-ray images. Five self-supervised learning methods, i.e., SimSiam, BYOL, PIRL-jigsaw, PIRL-rotation, and SimCLR, were compared with the proposed method. Furthermore, three previous methods, one pretrained on ImageNet, one trained from scratch, and one semi-supervised learning method, were compared with the proposed method.

Results

The proposed method’s harmonic mean score of sensitivity and specificity after fine-tuning with the annotated data of 10, 20, 30, and 40 patients were 0.875, 0.911, 0.915, and 0.931, respectively. The proposed method outperformed all comparative methods, including the five self-supervised learning and three previous methods. Experimental results showed the effectiveness of the proposed method in gastritis detection using a few annotated gastric X-ray images.

Conclusions

This paper proposes a novel self-supervised learning method based on a teacher–student architecture for gastritis detection using gastric X-ray images. The proposed method can perform explicit self-supervised learning and learn discriminative representations from gastric X-ray images. The proposed method exhibits potential clinical use in gastritis detection using a few annotated gastric X-ray images.
Literatur
1.
Zurück zum Zitat Bray F, Ferlay J, Soerjomataram I, Siegel RL, Torre LA, Jemal A (2018) Global cancer statistics 2018: Globocan estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA: Cancer J Clin 68(6):394–424PubMed Bray F, Ferlay J, Soerjomataram I, Siegel RL, Torre LA, Jemal A (2018) Global cancer statistics 2018: Globocan estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA: Cancer J Clin 68(6):394–424PubMed
2.
Zurück zum Zitat Chen T, Kornblith S, Norouzi M, Hinton G (2020) A simple framework for contrastive learning of visual representations. In: Proceedings of the international conference on machine learning (ICML) Chen T, Kornblith S, Norouzi M, Hinton G (2020) A simple framework for contrastive learning of visual representations. In: Proceedings of the international conference on machine learning (ICML)
3.
Zurück zum Zitat Chen X, He K (2021) Exploring simple siamese representation learning. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR) Chen X, He K (2021) Exploring simple siamese representation learning. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR)
4.
Zurück zum Zitat Deng J, Dong W, Socher R, Li LJ, Li K, Fei-Fei L (2009) Imagenet: a large-scale hierarchical image database. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), pp 248–255 Deng J, Dong W, Socher R, Li LJ, Li K, Fei-Fei L (2009) Imagenet: a large-scale hierarchical image database. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), pp 248–255
5.
Zurück zum Zitat Gidaris S, Singh P, Komodakis N (2018) Unsupervised representation learning by predicting image rotations. In: Proceedings of the international conference on learning representations (ICLR) Gidaris S, Singh P, Komodakis N (2018) Unsupervised representation learning by predicting image rotations. In: Proceedings of the international conference on learning representations (ICLR)
6.
Zurück zum Zitat Grill JB, Strub F, Altché F, Tallec C, Richemond P, Buchatskaya E, Doersch C, Avila Pires B, Guo Z, Gheshlaghi Azar M., Piot B, Kavukcuoglu K, Munos R, Valko M (2020) Bootstrap your own latent-a new approach to self-supervised learning. In: Proceedings of the advances in neural information processing systems (NeurIPS) Grill JB, Strub F, Altché F, Tallec C, Richemond P, Buchatskaya E, Doersch C, Avila Pires B, Guo Z, Gheshlaghi Azar M., Piot B, Kavukcuoglu K, Munos R, Valko M (2020) Bootstrap your own latent-a new approach to self-supervised learning. In: Proceedings of the advances in neural information processing systems (NeurIPS)
7.
Zurück zum Zitat He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition (CVPR), pp. 770–778 He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition (CVPR), pp. 770–778
8.
Zurück zum Zitat Jing L, Tian Y (2020) Self-supervised visual feature learning with deep neural networks: a survey. IEEE Trans Pattern Anal Mach Intell 43:4037–4058CrossRef Jing L, Tian Y (2020) Self-supervised visual feature learning with deep neural networks: a survey. IEEE Trans Pattern Anal Mach Intell 43:4037–4058CrossRef
9.
Zurück zum Zitat Kanai M, Togo R, Ogawa T, Haseyama M (2019) Gastritis detection from gastric x-ray images via fine-tuning of patch-based deep convolutional neural network. In: Proceedings of the IEEE international conference on image processing (ICIP), pp 1371–1375 Kanai M, Togo R, Ogawa T, Haseyama M (2019) Gastritis detection from gastric x-ray images via fine-tuning of patch-based deep convolutional neural network. In: Proceedings of the IEEE international conference on image processing (ICIP), pp 1371–1375
11.
Zurück zum Zitat Lee YC, Chiang TH, Chou CK, Tu YK, Liao WC, Wu MS, Graham DY (2016) Association between helicobacter pylori eradication and gastric cancer incidence: a systematic review and meta-analysis. Gastroenterology 150(5):1113–1124CrossRefPubMed Lee YC, Chiang TH, Chou CK, Tu YK, Liao WC, Wu MS, Graham DY (2016) Association between helicobacter pylori eradication and gastric cancer incidence: a systematic review and meta-analysis. Gastroenterology 150(5):1113–1124CrossRefPubMed
12.
Zurück zum Zitat Li G, Togo R, Ogawa T, Haseyama M (2020) Soft-label anonymous gastric X-ray image distillation. In: Proceedings of the IEEE international conference on image processing (ICIP), pp 305–309 Li G, Togo R, Ogawa T, Haseyama M (2020) Soft-label anonymous gastric X-ray image distillation. In: Proceedings of the IEEE international conference on image processing (ICIP), pp 305–309
13.
Zurück zum Zitat Li G, Togo R, Ogawa T, Haseyama M (2021) Cross-view self-supervised learning via momentum statistics in batch normalization. In: Proceedings of the IEEE international conference on consumer electronics—Taiwan (ICCE-TW) Li G, Togo R, Ogawa T, Haseyama M (2021) Cross-view self-supervised learning via momentum statistics in batch normalization. In: Proceedings of the IEEE international conference on consumer electronics—Taiwan (ICCE-TW)
14.
Zurück zum Zitat Li G, Togo R, Ogawa T, Haseyama M (2022) Compressed gastric image generation based on soft-label dataset distillation for medical data sharing. Comput Methods Progr Biomed 227:107189CrossRef Li G, Togo R, Ogawa T, Haseyama M (2022) Compressed gastric image generation based on soft-label dataset distillation for medical data sharing. Comput Methods Progr Biomed 227:107189CrossRef
15.
Zurück zum Zitat Li G, Togo R, Ogawa T, Haseyama M (2022) Self-knowledge distillation based self-supervised learning for covid-19 detection from chest X-ray images. In: Proceedings of IEEE international conference acoustics, speech and signal process. IEEE, pp 1371–1375 Li G, Togo R, Ogawa T, Haseyama M (2022) Self-knowledge distillation based self-supervised learning for covid-19 detection from chest X-ray images. In: Proceedings of IEEE international conference acoustics, speech and signal process. IEEE, pp 1371–1375
16.
Zurück zum Zitat Li G, Togo R, Ogawa T, Haseyama M (2022) Tribyol: triplet byol for self-supervised representation learning. In: Proceedings of IEEE international conference on acoustics, speech and signal process. IEEE, pp 3458–3462 Li G, Togo R, Ogawa T, Haseyama M (2022) Tribyol: triplet byol for self-supervised representation learning. In: Proceedings of IEEE international conference on acoustics, speech and signal process. IEEE, pp 3458–3462
17.
Zurück zum Zitat Li G, Togo R, Ogawa T, Haseyama M (2023) Dataset distillation for medical dataset sharing. In: Proceedings of the AAAI conference on artificial intelligence (AAAI), Workshop, pp 1–6 Li G, Togo R, Ogawa T, Haseyama M (2023) Dataset distillation for medical dataset sharing. In: Proceedings of the AAAI conference on artificial intelligence (AAAI), Workshop, pp 1–6
18.
Zurück zum Zitat Li Z, Togo R, Ogawa T, Haseyama M (2020) Chronic gastritis classification using gastric X-ray images with a semi-supervised learning method based on tri-training. Med Biol Eng Comput 58(6):1239–1250CrossRefPubMed Li Z, Togo R, Ogawa T, Haseyama M (2020) Chronic gastritis classification using gastric X-ray images with a semi-supervised learning method based on tri-training. Med Biol Eng Comput 58(6):1239–1250CrossRefPubMed
19.
Zurück zum Zitat Liu X, Zhang F, Hou Z, Mian L, Wang Z, Zhang J, Tang J (2021) Self-supervised learning: generative or contrastive. IEEE Trans Knowl Data Eng 35:857–876 Liu X, Zhang F, Hou Z, Mian L, Wang Z, Zhang J, Tang J (2021) Self-supervised learning: generative or contrastive. IEEE Trans Knowl Data Eng 35:857–876
20.
Zurück zum Zitat Maktabi M, Köhler H, Ivanova M, Jansen-Winkeln B, Takoh J, Niebisch S, Rabe SM, Neumuth T, Gockel I, Chalopin C (2019) Tissue classification of oncologic esophageal resectates based on hyperspectral data. Int J Comput Assist Radiol Surg 14(10):1651–1661CrossRefPubMed Maktabi M, Köhler H, Ivanova M, Jansen-Winkeln B, Takoh J, Niebisch S, Rabe SM, Neumuth T, Gockel I, Chalopin C (2019) Tissue classification of oncologic esophageal resectates based on hyperspectral data. Int J Comput Assist Radiol Surg 14(10):1651–1661CrossRefPubMed
21.
Zurück zum Zitat Misra I, Maaten Lvd (2020) Self-supervised learning of pretext-invariant representations. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition (CVPR), pp 6707–6717 Misra I, Maaten Lvd (2020) Self-supervised learning of pretext-invariant representations. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition (CVPR), pp 6707–6717
22.
Zurück zum Zitat Noroozi M, Favaro P (2016) Unsupervised learning of visual representations by solving jigsaw puzzles. In: Proceedings of the European conference on computer vision (ECCV), pp 69–84 Noroozi M, Favaro P (2016) Unsupervised learning of visual representations by solving jigsaw puzzles. In: Proceedings of the European conference on computer vision (ECCV), pp 69–84
24.
Zurück zum Zitat Sugano K (2015) Screening of gastric cancer in Asia. Best Pract Res Clin Gastroenterol 29(6):895–905CrossRefPubMed Sugano K (2015) Screening of gastric cancer in Asia. Best Pract Res Clin Gastroenterol 29(6):895–905CrossRefPubMed
25.
Zurück zum Zitat Tarvainen A, Valpola H (2017) Mean teachers are better role models: weight-averaged consistency targets improve semi-supervised deep learning results. In: Proceedings of the advances in neural information processing systems (NeurIPS), pp 1195–1204 Tarvainen A, Valpola H (2017) Mean teachers are better role models: weight-averaged consistency targets improve semi-supervised deep learning results. In: Proceedings of the advances in neural information processing systems (NeurIPS), pp 1195–1204
26.
Zurück zum Zitat Togo R, Yamamichi N, Mabe K, Takahashi Y, Takeuchi C, Kato M, Sakamoto N, Ishihara K, Ogawa T, Haseyama M (2019) Detection of gastritis by a deep convolutional neural network from double-contrast upper gastrointestinal barium X-ray radiography. J Gastroenterol 54(4):321–329CrossRefPubMed Togo R, Yamamichi N, Mabe K, Takahashi Y, Takeuchi C, Kato M, Sakamoto N, Ishihara K, Ogawa T, Haseyama M (2019) Detection of gastritis by a deep convolutional neural network from double-contrast upper gastrointestinal barium X-ray radiography. J Gastroenterol 54(4):321–329CrossRefPubMed
27.
Zurück zum Zitat Wroblewski LE, Peek RM, Wilson KT (2010) Helicobacter pylori and gastric cancer: factors that modulate disease risk. Clin Microbiol Rev 23(4):713–739CrossRefPubMedPubMedCentral Wroblewski LE, Peek RM, Wilson KT (2010) Helicobacter pylori and gastric cancer: factors that modulate disease risk. Clin Microbiol Rev 23(4):713–739CrossRefPubMedPubMedCentral
28.
Metadaten
Titel
Self-supervised learning for gastritis detection with gastric X-ray images
verfasst von
Guang Li
Ren Togo
Takahiro Ogawa
Miki Haseyama
Publikationsdatum
11.04.2023
Verlag
Springer International Publishing
Erschienen in
International Journal of Computer Assisted Radiology and Surgery / Ausgabe 10/2023
Print ISSN: 1861-6410
Elektronische ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-023-02891-5

Weitere Artikel der Ausgabe 10/2023

International Journal of Computer Assisted Radiology and Surgery 10/2023 Zur Ausgabe

„Übersichtlicher Wegweiser“: Lauterbachs umstrittener Klinik-Atlas ist online

17.05.2024 Klinik aktuell Nachrichten

Sie sei „ethisch geboten“, meint Gesundheitsminister Karl Lauterbach: mehr Transparenz über die Qualität von Klinikbehandlungen. Um sie abzubilden, lässt er gegen den Widerstand vieler Länder einen virtuellen Klinik-Atlas freischalten.

Klinikreform soll zehntausende Menschenleben retten

15.05.2024 Klinik aktuell Nachrichten

Gesundheitsminister Lauterbach hat die vom Bundeskabinett beschlossene Klinikreform verteidigt. Kritik an den Plänen kommt vom Marburger Bund. Und in den Ländern wird über den Gang zum Vermittlungsausschuss spekuliert.

Darf man die Behandlung eines Neonazis ablehnen?

08.05.2024 Gesellschaft Nachrichten

In einer Leseranfrage in der Zeitschrift Journal of the American Academy of Dermatology möchte ein anonymer Dermatologe bzw. eine anonyme Dermatologin wissen, ob er oder sie einen Patienten behandeln muss, der eine rassistische Tätowierung trägt.

Ein Drittel der jungen Ärztinnen und Ärzte erwägt abzuwandern

07.05.2024 Klinik aktuell Nachrichten

Extreme Arbeitsverdichtung und kaum Supervision: Dr. Andrea Martini, Sprecherin des Bündnisses Junge Ärztinnen und Ärzte (BJÄ) über den Frust des ärztlichen Nachwuchses und die Vorteile des Rucksack-Modells.

Update Radiologie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.