Skip to main content
Erschienen in: Journal of Medical Systems 5/2020

01.05.2020 | Image & Signal Processing

Optic Disc and Cup Image Segmentation Utilizing Contour-Based Transformation and Sequence Labeling Networks

Erschienen in: Journal of Medical Systems | Ausgabe 5/2020

Einloggen, um Zugang zu erhalten

Abstract

Optic disc (OD) and optic cup (OC) segmentation are important steps for automatic screening and diagnosing of optic nerve head abnormalities such as glaucoma. Many recent works formulated the OD and OC segmentation as a pixel classification task. However, it is hard for these methods to explicitly model the spatial relations between the labels in the output mask. Furthermore, the proportion of the background, OD and OC are unbalanced which also may result in a biased model as well as introduce more noise. To address these problems, we developed an approach that follows a coarse-to-fine segmentation process. We start with a U-Net to obtain a rough segmenting boundary and then crop the area around the boundary to form a boundary contour centered image. Second, inspired by sequence labeling tasks in natural language processing, we regard the OD and OC segmentation as a sequence labeling task and propose a novel fully convolutional network called SU-Net and combine it with the Viterbi algorithm to jointly decode the segmentation boundary. We also introduced a geometric parameter-based data augmentation method to generate more training samples in order to minimize the differences between training and test sets and reduce overfitting. Experimental results show that our method achieved state-of-the-art results on 2 datasets for both OD and OC segmentation and our method outperforms most of the ophthalmologists in terms of achieving agreement out of 6 ophthalmologists on the MESSIDOR dataset for both OD and OC segmentation. In terms of glaucoma screening, we achieved the best cup-to-disc ratio (CDR) error and area under the ROC curve (AUC) for glaucoma classification on the Drishti-GS dataset.
Literatur
1.
Zurück zum Zitat Sadun A. A, Wang M. Y (2011) Abnormalities of the optic disc Sadun A. A, Wang M. Y (2011) Abnormalities of the optic disc
2.
Zurück zum Zitat Gagnon L, Lalonde M, Beaulieu M, Boucher M. C (2001) Procedure to detect anatomical structures in optical fundus images. In: Medical imaging 2001: Image processing. Pp 1218–1225 Gagnon L, Lalonde M, Beaulieu M, Boucher M. C (2001) Procedure to detect anatomical structures in optical fundus images. In: Medical imaging 2001: Image processing. Pp 1218–1225
4.
Zurück zum Zitat Murthy V, Shankar M, Lin J, Lieu S, Patel M, Post H, Murthy H, Liu BJ (2019) Fundus Analysis Software Tool (FAST): development of software integrating CAD with the EHR for the longitudinal study of fundus images. In: Proc. SPIE 10954, Medical Imaging 2019: Imaging informatics for healthcare, Research, and Applications Murthy V, Shankar M, Lin J, Lieu S, Patel M, Post H, Murthy H, Liu BJ (2019) Fundus Analysis Software Tool (FAST): development of software integrating CAD with the EHR for the longitudinal study of fundus images. In: Proc. SPIE 10954, Medical Imaging 2019: Imaging informatics for healthcare, Research, and Applications
8.
Zurück zum Zitat Ronneberger O, Fischer P, Brox T (2015) U-net: Convolutional networks for biomedical image segmentation. In: Lecture notes in computer science (including subseries lecture notes in artificial intelligence and lecture notes in bioinformatics) Ronneberger O, Fischer P, Brox T (2015) U-net: Convolutional networks for biomedical image segmentation. In: Lecture notes in computer science (including subseries lecture notes in artificial intelligence and lecture notes in bioinformatics)
9.
Zurück zum Zitat Dauphin Y. N, Fan A, Auli M, Grangier D (2017) Language modeling with gated convolutional networks. In: 34th international conference on machine learning, ICML 2017 Dauphin Y. N, Fan A, Auli M, Grangier D (2017) Language modeling with gated convolutional networks. In: 34th international conference on machine learning, ICML 2017
10.
Zurück zum Zitat Yu F, Koltun V (2016) Multi-scale context aggregation by dilated convolutions. In: 4th international conference on learning representations, ICLR 2016 - conference track proceedings Yu F, Koltun V (2016) Multi-scale context aggregation by dilated convolutions. In: 4th international conference on learning representations, ICLR 2016 - conference track proceedings
13.
Zurück zum Zitat Pallawala P. M. D. S, Hsu W, Lee M. L, Eong K. G. A (2004) Automated optic disc localization and contour detection using ellipse fitting and wavelet transform. Lect Notes Comput Sci (including Subser Lect Notes Artif Intell Lect Notes Bioinformatics). https://doi.org/10.1007/978-3-540-24671-8_11 Pallawala P. M. D. S, Hsu W, Lee M. L, Eong K. G. A (2004) Automated optic disc localization and contour detection using ellipse fitting and wavelet transform. Lect Notes Comput Sci (including Subser Lect Notes Artif Intell Lect Notes Bioinformatics). https://​doi.​org/​10.​1007/​978-3-540-24671-8_​11
14.
Zurück zum Zitat Zhu X, Rangayyan R. M (2008) Detection of the optic disc in images of the retina using the Hough transform. In: Proceedings of the 30th annual international conference of the IEEE engineering in medicine and biology society, EMBS’08 - “personalized healthcare through technology” Zhu X, Rangayyan R. M (2008) Detection of the optic disc in images of the retina using the Hough transform. In: Proceedings of the 30th annual international conference of the IEEE engineering in medicine and biology society, EMBS’08 - “personalized healthcare through technology”
18.
Zurück zum Zitat Osareh A (2004) Automated identification of diabetic retinal exudates and the optic disc Osareh A (2004) Automated identification of diabetic retinal exudates and the optic disc
20.
Zurück zum Zitat Barrett S. F, Naess E, Molvik T (2001) Employing the hough transform to locate the optic disk. In: Biomedical Sciences Instrumentation Barrett S. F, Naess E, Molvik T (2001) Employing the hough transform to locate the optic disk. In: Biomedical Sciences Instrumentation
22.
Zurück zum Zitat Mendels F, Heneghan C, Thiran J. P (1999) Identification of the optic disk boundary in retinal images using active contours. Proc Irish Mach Vis Image Process Conf Mendels F, Heneghan C, Thiran J. P (1999) Identification of the optic disk boundary in retinal images using active contours. Proc Irish Mach Vis Image Process Conf
23.
Zurück zum Zitat Sedai S, Roy P. K, Mahapatra D, Garnavi R (2016) Segmentation of optic disc and optic cup in retinal fundus images using shape regression. In: Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS Sedai S, Roy P. K, Mahapatra D, Garnavi R (2016) Segmentation of optic disc and optic cup in retinal fundus images using shape regression. In: Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS
24.
Zurück zum Zitat Hatanaka Y, Nagahata Y, Muramatsu C, Okumura S, Ogohara K, Sawada A, Ishida K, Yamamoto T, Fujita H (2014) Improved automated optic cup segmentation based on detection of blood vessel bends in retinal fundus images. In: 2014 36th annual international conference of the IEEE engineering in medicine and biology society, EMBC 2014 Hatanaka Y, Nagahata Y, Muramatsu C, Okumura S, Ogohara K, Sawada A, Ishida K, Yamamoto T, Fujita H (2014) Improved automated optic cup segmentation based on detection of blood vessel bends in retinal fundus images. In: 2014 36th annual international conference of the IEEE engineering in medicine and biology society, EMBC 2014
29.
Zurück zum Zitat Yin F, Liu J, Ong S. H, Sun Y, Wong D. W. K, Tan N. M, Cheung C, Baskaran M, Aung T, Wong T. Y (2011) Model-based optic nerve head segmentation on retinal fundus images. In: Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS Yin F, Liu J, Ong S. H, Sun Y, Wong D. W. K, Tan N. M, Cheung C, Baskaran M, Aung T, Wong T. Y (2011) Model-based optic nerve head segmentation on retinal fundus images. In: Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS
30.
Zurück zum Zitat Hamednejad G, Pourghassem H (2017) Retinal optic disk segmentation and analysis in fundus images using DBSCAN clustering algorithm. In: 2016 23rd Iranian conference on biomedical engineering and 2016 1st international Iranian conference on biomedical engineering, ICBME 2016 Hamednejad G, Pourghassem H (2017) Retinal optic disk segmentation and analysis in fundus images using DBSCAN clustering algorithm. In: 2016 23rd Iranian conference on biomedical engineering and 2016 1st international Iranian conference on biomedical engineering, ICBME 2016
31.
Zurück zum Zitat Khalid N. E. A, Noor N. M, Ariff N. M (2014) Fuzzy c-means (FCM) for optic cup and disc segmentation with morphological operation. In: Procedia Computer Science Khalid N. E. A, Noor N. M, Ariff N. M (2014) Fuzzy c-means (FCM) for optic cup and disc segmentation with morphological operation. In: Procedia Computer Science
32.
Zurück zum Zitat Thakur, N., and Juneja, M., Optic disc and optic cup segmentation from retinal images using hybrid approach. Expert Systems with Applications 127:308–322, 2019.CrossRef Thakur, N., and Juneja, M., Optic disc and optic cup segmentation from retinal images using hybrid approach. Expert Systems with Applications 127:308–322, 2019.CrossRef
35.
Zurück zum Zitat Xu Y, Duan L, Lin S, Chen X, Wong D. W. K, Wong T. Y, Liu J (2014) Optic cup segmentation for glaucoma detection using low-rank superpixel representation. In: Lecture notes in computer science (including subseries lecture notes in artificial intelligence and lecture notes in bioinformatics) Xu Y, Duan L, Lin S, Chen X, Wong D. W. K, Wong T. Y, Liu J (2014) Optic cup segmentation for glaucoma detection using low-rank superpixel representation. In: Lecture notes in computer science (including subseries lecture notes in artificial intelligence and lecture notes in bioinformatics)
38.
Zurück zum Zitat Simonyan K, Zisserman A (2015) Very deep convolutional networks for large-scale image recognition. In: 3rd international conference on learning representations, ICLR 2015 - conference track proceedings Simonyan K, Zisserman A (2015) Very deep convolutional networks for large-scale image recognition. In: 3rd international conference on learning representations, ICLR 2015 - conference track proceedings
39.
Zurück zum Zitat Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Erhan D, Vanhoucke V, Rabinovich A (2015) Going deeper with convolutions. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Erhan D, Vanhoucke V, Rabinovich A (2015) Going deeper with convolutions. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition
40.
Zurück zum Zitat Long J, Shelhamer E, Darrell T (2015) Fully convolutional networks for semantic segmentation. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition Long J, Shelhamer E, Darrell T (2015) Fully convolutional networks for semantic segmentation. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition
43.
Zurück zum Zitat Zhao H, Shi J, Qi X, Wang X, Jia J (2017) Pyramid scene parsing network. In: Proceedings - 30th IEEE conference on computer vision and pattern recognition, CVPR 2017 Zhao H, Shi J, Qi X, Wang X, Jia J (2017) Pyramid scene parsing network. In: Proceedings - 30th IEEE conference on computer vision and pattern recognition, CVPR 2017
44.
Zurück zum Zitat Muramatsu C, Nakagawa T, Sawada A, Hatanaka Y, Hara T, Yamamoto T, Fujita H (2009) Determination of cup-to-disc ratio of optical nerve head for diagnosis of glaucoma on stereo retinal fundus image pairs. In: Medical imaging 2009: Computer-aided diagnosis Muramatsu C, Nakagawa T, Sawada A, Hatanaka Y, Hara T, Yamamoto T, Fujita H (2009) Determination of cup-to-disc ratio of optical nerve head for diagnosis of glaucoma on stereo retinal fundus image pairs. In: Medical imaging 2009: Computer-aided diagnosis
46.
Zurück zum Zitat Zuiderveld K (1994) Contrast limited adaptive histogram equalization. In: Graphics Gems Zuiderveld K (1994) Contrast limited adaptive histogram equalization. In: Graphics Gems
47.
Zurück zum Zitat Shankaranarayana S. M, Ram K, Mitra K, Sivaprakasam M (2017) Joint optic disc and cup segmentation using fully convolutional and adversarial networks. In: Lecture notes in computer science (including subseries lecture notes in artificial intelligence and lecture notes in bioinformatics) Shankaranarayana S. M, Ram K, Mitra K, Sivaprakasam M (2017) Joint optic disc and cup segmentation using fully convolutional and adversarial networks. In: Lecture notes in computer science (including subseries lecture notes in artificial intelligence and lecture notes in bioinformatics)
48.
Zurück zum Zitat Singh V. K, Rashwan H. A, Akram F, Pandey N, Sarker M. M. K, Saleh A, Abdulwahab S, Maaroof N, Barrena J. T, Romani S, Puig D (2018) Retinal optic disc segmentation using conditional generative adversarial network. In: Frontiers in Artificial Intelligence and Applications Singh V. K, Rashwan H. A, Akram F, Pandey N, Sarker M. M. K, Saleh A, Abdulwahab S, Maaroof N, Barrena J. T, Romani S, Puig D (2018) Retinal optic disc segmentation using conditional generative adversarial network. In: Frontiers in Artificial Intelligence and Applications
51.
Zurück zum Zitat Gehring J, Auli M, Grangier D, Yarats D, Dauphin Y. N (2017) Convolutional sequence to sequence learning. In: 34th international conference on machine learning, ICML 2017 Gehring J, Auli M, Grangier D, Yarats D, Dauphin Y. N (2017) Convolutional sequence to sequence learning. In: 34th international conference on machine learning, ICML 2017
52.
Zurück zum Zitat Decencière E, Zhang X, Cazuguel G, Laÿ B, Cochener B, Trone C, Gain P, Ordóñez-Varela J. R, Massin P, Erginay A, Charton B, Klein JC (2014) Feedback on a publicly distributed image database: The Messidor database. Image Anal Stereol. https://doi.org/10.5566/ias.1155 Decencière E, Zhang X, Cazuguel G, Laÿ B, Cochener B, Trone C, Gain P, Ordóñez-Varela J. R, Massin P, Erginay A, Charton B, Klein JC (2014) Feedback on a publicly distributed image database: The Messidor database. Image Anal Stereol. https://​doi.​org/​10.​5566/​ias.​1155
53.
Zurück zum Zitat Sivaswamy J, Krishnadas S. R, Joshi G. D, Ujjwal M. J, Tabish S (2014) Drishti-GS: Retinal image dataset for optic nerve head (ONH) segmentation. In: 2014 IEEE 11th international symposium on biomedical imaging, ISBI 2014 Sivaswamy J, Krishnadas S. R, Joshi G. D, Ujjwal M. J, Tabish S (2014) Drishti-GS: Retinal image dataset for optic nerve head (ONH) segmentation. In: 2014 IEEE 11th international symposium on biomedical imaging, ISBI 2014
54.
Zurück zum Zitat Almazroa A. A, Alodhayb S, Osman E, Ramadan E, Hummadi M, Dlaim M, Alkatee M, Raahemifar K, Lakshminarayanan V (2018) Retinal fundus images for glaucoma analysis: The RIGA dataset Almazroa A. A, Alodhayb S, Osman E, Ramadan E, Hummadi M, Dlaim M, Alkatee M, Raahemifar K, Lakshminarayanan V (2018) Retinal fundus images for glaucoma analysis: The RIGA dataset
55.
Zurück zum Zitat He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition
Metadaten
Titel
Optic Disc and Cup Image Segmentation Utilizing Contour-Based Transformation and Sequence Labeling Networks
Publikationsdatum
01.05.2020
Erschienen in
Journal of Medical Systems / Ausgabe 5/2020
Print ISSN: 0148-5598
Elektronische ISSN: 1573-689X
DOI
https://doi.org/10.1007/s10916-020-01561-2

Weitere Artikel der Ausgabe 5/2020

Journal of Medical Systems 5/2020 Zur Ausgabe