Skip to main content
Erschienen in: Journal of Medical Systems 11/2018

01.11.2018 | Image & Signal Processing

Multilayered Deep Structure Tensor Delaunay Triangulation and Morphing Based Automated Diagnosis and 3D Presentation of Human Macula

verfasst von: Taimur Hassan, M. Usman Akram, Mahmood Akhtar, Shoab Ahmad Khan, Ubaidullah Yasin

Erschienen in: Journal of Medical Systems | Ausgabe 11/2018

Einloggen, um Zugang zu erhalten

Abstract

Maculopathy is the group of diseases that affects central vision of a person and they are often associated with diabetes. Many researchers reported automated diagnosis of maculopathy from optical coherence tomography (OCT) images. However, to the best of our knowledge there is no literature that presents a complete 3D suite for the extraction as well as diagnosis of macula. Therefore, this paper presents a multilayered convolutional neural networks (CNN) structure tensor Delaunay triangulation and morphing based fully autonomous system that extracts up to nine retinal and choroidal layers along with the macular fluids. Furthermore, the proposed system utilizes the extracted retinal information for the automated diagnosis of maculopathy as well as for the robust reconstruction of 3D macula of retina. The proposed system has been validated on 41,921 retinal OCT scans acquired from different OCT machines and it significantly outperformed existing state of the art solutions by achieving the mean accuracy of 95.27% for extracting retinal and choroidal layers, mean dice coefficient of 0.90 for extracting fluid pathology and the overall accuracy of 96.07% for maculopathy diagnosis. To the best of our knowledge, the proposed framework is first of its kind that provides a fully automated and complete 3D integrated solution for the extraction of candidate macula along with its fully automated diagnosis against different macular syndromes.
Literatur
1.
Zurück zum Zitat Snell, R. S., and Lemp, M. A., Clinical anatomy of the eye, 2nd edition, May 31st, 2013.CrossRef Snell, R. S., and Lemp, M. A., Clinical anatomy of the eye, 2nd edition, May 31st, 2013.CrossRef
2.
Zurück zum Zitat "Implant gives rats sixth sense for infrared light". Wired UK. 14 February 2013. Accessed 14 February 2013. "Implant gives rats sixth sense for infrared light". Wired UK. 14 February 2013. Accessed 14 February 2013.
3.
Zurück zum Zitat Comers, G. M., Cystoid macular edema, Kellog Eye Center, Accessed June 2016. Comers, G. M., Cystoid macular edema, Kellog Eye Center, Accessed June 2016.
4.
Zurück zum Zitat Wang, M., Munch, I. C., Hasler, P. W., Prünte, C., and Larsen, M., Central serous chorioretinopathy. Acta Ophthalmol. 86(2):126–145, 2008.CrossRef Wang, M., Munch, I. C., Hasler, P. W., Prünte, C., and Larsen, M., Central serous chorioretinopathy. Acta Ophthalmol. 86(2):126–145, 2008.CrossRef
5.
Zurück zum Zitat Saine P. J., Fundus Photography: What is a Fundus Camera? Ophthalmic Photographers Society Accessed March 30th, 2018. Saine P. J., Fundus Photography: What is a Fundus Camera? Ophthalmic Photographers Society Accessed March 30th, 2018.
6.
Zurück zum Zitat Schuman, J. S., Introduction to Optical Coherence Tomography Technology. Schuman, J. S., Introduction to Optical Coherence Tomography Technology.
7.
Zurück zum Zitat Shrestha, A., Maharjan, N., Shrestha, A., Thapa, R., and Poudyal, G., Optical Coherence Tomographic assessment of macular thickness and morphological patterns in diabetic macular edema: Prognosis after modified grid photocoagulation. Nepal J. Ophthalmol. 4(7):128–133, 2012. Shrestha, A., Maharjan, N., Shrestha, A., Thapa, R., and Poudyal, G., Optical Coherence Tomographic assessment of macular thickness and morphological patterns in diabetic macular edema: Prognosis after modified grid photocoagulation. Nepal J. Ophthalmol. 4(7):128–133, 2012.
8.
Zurück zum Zitat Zhang, W., Yamamoto, K., and Hori, S., Optical Coherence Tomography for assessment of diabetic macular edema. Int. J. Opthalmol. 1, December 18, 2008. Zhang, W., Yamamoto, K., and Hori, S., Optical Coherence Tomography for assessment of diabetic macular edema. Int. J. Opthalmol. 1, December 18, 2008.
9.
Zurück zum Zitat Hannouche, R. Z., and Ávila, M. P., Detection of diabetic foveal edema with bio microscopy, fluorescein angiography and optical coherence tomography. Arq. Bras. Oftalmol. 71(5):759–763, 2008.CrossRef Hannouche, R. Z., and Ávila, M. P., Detection of diabetic foveal edema with bio microscopy, fluorescein angiography and optical coherence tomography. Arq. Bras. Oftalmol. 71(5):759–763, 2008.CrossRef
10.
Zurück zum Zitat Mokwa, N. F., Ristau, T., Keane, P. A., Kirchhoff, B., Sadda, S. R., and Liakopoulos, S., Diagnosis of age-related macular degeneration: comparison between color fundus photography, fluorescein angiography, and spectral domain optical coherence tomography. J. Ophthalmol. 2013:6, 2013), Article ID 85915. Mokwa, N. F., Ristau, T., Keane, P. A., Kirchhoff, B., Sadda, S. R., and Liakopoulos, S., Diagnosis of age-related macular degeneration: comparison between color fundus photography, fluorescein angiography, and spectral domain optical coherence tomography. J. Ophthalmol. 2013:6, 2013), Article ID 85915.
11.
Zurück zum Zitat Georgieva, D. K., Optical coherence tomography findings in diabetic macular edema, February 24, 2012. Georgieva, D. K., Optical coherence tomography findings in diabetic macular edema, February 24, 2012.
12.
Zurück zum Zitat Helmy, Y. M., and Atta Allah, H. R., Optical coherence tomography classification of diabetic cystoid macular edema. Clinical Ophthalmology - Dove press, August 27, 2013. Helmy, Y. M., and Atta Allah, H. R., Optical coherence tomography classification of diabetic cystoid macular edema. Clinical Ophthalmology - Dove press, August 27, 2013.
13.
Zurück zum Zitat Virgili, G., Menchini, F., Murro, V., Peluso, E., Rosa, F., Casazza, G., Optical coherence tomography (OCT) for detection of macular oedema in patients with diabetic retinopathy. Cochrane Database Syst. Rev. Jul 6;(7): CD008081. doi:https://doi.org/10.1002/14651858, 2011. Virgili, G., Menchini, F., Murro, V., Peluso, E., Rosa, F., Casazza, G., Optical coherence tomography (OCT) for detection of macular oedema in patients with diabetic retinopathy. Cochrane Database Syst. Rev. Jul 6;(7): CD008081. doi:https://​doi.​org/​10.​1002/​14651858, 2011.
14.
Zurück zum Zitat Sikorski, B. L., Malukiewicz, G., Stafiej, J., Junk, H. L., and Raczynska, D., The Diagnostic Function of OCT in Diabetic Maculopathy, Mediators of Inflammation, Volume 2013, Article ID 434560, 12 pages, 2013.CrossRef Sikorski, B. L., Malukiewicz, G., Stafiej, J., Junk, H. L., and Raczynska, D., The Diagnostic Function of OCT in Diabetic Maculopathy, Mediators of Inflammation, Volume 2013, Article ID 434560, 12 pages, 2013.CrossRef
18.
Zurück zum Zitat Zhang, L., Zhu, W., Shi, F., Chen, H., and Chen, X., Automated segmentation of intra-retinal cystoid macular edema for retinal 3D OCT images with macular hole. Int. Symp. Biomed. Imag. 12:1494–1497, 2015. Zhang, L., Zhu, W., Shi, F., Chen, H., and Chen, X., Automated segmentation of intra-retinal cystoid macular edema for retinal 3D OCT images with macular hole. Int. Symp. Biomed. Imag. 12:1494–1497, 2015.
19.
Zurück zum Zitat Wilkins, G. R., Houghton, O. M., and Oldenburg, A. L., Automated segmentation of intraretinal cystoid fluid in optical coherence tomography. IEEE Trans. Biomed. Eng. 59(4):1109–1114, 2012.CrossRef Wilkins, G. R., Houghton, O. M., and Oldenburg, A. L., Automated segmentation of intraretinal cystoid fluid in optical coherence tomography. IEEE Trans. Biomed. Eng. 59(4):1109–1114, 2012.CrossRef
20.
Zurück zum Zitat Sugruk, J., Kiattisin, S., and Lasantitham, A. L., Automated classification between age-related macular degeneration and diabetic macular edema in OCT image using image segmentation. IEEE Biomed. Eng. Int. Conf. 2014. Sugruk, J., Kiattisin, S., and Lasantitham, A. L., Automated classification between age-related macular degeneration and diabetic macular edema in OCT image using image segmentation. IEEE Biomed. Eng. Int. Conf. 2014.
21.
Zurück zum Zitat Hassan, B., and Raja, G., Fully automated assessment of macular edema using optical coherence tomography (OCT) images. 2016 Int Conf Intell. Syst. Eng. (ICISE), 15th – 17th January 2016. Hassan, B., and Raja, G., Fully automated assessment of macular edema using optical coherence tomography (OCT) images. 2016 Int Conf Intell. Syst. Eng. (ICISE), 15th – 17th January 2016.
22.
Zurück zum Zitat Fernández, D. C., Salinas, H. M., and Puliafito, C. A., Automated detection of retinal layer structures on optical coherence tomography images. Opt. Express 13(25):10200–10216, 2005.CrossRef Fernández, D. C., Salinas, H. M., and Puliafito, C. A., Automated detection of retinal layer structures on optical coherence tomography images. Opt. Express 13(25):10200–10216, 2005.CrossRef
23.
Zurück zum Zitat Chiu, S. J., Li, X. T., Nicholas, P., Toth, C. A., Izatt, J. A., and Farsiu, S., Automatic segmentation of seven retinal layers in SD-OCT images congruent with expert manual segmentation. Opt. Express 18(18):19413–19428, 2010.CrossRef Chiu, S. J., Li, X. T., Nicholas, P., Toth, C. A., Izatt, J. A., and Farsiu, S., Automatic segmentation of seven retinal layers in SD-OCT images congruent with expert manual segmentation. Opt. Express 18(18):19413–19428, 2010.CrossRef
24.
Zurück zum Zitat Yang, Q., Reisman, C. A., Wang, Z., Fukuma, Y., Hangai, M., Yoshimura, N., Tomidokoro, A., Araie, M., Raza, A. S., Hood, D. C., and Chan, K., Automated layer segmentation of macular OCT images using dual-scale gradient information. Opt. Express 18(20):21293–21307, 2010.CrossRef Yang, Q., Reisman, C. A., Wang, Z., Fukuma, Y., Hangai, M., Yoshimura, N., Tomidokoro, A., Araie, M., Raza, A. S., Hood, D. C., and Chan, K., Automated layer segmentation of macular OCT images using dual-scale gradient information. Opt. Express 18(20):21293–21307, 2010.CrossRef
25.
Zurück zum Zitat Abhishek, A. M., Berendschot, T. T., Rao, S. V., and Dabir, S., Segmentation and analysis of retinal layers (ILM & RPE) in optical coherence tomography images with edema. IEEE Conf. Biomed. Eng. Sci. (IECBES). 204-209, 2014 Abhishek, A. M., Berendschot, T. T., Rao, S. V., and Dabir, S., Segmentation and analysis of retinal layers (ILM & RPE) in optical coherence tomography images with edema. IEEE Conf. Biomed. Eng. Sci. (IECBES). 204-209, 2014
26.
Zurück zum Zitat Kaba, D., Wang, Y., Wang, C., Liu, X., Zhu, H., Salazar-Gonzalez, A. G., and Li, Y., Retina layer segmentation using kernel graph cuts and continuous max-flow. Opt. Express 23(6):7366–7384, 2015.CrossRef Kaba, D., Wang, Y., Wang, C., Liu, X., Zhu, H., Salazar-Gonzalez, A. G., and Li, Y., Retina layer segmentation using kernel graph cuts and continuous max-flow. Opt. Express 23(6):7366–7384, 2015.CrossRef
27.
Zurück zum Zitat Y. Huang, R. P. Danis, J. W. Pak, S. Luo, J. White, X. Zhang, A. Narkar and A. Domalpally, “Development of a semi-automatic segmentation method for retinal OCT images tested in patients with diabetic macular edema”, PLOS one, 8(12), p.e 82922, 2013.CrossRef Y. Huang, R. P. Danis, J. W. Pak, S. Luo, J. White, X. Zhang, A. Narkar and A. Domalpally, “Development of a semi-automatic segmentation method for retinal OCT images tested in patients with diabetic macular edema”, PLOS one, 8(12), p.e 82922, 2013.CrossRef
28.
Zurück zum Zitat Srinivasan, P. P., Kim, L. A., Mettu, P. S., Cousins, S. W., Comer, G. M., Izatt, J. A., and Farsiu, S., Fully automated detection of diabetic macular edema and dry age-related macular degeneration from optical coherence tomography images. Biomed. Opt. Express 5(10). https://doi.org/10.1364/BOE.5.003568, 12 Sep 2014.CrossRef Srinivasan, P. P., Kim, L. A., Mettu, P. S., Cousins, S. W., Comer, G. M., Izatt, J. A., and Farsiu, S., Fully automated detection of diabetic macular edema and dry age-related macular degeneration from optical coherence tomography images. Biomed. Opt. Express 5(10). https://​doi.​org/​10.​1364/​BOE.​5.​003568, 12 Sep 2014.CrossRef
29.
Zurück zum Zitat Chiu, S. J., Allingham, M. J., Mettu, P. S., Cousins, S. W., Izatt, J. A., and Farsiu, S., Kernel regression based segmentation of optical coherence tomography images with diabetic macular edema. Biomed. Opt. Express 6(4), 2015.CrossRef Chiu, S. J., Allingham, M. J., Mettu, P. S., Cousins, S. W., Izatt, J. A., and Farsiu, S., Kernel regression based segmentation of optical coherence tomography images with diabetic macular edema. Biomed. Opt. Express 6(4), 2015.CrossRef
30.
Zurück zum Zitat Fang, L., Cunefare, D., Wang, C., Guymer, R. H., Li, S., and Farsiu, S., Automatic segmentation of nine retinal layer boundaries in OCT images of non-exudative AMD patients using deep learning and graph search. Biomed Opt. Express 8(5), 2017.CrossRef Fang, L., Cunefare, D., Wang, C., Guymer, R. H., Li, S., and Farsiu, S., Automatic segmentation of nine retinal layer boundaries in OCT images of non-exudative AMD patients using deep learning and graph search. Biomed Opt. Express 8(5), 2017.CrossRef
31.
Zurück zum Zitat Rashno, A., Koozekanani, D. D., Drayna, P. M., Nazari, B., Sadri, S., Rabbani, H., Parhi, K. K., Fully-automated segmentation of fluid/cyst regions in optical coherence tomography images with diabetic macular edema using neutrosophic sets and graph algorithms. IEEE Trans. Biomed. Eng., vol. PP, no. 99, pp. 1-1, 2017. Rashno, A., Koozekanani, D. D., Drayna, P. M., Nazari, B., Sadri, S., Rabbani, H., Parhi, K. K., Fully-automated segmentation of fluid/cyst regions in optical coherence tomography images with diabetic macular edema using neutrosophic sets and graph algorithms. IEEE Trans. Biomed. Eng., vol. PP, no. 99, pp. 1-1, 2017.
32.
Zurück zum Zitat Lee, C. S., Tyring, A. J., Deruyter, N. P., Wu, Y., Rokem, A., and Lee, A. Y., Deep-learning based, automated segmentation of macular edema in optical coherence tomography. Biomed. Opt. Express 8(7), 2017. Lee, C. S., Tyring, A. J., Deruyter, N. P., Wu, Y., Rokem, A., and Lee, A. Y., Deep-learning based, automated segmentation of macular edema in optical coherence tomography. Biomed. Opt. Express 8(7), 2017.
33.
Zurück zum Zitat Hassan, T., Akram, M. U., Hassan, B., Syed, A. M., and Bazaz, S. A., Automated segmentation of subretinal layers for the detection of macular edema. Appl. Opt. 55:454–461, 2016.CrossRef Hassan, T., Akram, M. U., Hassan, B., Syed, A. M., and Bazaz, S. A., Automated segmentation of subretinal layers for the detection of macular edema. Appl. Opt. 55:454–461, 2016.CrossRef
34.
Zurück zum Zitat Hassan, B., Raja, G., Hassan, T., and Akram, M. U., Structure tensor based automated detection of macular edema and central serous retinopathy using optical coherence tomography images. J. Opt. Soc. Am. A 33:455–463, 2016.CrossRef Hassan, B., Raja, G., Hassan, T., and Akram, M. U., Structure tensor based automated detection of macular edema and central serous retinopathy using optical coherence tomography images. J. Opt. Soc. Am. A 33:455–463, 2016.CrossRef
35.
Zurück zum Zitat Syed, A. M., Hassan, T., Akram, M. U., Naz, S., and Khalid, S., Automated diagnosis of macular edema and central serous retinopathy through robust reconstruction of 3D retinal surfaces. Comput. Methods Prog. Biomed. 137:1–10, 2016.CrossRef Syed, A. M., Hassan, T., Akram, M. U., Naz, S., and Khalid, S., Automated diagnosis of macular edema and central serous retinopathy through robust reconstruction of 3D retinal surfaces. Comput. Methods Prog. Biomed. 137:1–10, 2016.CrossRef
36.
Zurück zum Zitat Badrinarayanan, V., Kendall, A., and Cipolla, R.. SegNet: A deep convolutional encoder-decoder architecture for image segmentation. arXiv preprint arXiv: 1511.00561, 2015. Badrinarayanan, V., Kendall, A., and Cipolla, R.. SegNet: A deep convolutional encoder-decoder architecture for image segmentation. arXiv preprint arXiv: 1511.00561, 2015.
37.
Zurück zum Zitat Krizhevsky, A., Sutskever, I., Hinton, G. E., imagenet classification with deep convolutional neural networks. Advances in Neural Information Processing Systems (NIPS), 2012. Krizhevsky, A., Sutskever, I., Hinton, G. E., imagenet classification with deep convolutional neural networks. Advances in Neural Information Processing Systems (NIPS), 2012.
38.
Zurück zum Zitat Farsiu, S., Chiu, S. J., O’Connell, R. V., Folgar, F. A., Yuan, E., Izatt, J. A., and Toth, C. A., Quantitative classification of eyes with and without intermediate age-related macular degeneration using optical coherence tomography. Ophthalmology, 121(1), 162-172 Jan. (2014).CrossRef Farsiu, S., Chiu, S. J., O’Connell, R. V., Folgar, F. A., Yuan, E., Izatt, J. A., and Toth, C. A., Quantitative classification of eyes with and without intermediate age-related macular degeneration using optical coherence tomography. Ophthalmology, 121(1), 162-172 Jan. (2014).CrossRef
39.
Zurück zum Zitat Delaunay, B., "Sur la sphère vide", Bulletin de l'Académie des Sciences de l'URSS. Classe des sciences mathématiques et naturelles. 6:793–800, 1934. Delaunay, B., "Sur la sphère vide", Bulletin de l'Académie des Sciences de l'URSS. Classe des sciences mathématiques et naturelles. 6:793–800, 1934.
40.
Zurück zum Zitat Rebay, S., Efficient unstructured mesh generation by means of delaunay triangulation and bowyer-watson algorithm. J. Comput. Phys. 106(1):127, 1993.CrossRef Rebay, S., Efficient unstructured mesh generation by means of delaunay triangulation and bowyer-watson algorithm. J. Comput. Phys. 106(1):127, 1993.CrossRef
41.
Zurück zum Zitat Bengio, Y., Practical recommendations for gradient based training of deep architectures. Neural Networks: Tricks of the Trade, Springer, 437-478, 2012. Bengio, Y., Practical recommendations for gradient based training of deep architectures. Neural Networks: Tricks of the Trade, Springer, 437-478, 2012.
42.
Zurück zum Zitat Murguia, M., and Villasenor, J. L., Estimating the effect of the similarity coefficient and the cluster algorithm on biogeographic classifications. Ann. Bot. Fennici. 40:415–421, 2003. Murguia, M., and Villasenor, J. L., Estimating the effect of the similarity coefficient and the cluster algorithm on biogeographic classifications. Ann. Bot. Fennici. 40:415–421, 2003.
Metadaten
Titel
Multilayered Deep Structure Tensor Delaunay Triangulation and Morphing Based Automated Diagnosis and 3D Presentation of Human Macula
verfasst von
Taimur Hassan
M. Usman Akram
Mahmood Akhtar
Shoab Ahmad Khan
Ubaidullah Yasin
Publikationsdatum
01.11.2018
Verlag
Springer US
Erschienen in
Journal of Medical Systems / Ausgabe 11/2018
Print ISSN: 0148-5598
Elektronische ISSN: 1573-689X
DOI
https://doi.org/10.1007/s10916-018-1078-3

Weitere Artikel der Ausgabe 11/2018

Journal of Medical Systems 11/2018 Zur Ausgabe