Skip to main content
Erschienen in: International Journal of Computer Assisted Radiology and Surgery 3/2019

12.12.2018 | Original Article

Unsupervised pathology detection in medical images using conditional variational autoencoders

verfasst von: Hristina Uzunova, Sandra Schultz, Heinz Handels, Jan Ehrhardt

Erschienen in: International Journal of Computer Assisted Radiology and Surgery | Ausgabe 3/2019

Einloggen, um Zugang zu erhalten

Abstract

Purpose

Pathology detection in medical image data is an important but a rather complicated task. In particular, the big variability of the pathologies is a challenge to automatic detection methods and even to machine learning methods. Supervised algorithms would usually learn the appearance of a single pathological structure based on a large annotated dataset. As such data is not usually available, especially in large amounts, in this work we pursue a different unsupervised approach.

Methods

Our method is based on learning the entire variability of healthy data and detect pathologies by their differences to the learned norm. For this purpose, we use conditional variational autoencoders which learn the reconstruction and encoding distribution of healthy images and also have the ability to integrate certain prior knowledge about the data (condition).

Results

Our experiments on different 2D and 3D datasets show that the approach is suitable for the detection of pathologies and deliver reasonable Dice coefficients and AUCs. Also this method can estimate missing correspondences in pathological images and thus can be used as a pre-step to a registration method. Our experiments show improving registration results on pathological data when using this approach.

Conclusions

Overall the presented approach is suitable for a rough pathology detection in medical images and can be successfully used as a preprocessing step to other image processing methods.
Literatur
1.
Zurück zum Zitat Bao J, Chen D, Wen F, Li H, Hua G (2017) CVAE-GAN: fine-grained image generation through asymmetric training. In: IEEE international conference on computer vision, ICCV 2017, Venice, Italy, October 22–29, 2017, pp 2764–2773 Bao J, Chen D, Wen F, Li H, Hua G (2017) CVAE-GAN: fine-grained image generation through asymmetric training. In: IEEE international conference on computer vision, ICCV 2017, Venice, Italy, October 22–29, 2017, pp 2764–2773
2.
Zurück zum Zitat Ehrhardt J, Schmidt-Richberg A, Werner R, Handels H (2015) Variational registration—a flexible open-source ITK toolbox for nonrigid image registration. In: Bildverarbeitung Für Die Medizin 2015, Informatik aktuell, Lübeck, pp 209–214 Ehrhardt J, Schmidt-Richberg A, Werner R, Handels H (2015) Variational registration—a flexible open-source ITK toolbox for nonrigid image registration. In: Bildverarbeitung Für Die Medizin 2015, Informatik aktuell, Lübeck, pp 209–214
3.
Zurück zum Zitat Faktor A, Irani M (2012) Clustering by Composition—unsupervised discovery of image categories. In: Fitzgibbon A, Lazebnik S, Perona P, Sato Y, Schmid C (eds) Computer vision—ECCV 2012. Lecture notes in computer science, vol 7578. Springer, Berlin, Heidelber, Faktor A, Irani M (2012) Clustering by Composition—unsupervised discovery of image categories. In: Fitzgibbon A, Lazebnik S, Perona P, Sato Y, Schmid C (eds) Computer vision—ECCV 2012. Lecture notes in computer science, vol 7578. Springer, Berlin, Heidelber,
4.
Zurück zum Zitat Kamnitsas K, Ferrante E, Parisot S, Ledig C, Nori AV, Criminisi A, Rueckert D, Glocker B (2016) Deepmedic forbrain tumor segmentation. In: BrainLes 2016, with the challenges on BRATS, ISLES and mTOP, MICCAI, pp 138–149 Kamnitsas K, Ferrante E, Parisot S, Ledig C, Nori AV, Criminisi A, Rueckert D, Glocker B (2016) Deepmedic forbrain tumor segmentation. In: BrainLes 2016, with the challenges on BRATS, ISLES and mTOP, MICCAI, pp 138–149
5.
Zurück zum Zitat Kingma DP, Welling M (2013) Auto-encoding variational bayes. In: Proceedings of the 2nd international conference on learning representations—ICLR Kingma DP, Welling M (2013) Auto-encoding variational bayes. In: Proceedings of the 2nd international conference on learning representations—ICLR
6.
Zurück zum Zitat Klein A, Andersson J, Ardekani BA, Ashburner J, Avants B, Chiang MC, Christensen GE, Collins DL, Gee J, Hellier P, Song JH, Jenkinson M, Lepage C, Rueckert D, Thompson P, Vercauteren T, Woods RP, Mann JJ, Parsey RV (2009) Evaluation of 14 nonlinear deformation algorithms applied to human brain MRI registration. Neuroimage 46(3):786–802CrossRefPubMedPubMedCentral Klein A, Andersson J, Ardekani BA, Ashburner J, Avants B, Chiang MC, Christensen GE, Collins DL, Gee J, Hellier P, Song JH, Jenkinson M, Lepage C, Rueckert D, Thompson P, Vercauteren T, Woods RP, Mann JJ, Parsey RV (2009) Evaluation of 14 nonlinear deformation algorithms applied to human brain MRI registration. Neuroimage 46(3):786–802CrossRefPubMedPubMedCentral
7.
Zurück zum Zitat Krüger J, Ehrhardt J, Handels H (2015) Probabilistic appearance models for segmentation and classification. In: International conference on computer vision—ICCV, pp 1698–1706 Krüger J, Ehrhardt J, Handels H (2015) Probabilistic appearance models for segmentation and classification. In: International conference on computer vision—ICCV, pp 1698–1706
8.
Zurück zum Zitat Larsen ABL, Sønderby SK, Larochelle H, Winther O (2016) Autoencoding beyond pixels using a learned similarity metric. In: Proceedings of the 33rd international conference on international conference on machine learning, vol 48, pp 1558–1566 Larsen ABL, Sønderby SK, Larochelle H, Winther O (2016) Autoencoding beyond pixels using a learned similarity metric. In: Proceedings of the 33rd international conference on international conference on machine learning, vol 48, pp 1558–1566
9.
Zurück zum Zitat Litjens GJS, Kooi T, Bejnordi BE, Setio AAA, Ciompi F, Ghafoorian M, van der Laak JAWM, van Ginneken B, Sánchez CI (2017) A survey on deep learning in medical image analysis. Med Image Anal 42:60–88CrossRefPubMed Litjens GJS, Kooi T, Bejnordi BE, Setio AAA, Ciompi F, Ghafoorian M, van der Laak JAWM, van Ginneken B, Sánchez CI (2017) A survey on deep learning in medical image analysis. Med Image Anal 42:60–88CrossRefPubMed
10.
Zurück zum Zitat Lotan O, Irani M (2016) Needle-match: Reliable patch matching under high uncertainty. In: IEEE conference on computer vision and pattern recognition—CVPR Lotan O, Irani M (2016) Needle-match: Reliable patch matching under high uncertainty. In: IEEE conference on computer vision and pattern recognition—CVPR
11.
Zurück zum Zitat Maier O, Menze BH, von der Gablentz J, Häni L, Heinrich MP, Liebrand M, Winzeck S, Basit A, Bentley P, Chen L, Christiaens D, Dutil F, Egger K, Feng C, Glocker B, Götz M, Haeck T, Halme HL, Havaei M, Iftekharuddin KM, Jodoin PM, Kamnitsas K, Kellner E, Korvenoja A, Larochelle H, Ledig C, Lee JH, Maes F, Mahmood Q, Maier-Hein KH, McKinley R, Muschelli J, Pal C, Pei L, Rangarajan JR, Reza SM, Robben D, Rueckert D, Salli E, Suetens P, Wang CW, Wilms M, Kirschke JS, Krämer UM, Münte TF, Schramm P, Wiest R, Handels H, Reyes M (2017) Isles 2015—a public evaluation benchmark for ischemic stroke lesion segmentation from multispectral MRI. Med Image Anal 35:250–269CrossRefPubMed Maier O, Menze BH, von der Gablentz J, Häni L, Heinrich MP, Liebrand M, Winzeck S, Basit A, Bentley P, Chen L, Christiaens D, Dutil F, Egger K, Feng C, Glocker B, Götz M, Haeck T, Halme HL, Havaei M, Iftekharuddin KM, Jodoin PM, Kamnitsas K, Kellner E, Korvenoja A, Larochelle H, Ledig C, Lee JH, Maes F, Mahmood Q, Maier-Hein KH, McKinley R, Muschelli J, Pal C, Pei L, Rangarajan JR, Reza SM, Robben D, Rueckert D, Salli E, Suetens P, Wang CW, Wilms M, Kirschke JS, Krämer UM, Münte TF, Schramm P, Wiest R, Handels H, Reyes M (2017) Isles 2015—a public evaluation benchmark for ischemic stroke lesion segmentation from multispectral MRI. Med Image Anal 35:250–269CrossRefPubMed
12.
Zurück zum Zitat McKinley R, Häni L, Wiest R, Reyes M (2016) Segmenting the ischemic penumbra: a decision forest approach with automatic threshold finding. Springer, Berlin, pp 275–283 McKinley R, Häni L, Wiest R, Reyes M (2016) Segmenting the ischemic penumbra: a decision forest approach with automatic threshold finding. Springer, Berlin, pp 275–283
13.
Zurück zum Zitat Menze BH, Jakab A, Bauer S, Kalpathy-Cramer J, Farahani K, Kirby J, Burren Y, Porz N, Slotboom J, Wiest R, Lanczi L, Gerstner ER, Weber MA, Arbel T, Avants BB, Ayache N, Buendia P, Collins DL, Cordier N, Corso JJ, Criminisi A, Das T, Delingette H, Demiralp C, Durst CR, Dojat M, Doyle S, Festa J, Forbes F, Geremia E, Glocker B, Golland P, Guo X, Hamamci A, Iftekharuddin KM, Jena R, John NM, Konukoglu E, Lashkari D, Mariz JA, Meier R, Pereira S, Precup D, Price SJ, Raviv TR, Reza SMS, Ryan MT, Sarikaya D, Schwartz LH, Shin HC, Shotton J, Silva CA, Sousa N, Subbanna NK, Székely G, Taylor TJ, Thomas OM, Tustison NJ, Ünal GB, Vasseur F, Wintermark M, Ye DH, Zhao L, Zhao B, Zikic D, Prastawa M, Reyes M, Leemput KV (2015) The multimodal brain tumor image segmentation benchmark (BRATS). IEEE Trans Med Imaging 34(10):1993–2024CrossRefPubMed Menze BH, Jakab A, Bauer S, Kalpathy-Cramer J, Farahani K, Kirby J, Burren Y, Porz N, Slotboom J, Wiest R, Lanczi L, Gerstner ER, Weber MA, Arbel T, Avants BB, Ayache N, Buendia P, Collins DL, Cordier N, Corso JJ, Criminisi A, Das T, Delingette H, Demiralp C, Durst CR, Dojat M, Doyle S, Festa J, Forbes F, Geremia E, Glocker B, Golland P, Guo X, Hamamci A, Iftekharuddin KM, Jena R, John NM, Konukoglu E, Lashkari D, Mariz JA, Meier R, Pereira S, Precup D, Price SJ, Raviv TR, Reza SMS, Ryan MT, Sarikaya D, Schwartz LH, Shin HC, Shotton J, Silva CA, Sousa N, Subbanna NK, Székely G, Taylor TJ, Thomas OM, Tustison NJ, Ünal GB, Vasseur F, Wintermark M, Ye DH, Zhao L, Zhao B, Zikic D, Prastawa M, Reyes M, Leemput KV (2015) The multimodal brain tumor image segmentation benchmark (BRATS). IEEE Trans Med Imaging 34(10):1993–2024CrossRefPubMed
14.
Zurück zum Zitat Pawlowski N, Lee MCH, Rajchl M, McDonagh S, Ferrante E, Kamnitsas K, Cooke S, Stevenson SK, Khetani AM, Newman T, Zeiler FA, Digby RJ, Coles JP, Rueckert D, Menon DK, Newcombe VFJ, Glocker B (2018) Unsupervised lesion detection in brain CT using bayesian convolutional autoencoders. In: Medical imaging with deep learning—MIDL Pawlowski N, Lee MCH, Rajchl M, McDonagh S, Ferrante E, Kamnitsas K, Cooke S, Stevenson SK, Khetani AM, Newman T, Zeiler FA, Digby RJ, Coles JP, Rueckert D, Menon DK, Newcombe VFJ, Glocker B (2018) Unsupervised lesion detection in brain CT using bayesian convolutional autoencoders. In: Medical imaging with deep learning—MIDL
15.
Zurück zum Zitat Schlegl T, Seeböck P, Waldstein SM, Schmidt-Erfurth U, Langs G (2017) Unsupervised anomaly detection with generative adversarial networks to guide marker discovery. In: Information processing in medical imaging—IPMI, pp 146–157 Schlegl T, Seeböck P, Waldstein SM, Schmidt-Erfurth U, Langs G (2017) Unsupervised anomaly detection with generative adversarial networks to guide marker discovery. In: Information processing in medical imaging—IPMI, pp 146–157
16.
Zurück zum Zitat Shattuck DW, Mirza M, Adisetiyo V, Hojatkashani C, Salamon G, Narr KL, Poldrack RA, Bilder RM, Toga AW (2008) Construction of a 3d probabilistic atlas of human cortical structures. NeuroImage 39(3):1064–1080CrossRefPubMed Shattuck DW, Mirza M, Adisetiyo V, Hojatkashani C, Salamon G, Narr KL, Poldrack RA, Bilder RM, Toga AW (2008) Construction of a 3d probabilistic atlas of human cortical structures. NeuroImage 39(3):1064–1080CrossRefPubMed
17.
Zurück zum Zitat Shechtman E, Irani M (2007) Matching local self-similarities across images and videos. In: IEEE conference on computer vision and pattern recognition—CVPR Shechtman E, Irani M (2007) Matching local self-similarities across images and videos. In: IEEE conference on computer vision and pattern recognition—CVPR
18.
Zurück zum Zitat Sohn K, Lee H, Yan X (2015) Learning structured output representation using deep conditional generative models. Adv Neural Inf Process Syst 28:3483–3491 Sohn K, Lee H, Yan X (2015) Learning structured output representation using deep conditional generative models. Adv Neural Inf Process Syst 28:3483–3491
19.
Zurück zum Zitat Uzunova H, Handels H, Ehrhardt J (2018) Unsupervised pathology detection in medical images using learning-based methods. Bildverarbeitung für die Medizin 2018. Springer, Berlin, pp 61–66CrossRef Uzunova H, Handels H, Ehrhardt J (2018) Unsupervised pathology detection in medical images using learning-based methods. Bildverarbeitung für die Medizin 2018. Springer, Berlin, pp 61–66CrossRef
20.
Zurück zum Zitat Werner R, Schmidt-Richberg A, Handels H, Ehrhardt J (2014) Estimation of lung motion fields in 4D CT data by variational non-linear intensity-based registration: a comparison and evaluation study. Phys Med Biol 59(15):4247–4260CrossRefPubMed Werner R, Schmidt-Richberg A, Handels H, Ehrhardt J (2014) Estimation of lung motion fields in 4D CT data by variational non-linear intensity-based registration: a comparison and evaluation study. Phys Med Biol 59(15):4247–4260CrossRefPubMed
21.
Zurück zum Zitat Xue W, Islam A, Bhaduri M, Li S (2017) Direct multitype cardiac indices estimation via joint representation and regression learning. IEEE Trans Med Imaging 36(10):2057–2067CrossRefPubMed Xue W, Islam A, Bhaduri M, Li S (2017) Direct multitype cardiac indices estimation via joint representation and regression learning. IEEE Trans Med Imaging 36(10):2057–2067CrossRefPubMed
22.
Zurück zum Zitat Yan X, Yang J, Sohn K, Lee H (2016) Attribute2image: conditional image generation from visual attributes. In: European conference on computer vision—ECCV, vol 9908. Springer, pp 776–791 Yan X, Yang J, Sohn K, Lee H (2016) Attribute2image: conditional image generation from visual attributes. In: European conference on computer vision—ECCV, vol 9908. Springer, pp 776–791
Metadaten
Titel
Unsupervised pathology detection in medical images using conditional variational autoencoders
verfasst von
Hristina Uzunova
Sandra Schultz
Heinz Handels
Jan Ehrhardt
Publikationsdatum
12.12.2018
Verlag
Springer International Publishing
Erschienen in
International Journal of Computer Assisted Radiology and Surgery / Ausgabe 3/2019
Print ISSN: 1861-6410
Elektronische ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-018-1898-0

Weitere Artikel der Ausgabe 3/2019

International Journal of Computer Assisted Radiology and Surgery 3/2019 Zur Ausgabe

Update Radiologie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.