Skip to main content
Erschienen in: International Journal of Computer Assisted Radiology and Surgery 11/2019

08.06.2019 | Original Article

Hyperparameter optimization for image analysis: application to prostate tissue images and live cell data of virus-infected cells

verfasst von: Christian Ritter, Thomas Wollmann, Patrick Bernhard, Manuel Gunkel, Delia M. Braun, Ji-Young Lee, Jan Meiners, Ronald Simon, Guido Sauter, Holger Erfle, Karsten Rippe, Ralf Bartenschlager, Karl Rohr

Erschienen in: International Journal of Computer Assisted Radiology and Surgery | Ausgabe 11/2019

Einloggen, um Zugang zu erhalten

Abstract

Purpose

Automated analysis of microscopy image data typically requires complex pipelines that involve multiple methods for different image analysis tasks. To achieve best results of the analysis pipelines, method-dependent hyperparameters need to be optimized. However, complex pipelines often suffer from the fact that calculation of the gradient of the loss function is analytically or computationally infeasible. Therefore, first- or higher-order optimization methods cannot be applied.

Methods

We developed a new framework for zero-order black-box hyperparameter optimization called HyperHyper, which has a modular architecture that separates hyperparameter sampling and optimization. We also developed a visualization of the loss function based on infimum projection to obtain further insights into the optimization problem.

Results

We applied HyperHyper in three different experiments with different imaging modalities, and evaluated in total more than 400.000 hyperparameter combinations. HyperHyper was used for optimizing two pipelines for cell nuclei segmentation in prostate tissue microscopy images and two pipelines for detection of hepatitis C virus proteins in live cell microscopy data. We evaluated the impact of separating the sampling and optimization strategy using different optimizers and employed an infimum projection for visualizing the hyperparameter space.

Conclusions

The separation of sampling and optimization strategy of the proposed HyperHyper optimization framework improves the result of the investigated image analysis pipelines. Visualization of the loss function based on infimum projection enables gaining further insights on the optimization process.
Literatur
1.
Zurück zum Zitat Afgan E, Baker D, Batut B, van den Beek M, Bouvier D, Čech M, Chilton J, Clements D, Coraor N, Grüning BA, Guerler A, Hillman-Jackson J, Hiltemann S, Jalili V, Rasche H, Soranzo N, Goecks J, Taylor J, Nekrutenko A, Blankenberg D (2018) The Galaxy platform for accessible, reproducible and collaborative biomedical analyses: 2018 update. Nucleic Acids Res 46(1):537–544CrossRef Afgan E, Baker D, Batut B, van den Beek M, Bouvier D, Čech M, Chilton J, Clements D, Coraor N, Grüning BA, Guerler A, Hillman-Jackson J, Hiltemann S, Jalili V, Rasche H, Soranzo N, Goecks J, Taylor J, Nekrutenko A, Blankenberg D (2018) The Galaxy platform for accessible, reproducible and collaborative biomedical analyses: 2018 update. Nucleic Acids Res 46(1):537–544CrossRef
2.
Zurück zum Zitat Chen T, Guestrin C (2016) Xgboost: a scalable tree boosting system. In: Proceedings of SIGKDD. ACM, pp 785–794 Chen T, Guestrin C (2016) Xgboost: a scalable tree boosting system. In: Proceedings of SIGKDD. ACM, pp 785–794
3.
Zurück zum Zitat Chenouard N, Smal I, De Chaumont F, Maška M, Sbalzarini IF, Gong Y, Cardinale J, Carthel C, Coraluppi S, Winter M, Cohen AR, Godinez WJ, Rohr K, Kalaidzidis Y, Liang L, Duncan J, Shen H, Xu Y, Magnusson KE, Jaldén J, Blau HM, Paul-Gilloteaux P, Roudot P, Kervrann C, Waharte F, Tinevez JY, Shorte SL, Willemse J, Celler K, van Wezel GP, Dan HW, Tsai YS, Ortiz de Solórzano C, Olivo-Marin JC, Meijering E (2014) Objective comparison of particle tracking methods. Nat Methods 11(3):281–290CrossRef Chenouard N, Smal I, De Chaumont F, Maška M, Sbalzarini IF, Gong Y, Cardinale J, Carthel C, Coraluppi S, Winter M, Cohen AR, Godinez WJ, Rohr K, Kalaidzidis Y, Liang L, Duncan J, Shen H, Xu Y, Magnusson KE, Jaldén J, Blau HM, Paul-Gilloteaux P, Roudot P, Kervrann C, Waharte F, Tinevez JY, Shorte SL, Willemse J, Celler K, van Wezel GP, Dan HW, Tsai YS, Ortiz de Solórzano C, Olivo-Marin JC, Meijering E (2014) Objective comparison of particle tracking methods. Nat Methods 11(3):281–290CrossRef
4.
Zurück zum Zitat Cleary K, Peters TM (2010) Image-guided interventions: technology review and clinical applications. Annu Rev Biomed Eng 12:119–142CrossRef Cleary K, Peters TM (2010) Image-guided interventions: technology review and clinical applications. Annu Rev Biomed Eng 12:119–142CrossRef
5.
Zurück zum Zitat Cypko MA, Stoehr M, Kozniewski M, Druzdzel MJ, Dietz A, Berliner L, Lemke HU (2017) Validation workflow for a clinical Bayesian network model in multidisciplinary decision making in head and neck oncology treatment. Int J Comput Assist Radiol Surg 12(11):1959–1970CrossRef Cypko MA, Stoehr M, Kozniewski M, Druzdzel MJ, Dietz A, Berliner L, Lemke HU (2017) Validation workflow for a clinical Bayesian network model in multidisciplinary decision making in head and neck oncology treatment. Int J Comput Assist Radiol Surg 12(11):1959–1970CrossRef
6.
Zurück zum Zitat Di Tommaso P, Chatzou M, Floden EW, Barja PP, Palumbo E, Notredame C (2017) Nextflow enables reproducible computational workflows. Nat Biotechnol 35(4):316–319CrossRef Di Tommaso P, Chatzou M, Floden EW, Barja PP, Palumbo E, Notredame C (2017) Nextflow enables reproducible computational workflows. Nat Biotechnol 35(4):316–319CrossRef
7.
Zurück zum Zitat Godinez WJ, Lampe M, Koch P, Eils R, Muller B, Rohr K (2012) Identifying virus-cell fusion in two-channel fluorescence microscopy image sequences based on a layered probabilistic approach. IEEE Trans Med Imaging 31(9):1786–1808CrossRef Godinez WJ, Lampe M, Koch P, Eils R, Muller B, Rohr K (2012) Identifying virus-cell fusion in two-channel fluorescence microscopy image sequences based on a layered probabilistic approach. IEEE Trans Med Imaging 31(9):1786–1808CrossRef
8.
Zurück zum Zitat Godinez WJ, Rohr K (2015) Tracking multiple particles in fluorescence time-lapse microscopy images via probabilistic data association. IEEE Trans Med Imaging 34(2):415–432CrossRef Godinez WJ, Rohr K (2015) Tracking multiple particles in fluorescence time-lapse microscopy images via probabilistic data association. IEEE Trans Med Imaging 34(2):415–432CrossRef
9.
Zurück zum Zitat Goldberg DE (1989) Genetic algorithms in search, optimization, and machine learning. Addison-Wesley, Boston Goldberg DE (1989) Genetic algorithms in search, optimization, and machine learning. Addison-Wesley, Boston
10.
Zurück zum Zitat Golovin D, Solnik B, Moitra S, Kochanski G, Karro J, Sculley D (2017) Google vizier: a service for black-box optimization. In: Proceedings of SIGKDD. ACM, pp 1487–1495 Golovin D, Solnik B, Moitra S, Kochanski G, Karro J, Sculley D (2017) Google vizier: a service for black-box optimization. In: Proceedings of SIGKDD. ACM, pp 1487–1495
11.
Zurück zum Zitat Hertel L, Collado J, Sadowski P, Baldi P (2018) Sherpa: hyperparameter optimization for machine learning models. In: Proceedings of NIPS (submitted) Hertel L, Collado J, Sadowski P, Baldi P (2018) Sherpa: hyperparameter optimization for machine learning models. In: Proceedings of NIPS (submitted)
12.
Zurück zum Zitat Hutter F, Hoos HH, Leyton-Brown K (2011) Sequential model-based optimization for general algorithm configuration. In: Proceedings of LION. Springer, pp 507–523 Hutter F, Hoos HH, Leyton-Brown K (2011) Sequential model-based optimization for general algorithm configuration. In: Proceedings of LION. Springer, pp 507–523
14.
Zurück zum Zitat Komer B, Bergstra J, Eliasmith C (2014) Hyperopt-sklearn: automatic hyperparameter configuration for scikit-learn. In: Proceedings of ICML workshop on AutoML, pp 2825–2830 Komer B, Bergstra J, Eliasmith C (2014) Hyperopt-sklearn: automatic hyperparameter configuration for scikit-learn. In: Proceedings of ICML workshop on AutoML, pp 2825–2830
15.
Zurück zum Zitat Kuhn HW (2005) The Hungarian method for the assignment problem. NRL 2:7–21CrossRef Kuhn HW (2005) The Hungarian method for the assignment problem. NRL 2:7–21CrossRef
16.
Zurück zum Zitat Milletari F, Navab N, Ahmadi SA (2016) V-net: fully convolutional neural networks for volumetric medical image segmentation. In: Proceedings of 3DV. IEEE, pp 565–571 Milletari F, Navab N, Ahmadi SA (2016) V-net: fully convolutional neural networks for volumetric medical image segmentation. In: Proceedings of 3DV. IEEE, pp 565–571
17.
18.
Zurück zum Zitat Parzen E (1962) On estimation of a probability density function and mode. Ann Math Stat 33(3):1065–1076CrossRef Parzen E (1962) On estimation of a probability density function and mode. Ann Math Stat 33(3):1065–1076CrossRef
19.
Zurück zum Zitat Rahman SA, Koch P, Weichsel J, Godinez WJ, Schwarz U, Rohr K, Lamb DC, Kräusslich HG, Müller B (2014) Investigating the role of f-actin in human immunodeficiency virus assembly by live-cell microscopy. J Virol 88(14):7904–7914CrossRef Rahman SA, Koch P, Weichsel J, Godinez WJ, Schwarz U, Rohr K, Lamb DC, Kräusslich HG, Müller B (2014) Investigating the role of f-actin in human immunodeficiency virus assembly by live-cell microscopy. J Virol 88(14):7904–7914CrossRef
20.
Zurück zum Zitat Ritter C, Imle A, Lee JY, Müller B, Fackler OT, Bartenschlager R, Rohr K (2018) Two-filter probabilistic data association for tracking of virus particles in fluorescence microscopy images. In: Proceedings of ISBI. IEEE, pp 957–960 Ritter C, Imle A, Lee JY, Müller B, Fackler OT, Bartenschlager R, Rohr K (2018) Two-filter probabilistic data association for tracking of virus particles in fluorescence microscopy images. In: Proceedings of ISBI. IEEE, pp 957–960
21.
Zurück zum Zitat Ronneberger O, Fischer P, Brox T (2015) U-Net: convolutional networks for biomedical image segmentation. In: Proceedings of MICCAI. Springer, pp 234–241 Ronneberger O, Fischer P, Brox T (2015) U-Net: convolutional networks for biomedical image segmentation. In: Proceedings of MICCAI. Springer, pp 234–241
22.
Zurück zum Zitat Sage D, Neumann FR, Hediger F, Gasser SM, Unser M (2005) Automatic tracking of individual fluorescence particles: application to the study of chromosome dynamics. IEEE Trans Image Process 14(9):1372–1383CrossRef Sage D, Neumann FR, Hediger F, Gasser SM, Unser M (2005) Automatic tracking of individual fluorescence particles: application to the study of chromosome dynamics. IEEE Trans Image Process 14(9):1372–1383CrossRef
23.
Zurück zum Zitat Snoek J, Larochelle H, Adams RP (2012) Practical Bayesian optimization of machine learning algorithms. In: Proceedings of the advances in neural information processing systems, pp 2951–2959 Snoek J, Larochelle H, Adams RP (2012) Practical Bayesian optimization of machine learning algorithms. In: Proceedings of the advances in neural information processing systems, pp 2951–2959
24.
Zurück zum Zitat Svensson CM, Medyukhina A, Belyaev I, Al-Zaben N, Figge MT (2018) Untangling cell tracks: quantifying cell migration by time lapse image data analysis. Cytom Part A 93(3):357–370CrossRef Svensson CM, Medyukhina A, Belyaev I, Al-Zaben N, Figge MT (2018) Untangling cell tracks: quantifying cell migration by time lapse image data analysis. Cytom Part A 93(3):357–370CrossRef
25.
Zurück zum Zitat Tektonidis M, Rohr K (2017) Diffeomorphic multi-frame non-rigid registration of cell nuclei in 2D and 3D live cell images. IEEE Trans Image Process 26(3):1405–1417CrossRef Tektonidis M, Rohr K (2017) Diffeomorphic multi-frame non-rigid registration of cell nuclei in 2D and 3D live cell images. IEEE Trans Image Process 26(3):1405–1417CrossRef
26.
Zurück zum Zitat Thornton C, Hutter F, Hoos HH, Leyton-Brown K (2013) Auto-WEKA: combined selection and hyperparameter optimization of classification algorithms. In: Proceedigns of SIGKDD. ACM, pp 847–855 Thornton C, Hutter F, Hoos HH, Leyton-Brown K (2013) Auto-WEKA: combined selection and hyperparameter optimization of classification algorithms. In: Proceedigns of SIGKDD. ACM, pp 847–855
27.
Zurück zum Zitat Ulman V, Maška M, Magnusson KE, Ronneberger O, Haubold C, Harder N, Matula P, Matula P, Svoboda D, Radojevic M, Smal I, Rohr K, Jaldén J, Blau HM, Dzyubachyk O, Lelieveldt B, Xiao P, Li Y, Cho SY, Dufour AC, Olivo-Marin JC, Reyes-Aldasoro CC, Solis-Lemus JA, Bensch R, Brox T, Stegmaier J, Mikut R, Wolf S, Hamprecht FA, Esteves T, Quelhas P, Demirel Ö, Malmström L, Jug F, Tomancak P, Meijering E, Muñoz-Barrutia A, Kozubek M, Ortiz-de Solorzano C (2017) An objective comparison of cell-tracking algorithms. Nat Methods 14(12):1141–1552CrossRef Ulman V, Maška M, Magnusson KE, Ronneberger O, Haubold C, Harder N, Matula P, Matula P, Svoboda D, Radojevic M, Smal I, Rohr K, Jaldén J, Blau HM, Dzyubachyk O, Lelieveldt B, Xiao P, Li Y, Cho SY, Dufour AC, Olivo-Marin JC, Reyes-Aldasoro CC, Solis-Lemus JA, Bensch R, Brox T, Stegmaier J, Mikut R, Wolf S, Hamprecht FA, Esteves T, Quelhas P, Demirel Ö, Malmström L, Jug F, Tomancak P, Meijering E, Muñoz-Barrutia A, Kozubek M, Ortiz-de Solorzano C (2017) An objective comparison of cell-tracking algorithms. Nat Methods 14(12):1141–1552CrossRef
28.
29.
Zurück zum Zitat Wollmann T, Bernhard P, Gunkel M, Braun DM, Meiners J, Simon R, Sauter G, Erfle H, Rippe K, Rohr K (2019) Black-box hyperparameter optimization for nuclei segmentation in prostate tissue images. In: Proceedings of Bildverarbeitung für die Medizin. Springer, pp 345–350 Wollmann T, Bernhard P, Gunkel M, Braun DM, Meiners J, Simon R, Sauter G, Erfle H, Rippe K, Rohr K (2019) Black-box hyperparameter optimization for nuclei segmentation in prostate tissue images. In: Proceedings of Bildverarbeitung für die Medizin. Springer, pp 345–350
30.
Zurück zum Zitat Wollmann T, Erfle H, Eils R, Rohr K, Gunkel M (2017) Workflows for microscopy image analysis and cellular phenotyping. J Biotechnol 261:70–75CrossRef Wollmann T, Erfle H, Eils R, Rohr K, Gunkel M (2017) Workflows for microscopy image analysis and cellular phenotyping. J Biotechnol 261:70–75CrossRef
Metadaten
Titel
Hyperparameter optimization for image analysis: application to prostate tissue images and live cell data of virus-infected cells
verfasst von
Christian Ritter
Thomas Wollmann
Patrick Bernhard
Manuel Gunkel
Delia M. Braun
Ji-Young Lee
Jan Meiners
Ronald Simon
Guido Sauter
Holger Erfle
Karsten Rippe
Ralf Bartenschlager
Karl Rohr
Publikationsdatum
08.06.2019
Verlag
Springer International Publishing
Erschienen in
International Journal of Computer Assisted Radiology and Surgery / Ausgabe 11/2019
Print ISSN: 1861-6410
Elektronische ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-019-02010-3

Weitere Artikel der Ausgabe 11/2019

International Journal of Computer Assisted Radiology and Surgery 11/2019 Zur Ausgabe

Update Radiologie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.