Skip to main content

Employing Docker Swarm on OpenStack for Biomedical Analysis

  • Conference paper
  • First Online:
Computational Science and Its Applications – ICCSA 2016 (ICCSA 2016)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 9787))

Included in the following conference series:

Abstract

Biomedical analysis, in particular image and biosignal analysis, often requires several methods applied to the same data. The data is typically of large volume, so data transfer can become a bottleneck in remote analysis. Furthermore, biomedical data may contain patient data, raising data protection issues. We propose a highly virtualized infrastructure, employing Docker Swarm technology as the computing infrastructure. An underlying Openstack based IaaS cloud provides additional security features for a flexible and efficient multi-tenant analysis platform. We introduce the prototype infrastructure along a sample use-case of multiple versions of a machine-learning method applied to feature sets extracted from multidimensional biosignal recordings from Sleep Apnea patients and healthy controls.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    http://www.mathworks.com.

  2. 2.

    https://www.docker.com. If not individually referenced, details about specific Docker technologies within this paper can also be found on this website.

  3. 3.

    https://www.openstack.org.

  4. 4.

    http://keras.io/.

  5. 5.

    https://hub.docker.com/.

  6. 6.

    https://docs.docker.com/engine/userguide/networking/get-started-overlay/.

  7. 7.

    http://www.adaptivecomputing.com/products/open-source/torque/.

  8. 8.

    http://slurm.schedmd.com/.

  9. 9.

    http://kubernetes.io/.

  10. 10.

    http://mesos.apache.org/.

  11. 11.

    https://www.pandastrike.com/posts/20160307-docker-swarm-aws-vpc.

  12. 12.

    https://wiki.openstack.org/wiki/Docker.

  13. 13.

    https://wiki.openstack.org/wiki/Magnum.

  14. 14.

    https://github.com/docker/libnetwork/pull/1065.

  15. 15.

    https://hub.docker.com/.

References

  1. Solomonides, T. (ed.): Healthgrid Applications and Core Technologies. Proceedings of HealthGrid 2010. Studies in Health Technology and Informatics, vol. 159. IOS Press, Amsterdam (2010)

    Google Scholar 

  2. Glatard, T., et al.: Large-scale functional MRI study on a production grid. Future Gener. Comput. Syst. 26(4), 685–692 (2010)

    Article  Google Scholar 

  3. Gu, Y., Huang, Z.: Robinia-BLAST: an extensible parallel BLAST based on data-intensive distributed computing. In: 2014 IEEE 12th International Conference on Dependable, Autonomic and Secure Computing (DASC) (2014)

    Google Scholar 

  4. Korkhov, V., et al.: Exploring workflow interoperability for neuroimage analysis on the SHIWA platform. J. Grid Comput. 11, 1–18 (2013)

    Article  Google Scholar 

  5. Goldberger, A.L., et al.: PhysioBank, PhysioToolkit, and PhysioNet: components of a new research resource for complex physiologic signals. Circulation 101, e215–e220 (2000)

    Article  Google Scholar 

  6. Shahand, S., et al.: A data-centric neuroscience gateway: design, implementation, and experiences. Concur. Comput. Pract. Exper. 27, 489–506 (2015)

    Article  Google Scholar 

  7. Jansen, C., et al.: Extending XNAT towards a cloud-based quality assessment platform for retinal optical coherence tomographies. Scalable Comput. Pract. Exper. 16(1), 85–102 (2015)

    Google Scholar 

  8. Krefting, D., et al.: Performance analysis of diffusion tensor imaging an academic production grid. In: Parashar, M., Buyya, R. (eds.) 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing. CPS Conference Publishing Service (2010)

    Google Scholar 

  9. Sherif, T., et al.: CBRAIN: a web-based, distributed computing platform for collaborative neuroimaging research. Front. Neuroinformatics 8, 54 (2014)

    Article  Google Scholar 

  10. Krefting, D., et al.: Grid based sleep research analysis of polysomnographies using a grid infrastructure. Future Gener. Comput. Syst. 29(7), 1671–1679 (2013)

    Article  Google Scholar 

  11. Young, T., et al.: Population-based study of sleep-disordered breathing as a risk factor for hypertension. Arch. Intern. Med. 157, 1746–1752 (1997)

    Article  Google Scholar 

  12. Bashan, A., et al.: Network physiology reveals relations between network topology and physiological function. Nat. Commun. 3, 702 (2012)

    Article  Google Scholar 

  13. Dickhaus, H., Maier, C.: Detection of sleep apnea episodes from multi-lead ECGs considering different physiological influences. Methods Inf. Med. 46, 216–221 (2007)

    Google Scholar 

  14. Srivastava, N., et al.: Dropout: a simple way to prevent neural networks from overfitting. J. Mach. Learn. Res. 15(1), 1929–1958 (2014)

    MathSciNet  MATH  Google Scholar 

  15. Dooley, R., Stubbs, J.: Dynamically provisioning portable gateway infrastructure using Docker and Agave. In: Proceedings of the 2014 Annual Conference on Extreme Science and Engineering Discovery Environment, XSEDE 2014, pp. 55:1–55:2. ACM, New York (2014)

    Google Scholar 

  16. Tristan, G., et al.: Boutiques: an application-sharing system based on Linux containers. Front. Neurosci. 9

    Google Scholar 

Download references

Acknowledgements

The work is supported by the German Ministry of Education and Research (Project BB-IT-Boost, 03FH0061X5) and the German Ministry of Economic Affairs and Energy (ZIM Project BeCRF, Grant number KF3470401BZ4).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Dagmar Krefting .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this paper

Cite this paper

Jansen, C., Witt, M., Krefting, D. (2016). Employing Docker Swarm on OpenStack for Biomedical Analysis. In: Gervasi, O., et al. Computational Science and Its Applications – ICCSA 2016. ICCSA 2016. Lecture Notes in Computer Science(), vol 9787. Springer, Cham. https://doi.org/10.1007/978-3-319-42108-7_23

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-42108-7_23

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-42107-0

  • Online ISBN: 978-3-319-42108-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics