Skip to main content
Erschienen in: International Journal of Computer Assisted Radiology and Surgery 9/2016

01.09.2016 | Original Article

Toward cognitive pipelines of medical assistance algorithms

verfasst von: Patrick Philipp, Maria Maleshkova, Darko Katic, Christian Weber, Michael Götz, Achim Rettinger, Stefanie Speidel, Benedikt Kämpgen, Marco Nolden, Anna-Laura Wekerle, Rüdiger Dillmann, Hannes Kenngott, Beat Müller, Rudi Studer

Erschienen in: International Journal of Computer Assisted Radiology and Surgery | Ausgabe 9/2016

Einloggen, um Zugang zu erhalten

Abstract

Purpose

Assistance algorithms for medical tasks have great potential to support physicians with their daily work. However, medicine is also one of the most demanding domains for computer-based support systems, since medical assistance tasks are complex and the practical experience of the physician is crucial. Recent developments in the area of cognitive computing appear to be well suited to tackle medicine as an application domain.

Methods

We propose a system based on the idea of cognitive computing and consisting of auto-configurable medical assistance algorithms and their self-adapting combination. The system enables automatic execution of new algorithms, given they are made available as Medical Cognitive Apps and are registered in a central semantic repository. Learning components can be added to the system to optimize the results in the cases when numerous Medical Cognitive Apps are available for the same task. Our prototypical implementation is applied to the areas of surgical phase recognition based on sensor data and image progressing for tumor progression mappings.

Results

Our results suggest that such assistance algorithms can be automatically configured in execution pipelines, candidate results can be automatically scored and combined, and the system can learn from experience. Furthermore, our evaluation shows that the Medical Cognitive Apps are providing the correct results as they did for local execution and run in a reasonable amount of time.

Conclusion

The proposed solution is applicable to a variety of medical use cases and effectively supports the automated and self-adaptive configuration of cognitive pipelines based on medical interpretation algorithms.
Literatur
1.
Zurück zum Zitat Ferrucci D (2010) Build watson: an overview of deepqa for the jeopardy challenge. In: Proceedings of international conference on parallel architecture and compilation techniques, ACM pp 1–2 Ferrucci D (2010) Build watson: an overview of deepqa for the jeopardy challenge. In: Proceedings of international conference on parallel architecture and compilation techniques, ACM pp 1–2
2.
Zurück zum Zitat Butcher L (2012) Case study: how health it is changing the practice of oncology using data in new ways. Oncol Times 34(24):29–30CrossRef Butcher L (2012) Case study: how health it is changing the practice of oncology using data in new ways. Oncol Times 34(24):29–30CrossRef
3.
Zurück zum Zitat Gil Y, Gonzlez-Calero PA, Kim J, Moody J, Ratnakar V (2011) A semantic framework for automatic generation of computational workflows using distributed data and component catalogues. J Exp Theor Artif Intell 23(4):389–467CrossRef Gil Y, Gonzlez-Calero PA, Kim J, Moody J, Ratnakar V (2011) A semantic framework for automatic generation of computational workflows using distributed data and component catalogues. J Exp Theor Artif Intell 23(4):389–467CrossRef
4.
Zurück zum Zitat Oinn T, Greenwood M, Addis M, Alpdemir MN, Ferris J, Glover K, Goble C, Goderis A, Hull D, Marvin D, Li P, Lord P, Pocock MR, Senger M, Stevens R, Wipat A, Wroe C (2006) Taverna: lessons in creating a workflow environment for the life sciences. Concurr Comput Pract Exp 18(10):1067–1100CrossRef Oinn T, Greenwood M, Addis M, Alpdemir MN, Ferris J, Glover K, Goble C, Goderis A, Hull D, Marvin D, Li P, Lord P, Pocock MR, Senger M, Stevens R, Wipat A, Wroe C (2006) Taverna: lessons in creating a workflow environment for the life sciences. Concurr Comput Pract Exp 18(10):1067–1100CrossRef
5.
Zurück zum Zitat Wood I, Vandervalk B, McCarthy L, Wilkinson M (2012) OWL-DL domain-models as abstract workflows. In: Margaria T, Steffen B (eds) Leveraging applications of formal methods, verification and validation. Applications and case studies. Volume 7610 of lecture notes in computer science. Springer, Berlin, pp 56–66CrossRef Wood I, Vandervalk B, McCarthy L, Wilkinson M (2012) OWL-DL domain-models as abstract workflows. In: Margaria T, Steffen B (eds) Leveraging applications of formal methods, verification and validation. Applications and case studies. Volume 7610 of lecture notes in computer science. Springer, Berlin, pp 56–66CrossRef
6.
Zurück zum Zitat Beygelzimer A, Riabov A, Sow D, Turaga DS, Udrea O (2013) Big data exploration via automated orchestration of analytic workflows. In: Proceedings of international conference on autonomic computing, San Jose, CA, pp 153–158 Beygelzimer A, Riabov A, Sow D, Turaga DS, Udrea O (2013) Big data exploration via automated orchestration of analytic workflows. In: Proceedings of international conference on autonomic computing, San Jose, CA, pp 153–158
7.
Zurück zum Zitat Brazdil P, Carrier CG, Soares C, Vilalta R (2008) Metalearning: applications to data mining. Springer, Berlin Brazdil P, Carrier CG, Soares C, Vilalta R (2008) Metalearning: applications to data mining. Springer, Berlin
8.
Zurück zum Zitat Nguyen P, Hilario M, Kalousis A (2014) Using meta-mining to support data mining workflow planning and optimization. J Artif Intell Res 51:605–644 Nguyen P, Hilario M, Kalousis A (2014) Using meta-mining to support data mining workflow planning and optimization. J Artif Intell Res 51:605–644
9.
Zurück zum Zitat Kotthoff L (2014) Algorithm selection for combinatorial search problems: a survey. AI Mag 35(3):48–60 Kotthoff L (2014) Algorithm selection for combinatorial search problems: a survey. AI Mag 35(3):48–60
10.
Zurück zum Zitat Thornton C, Hutter F, Hoos HH, Leyton-Brown K (2013) Auto-weka: combined selection and hyperparameter optimization of classification algorithms. In: Proceedings of the 19th ACM SIGKDD international conference on Knowledge discovery and data mining, ACM pp 847–855 Thornton C, Hutter F, Hoos HH, Leyton-Brown K (2013) Auto-weka: combined selection and hyperparameter optimization of classification algorithms. In: Proceedings of the 19th ACM SIGKDD international conference on Knowledge discovery and data mining, ACM pp 847–855
11.
Zurück zum Zitat Samulowitz H, Sabharwal A, Reddy C (2014) Cognitive automation of data science. In: ICML AutoML workshop Samulowitz H, Sabharwal A, Reddy C (2014) Cognitive automation of data science. In: ICML AutoML workshop
12.
Zurück zum Zitat Clearly K, Chung HY, Mun SK (2005) Or 2020: the operating room of the future. Laparoendosc Adv Surg Tech 15(5):495–500CrossRef Clearly K, Chung HY, Mun SK (2005) Or 2020: the operating room of the future. Laparoendosc Adv Surg Tech 15(5):495–500CrossRef
13.
Zurück zum Zitat Kranzfelder M, Staub C, Fiolka A, Schneider A, Gillen S, Wilhelm D, Friess H, Knoll A, Feussner H (2013) Toward increased autonomy in the surgical OR: needs, requests, and expectations. Surg Endosc 27(5):1681–1688CrossRefPubMed Kranzfelder M, Staub C, Fiolka A, Schneider A, Gillen S, Wilhelm D, Friess H, Knoll A, Feussner H (2013) Toward increased autonomy in the surgical OR: needs, requests, and expectations. Surg Endosc 27(5):1681–1688CrossRefPubMed
14.
Zurück zum Zitat Joyce JP, Lapinsky GW (1983) A history and overview of the safety parameter display system concept. Nucl Sci IEEE Trans 30(1):744–749CrossRef Joyce JP, Lapinsky GW (1983) A history and overview of the safety parameter display system concept. Nucl Sci IEEE Trans 30(1):744–749CrossRef
15.
Zurück zum Zitat Neumuth T, Strau G, Meixensberger J, Lemke H, Burgert O (2006) Acquisition of process descriptions from surgical interventions. Database and expert systems applications. Volume 4080 of lecture notes in computer science. Springer, Berlin, pp 602–611 Neumuth T, Strau G, Meixensberger J, Lemke H, Burgert O (2006) Acquisition of process descriptions from surgical interventions. Database and expert systems applications. Volume 4080 of lecture notes in computer science. Springer, Berlin, pp 602–611
16.
Zurück zum Zitat Lalys F, Bouget D, Riffaud L, Jannin P (2013) Automatic knowledge-based recognition of low-level tasks in ophthalmological procedures. Int J Comput Assist Radiol Surg 8(1):39–49CrossRefPubMed Lalys F, Bouget D, Riffaud L, Jannin P (2013) Automatic knowledge-based recognition of low-level tasks in ophthalmological procedures. Int J Comput Assist Radiol Surg 8(1):39–49CrossRefPubMed
17.
Zurück zum Zitat Speidel S, Benzko J, Krappe S, Sudra G, Azad P, Müller-Stich BP, Gutt C, Dillmann R (2009) Automatic classification of minimally invasive instruments based on endoscopic image sequences, vol 7261. In: Proceedings of SPIE Speidel S, Benzko J, Krappe S, Sudra G, Azad P, Müller-Stich BP, Gutt C, Dillmann R (2009) Automatic classification of minimally invasive instruments based on endoscopic image sequences, vol 7261. In: Proceedings of SPIE
18.
Zurück zum Zitat Neumuth T, Jannin P, Strauss G, Meixensberger J, Burgert O (2009) Validation of knowledge acquisition for surgical process models. J Am Med Inf Assoc 16(1):72–80 Neumuth T, Jannin P, Strauss G, Meixensberger J, Burgert O (2009) Validation of knowledge acquisition for surgical process models. J Am Med Inf Assoc 16(1):72–80
19.
Zurück zum Zitat Katic D, Wekerle AL, Gärtner F, Kenngott HG, Müller-Stich BP, Dillmann R, Speidel S (2014) Knowledge-driven formalization of laparoscopic surgeries for rule-based intraoperative context-aware assistance. In: IPCAI Katic D, Wekerle AL, Gärtner F, Kenngott HG, Müller-Stich BP, Dillmann R, Speidel S (2014) Knowledge-driven formalization of laparoscopic surgeries for rule-based intraoperative context-aware assistance. In: IPCAI
20.
Zurück zum Zitat Gemmeke P, Maleshkova M, Philipp P, Götz M, Weber C, Kämpgen B, Zelzer S, Maier-Hein K, Rettinger A (2014) Using linked data and Web APIs for automating the pre-processing of medical images. COLD (ISWC) Gemmeke P, Maleshkova M, Philipp P, Götz M, Weber C, Kämpgen B, Zelzer S, Maier-Hein K, Rettinger A (2014) Using linked data and Web APIs for automating the pre-processing of medical images. COLD (ISWC)
21.
Zurück zum Zitat Philipp P, Maleshkova M, Götz M, Weber C, Kämpgen B, Zelzer S, Maier-Hein K, Rettinger A (2015) Automatisierte Verarbeitung von Bildverarbeitungsalgorithmen mit semantischen Technologien. In: BVM Philipp P, Maleshkova M, Götz M, Weber C, Kämpgen B, Zelzer S, Maier-Hein K, Rettinger A (2015) Automatisierte Verarbeitung von Bildverarbeitungsalgorithmen mit semantischen Technologien. In: BVM
22.
Zurück zum Zitat Krötzsch M, Vrandečić D, Völkel M (2006) Semantic mediawiki. In: The Semantic Web-ISWC 2006. Springer, pp 935–942 Krötzsch M, Vrandečić D, Völkel M (2006) Semantic mediawiki. In: The Semantic Web-ISWC 2006. Springer, pp 935–942
23.
Zurück zum Zitat Speiser S, Harth A (2011) Integrating linked data and services with linked data services. In: The semantic web: research and appl. Springer 170–184 Speiser S, Harth A (2011) Integrating linked data and services with linked data services. In: The semantic web: research and appl. Springer 170–184
24.
Zurück zum Zitat Wolpert DH, Macready WG (1997) No free lunch theorems for optimization. Evol Comput IEEE Trans 1(1):67–82CrossRef Wolpert DH, Macready WG (1997) No free lunch theorems for optimization. Evol Comput IEEE Trans 1(1):67–82CrossRef
25.
Zurück zum Zitat Freund Y, Schapire RE (1995) A desicion-theoretic generalization of on-line learning and an application to boosting. In: Vitányi P (ed) Computational learning theory. Springer, Heidelberg, pp 23–37 Freund Y, Schapire RE (1995) A desicion-theoretic generalization of on-line learning and an application to boosting. In: Vitányi P (ed) Computational learning theory. Springer, Heidelberg, pp 23–37
26.
Zurück zum Zitat Breiman L (1996) Bagging predictors. Mach learn 24(2):123–140 Breiman L (1996) Bagging predictors. Mach learn 24(2):123–140
27.
28.
Zurück zum Zitat Jacobs RA, Jordan MI, Nowlan SJ, Hinton GE (1991) Adaptive mixtures of local experts. Neural Comput 3(1):79–87CrossRef Jacobs RA, Jordan MI, Nowlan SJ, Hinton GE (1991) Adaptive mixtures of local experts. Neural Comput 3(1):79–87CrossRef
29.
Zurück zum Zitat Stadtmüller S, Speiser S, Harth A, Studer R (2013) Data-fu: a language and an interpreter for interaction with read/write linked data. In: Proceedings of the international conference on World Wide Web, pp 1225–1236 Stadtmüller S, Speiser S, Harth A, Studer R (2013) Data-fu: a language and an interpreter for interaction with read/write linked data. In: Proceedings of the international conference on World Wide Web, pp 1225–1236
Metadaten
Titel
Toward cognitive pipelines of medical assistance algorithms
verfasst von
Patrick Philipp
Maria Maleshkova
Darko Katic
Christian Weber
Michael Götz
Achim Rettinger
Stefanie Speidel
Benedikt Kämpgen
Marco Nolden
Anna-Laura Wekerle
Rüdiger Dillmann
Hannes Kenngott
Beat Müller
Rudi Studer
Publikationsdatum
01.09.2016
Verlag
Springer Berlin Heidelberg
Erschienen in
International Journal of Computer Assisted Radiology and Surgery / Ausgabe 9/2016
Print ISSN: 1861-6410
Elektronische ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-015-1322-y

Weitere Artikel der Ausgabe 9/2016

International Journal of Computer Assisted Radiology and Surgery 9/2016 Zur Ausgabe

Screening-Mammografie offenbart erhöhtes Herz-Kreislauf-Risiko

26.04.2024 Mammografie Nachrichten

Routinemäßige Mammografien helfen, Brustkrebs frühzeitig zu erkennen. Anhand der Röntgenuntersuchung lassen sich aber auch kardiovaskuläre Risikopatientinnen identifizieren. Als zuverlässiger Anhaltspunkt gilt die Verkalkung der Brustarterien.

S3-Leitlinie zu Pankreaskrebs aktualisiert

23.04.2024 Pankreaskarzinom Nachrichten

Die Empfehlungen zur Therapie des Pankreaskarzinoms wurden um zwei Off-Label-Anwendungen erweitert. Und auch im Bereich der Früherkennung gibt es Aktualisierungen.

Fünf Dinge, die im Kindernotfall besser zu unterlassen sind

18.04.2024 Pädiatrische Notfallmedizin Nachrichten

Im Choosing-Wisely-Programm, das für die deutsche Initiative „Klug entscheiden“ Pate gestanden hat, sind erstmals Empfehlungen zum Umgang mit Notfällen von Kindern erschienen. Fünf Dinge gilt es demnach zu vermeiden.

„Nur wer sich gut aufgehoben fühlt, kann auch für Patientensicherheit sorgen“

13.04.2024 Klinik aktuell Kongressbericht

Die Teilnehmer eines Forums beim DGIM-Kongress waren sich einig: Fehler in der Medizin sind häufig in ungeeigneten Prozessen und mangelnder Kommunikation begründet. Gespräche mit Patienten und im Team können helfen.

Update Radiologie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.