Skip to main content
Erschienen in: International Journal of Computer Assisted Radiology and Surgery 8/2018

24.05.2018 | Original Article

The intelligent OR: design and validation of a context-aware surgical working environment

verfasst von: Stefan Franke, Max Rockstroh, Mathias Hofer, Thomas Neumuth

Erschienen in: International Journal of Computer Assisted Radiology and Surgery | Ausgabe 8/2018

Einloggen, um Zugang zu erhalten

Abstract

Purpose

Interoperability of medical devices based on standards starts to establish in the operating room (OR). Devices share their data and control functionalities. Yet, the OR technology rarely implements cooperative, intelligent behavior, especially in terms of active cooperation with the OR team. Technical context-awareness will be an essential feature of the next generation of medical devices to address the increasing demands to clinicians in information seeking, decision making, and human–machine interaction in complex surgical working environments.

Methods

The paper describes the technical validation of an intelligent surgical working environment for endoscopic ear–nose–throat surgery. We briefly summarize the design of our framework for context-aware system’s behavior in integrated OR and present example realizations of novel assistance functionalities. In a study on patient phantoms, twenty-four procedures were implemented in the proposed intelligent surgical working environment based on recordings of real interventions. Subsequently, the whole processing pipeline for context-awareness from workflow recognition to the final system’s behavior is analyzed.

Results

Rule-based behavior that considers multiple perspectives on the procedure can partially compensate recognition errors. A considerable robustness could be achieved with a reasonable quality of the recognition. Overall, reliable reactive as well as proactive behavior of the surgical working environment can be implemented in the proposed environment.

Conclusions

The obtained validation results indicate the suitability of the overall approach. The setup is a reliable starting point for a subsequent evaluation of the proposed context-aware assistance. The major challenge for future work will be to implement the complex approach in a cross-vendor setting.
Literatur
1.
Zurück zum Zitat Kasparick M, Schlichting S, Golatowski F, Timmermann D (2015) New IEEE 11073 standards for interoperable, networked point-of-care medical devices. In: Proceedings of the 37th IEEE engineering in medicine and biology society (EMBC). IEEE, pp 1721–1724 Kasparick M, Schlichting S, Golatowski F, Timmermann D (2015) New IEEE 11073 standards for interoperable, networked point-of-care medical devices. In: Proceedings of the 37th IEEE engineering in medicine and biology society (EMBC). IEEE, pp 1721–1724
2.
Zurück zum Zitat Andersen B, Ulrich H, Rehmann D, Kock A-K, Wrage J-H, Ingenerf J (2015) Reporting device observations for semantic interoperability of surgical devices and clinical information systems. In: Proceedings of the 37th IEEE engineering in medicine and biology society (EMBC). IEEE, pp 1725–1728 Andersen B, Ulrich H, Rehmann D, Kock A-K, Wrage J-H, Ingenerf J (2015) Reporting device observations for semantic interoperability of surgical devices and clinical information systems. In: Proceedings of the 37th IEEE engineering in medicine and biology society (EMBC). IEEE, pp 1725–1728
5.
Zurück zum Zitat Blum T, Padoy N, Feußner H, Navab N (2008) Modeling and online recognition of surgical phases using hidden Markov models. In: Metaxas D, Axel L, Fichtinger G, Székely G (eds) Medical image computing and computer-assisted intervention-MICCAI 2008. Springer, Berlin, pp 627–635CrossRef Blum T, Padoy N, Feußner H, Navab N (2008) Modeling and online recognition of surgical phases using hidden Markov models. In: Metaxas D, Axel L, Fichtinger G, Székely G (eds) Medical image computing and computer-assisted intervention-MICCAI 2008. Springer, Berlin, pp 627–635CrossRef
6.
Zurück zum Zitat Lalys F, Riffaud L, Bouget D, Jannin P (2011) An application-dependent framework for the recognition of high-level surgical tasks in the OR. In: Fichtinger G, Martel A, Peters T (eds) Medical image computing and computer-assisted intervention-MICCAI 2011. Springer, Berlin, pp 331–338CrossRef Lalys F, Riffaud L, Bouget D, Jannin P (2011) An application-dependent framework for the recognition of high-level surgical tasks in the OR. In: Fichtinger G, Martel A, Peters T (eds) Medical image computing and computer-assisted intervention-MICCAI 2011. Springer, Berlin, pp 331–338CrossRef
7.
Zurück zum Zitat Speidel S, Zentek T, Sudra G, Gehrig T, Müller-Stich BP, Gutt C, Dillmann R (2009) Recognition of surgical skills using hidden Markov models. In: Proceedings volume 7261, medical imaging 2009: visualization, image-guided procedures, and modeling, pp 726125-8–726125-8 Speidel S, Zentek T, Sudra G, Gehrig T, Müller-Stich BP, Gutt C, Dillmann R (2009) Recognition of surgical skills using hidden Markov models. In: Proceedings volume 7261, medical imaging 2009: visualization, image-guided procedures, and modeling, pp 726125-8–726125-8
15.
Zurück zum Zitat Franke S, Meixensberger J, Neumuth T (2015) Multi-perspective workflow modeling for online surgical situation models. J Biomed Inform 54:158–166CrossRefPubMed Franke S, Meixensberger J, Neumuth T (2015) Multi-perspective workflow modeling for online surgical situation models. J Biomed Inform 54:158–166CrossRefPubMed
16.
Zurück zum Zitat Franke S, Neumuth T (2015) Adaptive surgical process models for prediction of surgical work steps from surgical low-level activities. In: Workshop on modeling and monitoring of computer-aided interventions (M2CAI). Medical Image Computing and Computer Assisted Intervention, Munich, Germany Franke S, Neumuth T (2015) Adaptive surgical process models for prediction of surgical work steps from surgical low-level activities. In: Workshop on modeling and monitoring of computer-aided interventions (M2CAI). Medical Image Computing and Computer Assisted Intervention, Munich, Germany
18.
Zurück zum Zitat Franke S, Neumuth T (2015) Towards structuring contextual information for workflow-driven surgical assistance functionalities. In: 49th annual conference of the German society for biomedical engineering (BMT 2015), Lübeck, Germany Franke S, Neumuth T (2015) Towards structuring contextual information for workflow-driven surgical assistance functionalities. In: 49th annual conference of the German society for biomedical engineering (BMT 2015), Lübeck, Germany
19.
Zurück zum Zitat Franke S, Neumuth T (2015) Rule-based medical device adaptation for the digital operating room. In: Proceedings of 37th annual international conference of the IEEE engineering in medicine and biology society. IEEE, Milano, pp 1733–1736 Franke S, Neumuth T (2015) Rule-based medical device adaptation for the digital operating room. In: Proceedings of 37th annual international conference of the IEEE engineering in medicine and biology society. IEEE, Milano, pp 1733–1736
20.
Zurück zum Zitat Franke S, Rockstroh M, Schreiber E, Neumann J, Neumuth T (2016) Context-aware medical assistance systems in integrated surgical environments. In: 28th conference of the international society for medical innovation and technology (SMIT), Delft, Netherlands, p 98 Franke S, Rockstroh M, Schreiber E, Neumann J, Neumuth T (2016) Context-aware medical assistance systems in integrated surgical environments. In: 28th conference of the international society for medical innovation and technology (SMIT), Delft, Netherlands, p 98
24.
Zurück zum Zitat Rockstroh M, Franke S, Neumuth T (2013) A workflow-driven surgical information source management. In: Lemke HU (ed) The international journal for computer assisted radiology and surgery. Springer, Heidelberg, pp 189–191 Rockstroh M, Franke S, Neumuth T (2013) A workflow-driven surgical information source management. In: Lemke HU (ed) The international journal for computer assisted radiology and surgery. Springer, Heidelberg, pp 189–191
25.
Zurück zum Zitat Neumuth T, Jannin P, Strauss G, Meixensberger J, Burgert O (2009) Validation of knowledge acquisition for surgical process models. J Am Med Inf Assoc 16(1):72–80CrossRef Neumuth T, Jannin P, Strauss G, Meixensberger J, Burgert O (2009) Validation of knowledge acquisition for surgical process models. J Am Med Inf Assoc 16(1):72–80CrossRef
26.
Zurück zum Zitat Twinanda A, Shehata S, Mutter D, Marescaux J, de Mathelin M, Padoy N (2017) EndoNet: a deep architecture for recognition tasks on laparoscopic videos. IEEE Trans Med Imaging 36(1):86–97CrossRefPubMed Twinanda A, Shehata S, Mutter D, Marescaux J, de Mathelin M, Padoy N (2017) EndoNet: a deep architecture for recognition tasks on laparoscopic videos. IEEE Trans Med Imaging 36(1):86–97CrossRefPubMed
Metadaten
Titel
The intelligent OR: design and validation of a context-aware surgical working environment
verfasst von
Stefan Franke
Max Rockstroh
Mathias Hofer
Thomas Neumuth
Publikationsdatum
24.05.2018
Verlag
Springer International Publishing
Erschienen in
International Journal of Computer Assisted Radiology and Surgery / Ausgabe 8/2018
Print ISSN: 1861-6410
Elektronische ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-018-1791-x

Weitere Artikel der Ausgabe 8/2018

International Journal of Computer Assisted Radiology and Surgery 8/2018 Zur Ausgabe

Screening-Mammografie offenbart erhöhtes Herz-Kreislauf-Risiko

26.04.2024 Mammografie Nachrichten

Routinemäßige Mammografien helfen, Brustkrebs frühzeitig zu erkennen. Anhand der Röntgenuntersuchung lassen sich aber auch kardiovaskuläre Risikopatientinnen identifizieren. Als zuverlässiger Anhaltspunkt gilt die Verkalkung der Brustarterien.

S3-Leitlinie zu Pankreaskrebs aktualisiert

23.04.2024 Pankreaskarzinom Nachrichten

Die Empfehlungen zur Therapie des Pankreaskarzinoms wurden um zwei Off-Label-Anwendungen erweitert. Und auch im Bereich der Früherkennung gibt es Aktualisierungen.

Fünf Dinge, die im Kindernotfall besser zu unterlassen sind

18.04.2024 Pädiatrische Notfallmedizin Nachrichten

Im Choosing-Wisely-Programm, das für die deutsche Initiative „Klug entscheiden“ Pate gestanden hat, sind erstmals Empfehlungen zum Umgang mit Notfällen von Kindern erschienen. Fünf Dinge gilt es demnach zu vermeiden.

„Nur wer sich gut aufgehoben fühlt, kann auch für Patientensicherheit sorgen“

13.04.2024 Klinik aktuell Kongressbericht

Die Teilnehmer eines Forums beim DGIM-Kongress waren sich einig: Fehler in der Medizin sind häufig in ungeeigneten Prozessen und mangelnder Kommunikation begründet. Gespräche mit Patienten und im Team können helfen.

Update Radiologie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.