Skip to main content
Erschienen in: International Journal of Computer Assisted Radiology and Surgery 9/2023

08.04.2023 | Original Article

A multi-view interactive virtual-physical registration method for mixed reality based surgical navigation in pelvic and acetabular fracture fixation

verfasst von: Puxun Tu, Huixiang Wang, Leo Joskowicz, Xiaojun Chen

Erschienen in: International Journal of Computer Assisted Radiology and Surgery | Ausgabe 9/2023

Einloggen, um Zugang zu erhalten

Abstract

Purpose

The treatment of pelvic and acetabular fractures remains technically demanding, and traditional surgical navigation systems suffer from the hand–eye mis-coordination. This paper describes a multi-view interactive virtual-physical registration method to enhance the surgeon’s depth perception and a mixed reality (MR)-based surgical navigation system for pelvic and acetabular fracture fixation.

Methods

First, the pelvic structure is reconstructed by segmentation in a preoperative CT scan, and an insertion path for the percutaneous LC-II screw is computed. A custom hand-held registration cube is used for virtual-physical registration. Three strategies are proposed to improve the surgeon’s depth perception: vertices alignment, tremble compensation and multi-view averaging. During navigation, distance and angular deviation visual cues are updated to help the surgeon with the guide wire insertion. The methods have been integrated into an MR module in a surgical navigation system.

Results

Phantom experiments were conducted. Ablation experimental results demonstrated the effectiveness of each strategy in the virtual-physical registration method. The proposed method achieved the best accuracy in comparison with related works. For percutaneous guide wire placement, our system achieved a mean bony entry point error of 2.76 ± 1.31 mm, a mean bony exit point error of 4.13 ± 1.74 mm, and a mean angular deviation of 3.04 ± 1.22°.

Conclusions

The proposed method can improve the virtual-physical fusion accuracy. The developed MR-based surgical navigation system has clinical application potential. Cadaver and clinical experiments will be conducted in future.
Literatur
1.
Zurück zum Zitat Butterwick D, Papp S, Gofton W, Liew A, Beaulé PE (2015) Acetabular fractures in the elderly: evaluation and management. J Bone Joint Surg 97(9):758–768CrossRefPubMed Butterwick D, Papp S, Gofton W, Liew A, Beaulé PE (2015) Acetabular fractures in the elderly: evaluation and management. J Bone Joint Surg 97(9):758–768CrossRefPubMed
2.
Zurück zum Zitat Wong JML, Bewsher S, Yew J, Bucknill A, Steiger R (2015) Fluoroscopically assisted computer navigation enables accurate percutaneous screw placement for pelvic and acetabular fracture fixation. Injury 46(6):1064–1068CrossRefPubMed Wong JML, Bewsher S, Yew J, Bucknill A, Steiger R (2015) Fluoroscopically assisted computer navigation enables accurate percutaneous screw placement for pelvic and acetabular fracture fixation. Injury 46(6):1064–1068CrossRefPubMed
3.
Zurück zum Zitat Karkenny AJ, Mendelis JR, Geller DS, Gomez JA (2019) The role of intraoperative navigation in orthopaedic surgery. JAAOS-J Am Acad Orthopaedic Surg 27(19):e849–e858CrossRef Karkenny AJ, Mendelis JR, Geller DS, Gomez JA (2019) The role of intraoperative navigation in orthopaedic surgery. JAAOS-J Am Acad Orthopaedic Surg 27(19):e849–e858CrossRef
4.
Zurück zum Zitat Lungu AJ, Swinkels W, Claesen L, Tu P, Egger J, Chen X (2021) A review on the applications of virtual reality, augmented reality and mixed reality in surgical simulation: an extension to different kinds of surgery. Expert Rev Med Devices 18(1):47–62CrossRefPubMed Lungu AJ, Swinkels W, Claesen L, Tu P, Egger J, Chen X (2021) A review on the applications of virtual reality, augmented reality and mixed reality in surgical simulation: an extension to different kinds of surgery. Expert Rev Med Devices 18(1):47–62CrossRefPubMed
5.
Zurück zum Zitat Chen X, Xu L, Wang Y, Wang H, Wang F, Zeng X, Egger J (2015) Development of a surgical navigation system based on augmented reality using an optical see-through head-mounted display. J Biomed Inform 55:124–131CrossRefPubMed Chen X, Xu L, Wang Y, Wang H, Wang F, Zeng X, Egger J (2015) Development of a surgical navigation system based on augmented reality using an optical see-through head-mounted display. J Biomed Inform 55:124–131CrossRefPubMed
6.
Zurück zum Zitat Liebmann F, Roner S, Atzigen M, Scaramuzza D, Sutter R, Snedeker J, Fürnstahl P (2019) Pedicle screw navigation using surface digitization on the Microsoft HoloLens. Int J Comp Assist Radiol Surg 14(7):1157–1165. Liebmann F, Roner S, Atzigen M, Scaramuzza D, Sutter R, Snedeker J, Fürnstahl P (2019) Pedicle screw navigation using surface digitization on the Microsoft HoloLens. Int J Comp Assist Radiol Surg 14(7):1157–1165.
7.
Zurück zum Zitat Gsaxner C, Pepe A, Li J, Ibrahimpasic U, Wallner J, Schmalstieg D, Egger J (2021) Augmented reality for head and neck carcinoma imaging: Description and feasibility of an instant calibration, markerless approach. Comput Methods Programs Biomed 200:105854CrossRefPubMed Gsaxner C, Pepe A, Li J, Ibrahimpasic U, Wallner J, Schmalstieg D, Egger J (2021) Augmented reality for head and neck carcinoma imaging: Description and feasibility of an instant calibration, markerless approach. Comput Methods Programs Biomed 200:105854CrossRefPubMed
8.
Zurück zum Zitat Atzigen M, Liebmann F, Hoch A, Spirig JM, Farshad M, Snedeker J, Fürnstahl P (2022) Marker-free surgical navigation of rod bending using a stereo neural network and augmented reality in spinal fusion. Med Image Anal 77:102365CrossRef Atzigen M, Liebmann F, Hoch A, Spirig JM, Farshad M, Snedeker J, Fürnstahl P (2022) Marker-free surgical navigation of rod bending using a stereo neural network and augmented reality in spinal fusion. Med Image Anal 77:102365CrossRef
9.
Zurück zum Zitat Gsaxner C, Pepe A, Wallner J, Schmalstieg D, Egger J (2019) Markerless image-to-face registration for untethered augmented reality in head and neck surgery. In: Proceedings of International Conference on Medical Image Computing and Computer-Assisted Intervention, pp 236–244. Gsaxner C, Pepe A, Wallner J, Schmalstieg D, Egger J (2019) Markerless image-to-face registration for untethered augmented reality in head and neck surgery. In: Proceedings of International Conference on Medical Image Computing and Computer-Assisted Intervention, pp 236–244.
10.
Zurück zum Zitat Sun Q, Mai Y, Yang R, Ji T, Jiang X, Chen X (2020) Fast and accurate online calibration of optical see-through head-mounted display for AR-based surgical navigation using Microsoft HoloLens. Int J Comp Assist Radiol Surg 15(11):1907–1919. Sun Q, Mai Y, Yang R, Ji T, Jiang X, Chen X (2020) Fast and accurate online calibration of optical see-through head-mounted display for AR-based surgical navigation using Microsoft HoloLens. Int J Comp Assist Radiol Surg 15(11):1907–1919.
11.
Zurück zum Zitat Li R, Tong Y, Yang T, Guo J, Si W, Zhang Y, Heng PA (2021) Towards quantitative and intuitive percutaneous tumor puncture via augmented virtual reality. Comput Med Imaging Graph 90:101905CrossRefPubMed Li R, Tong Y, Yang T, Guo J, Si W, Zhang Y, Heng PA (2021) Towards quantitative and intuitive percutaneous tumor puncture via augmented virtual reality. Comput Med Imaging Graph 90:101905CrossRefPubMed
12.
Zurück zum Zitat Song T, Yang C, Dianat O, Azimi E (2018) Endodontic guided treatment using augmented reality on a head-mounted display system. Healthcare Technol Lett 5(5):201–207CrossRef Song T, Yang C, Dianat O, Azimi E (2018) Endodontic guided treatment using augmented reality on a head-mounted display system. Healthcare Technol Lett 5(5):201–207CrossRef
13.
Zurück zum Zitat Tu P, Qin C, Guo Y, Li D, Lungu AJ, Wang H, Chen X (2022) Ultrasound image guided and mixed reality-based surgical system with real-time soft tissue deformation computing for robotic cervical pedicle screw placement. IEEE Trans Biomed Eng 68(8):2593–2603CrossRef Tu P, Qin C, Guo Y, Li D, Lungu AJ, Wang H, Chen X (2022) Ultrasound image guided and mixed reality-based surgical system with real-time soft tissue deformation computing for robotic cervical pedicle screw placement. IEEE Trans Biomed Eng 68(8):2593–2603CrossRef
14.
Zurück zum Zitat Oliveira ME, Debarba HG, Lädermann A, Chagué S, Charbonnier C (2019) A hand‐eye calibration method for augmented reality applied to computer‐assisted orthopedic surgery. Int J Med Robot Computer Assisted Surg 15(2):e1969. Oliveira ME, Debarba HG, Lädermann A, Chagué S, Charbonnier C (2019) A hand‐eye calibration method for augmented reality applied to computer‐assisted orthopedic surgery. Int J Med Robot Computer Assisted Surg 15(2):e1969.
15.
Zurück zum Zitat Fotouhi J, Mehrfard A, Song T, Johnson A, Osgood G, Unberath M, Navab N (2020) Development and pre-clinical analysis of spatiotemporal-aware augmented reality in orthopedic interventions. IEEE Trans Med Imaging 40(2):765–778CrossRef Fotouhi J, Mehrfard A, Song T, Johnson A, Osgood G, Unberath M, Navab N (2020) Development and pre-clinical analysis of spatiotemporal-aware augmented reality in orthopedic interventions. IEEE Trans Med Imaging 40(2):765–778CrossRef
16.
Zurück zum Zitat Scherer J, Guy P, Lefaivre KA, Pape HC, Werner CM, Osterhoff G (2017) Guide wire insertion for percutaneous LC2 screws in acetabular and pelvic ring fixation using a transpedicular working cannula. Injury 48(10):2360–2364CrossRefPubMed Scherer J, Guy P, Lefaivre KA, Pape HC, Werner CM, Osterhoff G (2017) Guide wire insertion for percutaneous LC2 screws in acetabular and pelvic ring fixation using a transpedicular working cannula. Injury 48(10):2360–2364CrossRefPubMed
17.
Zurück zum Zitat Wang H, Wang F, Newman S, Lin Y, Chen X, Xu L, Wang Q (2016) Application of an innovative computerized virtual planning system in acetabular fracture surgery: a feasibility study. Injury 47(8):1698–1701CrossRefPubMed Wang H, Wang F, Newman S, Lin Y, Chen X, Xu L, Wang Q (2016) Application of an innovative computerized virtual planning system in acetabular fracture surgery: a feasibility study. Injury 47(8):1698–1701CrossRefPubMed
18.
Zurück zum Zitat Tu P, Gao Y, Lungu AJ, Li D, Wang H, Chen X (2021) Augmented reality based navigation for distal interlocking of intramedullary nails utilizing Microsoft HoloLens 2. Comput Biol Med 133:104402CrossRefPubMed Tu P, Gao Y, Lungu AJ, Li D, Wang H, Chen X (2021) Augmented reality based navigation for distal interlocking of intramedullary nails utilizing Microsoft HoloLens 2. Comput Biol Med 133:104402CrossRefPubMed
19.
Zurück zum Zitat Lane CG, Warren R, Pearle AD (2008) The pivot shift. JAAOS-J Am Acad Orthopaed Surgeons 16(12):679–688CrossRef Lane CG, Warren R, Pearle AD (2008) The pivot shift. JAAOS-J Am Acad Orthopaed Surgeons 16(12):679–688CrossRef
20.
Zurück zum Zitat Moakher M (2002) Means and averaging in the group of rotations. SIAM J Matrix Anal Appl 24(1):1–16CrossRef Moakher M (2002) Means and averaging in the group of rotations. SIAM J Matrix Anal Appl 24(1):1–16CrossRef
21.
Zurück zum Zitat Gao Y, Wang H, Tu P, Hu J, Wang Q, Chen X (2021) A novel dynamic electromagnetic tracking navigation system for distal locking of intramedullary nails. Comput Methods Programs Biomed 209:106326CrossRefPubMed Gao Y, Wang H, Tu P, Hu J, Wang Q, Chen X (2021) A novel dynamic electromagnetic tracking navigation system for distal locking of intramedullary nails. Comput Methods Programs Biomed 209:106326CrossRefPubMed
22.
Zurück zum Zitat Qin C, Cao Z, Fan S, Wu Y, Sun Y, Politis C, Chen X (2019) An oral and maxillofacial navigation system for implant placement with automatic identification of fiducial points. Int J Comp Assist Radiol Surg 14(2):281–289. Qin C, Cao Z, Fan S, Wu Y, Sun Y, Politis C, Chen X (2019) An oral and maxillofacial navigation system for implant placement with automatic identification of fiducial points. Int J Comp Assist Radiol Surg 14(2):281–289.
23.
Zurück zum Zitat Fan X, Zhu Q, Tu P, Joskowicz L, Chen X (2022) A review of advances in image-guided orthopedic surgery. Phys Med Biolo 68:02TR01. Fan X, Zhu Q, Tu P, Joskowicz L, Chen X (2022) A review of advances in image-guided orthopedic surgery. Phys Med Biolo 68:02TR01.
Metadaten
Titel
A multi-view interactive virtual-physical registration method for mixed reality based surgical navigation in pelvic and acetabular fracture fixation
verfasst von
Puxun Tu
Huixiang Wang
Leo Joskowicz
Xiaojun Chen
Publikationsdatum
08.04.2023
Verlag
Springer International Publishing
Erschienen in
International Journal of Computer Assisted Radiology and Surgery / Ausgabe 9/2023
Print ISSN: 1861-6410
Elektronische ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-023-02884-4

Weitere Artikel der Ausgabe 9/2023

International Journal of Computer Assisted Radiology and Surgery 9/2023 Zur Ausgabe

Darf man die Behandlung eines Neonazis ablehnen?

08.05.2024 Gesellschaft Nachrichten

In einer Leseranfrage in der Zeitschrift Journal of the American Academy of Dermatology möchte ein anonymer Dermatologe bzw. eine anonyme Dermatologin wissen, ob er oder sie einen Patienten behandeln muss, der eine rassistische Tätowierung trägt.

Ein Drittel der jungen Ärztinnen und Ärzte erwägt abzuwandern

07.05.2024 Klinik aktuell Nachrichten

Extreme Arbeitsverdichtung und kaum Supervision: Dr. Andrea Martini, Sprecherin des Bündnisses Junge Ärztinnen und Ärzte (BJÄ) über den Frust des ärztlichen Nachwuchses und die Vorteile des Rucksack-Modells.

Endlich: Zi zeigt, mit welchen PVS Praxen zufrieden sind

IT für Ärzte Nachrichten

Darauf haben viele Praxen gewartet: Das Zi hat eine Liste von Praxisverwaltungssystemen veröffentlicht, die von Nutzern positiv bewertet werden. Eine gute Grundlage für wechselwillige Ärztinnen und Psychotherapeuten.

Akuter Schwindel: Wann lohnt sich eine MRT?

28.04.2024 Schwindel Nachrichten

Akuter Schwindel stellt oft eine diagnostische Herausforderung dar. Wie nützlich dabei eine MRT ist, hat eine Studie aus Finnland untersucht. Immerhin einer von sechs Patienten wurde mit akutem ischämischem Schlaganfall diagnostiziert.

Update Radiologie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.