Skip to main content
Erschienen in: International Journal of Computer Assisted Radiology and Surgery 5/2019

07.02.2019 | Original Article

Robotic laser osteotomy through penscriptive structured light visual servoing

verfasst von: Jamil Jivraj, Ryan Deorajh, Phillips Lai, Chaoliang Chen, Nhu Nguyen, Joel Ramjist, Victor X. D. Yang

Erschienen in: International Journal of Computer Assisted Radiology and Surgery | Ausgabe 5/2019

Einloggen, um Zugang zu erhalten

Abstract

Purpose

Planning osteotomies is a task that surgeons do as part of standard surgical workflow. This task, however, becomes more difficult and less intuitive when a robot is tasked with performing the osteotomy. In this study, we aim to provide a new method for surgeons to allow for highly intuitive trajectory planning, similar to the way an attending surgeon would instruct a junior.

Methods

Planning an osteotomy, especially during a craniotomy, is performed intraoperatively using a sterile surgical pen or pencil directly on the exposed bone surface. This paper presents a new method for generating osteotomy trajectories for a multi-DOF robotic manipulator using the same method and relaying the penscribed cut path to the manipulator as a three-dimensional trajectory. The penscribed cut path is acquired using structured light imaging, and detection, segmentation, optimization and orientation generation of the Cartesian trajectory are done autonomously after minimal user input.

Results

A 7-DOF manipulator (KUKA IIWA) is able to follow fully penscribed trajectories with sub-millimeter accuracy in the target plane and perpendicular to it (0.46 mm and 0.36 mm absolute mean error, respectively).

Conclusions

The robot is able to precisely follow cut paths drawn by the surgeon directly onto the exposed boney surface of the skull. We demonstrate through this study that current surgical workflow does not have to be drastically modified to introduce robotic technology in the operating room. We show that it is possible to guide a robot to perform an osteotomy in much the same way a senior surgeon would show a trainee by using a simple surgical pen or pencil.
Literatur
1.
Zurück zum Zitat Giraud JY, Villemin S, Darmana R, Cahuzac JP, Autefage A, Morucci JP (1991) Bone cutting. Clin Phys Physiol Meas 12(1):1CrossRefPubMed Giraud JY, Villemin S, Darmana R, Cahuzac JP, Autefage A, Morucci JP (1991) Bone cutting. Clin Phys Physiol Meas 12(1):1CrossRefPubMed
3.
Zurück zum Zitat Vadera S, Chan A, Low T, Gill A, Morenkova A, Phiellip NM, Hermanowicz N, Hsu FP (2017) Frameless stereotactic robot-assisted subthalamic nucleus deep brain stimulation: case report. World Neurosurg 97:762-e11CrossRef Vadera S, Chan A, Low T, Gill A, Morenkova A, Phiellip NM, Hermanowicz N, Hsu FP (2017) Frameless stereotactic robot-assisted subthalamic nucleus deep brain stimulation: case report. World Neurosurg 97:762-e11CrossRef
4.
Zurück zum Zitat Giger A, Jud C, Cattin P (2017) Respiratory motion compensation for the robot-guided laser osteotome. Int J Comput Assist Radiol Surg 12(10):1751–1762CrossRefPubMed Giger A, Jud C, Cattin P (2017) Respiratory motion compensation for the robot-guided laser osteotome. Int J Comput Assist Radiol Surg 12(10):1751–1762CrossRefPubMed
5.
Zurück zum Zitat Burgner J (2010) Robot assisted laser osteotomy. KIT Scientific Publishing, Karlsruhe Burgner J (2010) Robot assisted laser osteotomy. KIT Scientific Publishing, Karlsruhe
6.
Zurück zum Zitat Baek KW, Deibel W, Martinov D, Griessen M, Bruno A, Zeilhofer HF, Cattin P, Juergens P (2015) Clinical applicability of robot-guided contact-free laser osteotomy in cranio-maxillo-facial surgery: in-vitro simulation and in-vivo surgery in minipig mandibles. J Oral Maxillofac Surg 53(10):976–981CrossRef Baek KW, Deibel W, Martinov D, Griessen M, Bruno A, Zeilhofer HF, Cattin P, Juergens P (2015) Clinical applicability of robot-guided contact-free laser osteotomy in cranio-maxillo-facial surgery: in-vitro simulation and in-vivo surgery in minipig mandibles. J Oral Maxillofac Surg 53(10):976–981CrossRef
7.
Zurück zum Zitat Deibel W, Schneider A, Augello M, Bruno AE, Juergens P, Cattin P (2015) A compact, efficient and light weight laser head for CARLO®: integration, performance and benefits. In: Novel optical systems design and optimization XVIII, vol 9579, International Society for Optics and Photonics Deibel W, Schneider A, Augello M, Bruno AE, Juergens P, Cattin P (2015) A compact, efficient and light weight laser head for CARLO®: integration, performance and benefits. In: Novel optical systems design and optimization XVIII, vol 9579, International Society for Optics and Photonics
8.
Zurück zum Zitat Mönnich H, Stein D, Raczkowsky J, Wörn H (2010) Results of CO2 robotic laser oseotomy in surgery with motion compensation. In: Photonic therapeutics and diagnostics VI, vol 7548, International Society for Optics and Photonics Mönnich H, Stein D, Raczkowsky J, Wörn H (2010) Results of CO2 robotic laser oseotomy in surgery with motion compensation. In: Photonic therapeutics and diagnostics VI, vol 7548, International Society for Optics and Photonics
9.
Zurück zum Zitat Xu D, andLinkun Wang ZJ, Tan M (2004) Features extraction for structured light image of welding seam with arc and splash disturbance. In: 8th International conference on control, automation, robotics and vision, Kunming, China, pp 1559–1563 Xu D, andLinkun Wang ZJ, Tan M (2004) Features extraction for structured light image of welding seam with arc and splash disturbance. In: 8th International conference on control, automation, robotics and vision, Kunming, China, pp 1559–1563
10.
Zurück zum Zitat Xu D, Wang L, Tan M (2004) Image processing and visual control method for arc welding robot. In: International conference on robotics and biomimetics, Shenyang, pp 727–732 Xu D, Wang L, Tan M (2004) Image processing and visual control method for arc welding robot. In: International conference on robotics and biomimetics, Shenyang, pp 727–732
11.
Zurück zum Zitat Xu D, Tan M, Li Y (2006) Visual control system for robotic welding. In: Industrial robotics theory modelling control, Pro Literatur Verlag, Austria Xu D, Tan M, Li Y (2006) Visual control system for robotic welding. In: Industrial robotics theory modelling control, Pro Literatur Verlag, Austria
12.
Zurück zum Zitat Xu D, Tan M, Zhao X, Tu Z (2004) Seam tracking and visual control for robotic arc welding based on structured light stereovision. Int J Autom Comput 1:63–75CrossRef Xu D, Tan M, Zhao X, Tu Z (2004) Seam tracking and visual control for robotic arc welding based on structured light stereovision. Int J Autom Comput 1:63–75CrossRef
13.
Zurück zum Zitat Yu Z, He Y, Xu Y, Chen H (2018) Vision-based deviation extraction for three-dimensional control in robotic welding with steel sheet. Int J Adv Manuf Technol 95(9–12):4449–4458CrossRef Yu Z, He Y, Xu Y, Chen H (2018) Vision-based deviation extraction for three-dimensional control in robotic welding with steel sheet. Int J Adv Manuf Technol 95(9–12):4449–4458CrossRef
14.
Zurück zum Zitat Ye Z, Fang G, Chen S, Zou JJ (2012) Passive vision based seam tracking system for pulse-MAG welding. Int J Adv Manuf Technol 67:1987–1996CrossRef Ye Z, Fang G, Chen S, Zou JJ (2012) Passive vision based seam tracking system for pulse-MAG welding. Int J Adv Manuf Technol 67:1987–1996CrossRef
15.
Zurück zum Zitat Xu Y, Fang G, Chen S, Zou JJ, Ye Z (2014) Real-time image processing for vision-based weld seam tracking in robotic GMAW. Int J Adv Manuf Technol 73(9):1413–1425CrossRef Xu Y, Fang G, Chen S, Zou JJ, Ye Z (2014) Real-time image processing for vision-based weld seam tracking in robotic GMAW. Int J Adv Manuf Technol 73(9):1413–1425CrossRef
16.
Zurück zum Zitat Guha D, Gupta S, Fehlings MG, Yang V (2017) Optical topographic imaging for spinal intraoperative three-dimensional navigation in minimally invasive approaches: initial preclinical experience. Spine J 17(10):S254CrossRef Guha D, Gupta S, Fehlings MG, Yang V (2017) Optical topographic imaging for spinal intraoperative three-dimensional navigation in minimally invasive approaches: initial preclinical experience. Spine J 17(10):S254CrossRef
17.
Zurück zum Zitat Sciavicco L, Siciliano B (2000) Modelling and control of robot manipulators, 2nd edn. Springer, BerlinCrossRef Sciavicco L, Siciliano B (2000) Modelling and control of robot manipulators, 2nd edn. Springer, BerlinCrossRef
18.
Zurück zum Zitat Boomgaard RVD, Balen RV (1992) Computer vision, methods for fast morphological image transforms using bitmapped images. Gr Image Process Gr Models Image Process 54(3):254–258 Boomgaard RVD, Balen RV (1992) Computer vision, methods for fast morphological image transforms using bitmapped images. Gr Image Process Gr Models Image Process 54(3):254–258
19.
Zurück zum Zitat Sobel I, Feldman G (1968) A \(3\times 3\) isotropic gradient operator for image processing. In: A talk at the Stanford artificial project, pp 271–272 Sobel I, Feldman G (1968) A \(3\times 3\) isotropic gradient operator for image processing. In: A talk at the Stanford artificial project, pp 271–272
20.
Zurück zum Zitat Zill D, Cullen M (2006) Advanced engineering mathematics, 3rd edn. Jones & Bartlett Learning, Burlington Zill D, Cullen M (2006) Advanced engineering mathematics, 3rd edn. Jones & Bartlett Learning, Burlington
21.
Zurück zum Zitat Jolliffe I (2002) Principal component analysis, series: Springer series in statistics, 2nd edn. Springer, New York Jolliffe I (2002) Principal component analysis, series: Springer series in statistics, 2nd edn. Springer, New York
22.
Zurück zum Zitat Wiles A, Thompson D, Frantz D (2004) Accuracy assessment and interpretation for optical tracking systems. In: Proceedings of SPIE medical imaging 2004: visualization, image-guided procedures and display (SPIE), vol 5367, pp 421–432 Wiles A, Thompson D, Frantz D (2004) Accuracy assessment and interpretation for optical tracking systems. In: Proceedings of SPIE medical imaging 2004: visualization, image-guided procedures and display (SPIE), vol 5367, pp 421–432
23.
Zurück zum Zitat Elfring R, de la Fuente M, Radermarcher K (2010) Assessment of optical localizer accuracy for computer aided surgery systems. Comput Aided Surg 15(1–3):1–12CrossRefPubMed Elfring R, de la Fuente M, Radermarcher K (2010) Assessment of optical localizer accuracy for computer aided surgery systems. Comput Aided Surg 15(1–3):1–12CrossRefPubMed
24.
Zurück zum Zitat Dillon NP (2014) Preliminary testing of a compact bone-attached robot for otologic surgery. In: Medical imaging 2014: image-guided procedures, robotic interventions, and modeling, vol 9036, International Society for Optics and Photonics Dillon NP (2014) Preliminary testing of a compact bone-attached robot for otologic surgery. In: Medical imaging 2014: image-guided procedures, robotic interventions, and modeling, vol 9036, International Society for Optics and Photonics
25.
Zurück zum Zitat Dillion NP, Balachandran R, Fitzpatrick JM, Siebold MA, Labadie RF, Wanna GB, Withrow TJ, Webster RJ (2015) A compact, bone-attached robot for mastoidectomy. J Med Devices 9(3):031003CrossRef Dillion NP, Balachandran R, Fitzpatrick JM, Siebold MA, Labadie RF, Wanna GB, Withrow TJ, Webster RJ (2015) A compact, bone-attached robot for mastoidectomy. J Med Devices 9(3):031003CrossRef
26.
Zurück zum Zitat Gerber N, Bell B, Gavaghan K, Weisstanner C, Caversaccio M, Weber S (2014) Surgical planning tool for robotically assisted hearing aid implantation. Int J Comput Assist Radiol Surg 9(1):11–20CrossRefPubMed Gerber N, Bell B, Gavaghan K, Weisstanner C, Caversaccio M, Weber S (2014) Surgical planning tool for robotically assisted hearing aid implantation. Int J Comput Assist Radiol Surg 9(1):11–20CrossRefPubMed
27.
Zurück zum Zitat Zagzoog N, Yang VX (2018) State of robotic mastoidectomy: literature review. World Neurosurg 116:347–351CrossRefPubMed Zagzoog N, Yang VX (2018) State of robotic mastoidectomy: literature review. World Neurosurg 116:347–351CrossRefPubMed
Metadaten
Titel
Robotic laser osteotomy through penscriptive structured light visual servoing
verfasst von
Jamil Jivraj
Ryan Deorajh
Phillips Lai
Chaoliang Chen
Nhu Nguyen
Joel Ramjist
Victor X. D. Yang
Publikationsdatum
07.02.2019
Verlag
Springer International Publishing
Erschienen in
International Journal of Computer Assisted Radiology and Surgery / Ausgabe 5/2019
Print ISSN: 1861-6410
Elektronische ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-018-01905-x

Weitere Artikel der Ausgabe 5/2019

International Journal of Computer Assisted Radiology and Surgery 5/2019 Zur Ausgabe

Update Radiologie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.