Skip to main content
Erschienen in: International Journal of Computer Assisted Radiology and Surgery 9/2017

24.02.2017 | Original Article

3D ultrasound registration-based visual servoing for neurosurgical navigation

verfasst von: Oliver Zettinig, Benjamin Frisch, Salvatore Virga, Marco Esposito, Anna Rienmüller, Bernhard Meyer, Christoph Hennersperger, Yu-Mi Ryang, Nassir Navab

Erschienen in: International Journal of Computer Assisted Radiology and Surgery | Ausgabe 9/2017

Einloggen, um Zugang zu erhalten

Abstract

Purpose

We present a fully image-based visual servoing framework for neurosurgical navigation and needle guidance. The proposed servo-control scheme allows for compensation of target anatomy movements, maintaining high navigational accuracy over time, and automatic needle guide alignment for accurate manual insertions.

Method

Our system comprises a motorized 3D ultrasound (US) transducer mounted on a robotic arm and equipped with a needle guide. It continuously registers US sweeps in real time with a pre-interventional plan based on CT or MR images and annotations. While a visual control law maintains anatomy visibility and alignment of the needle guide, a force controller is employed for acoustic coupling and tissue pressure. We validate the servoing capabilities of our method on a geometric gel phantom and real human anatomy, and the needle targeting accuracy using CT images on a lumbar spine gel phantom under neurosurgery conditions.

Results

Despite the varying resolution of the acquired 3D sweeps, we achieved direction-independent positioning errors of \(0.35\pm 0.19\) mm and \(0.61^\circ \pm 0.45^\circ \), respectively. Our method is capable of compensating movements of around 25 mm/s and works reliably on human anatomy with errors of \(1.45\pm 0.78\) mm. In all four manual insertions by an expert surgeon, a needle could be successfully inserted into the facet joint, with an estimated targeting accuracy of \(1.33\pm 0.33\) mm, superior to the gold standard.

Conclusion

The experiments demonstrated the feasibility of robotic ultrasound-based navigation and needle guidance for neurosurgical applications such as lumbar spine injections.
Fußnoten
1
Throughout this article, linear transformations and vectors are expressed in computer vision notation, i.e., using 4\(\times \)4 homogeneous matrices and 4\(\times \)1 vectors.
 
Literatur
1.
Zurück zum Zitat Center P, Manchikanti L (2015) A systematic review and best evidence synthesis of effectiveness of therapeutic facet joint interventions in managing chronic spinal pain. Pain phys 18:E535–E582 Center P, Manchikanti L (2015) A systematic review and best evidence synthesis of effectiveness of therapeutic facet joint interventions in managing chronic spinal pain. Pain phys 18:E535–E582
2.
Zurück zum Zitat Yoon SH, O’Brien SL, Tran M (2013) Ultrasound guided spine injections: advancement over fluoroscopic guidance? Curr Phys Med Rehabil Rep 1(2):104–113CrossRef Yoon SH, O’Brien SL, Tran M (2013) Ultrasound guided spine injections: advancement over fluoroscopic guidance? Curr Phys Med Rehabil Rep 1(2):104–113CrossRef
3.
Zurück zum Zitat Atci IB, Ucler N, Ayden O, Albayrak S, Bitlisli H, Kilic S, Altinsoy HB (2016) The comparison of pain management efficiency of ultrasonography-guided facet joint injection with fluoroscopy-guided injection in lower lumbar facet syndrome. Neurosurg Q 23(3):246–250CrossRef Atci IB, Ucler N, Ayden O, Albayrak S, Bitlisli H, Kilic S, Altinsoy HB (2016) The comparison of pain management efficiency of ultrasonography-guided facet joint injection with fluoroscopy-guided injection in lower lumbar facet syndrome. Neurosurg Q 23(3):246–250CrossRef
4.
Zurück zum Zitat Freire V, Grabs D, Lepage-Saucier M, Moser TP (2016) Ultrasound-guided cervical facet joint injections a viable substitution for fluoroscopy-guided injections? J Ultrasound Med 35(6):1253–1258CrossRefPubMed Freire V, Grabs D, Lepage-Saucier M, Moser TP (2016) Ultrasound-guided cervical facet joint injections a viable substitution for fluoroscopy-guided injections? J Ultrasound Med 35(6):1253–1258CrossRefPubMed
5.
Zurück zum Zitat Soni NJ, Franco-Sadud R, Schnobrich D, Dancel R, Tierney DM, Salame G, Restrepo MI, McHardy P (2016) Ultrasound guidance for lumbar puncture. Neurol Clin Pract 6(4):358–368CrossRefPubMedPubMedCentral Soni NJ, Franco-Sadud R, Schnobrich D, Dancel R, Tierney DM, Salame G, Restrepo MI, McHardy P (2016) Ultrasound guidance for lumbar puncture. Neurol Clin Pract 6(4):358–368CrossRefPubMedPubMedCentral
6.
Zurück zum Zitat de Oliveira Filho GR (2002) The construction of learning curves for basic skills in anesthetic procedures: an application for the cumulative sum method. Anesth Analg 95(2):411–416PubMed de Oliveira Filho GR (2002) The construction of learning curves for basic skills in anesthetic procedures: an application for the cumulative sum method. Anesth Analg 95(2):411–416PubMed
7.
Zurück zum Zitat Moult E, Ungi T, Welch M, Lu J, McGraw RC, Fichtinger G (2013) Ultrasound-guided facet joint injection training using perk tutor. Int j comput assist radiol surg 8(5):831–836CrossRefPubMed Moult E, Ungi T, Welch M, Lu J, McGraw RC, Fichtinger G (2013) Ultrasound-guided facet joint injection training using perk tutor. Int j comput assist radiol surg 8(5):831–836CrossRefPubMed
8.
Zurück zum Zitat Evans K, Roll S, Baker J (2009) Work-related musculoskeletal disorders (WRMSD) among registered diagnostic medical sonographers and vascular technologists: a representative sample. J Diagn Med Sonogr 25(6):287–299CrossRef Evans K, Roll S, Baker J (2009) Work-related musculoskeletal disorders (WRMSD) among registered diagnostic medical sonographers and vascular technologists: a representative sample. J Diagn Med Sonogr 25(6):287–299CrossRef
9.
Zurück zum Zitat Lonjon N, Chan-Seng E, Costalat V, Bonnafoux B, Vassal M, Boetto J (2016) Robot-assisted spine surgery: feasibility study through a prospective case-matched analysis. Eur Spine J 25(3):947–955CrossRefPubMed Lonjon N, Chan-Seng E, Costalat V, Bonnafoux B, Vassal M, Boetto J (2016) Robot-assisted spine surgery: feasibility study through a prospective case-matched analysis. Eur Spine J 25(3):947–955CrossRefPubMed
10.
Zurück zum Zitat Zettinig O, Fuerst B, Kojcev R, Esposito M, Salehi M, Wein W, Rackerseder J, Sinibaldi E, Frisch B, Navab N (2016) “Toward real-time 3D ultrasound registration-based visual servoing for interventional navigation,” In: 2016 IEEE International conference on robotics and automation (ICRA). IEEE, p 945–950 Zettinig O, Fuerst B, Kojcev R, Esposito M, Salehi M, Wein W, Rackerseder J, Sinibaldi E, Frisch B, Navab N (2016) “Toward real-time 3D ultrasound registration-based visual servoing for interventional navigation,” In: 2016 IEEE International conference on robotics and automation (ICRA). IEEE, p 945–950
11.
Zurück zum Zitat Tran D, Kamani AA, Al-Attas E, Lessoway VA, Massey S, Rohling RN (2010) Single-operator real-time ultrasound-guidance to aim and insert a lumbar epidural needle. Can J Anesth/J can d’anesthésie 57(4):313–321CrossRef Tran D, Kamani AA, Al-Attas E, Lessoway VA, Massey S, Rohling RN (2010) Single-operator real-time ultrasound-guidance to aim and insert a lumbar epidural needle. Can J Anesth/J can d’anesthésie 57(4):313–321CrossRef
12.
Zurück zum Zitat Brudfors M, Seitel A, Rasoulian A, Lasso A, Lessoway V. A, Osborn J, Maki A, Rohling R. N, Abolmaesumi P (2015) “Towards real-time, tracker-less 3D ultrasound guidance for spine anaesthesia,” International Journal of Computer Assisted Radiology and Surgery, pp. 1–11 Brudfors M, Seitel A, Rasoulian A, Lasso A, Lessoway V. A, Osborn J, Maki A, Rohling R. N, Abolmaesumi P (2015) “Towards real-time, tracker-less 3D ultrasound guidance for spine anaesthesia,” International Journal of Computer Assisted Radiology and Surgery, pp. 1–11
13.
Zurück zum Zitat Yan CX, Goulet B, Pelletier J, Chen SJ-S, Tampieri D, Collins DL (2011) Towards accurate, robust and practical ultrasound-CT registration of vertebrae for image-guided spine surgery. Int J Comput Assist Radiol Surg 6(4):523–537CrossRefPubMed Yan CX, Goulet B, Pelletier J, Chen SJ-S, Tampieri D, Collins DL (2011) Towards accurate, robust and practical ultrasound-CT registration of vertebrae for image-guided spine surgery. Int J Comput Assist Radiol Surg 6(4):523–537CrossRefPubMed
14.
Zurück zum Zitat Ungi T, Abolmaesumi P, Jalal R, Welch M, Ayukawa I, Nagpal S, Lasso A, Jaeger M, Borschneck DP, Fichtinger G, Mousavi P (2012) Spinal needle navigation by tracked ultrasound snapshots. IEEE Trans Biomed Eng 59(10):2766–2772CrossRefPubMed Ungi T, Abolmaesumi P, Jalal R, Welch M, Ayukawa I, Nagpal S, Lasso A, Jaeger M, Borschneck DP, Fichtinger G, Mousavi P (2012) Spinal needle navigation by tracked ultrasound snapshots. IEEE Trans Biomed Eng 59(10):2766–2772CrossRefPubMed
15.
Zurück zum Zitat Rasoulian A, Osborn J, Sojoudi S, Nouranian S, Lessoway V. A, Rohling R. N, Abolmaesumi P (2014) “A system for ultrasound-guided spinal injections: A feasibility study,” In Information Processing in Computer-Assisted Interventions. Springer, pp. 90–99 Rasoulian A, Osborn J, Sojoudi S, Nouranian S, Lessoway V. A, Rohling R. N, Abolmaesumi P (2014) “A system for ultrasound-guided spinal injections: A feasibility study,” In Information Processing in Computer-Assisted Interventions. Springer, pp. 90–99
16.
Zurück zum Zitat Abolmaesumi P, Salcudean S, Zhu W (2000) “Visual servoing for robot-assisted diagnostic ultrasound,” In: Engineering in medicine and biology Society 2000. Proceedings of the 22nd annual international conference of the IEEE, vol. 4. IEEE, pp 2532–2535 Abolmaesumi P, Salcudean S, Zhu W (2000) “Visual servoing for robot-assisted diagnostic ultrasound,” In: Engineering in medicine and biology Society 2000. Proceedings of the 22nd annual international conference of the IEEE, vol. 4. IEEE, pp 2532–2535
17.
Zurück zum Zitat Nakadate R, Solis J, Takanishi A, Minagawa E, Sugawara M, Niki K (2011) “Out-of-plane visual servoing method for tracking the carotid artery with a robot-assisted ultrasound diagnostic system,” In: Robotics and automation (ICRA), 2011 IEEE International conference on IEEE, pp. 5267–5272 Nakadate R, Solis J, Takanishi A, Minagawa E, Sugawara M, Niki K (2011) “Out-of-plane visual servoing method for tracking the carotid artery with a robot-assisted ultrasound diagnostic system,” In: Robotics and automation (ICRA), 2011 IEEE International conference on IEEE, pp. 5267–5272
18.
Zurück zum Zitat Nadeau C, Krupa A (2013) Intensity-based ultrasound visual servoing: modeling and validation with 2-d and 3-d probes. IEEE Trans Robot 29(4):1003–1015CrossRef Nadeau C, Krupa A (2013) Intensity-based ultrasound visual servoing: modeling and validation with 2-d and 3-d probes. IEEE Trans Robot 29(4):1003–1015CrossRef
19.
Zurück zum Zitat Krupa A, Folio D, Novales C, Vieyres P, Li T (2014) Robotized tele-echography: an assisting visibility tool to support expert diagnostic. Syst J IEEE 99:1–10 Krupa A, Folio D, Novales C, Vieyres P, Li T (2014) Robotized tele-echography: an assisting visibility tool to support expert diagnostic. Syst J IEEE 99:1–10
20.
Zurück zum Zitat Chatelain P, Krupa A, Navab N (2015) “Optimization of ultrasound image quality via visual servoing.” In: IEEE International conference on robotics and automation, ICRA Chatelain P, Krupa A, Navab N (2015) “Optimization of ultrasound image quality via visual servoing.” In: IEEE International conference on robotics and automation, ICRA
21.
Zurück zum Zitat Virga S, Zettinig O, Esposito M, Pfister K, Frisch B, Neff T, Navab N, Hennersperger C (2016) “Automatic force-compliant robotic ultrasound screening of abdominal aortic aneurysms,” In: Intelligent robots and systems (IROS), 2016 IEEE/RSJ International conference on, October 2016 (vol. in press) Virga S, Zettinig O, Esposito M, Pfister K, Frisch B, Neff T, Navab N, Hennersperger C (2016) “Automatic force-compliant robotic ultrasound screening of abdominal aortic aneurysms,” In: Intelligent robots and systems (IROS), 2016 IEEE/RSJ International conference on, October 2016 (vol. in press)
22.
Zurück zum Zitat Adebar TK, Fletcher AE, Okamura AM (2014) 3-D Ultrasound-guided robotic needle steering in biological tissue. Biomed Eng IEEE Trans 61(12):2899–2910CrossRef Adebar TK, Fletcher AE, Okamura AM (2014) 3-D Ultrasound-guided robotic needle steering in biological tissue. Biomed Eng IEEE Trans 61(12):2899–2910CrossRef
23.
Zurück zum Zitat Krupa A (2014) “3D steering of a flexible needle by visual servoing,” In: Medical image computing and computer-assisted intervention-MICCAI 2014. Springer, Berlin, pp 480–487 Krupa A (2014) “3D steering of a flexible needle by visual servoing,” In: Medical image computing and computer-assisted intervention-MICCAI 2014. Springer, Berlin, pp 480–487
24.
Zurück zum Zitat Nadeau C, Ren H, Krupa A, Dupont P (2015) Intensity-based visual servoing for instrument and tissue tracking in 3D ultrasound volumes. Autom Sci Eng IEEE Trans 12(1):367–371CrossRef Nadeau C, Ren H, Krupa A, Dupont P (2015) Intensity-based visual servoing for instrument and tissue tracking in 3D ultrasound volumes. Autom Sci Eng IEEE Trans 12(1):367–371CrossRef
25.
Zurück zum Zitat De Schutter J, Van Brussel H (1988) Compliant robot motion ii. a control approach based on external control loops. Int J Robot Res 7(4):18–33CrossRef De Schutter J, Van Brussel H (1988) Compliant robot motion ii. a control approach based on external control loops. Int J Robot Res 7(4):18–33CrossRef
26.
Zurück zum Zitat Karamalis A, Wein W, Kutter O, Navab N (2009) “Fast hybrid freehand ultrasound volume reconstruction,” In: SPIE medical imaging. International society for optics and photonics, pp 726 114–726 114 Karamalis A, Wein W, Kutter O, Navab N (2009) “Fast hybrid freehand ultrasound volume reconstruction,” In: SPIE medical imaging. International society for optics and photonics, pp 726 114–726 114
27.
Zurück zum Zitat Wein W, Khamene A (2008) “Image-based method for in-vivo freehand ultrasound calibration,” In: Medical Imaging. International society for optics and photonics, pp 69 200K–69 200K Wein W, Khamene A (2008) “Image-based method for in-vivo freehand ultrasound calibration,” In: Medical Imaging. International society for optics and photonics, pp 69 200K–69 200K
28.
Zurück zum Zitat Fuerst B, Wein W, Müller M, Navab N (2014) Automatic ultrasound-MRI registration for neurosurgery using the 2D and 3D LC2 metric. Med Image Anal 18(8):1312–1319CrossRefPubMed Fuerst B, Wein W, Müller M, Navab N (2014) Automatic ultrasound-MRI registration for neurosurgery using the 2D and 3D LC2 metric. Med Image Anal 18(8):1312–1319CrossRefPubMed
29.
Zurück zum Zitat Modat M, Ridgway GR, Taylor ZA, Lehmann M, Barnes J, Hawkes DJ, Fox NC, Ourselin S (2010) Fast free-form deformation using graphics processing units. Comput methods progr biomed 98(3):278–284CrossRef Modat M, Ridgway GR, Taylor ZA, Lehmann M, Barnes J, Hawkes DJ, Fox NC, Ourselin S (2010) Fast free-form deformation using graphics processing units. Comput methods progr biomed 98(3):278–284CrossRef
30.
Zurück zum Zitat Powell MJ (2009) The BOBYQA algorithm for bound constrained optimization without derivatives, Cambridge NA Report NA2009/06. University of Cambridge, Cambridge Powell MJ (2009) The BOBYQA algorithm for bound constrained optimization without derivatives, Cambridge NA Report NA2009/06. University of Cambridge, Cambridge
31.
Zurück zum Zitat Wein W, Brunke S, Khamene A, Callstrom MR, Navab N (2008) Automatic CT-ultrasound registration for diagnostic imaging and image-guided intervention. Med Image Anal 12(5):577–585CrossRefPubMed Wein W, Brunke S, Khamene A, Callstrom MR, Navab N (2008) Automatic CT-ultrasound registration for diagnostic imaging and image-guided intervention. Med Image Anal 12(5):577–585CrossRefPubMed
32.
Zurück zum Zitat Lasso A, Heffter T, Rankin A, Pinter C, Ungi T, Fichtinger G (2014) PLUS: open-source toolkit for ultrasound-guided intervention systems. IEEE Trans Biomed Eng 10:2527–2537CrossRef Lasso A, Heffter T, Rankin A, Pinter C, Ungi T, Fichtinger G (2014) PLUS: open-source toolkit for ultrasound-guided intervention systems. IEEE Trans Biomed Eng 10:2527–2537CrossRef
33.
Zurück zum Zitat Tokuda J, Fischer GS, Papademetris X, Yaniv Z, Ibanez L, Cheng P, Liu H, Blevins J, Arata J, Golby AJ, Kapur T, Pieper S, Burdette EC, Fichtinger G, Tempany CM, Hata N (2009) OpenIGTLink: an open network protocol for image-guided therapy environment. Int J Med Robot Comput Assist Surg 5(4):423–434CrossRef Tokuda J, Fischer GS, Papademetris X, Yaniv Z, Ibanez L, Cheng P, Liu H, Blevins J, Arata J, Golby AJ, Kapur T, Pieper S, Burdette EC, Fichtinger G, Tempany CM, Hata N (2009) OpenIGTLink: an open network protocol for image-guided therapy environment. Int J Med Robot Comput Assist Surg 5(4):423–434CrossRef
34.
Zurück zum Zitat Tsai RY, Lenz RK (1989) A new technique for fully autonomous and efficient 3d robotics hand/eye calibration. IEEE Trans Robot Autom 5(3):345–358CrossRef Tsai RY, Lenz RK (1989) A new technique for fully autonomous and efficient 3d robotics hand/eye calibration. IEEE Trans Robot Autom 5(3):345–358CrossRef
35.
Zurück zum Zitat Liu Y, Zeng C, Fan M, Hu L, Ma C, Tian W (2016) Assessment of respiration-induced vertebral motion in prone-positioned patients during general anaesthesia. Int J Med Robot Comput Assist Surg 12(2):214–218CrossRef Liu Y, Zeng C, Fan M, Hu L, Ma C, Tian W (2016) Assessment of respiration-induced vertebral motion in prone-positioned patients during general anaesthesia. Int J Med Robot Comput Assist Surg 12(2):214–218CrossRef
36.
Zurück zum Zitat Galiano K, Obwegeser AA, Bodner G, Freund M, Maurer H, Kamelger FS, Schatzer R, Ploner F (2005) Ultrasound guidance for facet joint injections in the lumbar spine: a computed tomography-controlled feasibility study. Anesth Analg 101(2):579–583CrossRefPubMed Galiano K, Obwegeser AA, Bodner G, Freund M, Maurer H, Kamelger FS, Schatzer R, Ploner F (2005) Ultrasound guidance for facet joint injections in the lumbar spine: a computed tomography-controlled feasibility study. Anesth Analg 101(2):579–583CrossRefPubMed
37.
Zurück zum Zitat Kalman RE (1960) A new approach to linear filtering and prediction problems. J Basic Eng 82(1):35–45CrossRef Kalman RE (1960) A new approach to linear filtering and prediction problems. J Basic Eng 82(1):35–45CrossRef
38.
Zurück zum Zitat Jung B-H, Kim B-H, Hong S-M (2013) Respiratory motion prediction with extended kalman filters based on local circular motion model. Int J Bio-Sci Bio-Technol 5(1):51–58 Jung B-H, Kim B-H, Hong S-M (2013) Respiratory motion prediction with extended kalman filters based on local circular motion model. Int J Bio-Sci Bio-Technol 5(1):51–58
39.
Zurück zum Zitat Provost J, Papadacci C, Arango JE, Imbault M, Fink M, Gennisson J-L, Tanter M, Pernot M (2014) 3D ultrafast ultrasound imaging in vivo. Phys Med Biol 59(19):L1CrossRefPubMedPubMedCentral Provost J, Papadacci C, Arango JE, Imbault M, Fink M, Gennisson J-L, Tanter M, Pernot M (2014) 3D ultrafast ultrasound imaging in vivo. Phys Med Biol 59(19):L1CrossRefPubMedPubMedCentral
Metadaten
Titel
3D ultrasound registration-based visual servoing for neurosurgical navigation
verfasst von
Oliver Zettinig
Benjamin Frisch
Salvatore Virga
Marco Esposito
Anna Rienmüller
Bernhard Meyer
Christoph Hennersperger
Yu-Mi Ryang
Nassir Navab
Publikationsdatum
24.02.2017
Verlag
Springer International Publishing
Erschienen in
International Journal of Computer Assisted Radiology and Surgery / Ausgabe 9/2017
Print ISSN: 1861-6410
Elektronische ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-017-1536-2

Weitere Artikel der Ausgabe 9/2017

International Journal of Computer Assisted Radiology and Surgery 9/2017 Zur Ausgabe

Screening-Mammografie offenbart erhöhtes Herz-Kreislauf-Risiko

26.04.2024 Mammografie Nachrichten

Routinemäßige Mammografien helfen, Brustkrebs frühzeitig zu erkennen. Anhand der Röntgenuntersuchung lassen sich aber auch kardiovaskuläre Risikopatientinnen identifizieren. Als zuverlässiger Anhaltspunkt gilt die Verkalkung der Brustarterien.

S3-Leitlinie zu Pankreaskrebs aktualisiert

23.04.2024 Pankreaskarzinom Nachrichten

Die Empfehlungen zur Therapie des Pankreaskarzinoms wurden um zwei Off-Label-Anwendungen erweitert. Und auch im Bereich der Früherkennung gibt es Aktualisierungen.

Fünf Dinge, die im Kindernotfall besser zu unterlassen sind

18.04.2024 Pädiatrische Notfallmedizin Nachrichten

Im Choosing-Wisely-Programm, das für die deutsche Initiative „Klug entscheiden“ Pate gestanden hat, sind erstmals Empfehlungen zum Umgang mit Notfällen von Kindern erschienen. Fünf Dinge gilt es demnach zu vermeiden.

„Nur wer sich gut aufgehoben fühlt, kann auch für Patientensicherheit sorgen“

13.04.2024 Klinik aktuell Kongressbericht

Die Teilnehmer eines Forums beim DGIM-Kongress waren sich einig: Fehler in der Medizin sind häufig in ungeeigneten Prozessen und mangelnder Kommunikation begründet. Gespräche mit Patienten und im Team können helfen.

Update Radiologie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.