Skip to main content
Erschienen in: International Journal of Computer Assisted Radiology and Surgery 3/2017

31.08.2016 | Original Article

IBIS: an OR ready open-source platform for image-guided neurosurgery

verfasst von: Simon Drouin, Anna Kochanowska, Marta Kersten-Oertel, Ian J. Gerard, Rina Zelmann, Dante De Nigris, Silvain Bériault, Tal Arbel, Denis Sirhan, Abbas F. Sadikot, Jeffery A. Hall, David S. Sinclair, Kevin Petrecca, Rolando F. DelMaestro, D. Louis Collins

Erschienen in: International Journal of Computer Assisted Radiology and Surgery | Ausgabe 3/2017

Einloggen, um Zugang zu erhalten

Abstract

Purpose

Navigation systems commonly used in neurosurgery suffer from two main drawbacks: (1) their accuracy degrades over the course of the operation and (2) they require the surgeon to mentally map images from the monitor to the patient. In this paper, we introduce the Intraoperative Brain Imaging System (IBIS), an open-source image-guided neurosurgery research platform that implements a novel workflow where navigation accuracy is improved using tracked intraoperative ultrasound (iUS) and the visualization of navigation information is facilitated through the use of augmented reality (AR).

Methods

The IBIS platform allows a surgeon to capture tracked iUS images and use them to automatically update preoperative patient models and plans through fast GPU-based reconstruction and registration methods. Navigation, resection and iUS-based brain shift correction can all be performed using an AR view. IBIS has an intuitive graphical user interface for the calibration of a US probe, a surgical pointer as well as video devices used for AR (e.g., a surgical microscope).

Results

The components of IBIS have been validated in the laboratory and evaluated in the operating room. Image-to-patient registration accuracy is on the order of \(3.72\pm 1.27\,\hbox {mm}\) and can be improved with iUS to a median target registration error of 2.54 mm. The accuracy of the US probe calibration is between 0.49 and 0.82 mm. The average reprojection error of the AR system is \(0.37\pm 0.19\,\hbox {mm}\). The system has been used in the operating room for various types of surgery, including brain tumor resection, vascular neurosurgery, spine surgery and DBS electrode implantation.

Conclusions

The IBIS platform is a validated system that allows researchers to quickly bring the results of their work into the operating room for evaluation. It is the first open-source navigation system to provide a complete solution for AR visualization.
Fußnoten
2
Presently, in May 2016, only Linux and OSX operating systems are actively maintained.
 
Literatur
6.
Zurück zum Zitat Tokuda J, Gregory S, Yaniv Z, Cheng P, Blevins J, Golby AJ, Kapur T, Pieper S, Burdette EC, Fischer GS, Papademetris X, Ibanez L, Liu H, Arata J, Fichtinger G, Tempany CM, Hata N (2009) OpenIGTLink: an open network protocol for image-guided therapy environment. Int J Med Robot Comput Assist Surg 5:423–434. doi:10.1002/rcs.274 CrossRef Tokuda J, Gregory S, Yaniv Z, Cheng P, Blevins J, Golby AJ, Kapur T, Pieper S, Burdette EC, Fischer GS, Papademetris X, Ibanez L, Liu H, Arata J, Fichtinger G, Tempany CM, Hata N (2009) OpenIGTLink: an open network protocol for image-guided therapy environment. Int J Med Robot Comput Assist Surg 5:423–434. doi:10.​1002/​rcs.​274 CrossRef
8.
Zurück zum Zitat Nolden M, Zelzer S, Seitel A, Wald D, Müller M, Franz AM, Maleike D, Fangerau M, Baumhauer M, Maier-Hein L, Maier-Hein KH, Meinzer H-P, Wolf I (2013) The Medical Imaging Interaction Toolkit: challenges and advances?: 10 years of open-source development. Int J Comput Assist Radiol Surg 8:607–620. doi:10.1007/s11548-013-0840-8 CrossRefPubMed Nolden M, Zelzer S, Seitel A, Wald D, Müller M, Franz AM, Maleike D, Fangerau M, Baumhauer M, Maier-Hein L, Maier-Hein KH, Meinzer H-P, Wolf I (2013) The Medical Imaging Interaction Toolkit: challenges and advances?: 10 years of open-source development. Int J Comput Assist Radiol Surg 8:607–620. doi:10.​1007/​s11548-013-0840-8 CrossRefPubMed
9.
Zurück zum Zitat Fedorov A, Beichel R, Kalpathy-Cramer J, Finet J, Fillion-Robin J-C, Pujol S, Bauer C, Jennings D, Fennessy F, Sonka M, Buatti J, Aylward S, Miller JV, Pieper S, Kikinis R (2012) 3D slicer as an image computing platform for the quantitative imaging network. Magn Reson Imaging 30:1323–1341. doi:10.1016/j.mri.2012.05.001 CrossRefPubMedPubMedCentral Fedorov A, Beichel R, Kalpathy-Cramer J, Finet J, Fillion-Robin J-C, Pujol S, Bauer C, Jennings D, Fennessy F, Sonka M, Buatti J, Aylward S, Miller JV, Pieper S, Kikinis R (2012) 3D slicer as an image computing platform for the quantitative imaging network. Magn Reson Imaging 30:1323–1341. doi:10.​1016/​j.​mri.​2012.​05.​001 CrossRefPubMedPubMedCentral
10.
Zurück zum Zitat Franz AM, Seitel A, Servatius M, Zöllner C, Gergel I, Wegner I, Neuhaus J, Zelzer S, Nolden M, Gaa J, Mercea P, Yung K, Sommer CM, Radeleff BA, Schlemmer H-P, Kauczor H-U, Meinzer H-P, Maier-Hein L (2012) Simplified development of image-guided therapy software with MITK-IGT. In: Holmes DR III, Wong KH (eds) SPIE Med. International Society for Optics and Photonics, Imaging, p 83162J Franz AM, Seitel A, Servatius M, Zöllner C, Gergel I, Wegner I, Neuhaus J, Zelzer S, Nolden M, Gaa J, Mercea P, Yung K, Sommer CM, Radeleff BA, Schlemmer H-P, Kauczor H-U, Meinzer H-P, Maier-Hein L (2012) Simplified development of image-guided therapy software with MITK-IGT. In: Holmes DR III, Wong KH (eds) SPIE Med. International Society for Optics and Photonics, Imaging, p 83162J
11.
Zurück zum Zitat Clarkson MJ, Zombori G, Thompson S, Totz J, Song Y, Espak M, Johnsen S, Hawkes D, Ourselin S (2015) The NifTK software platform for image-guided interventions: platform overview and NiftyLink messaging. Int J Comput Assist Radiol Surg 10:301–316. doi:10.1007/s11548-014-1124-7 CrossRefPubMed Clarkson MJ, Zombori G, Thompson S, Totz J, Song Y, Espak M, Johnsen S, Hawkes D, Ourselin S (2015) The NifTK software platform for image-guided interventions: platform overview and NiftyLink messaging. Int J Comput Assist Radiol Surg 10:301–316. doi:10.​1007/​s11548-014-1124-7 CrossRefPubMed
12.
Zurück zum Zitat Ungi T, Gauvin G, Lasso A, Yeo CT, Pezeshki P, Vaughan T, Carter K, Rudan J, Engel CJ, Fichtinger G (2016) Navigated breast tumor excision using electromagnetically tracked ultrasound and surgical instruments. IEEE Trans Biomed Eng 63:600–606. doi:10.1109/TBME.2015.2466591 CrossRefPubMed Ungi T, Gauvin G, Lasso A, Yeo CT, Pezeshki P, Vaughan T, Carter K, Rudan J, Engel CJ, Fichtinger G (2016) Navigated breast tumor excision using electromagnetically tracked ultrasound and surgical instruments. IEEE Trans Biomed Eng 63:600–606. doi:10.​1109/​TBME.​2015.​2466591 CrossRefPubMed
13.
Zurück zum Zitat Askeland C, Solberg OV, Bakeng JBL, Reinertsen I, Tangen GA, Hofstad EF, Iversen DH, Våpenstad C, Selbekk T, Langø T, Hernes TAN, Olav Leira H, Unsgård G, Lindseth F (2015) CustusX: an open-source research platform for image-guided therapy. Int J Comput Assist Radiol Surg. doi:10.1007/s11548-015-1292-0 PubMedPubMedCentral Askeland C, Solberg OV, Bakeng JBL, Reinertsen I, Tangen GA, Hofstad EF, Iversen DH, Våpenstad C, Selbekk T, Langø T, Hernes TAN, Olav Leira H, Unsgård G, Lindseth F (2015) CustusX: an open-source research platform for image-guided therapy. Int J Comput Assist Radiol Surg. doi:10.​1007/​s11548-015-1292-0 PubMedPubMedCentral
16.
Zurück zum Zitat Wolfgang P (1994) Design patterns for object-oriented software development. Addison-Wesley, Boston Wolfgang P (1994) Design patterns for object-oriented software development. Addison-Wesley, Boston
19.
Zurück zum Zitat Stieglitz LH, Fichtner J, Andres R, Schucht P, Krähenbühl A-K, Raabe A, Beck J (2013) The silent loss of neuronavigation accuracy: a systematic retrospective analysis of factors influencing the mismatch of frameless stereotactic systems in cranial neurosurgery. Neurosurgery 72:796–807. doi:10.1227/NEU.0b013e318287072d CrossRefPubMed Stieglitz LH, Fichtner J, Andres R, Schucht P, Krähenbühl A-K, Raabe A, Beck J (2013) The silent loss of neuronavigation accuracy: a systematic retrospective analysis of factors influencing the mismatch of frameless stereotactic systems in cranial neurosurgery. Neurosurgery 72:796–807. doi:10.​1227/​NEU.​0b013e318287072d​ CrossRefPubMed
22.
Zurück zum Zitat Drouin S, Kersten-Oertel M, Collins DL (2015) Interaction-based registration correction for improved augmented reality overlay in neurosurgery. Lecture notes on comput science. Augment Environ Comput Interv 9365:21–29. doi:10.1007/978-3-319-24601-7_3 CrossRef Drouin S, Kersten-Oertel M, Collins DL (2015) Interaction-based registration correction for improved augmented reality overlay in neurosurgery. Lecture notes on comput science. Augment Environ Comput Interv 9365:21–29. doi:10.​1007/​978-3-319-24601-7_​3 CrossRef
23.
Zurück zum Zitat Brown RA (1979) A stereotactic head frame for use with CT body scanners. Invest Radiol 14:300–304CrossRefPubMed Brown RA (1979) A stereotactic head frame for use with CT body scanners. Invest Radiol 14:300–304CrossRefPubMed
24.
Zurück zum Zitat Comeau RM, Fenster A, Peters TM (1998) Integrated MR and ultrasound imaging for improved image guidance in neurosurgery. In: Hanson KM (ed) Med. Imaging ’98. International Society for Optics and Photonics, pp 747–754 Comeau RM, Fenster A, Peters TM (1998) Integrated MR and ultrasound imaging for improved image guidance in neurosurgery. In: Hanson KM (ed) Med. Imaging ’98. International Society for Optics and Photonics, pp 747–754
25.
Zurück zum Zitat Mercier L, Del Maestro RF, Petrecca K, Kochanowska A, Drouin S, Yan CXB, Janke AL, Chen SJ-S, Collins DL (2011) New prototype neuronavigation system based on preoperative imaging and intraoperative freehand ultrasound: system description and validation. Int J Comput Assist Radiol Surg 6:507–522CrossRefPubMed Mercier L, Del Maestro RF, Petrecca K, Kochanowska A, Drouin S, Yan CXB, Janke AL, Chen SJ-S, Collins DL (2011) New prototype neuronavigation system based on preoperative imaging and intraoperative freehand ultrasound: system description and validation. Int J Comput Assist Radiol Surg 6:507–522CrossRefPubMed
27.
Zurück zum Zitat De Nigris D, Collins DL, Arbel T (2013) Fast rigid registration of pre-operative magnetic resonance images to intra-operative ultrasound for neurosurgery based on high confidence gradient orientations. Int J Comput Assist Radiol Surg 8:649–661. doi:10.1007/s11548-013-0826-6 CrossRefPubMed De Nigris D, Collins DL, Arbel T (2013) Fast rigid registration of pre-operative magnetic resonance images to intra-operative ultrasound for neurosurgery based on high confidence gradient orientations. Int J Comput Assist Radiol Surg 8:649–661. doi:10.​1007/​s11548-013-0826-6 CrossRefPubMed
28.
Zurück zum Zitat Mercier L, Del Maestro RF, Petrecca K, Araujo D, Haegelen C, Collins DL (2012) Online database of clinical MR and ultrasound images of brain tumors. Med Phys 39:3253–3261. doi:10.1118/1.4709600 CrossRefPubMed Mercier L, Del Maestro RF, Petrecca K, Araujo D, Haegelen C, Collins DL (2012) Online database of clinical MR and ultrasound images of brain tumors. Med Phys 39:3253–3261. doi:10.​1118/​1.​4709600 CrossRefPubMed
29.
Zurück zum Zitat Heinrich MP, Jenkinson M, Papiez BW, Brady M, Schnabel JA (2013) Towards realtime multimodal fusion for image-guided interventions using self-similarities. In: International conference on medical image computing and computer-assisted intervention, pp 187–194 Heinrich MP, Jenkinson M, Papiez BW, Brady M, Schnabel JA (2013) Towards realtime multimodal fusion for image-guided interventions using self-similarities. In: International conference on medical image computing and computer-assisted intervention, pp 187–194
30.
Zurück zum Zitat Wein W, Ladikos A, Fuerst B, Shah A, Sharma K, Navab N (2013) Global registration of ultrasound to MRI using the LC2 metric for enabling neurosurgical guidance. In: Medical image computing and computer intervention. Lecture notes on computer science, pp 34–41 Wein W, Ladikos A, Fuerst B, Shah A, Sharma K, Navab N (2013) Global registration of ultrasound to MRI using the LC2 metric for enabling neurosurgical guidance. In: Medical image computing and computer intervention. Lecture notes on computer science, pp 34–41
31.
Zurück zum Zitat Ferrante E, Paragios N (2013) Non-rigid 2D-3D medical image registration using markov random fields. In: Medical image computing and computer-assisted intervention, pp 163–70 Ferrante E, Paragios N (2013) Non-rigid 2D-3D medical image registration using markov random fields. In: Medical image computing and computer-assisted intervention, pp 163–70
33.
Zurück zum Zitat Farnia P, Ahmadian A, Shabanian T, Serej ND, Alirezaie J (2015) Brain-shift compensation by non-rigid registration of intra-operative ultrasound images with preoperative MR images based on residual complexity. Int J Comput Assist Radiol Surg 10:555–562. doi:10.1007/s11548-014-1098-5 CrossRefPubMed Farnia P, Ahmadian A, Shabanian T, Serej ND, Alirezaie J (2015) Brain-shift compensation by non-rigid registration of intra-operative ultrasound images with preoperative MR images based on residual complexity. Int J Comput Assist Radiol Surg 10:555–562. doi:10.​1007/​s11548-014-1098-5 CrossRefPubMed
34.
Zurück zum Zitat Ferrante E, Fecamp V, Paragios N (2015) Slice-to-volume deformable registration: efficient one-shot consensus between plane selection and in-plane deformation. Int J Comput Assist Radiol Surg 10:791–800. doi:10.1007/s11548-015-1205-2 CrossRefPubMed Ferrante E, Fecamp V, Paragios N (2015) Slice-to-volume deformable registration: efficient one-shot consensus between plane selection and in-plane deformation. Int J Comput Assist Radiol Surg 10:791–800. doi:10.​1007/​s11548-015-1205-2 CrossRefPubMed
39.
Zurück zum Zitat Mercier L, Fonov V, Haegelen C, Del Maestro RF, Petrecca K, Collins DL (2012) Comparing two approaches to rigid registration of three-dimensional ultrasound and magnetic resonance images for neurosurgery. Int J Comput Assist Radiol Surg 7:125–136. doi:10.1007/s11548-011-0620-2 CrossRefPubMed Mercier L, Fonov V, Haegelen C, Del Maestro RF, Petrecca K, Collins DL (2012) Comparing two approaches to rigid registration of three-dimensional ultrasound and magnetic resonance images for neurosurgery. Int J Comput Assist Radiol Surg 7:125–136. doi:10.​1007/​s11548-011-0620-2 CrossRefPubMed
40.
41.
Zurück zum Zitat Drouin S, Kersten-oertel M, Chen SJ, Collins DL (2012) A realistic test and development environment for mixed reality in neurosurgery. In: Augmented environments for computer-assisted interventions, pp 13–23 Drouin S, Kersten-oertel M, Chen SJ, Collins DL (2012) A realistic test and development environment for mixed reality in neurosurgery. In: Augmented environments for computer-assisted interventions, pp 13–23
42.
43.
Zurück zum Zitat Kersten-Oertel M, Gerard I, Drouin S, Mok K, Sirhan D, Sinclair DS, Collins DL (2015) Augmented reality in neurovascular surgery: feasibility and first uses in the operating room. Int J Comput Assist Radiol Surg 10:1823–1836. doi:10.1007/s11548-015-1163-8 CrossRefPubMed Kersten-Oertel M, Gerard I, Drouin S, Mok K, Sirhan D, Sinclair DS, Collins DL (2015) Augmented reality in neurovascular surgery: feasibility and first uses in the operating room. Int J Comput Assist Radiol Surg 10:1823–1836. doi:10.​1007/​s11548-015-1163-8 CrossRefPubMed
44.
Zurück zum Zitat Kersten-Oertel M, Gerard I, Drouin S, Mok K, Sirhan D, Sinclair D, Collins DL (2014) Augmented Reality in Neurovascular Surgery: First Experiences. In: Augmented environments for computer-assisted interventions. Lecture notes on computer science, vol 8678, pp 80–89 Kersten-Oertel M, Gerard I, Drouin S, Mok K, Sirhan D, Sinclair D, Collins DL (2014) Augmented Reality in Neurovascular Surgery: First Experiences. In: Augmented environments for computer-assisted interventions. Lecture notes on computer science, vol 8678, pp 80–89
45.
Zurück zum Zitat Kersten-oertel M, Gerard IJ, Drouin S, Mok K, Sirhan D, Sinclair D, Collins DL (2015) Augmented reality for specific neurovascular tasks. In: Augmented environments for computer-assisted interventions. Lecture notes on computer science, vol 9365, pp 92–103 Kersten-oertel M, Gerard IJ, Drouin S, Mok K, Sirhan D, Sinclair D, Collins DL (2015) Augmented reality for specific neurovascular tasks. In: Augmented environments for computer-assisted interventions. Lecture notes on computer science, vol 9365, pp 92–103
46.
Zurück zum Zitat Gerard IJ, Kersten-Oertel M, Drouin S, Hall J a., Petrecca K, De Nigris D, Arbel T, Collins DL (2015) Improving patient specific neurosurgical models with intraoperative ultrasound and augmented reality visualizations in a neuronavigation environment. In: Workshop on clinical image-based procedures: translational research in medical imaging. Lecture notes on computer science, pp 28–35 Gerard IJ, Kersten-Oertel M, Drouin S, Hall J a., Petrecca K, De Nigris D, Arbel T, Collins DL (2015) Improving patient specific neurosurgical models with intraoperative ultrasound and augmented reality visualizations in a neuronavigation environment. In: Workshop on clinical image-based procedures: translational research in medical imaging. Lecture notes on computer science, pp 28–35
48.
Zurück zum Zitat Yan CXB, Goulet B, Pelletier J, Chen SJ-S, Tampieri D, Collins DL (2011) Towards accurate, robust and practical ultrasound-CT registration of vertebrae for image-guided spine surgery. Int J Comput Assist Radiol Surg 6:523–537. doi:10.1007/s11548-010-0536-2 CrossRefPubMed Yan CXB, Goulet B, Pelletier J, Chen SJ-S, Tampieri D, Collins DL (2011) Towards accurate, robust and practical ultrasound-CT registration of vertebrae for image-guided spine surgery. Int J Comput Assist Radiol Surg 6:523–537. doi:10.​1007/​s11548-010-0536-2 CrossRefPubMed
51.
52.
Zurück zum Zitat Bériault S, Sadikot AF, Alsubaie F, Drouin S, Collins DL, Pike GB (2014) Neuronavigation using susceptibility-weighted venography: application to deep brain stimulation and comparison with gadolinium contrast. J Neurosurg 0:1–11. doi:10.3171/2014.3.JNS131860 Bériault S, Sadikot AF, Alsubaie F, Drouin S, Collins DL, Pike GB (2014) Neuronavigation using susceptibility-weighted venography: application to deep brain stimulation and comparison with gadolinium contrast. J Neurosurg 0:1–11. doi:10.​3171/​2014.​3.​JNS131860
54.
Zurück zum Zitat Bériault S, Xiao Y, Bailey L, Collins DL, Sadikot AF, Pike GB (2012) Towards computer-assisted deep brain stimulation targeting with multiple active contacts. Med Image Comput Comput Assist Interv 15:487–494PubMed Bériault S, Xiao Y, Bailey L, Collins DL, Sadikot AF, Pike GB (2012) Towards computer-assisted deep brain stimulation targeting with multiple active contacts. Med Image Comput Comput Assist Interv 15:487–494PubMed
55.
Zurück zum Zitat Zelmann R, Beriault S, Marinho MM, Mok K, Hall JA, Guizard N, Haegelen C, Olivier A, Pike GB, Collins DL (2015) Improving recorded volume in mesial temporal lobe by optimizing stereotactic intracranial electrode implantation planning. Int J Comput Assist Radiol Surg 10:1599–1615. doi:10.1007/s11548-015-1165-6 CrossRefPubMed Zelmann R, Beriault S, Marinho MM, Mok K, Hall JA, Guizard N, Haegelen C, Olivier A, Pike GB, Collins DL (2015) Improving recorded volume in mesial temporal lobe by optimizing stereotactic intracranial electrode implantation planning. Int J Comput Assist Radiol Surg 10:1599–1615. doi:10.​1007/​s11548-015-1165-6 CrossRefPubMed
56.
Zurück zum Zitat Bériault S, Drouin S, Sadikot AF, Xiao Y, Collins DL, Pike GB (2013) A prospective evaluation of computer-assisted deep brain stimulation trajectory planning. In: Clinical image-based procedures from planning to intervention. Lecture notes on computer science, vol 7761, pp 42–49 Bériault S, Drouin S, Sadikot AF, Xiao Y, Collins DL, Pike GB (2013) A prospective evaluation of computer-assisted deep brain stimulation trajectory planning. In: Clinical image-based procedures from planning to intervention. Lecture notes on computer science, vol 7761, pp 42–49
Metadaten
Titel
IBIS: an OR ready open-source platform for image-guided neurosurgery
verfasst von
Simon Drouin
Anna Kochanowska
Marta Kersten-Oertel
Ian J. Gerard
Rina Zelmann
Dante De Nigris
Silvain Bériault
Tal Arbel
Denis Sirhan
Abbas F. Sadikot
Jeffery A. Hall
David S. Sinclair
Kevin Petrecca
Rolando F. DelMaestro
D. Louis Collins
Publikationsdatum
31.08.2016
Verlag
Springer International Publishing
Erschienen in
International Journal of Computer Assisted Radiology and Surgery / Ausgabe 3/2017
Print ISSN: 1861-6410
Elektronische ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-016-1478-0

Weitere Artikel der Ausgabe 3/2017

International Journal of Computer Assisted Radiology and Surgery 3/2017 Zur Ausgabe

Update Radiologie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.