Skip to main content
Erschienen in: International Journal of Computer Assisted Radiology and Surgery 4/2016

01.04.2016 | Original Article

X-ray and optical stereo-based 3D sensor fusion system for image-guided neurosurgery

verfasst von: Duk Nyeon Kim, You Seong Chae, Min Young Kim

Erschienen in: International Journal of Computer Assisted Radiology and Surgery | Ausgabe 4/2016

Einloggen, um Zugang zu erhalten

Abstract

Purpose

In neurosurgery, an image-guided operation is performed to confirm that the surgical instruments reach the exact lesion position. Among the multiple imaging modalities, an X-ray fluoroscope mounted on C- or O-arm is widely used for monitoring the position of surgical instruments and the target position of the patient. However, frequently used fluoroscopy can result in relatively high radiation doses, particularly for complex interventional procedures. The proposed system can reduce radiation exposure and provide the accurate three-dimensional (3D) position information of surgical instruments and the target position.

Methods

X-ray and optical stereo vision systems have been proposed for the C- or O-arm. Two subsystems have same optical axis and are calibrated simultaneously. This provides easy augmentation of the camera image and the X-ray image. Further, the 3D measurement of both systems can be defined in a common coordinate space.

Results

The proposed dual stereoscopic imaging system is designed and implemented for mounting on an O-arm. The calibration error of the 3D coordinates of the optical stereo and X-ray stereo is within 0.1 mm in terms of the mean and the standard deviation. Further, image augmentation with the camera image and the X-ray image using an artificial skull phantom is achieved.

Conclusion

As the developed dual stereoscopic imaging system provides 3D coordinates of the point of interest in both optical images and fluoroscopic images, it can be used by surgeons to confirm the position of surgical instruments in a 3D space with minimum radiation exposure and to verify whether the instruments reach the surgical target observed in fluoroscopic images.
Literatur
1.
Zurück zum Zitat Tate PM, Lachine V, Fu L, Croitoru H, Sati M (2001) Performance and robustness of automatic fluoroscopic image calibration in a new computer assisted surgery system. MICCAI, LNCS 2208. Springer, Berlin, pp 1130–1136 Tate PM, Lachine V, Fu L, Croitoru H, Sati M (2001) Performance and robustness of automatic fluoroscopic image calibration in a new computer assisted surgery system. MICCAI, LNCS 2208. Springer, Berlin, pp 1130–1136
2.
Zurück zum Zitat Livyatan H, Yaniv Z, Joskowicz L (2002) Robust automatic C-arm calibration for fluoroscopy-based navigation: a practical approach. MICCAI, Part II, LNCS 2489. Springer, Berlin, pp 60–68 Livyatan H, Yaniv Z, Joskowicz L (2002) Robust automatic C-arm calibration for fluoroscopy-based navigation: a practical approach. MICCAI, Part II, LNCS 2489. Springer, Berlin, pp 60–68
3.
Zurück zum Zitat Tomkowiak MT, Speidel MA, Raval AN, Van Lysel MS (2011) Calibration-free device sizing using an inverse geometry X-ray system. Med Phys 38(1):283–293CrossRefPubMedPubMedCentral Tomkowiak MT, Speidel MA, Raval AN, Van Lysel MS (2011) Calibration-free device sizing using an inverse geometry X-ray system. Med Phys 38(1):283–293CrossRefPubMedPubMedCentral
4.
Zurück zum Zitat Zbijewski W, Stayman JW (2009) Volumetric soft tissue brain imaging on xCAT, a mobile flat-panel X-ray CT system. In: Samei E, Hsieh J (eds) SPIE medical imaging 2009: physics of medical imaging, vol 7258, p 72582K Zbijewski W, Stayman JW (2009) Volumetric soft tissue brain imaging on xCAT, a mobile flat-panel X-ray CT system. In: Samei E, Hsieh J (eds) SPIE medical imaging 2009: physics of medical imaging, vol 7258, p 72582K
5.
Zurück zum Zitat Navab N, Heining SM, Traub J (2010) Camera augmented mobile C-arm (CAMC): calibration, accuracy study, and clinical applications. IEEE Trans Med Imaging 29(7):1412–1423CrossRefPubMed Navab N, Heining SM, Traub J (2010) Camera augmented mobile C-arm (CAMC): calibration, accuracy study, and clinical applications. IEEE Trans Med Imaging 29(7):1412–1423CrossRefPubMed
6.
Zurück zum Zitat Chen X, Wang L, Fallavollita P, Navab N (2012) Precise X-ray and video overlay for augmented reality fluoroscopy. Int J Comput Assist Radiol Surg 8(1):29–38CrossRefPubMed Chen X, Wang L, Fallavollita P, Navab N (2012) Precise X-ray and video overlay for augmented reality fluoroscopy. Int J Comput Assist Radiol Surg 8(1):29–38CrossRefPubMed
7.
Zurück zum Zitat Cox DD, Papanastassiou AM, Oreper D, Andken BB, Dicarlo JJ (2008) High-resolution three-dimensional microelectrode brain mapping using stereo microfocal X-ray imaging. J Neurophysiol 100(5):2966–2976CrossRefPubMed Cox DD, Papanastassiou AM, Oreper D, Andken BB, Dicarlo JJ (2008) High-resolution three-dimensional microelectrode brain mapping using stereo microfocal X-ray imaging. J Neurophysiol 100(5):2966–2976CrossRefPubMed
8.
Zurück zum Zitat Traub J, Heibel T, Dressel P, Heining SM, Graumann R, Navab N (2007) A multi-view opto-Xray imaging system. MICCAI, Part II, LNCS 4792. Springer, Berlin, pp 18–25 Traub J, Heibel T, Dressel P, Heining SM, Graumann R, Navab N (2007) A multi-view opto-Xray imaging system. MICCAI, Part II, LNCS 4792. Springer, Berlin, pp 18–25
9.
Zurück zum Zitat Chae Y, Lee S, Oh H, Kim M (2013) Coordinates tracking and augmented reality system using bipolar X-ray fluoroscopy and stereo vision for image-guided neurosurgery. In: IEEE 13th international conference on control, automation and systems, pp 107–112 Chae Y, Lee S, Oh H, Kim M (2013) Coordinates tracking and augmented reality system using bipolar X-ray fluoroscopy and stereo vision for image-guided neurosurgery. In: IEEE 13th international conference on control, automation and systems, pp 107–112
10.
Zurück zum Zitat Heikkila J (2000) Geometric camera calibration using circular control points. IEEE Trans Pattern Anal Mach Intell 22(10):1066–1077CrossRef Heikkila J (2000) Geometric camera calibration using circular control points. IEEE Trans Pattern Anal Mach Intell 22(10):1066–1077CrossRef
11.
Zurück zum Zitat Hartley R, Zisserman A (2004) Multiple view geometry in computer vision, 2nd edn. Cambridge University Press, New YorkCrossRef Hartley R, Zisserman A (2004) Multiple view geometry in computer vision, 2nd edn. Cambridge University Press, New YorkCrossRef
12.
Zurück zum Zitat Forsyth DA, Ponce J (2011) Computer vision: a modern approach, 2nd edn. Pearson, New Jersey Forsyth DA, Ponce J (2011) Computer vision: a modern approach, 2nd edn. Pearson, New Jersey
13.
Zurück zum Zitat Zhang Z (2000) A flexible new technique for camera calibration. IEEE Trans Pattern Anal Mach Intell 22(11):1330–1334CrossRef Zhang Z (2000) A flexible new technique for camera calibration. IEEE Trans Pattern Anal Mach Intell 22(11):1330–1334CrossRef
14.
Zurück zum Zitat Yu W (2004) Image-based lens geometric distortion correction using minimization of average bicoherence index. Pattern Recogn 37(6):1175–1187CrossRef Yu W (2004) Image-based lens geometric distortion correction using minimization of average bicoherence index. Pattern Recogn 37(6):1175–1187CrossRef
15.
Zurück zum Zitat Brown DC (1966) Decentering distortion of lenses. Photogramm Eng 32(3):444–462 Brown DC (1966) Decentering distortion of lenses. Photogramm Eng 32(3):444–462
16.
Zurück zum Zitat Basu A, Licardie S (1995) Alternative models for fish-eye lenses. Pattern Recogn Lett 16(4):433–441CrossRef Basu A, Licardie S (1995) Alternative models for fish-eye lenses. Pattern Recogn Lett 16(4):433–441CrossRef
17.
Zurück zum Zitat Beauchemin SS, Bajcsy R (2001) Modelling and removing radial and tangential distortions. Multi-image analysis, LNCS 2032. Springer, Berlin, pp 1–21 Beauchemin SS, Bajcsy R (2001) Modelling and removing radial and tangential distortions. Multi-image analysis, LNCS 2032. Springer, Berlin, pp 1–21
18.
Zurück zum Zitat Ma L, Quan Y, Moore KL (2003) Flexible camera calibration using a new analytical radial undistortion formula with application to mobile robot localization. In: IEEE international symposium on intelligent control, pp 799–804 Ma L, Quan Y, Moore KL (2003) Flexible camera calibration using a new analytical radial undistortion formula with application to mobile robot localization. In: IEEE international symposium on intelligent control, pp 799–804
19.
Zurück zum Zitat Mallon J, Whelan PF (2004) Precise radial un-distortion of images. In: IEEE 17th international conference on pattern recognition, pp 18–21 Mallon J, Whelan PF (2004) Precise radial un-distortion of images. In: IEEE 17th international conference on pattern recognition, pp 18–21
20.
Zurück zum Zitat Shah S, Aggarwal J (1996) Intrinsic parameter calibration procedure for a (high distortion) fish-eye lens camera with distortion model and accuracy estimation. Pattern Recogn 29(11):1775–1788CrossRef Shah S, Aggarwal J (1996) Intrinsic parameter calibration procedure for a (high distortion) fish-eye lens camera with distortion model and accuracy estimation. Pattern Recogn 29(11):1775–1788CrossRef
21.
Zurück zum Zitat Sturm P, Ramalingam S (2004) A generic concept for camera calibration. Computer vision-ECCV 2004, LNCS 3022. Springer, Berlin, pp 1–13CrossRef Sturm P, Ramalingam S (2004) A generic concept for camera calibration. Computer vision-ECCV 2004, LNCS 3022. Springer, Berlin, pp 1–13CrossRef
Metadaten
Titel
X-ray and optical stereo-based 3D sensor fusion system for image-guided neurosurgery
verfasst von
Duk Nyeon Kim
You Seong Chae
Min Young Kim
Publikationsdatum
01.04.2016
Verlag
Springer Berlin Heidelberg
Erschienen in
International Journal of Computer Assisted Radiology and Surgery / Ausgabe 4/2016
Print ISSN: 1861-6410
Elektronische ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-015-1290-2

Weitere Artikel der Ausgabe 4/2016

International Journal of Computer Assisted Radiology and Surgery 4/2016 Zur Ausgabe

Update Radiologie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.