nach oben

International Journal of Computer Assisted Radiology and Surgery

Erschienen in:

01.11.2014 | Original Article

Video-guided calibration of an augmented reality mobile C-arm

verfasst von: Xin Chen, Hemal Naik, Lejing Wang, Nassir Navab, Pascal Fallavollita

Erschienen in: International Journal of Computer Assisted Radiology and Surgery | Ausgabe 6/2014

Einloggen, um Zugang zu erhalten

Abstract

Purpose

The augmented reality (AR) fluoroscope augments an X-ray image by video and provides the surgeon with a real-time in situ overlay of the anatomy. The overlay alignment is crucial for diagnostic and intra-operative guidance, so precise calibration of the AR fluoroscope is required. The first and most complex step of the calibration procedure is the determination of the X-ray source position. Currently, this is achieved using a biplane phantom with movable metallic rings on its top layer and fixed X-ray opaque markers on its bottom layer. The metallic rings must be moved to positions where at least two pairs of rings and markers are isocentric in the X-ray image. The current “trial and error” calibration process currently requires acquisition of many X-ray images, a task that is both time consuming and radiation intensive. An improved process was developed and tested for C-arm calibration.

Methods

Video guidance was used to drive the calibration procedure to minimize both X-ray exposure and the time involved. For this, a homography between X-ray and video images is estimated. This homography is valid for the plane at which the metallic rings are positioned and is employed to guide the calibration procedure. Eight users having varying calibration experience (i.e., 2 experts, 2 semi-experts, 4 novices) were asked to participate in the evaluation.

Results

The video-guided technique reduced the number of intra-operative X-ray calibration images by 89 % and decreased the total time required by 59 %.

Conclusion

A video-based C-arm calibration method has been developed that improves the usability of the AR fluoroscope with a friendlier interface, reduced calibration time and clinically acceptable radiation doses.

Nur mit Berechtigung zugänglich

Paul P, Fleig O, Jannin P (2005) Augmented virtuality based on stereoscopic reconstruction in multimodal image-guided neurosurgery: methods and performance evaluation. IEEE Trans Med Imaging 24(11):1500–1511PubMedCrossRef

Birkfellner W, Figl M, Huber K, Watzinger F, Wanschitz F, Hummel J, Hanel R, Greimel W, Homolka P, Ewers R, Bergmann H (2002) A head-mounted operating binocular for augmented reality visualization in medicine—design and initial evaluation. IEEE Trans Med Imaging 21(8):991–997PubMedCrossRef

Grimson WEL, Lozano-Perez T, Wells WM III, Ettinger GJ, White SJ, Kikinis R (1996) An automatic registration method for frameless stereotaxy, image guided surgery, and enhanced reality visualization. IEEE Trans Med Imaging 15(2):129–140PubMedCrossRef

Bajura M, Fuchs H, Ohbuchi R (1992) Merging virtual objects with the real world: seeing ultrasound imagery within the patient. In: Proceedings of the 19th annual conference on computer graphics and interactive techniques. ACM Press, pp 203–210

State A, Chen DT, Tector C, Brandt A, Chen H, Ohbuchi R, Bajura M, Fuchs H (1994) Case study: observing a volume rendered fetus within a pregnant patient. In: Proceedings of the conference on visualization ’94. IEEE Computer Society Press, pp 364–368

Sauer F, Khamene A, Bascle B, Rubino GJ (2001) A head-mounted display system for augmented reality image guidance: towards clinical evaluation for imri-guided neurosurgery. In: Proceeings of the international conference on medical image computing and computer assisted intervention (MICCAI). Springer, London, pp 707–716

Sauer F, Schoepf UJ, Khamene A, Vogt S, Das M, Silverman SG (2003) Augmented reality system for ct-guided interventions: system description and initial phantom trials. In: Medical imaging: visualization, image-guided procedures, and display

Blackwell M, Nikou C, DiGioia AM, Kanade T (2000) An image overlay system for medical data visualization. Med Image Anal 4(1):67–72PubMedCrossRef

Sielhorst T, Feuerstein M, Navab N (2008) Advanced medical displays: a literature review of augmented reality. IEEE/OSA J Disp Technol. Special issue on Medical Displays, 4(4):451–467

10.

Stetten G, Cois A, Chang W, Shelton D, Tamburo R, Castellucci J, von Ramm O (2005) C-mode real-time tomographic reflection for a matrix array ultrasound sonic flashlight. Acad Radiol 12: 535–543

11.

Fichtinger G, Deguet A, Masamune K, Balogh E, Fischer GS, Mathieu H, Taylor RH, Zinreich SJ, Fayad LM (2005) Image overlay guidance for needle insertion in CT scanner. IEEE Trans Bio-Med Eng 52:1415–1424CrossRef

12.

Fischer GS, Deguet A, Csoma C, Taylor RH, Fayad L, Carrino JA, Zinreich SJ, Fichtinger G (2007) MRI image overlay: application to arthrography needle insertion. Comput Aided Surg Off J Int Soc Comput Aided Surg 12:2–14CrossRef

13.

Feuerstein M, Mussack T, Heining SM, Navab N (2008) Intraoperative laparoscope augmentation for port placement and resection planning in minimally invasive liver resection. IEEE Trans Med Imaging 27:355–369PubMedCrossRef

14.

Wendler T, Feuerstein M, Traub J, Lasser T, Vogel J, Daghighian F, Ziegler SI, Navab N (2007) Real-time fusion of ultrasound and gamma probe for navigated localization of liver metastases. In: International conference on medical image computing and computer-assisted intervention MICCAI 10, pp 252–260

15.

Moult E et al (2011) Automatic C-arm pose estimation via 2D/3D hybrid registration of a radiographic fiducial. In: SPIE medical imaging. p 79642S

16.

Fallavollita P et al (2010) C-arm pose estimation in prostate brachytherapy by registration to ultrasound. In: MICCAI (3). LNCS, Springer, pp 311–318

17.

Navab N, Mitschke M, Schütz O (1999) Camera-augmented mobile C-arm (CAMC) application: 3D reconstruction using a low-cost mobile C-arm. In: International conference on medical image computing and computer-assisted intervention, Lecture notes in computer science, vol 1679/1999, pp 688–697

18.

Navab N, Heining SM, Traub J (2010) Camera augmented mobile C-arm (CAMC): calibration, accuracy study, and clinical applications. IEEE Trans Med Imaging 29(7):1412–1423PubMedCrossRef

19.

Wang L, Traub J, Weidert S, Heining SM, Euler E, Navab N (2010) Parallax-free intraoperative X-ray image stitching. Med Image Anal 14(5):674–686PubMedCrossRef

20.

Navab N, Wiesner S, Benhimane S, Euler E, Heining SM (2006) Visual servoing for intraoperative positioning and repositioning of mobile C-arms. In: International conference on medical image computing and computer-assisted intervention, vol 19, no 1, pp 551–560

21.

Wang L, Landes J, Weidert S et al (2010) First animal cadaver study for interlocking of intramedullary nails under camera augmented mobile C-arm. A surgical workflow based preclinical evaluation. In: IPCAI’10 Proceedings of the first international conference on information processing in computer-assisted interventions, pp 56–66

22.

Diotte B, Fallavollita P, Wang L, Weidert S, Thaller P, Euler E, Navab N (2012) Radiation-free drill guidance in interlocking of intramedullary nails. In: 15th international conference on medical image computing and computer-assisted intervention, vol 7510, pp 18–25

23.

Londei R, Esposito M, Diotte B, Weidert S, Euler E, Thaller P, Navab N, Fallavollita P (2014) The ‘augmented’ circles: a video-guided solution for the down-the-beam positioning of IM nail holes. In: Information processing in computer-assisted interventions (IPCAI) (in press)

24.

Wang L, Fallavollita P, Zou R, Chen X, Weidert S, Navab N (2012 May) Closed-form inverse kinematics for interventional C-arm X-ray imaging with six degrees of freedom: modeling and application. IEEE Trans Med Imaging 31(5):1086–1099

25.

Chen X, Wang L, Fallavollita P, Navab N (2013) Precise X-ray and video overlay for augmented reality fluoroscopy. Int J Comput Assist Radiol Surg 8(1):29–38

26.

Chen X, Wang L, Fallavollita P, Navab N (2012) Error analysis of the X-ray projection geometry of camera-augmented mobile C-arm. In: SPIE medical imaging. International Society for Optics and Photonics, pp 83160P–83160P

27.

Pati S, Erat O, Wang L, Weidert S, Euler E, Navab N, Fallavollita P (2013) Accurate pose estimation using single marker single camera calibration system. In: SPIE medical imaging. International Society for Optics and Photonics, pp 867126–867126

28.

Wang L, Fallavollita P, Brand A, Erat O, Weidert S, Thaller P-H, Euler E, Navab N (2012) Intra-op measurement of the mechanical axis deviation: an evaluation study on 19 human cadaver legs. In: Medical image computing and computer-assisted intervention-MICCAI. Springer, Berlin, pp 609–616

29.

Erat O, Pauly O, Weidert S, Thaller P, Euler E, Mutschler W, Navab N, Fallavollita P (2013) How a surgeon becomes superman by visualization of intelligently fused multi-modalities. In: SPIE medical imaging. International Society for Optics and Photonics, pp 86710L–86710L

30.

Pauly O, Katouzian A, Eslami A, Fallavollita P, Navab N (2012) Supervised classification for customized intraoperative augmented reality visualization. In: IEEE international symposium on mixed and augmented reality (ISMAR), pp 311–312

31.

Pauly O, Diotte B, Habert S, Weidert S, Euler E, Fallavollita P, Navab N (2014) Visualization inside the operating room: “learning” what the surgeon wants to see. In: Information processing in computer-assisted interventions (IPCAI) (in press)

32.

Bradski G (2000) The OpenCV library. Dr Dobb’s J 25(11):120–126

33.

Wright R et al (2010) OpenGL SuperBible: comprehensive tutorial and reference. Pearson Education, Upper Saddle River

34.

Suzuki S, Abe K (1985) Topological structural analysis of digital binary images by border following. CVGIP 30(1):32–46

Titel: Video-guided calibration of an augmented reality mobile C-arm
verfasst von: Xin Chen
Hemal Naik
Lejing Wang
Nassir Navab
Pascal Fallavollita
Publikationsdatum: 01.11.2014
Verlag: Springer Berlin Heidelberg
Erschienen in: International Journal of Computer Assisted Radiology and Surgery / Ausgabe 6/2014
Print ISSN: 1861-6410
Elektronische ISSN: 1861-6429
DOI: https://doi.org/10.1007/s11548-014-0995-y

Update Radiologie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.

Newsletter bestellen

Springer Medizin

Video-guided calibration of an augmented reality mobile C-arm

Abstract

Purpose

Methods

Results

Conclusion

Neu im Fachgebiet Radiologie

Akuter Schwindel: Wann lohnt sich eine MRT?

Screening-Mammografie offenbart erhöhtes Herz-Kreislauf-Risiko

S3-Leitlinie zu Pankreaskrebs aktualisiert

Fünf Dinge, die im Kindernotfall besser zu unterlassen sind

Update Radiologie

Springer Medizin

Abstract

Purpose

Methods

Results

Conclusion

Bitte loggen Sie sich ein, um Zugang zu diesem Inhalt zu erhalten

Weitere Artikel der Ausgabe 6/2014

AneuSearch: a software prototype for intracranial aneurysm searching and clinical decision support

Variable dose interplay effects across radiosurgical apparatus in treating multiple brain metastases

Experimental evaluation of ultrasound-guided 3D needle steering in biological tissue

Reliability of sensor-based real-time workflow recognition in laparoscopic cholecystectomy

Intraoperative detection and localization of cylindrical implants in cone-beam CT image data

Intraoperative visualization of cerebral oxygenation using hyperspectral image data: a two-dimensional mapping method

Neu im Fachgebiet Radiologie

Akuter Schwindel: Wann lohnt sich eine MRT?

Screening-Mammografie offenbart erhöhtes Herz-Kreislauf-Risiko

S3-Leitlinie zu Pankreaskrebs aktualisiert

Fünf Dinge, die im Kindernotfall besser zu unterlassen sind

Update Radiologie