nach oben

International Journal of Computer Assisted Radiology and Surgery

Erschienen in:

31.08.2017 | Original Article

A method for going from 2D laparoscope to 3D acquisition of surface landmarks by a novel computer vision approach

verfasst von: Marc Garbey, Toan B. Nguyen, Albert Y. Huang, Vid Fikfak, Brian J. Dunkin

Erschienen in: International Journal of Computer Assisted Radiology and Surgery | Ausgabe 2/2018

Einloggen, um Zugang zu erhalten

Abstract

Purpose

This paper presents a method to use the Smart Trocars—our new surgical instrument recognition system—or any accurate localization system of surgical instrument for acquiring intraoperative surface data. Complex laparoscopic surgeries need a proper guidance system which requires registering the preoperative data from a CT or MRI scan to the intraoperative patient state. The Smart Trocar can be used to localize the instruments when it comes to contact with the soft tissue surface.

Method

Two successive views through the laparoscope at different angles with the 3D localization of a fixed tool at one single location using the Smart Trocars can point out visible features during the surgery and acquire their location in 3D to provide a depth map in the region of interest. In other words, our method transforms a standard laparoscope system into a system with three-dimensional registration capability.

Result

This method was initially tested on a simulation for uncertainty assessment and then on a rigid model for verification with an accuracy within 2 mm distance. In addition, an in vivo experiment on pig model was also conducted to investigate how the method might be used during a physiologic respiratory cycle.

Conclusion

This method can be applied in a large number of surgical applications as a guidance system on its own or in conjunction with other navigation techniques. Our work encourages further testing with realistic surgical applications in the near future.

Miga MI, Dumpurib P, Simpsona A, Weisa J, Jarnaginc W (2012) Model-assisted image-guided liver surgery using sparse intraoperative data. In: Payan Y (ed) Soft tissue biomechanical modeling for computer assisted surgery. Springer, New York, pp 7–40

Haouchine N, Dequidt J, Peterlik I, Kerrien E, Berger MO, Cotin S (2013) Image-guided simulation of heterogeneous tissue deformation for augmented reality during hepatic surgery. In: ISMAR—IEEE international symposium on mixed and augmented reality

Wu Y, Rucker DC, Conley RH, Pheiffer TS, Simpson AL, Geeverghese SK, Miga MI (2014) Registration of liver images to minimally invasive intraoperative surface and subsurface data. SPIE Med Imaging Image-Guided Proced Robot Interven Model. doi:10.1117/12.2044250

Nguyen T, Huang A, Fikfak V, Dunkin B, Garbey M (2016) Image-guided simulation of tissue deformation using a mechanical model on a surgical application. Comput Methods Biomech Biomed Eng 20(2):206–214CrossRef

Ma B, Ellis RE (2003) Robust registration for computer-integrated orthopedic surgery: laboratory validation and clinical experience. Med Image Anal 7(3):237–250CrossRefPubMed

Clements W, Chapman WC, Dawant BM, Galloway RL, Miga MI (2008) Robust surface registration using salient anatomical features for image-guided liver surgery: algorithm and validation. Med Phys 35(6):2528–2540CrossRefPubMedPubMedCentral

Strobl KH, Mair E, Bodenmüller T, Kielhöfer S, Sepp W, Suppa M, Burschka D, Hirzinger G (2009) The self-referenced DLR 3D-modeler. In: Proceedings of the IEEE/RSJ international conference on intelligent robots and systems (IROS 2009), St. Louis, pp 21–28

Rauth TP, Bao PQ, Galloway RL, Bieszczad J, Friets EM, Knaus DA, Kynor DB, Herline AJ (2007) Laparoscopic surface scanning and subsurface targeting: implications for image-guided laparoscopic liver surgery. Surgery 142(2):207–14CrossRefPubMed

Maier-Hein L, Groch A, Bartoli A, Bodenstedt S, Boissonnat G, Chang PL, Clancy NT, Elson DS, Haase S, Heim E, Hornegger J, Jannin P, Kenngott H, Kilgus T, Müller-Stich B, Oladokun D, Röhl S, Dos Santos TR, Schlemmer HP, Seitel A, Speidel S, Wagner M, Stoyanov D (2014) Comparative validation of single-shot optical techniques for laparoscopic 3-D surface reconstruction. IEEE Trans Med Imaging 33(10):1913–30CrossRefPubMed

10.

Sirat G, Psaltis D (1985) Conoscopic holography. Opt Lett 10(1):4–6CrossRefPubMed

11.

Lathrop RA, Hackworth DM, Webster RJ (2010) Minimally invasive holographic surface scanning for soft-tissue image registration. IEEE Trans Biomed Eng 57(6):1497–1506CrossRefPubMedPubMedCentral

12.

Fofi D, Sliwa T, Voisin Y (2004) A comparative survey on invisible structured light. In: Proceedings of SPIE, vol 5303, pp 90–97

13.

Hostettler A, Nicolau SA, Remond Y, Marescaux J, Soler L (2010) A real-time predictive simulation of abdominal viscera positions during quiet free breathing. Prog Biophys Mol Biol 103:169–184CrossRefPubMed

14.

Maier-Hein L, Mountney P, Bartoli A, Elhawary H, Elson D, Groch A, Kolb A, Rodrigues M, Sorger J, Speidel S, Stoyanov D (2013) Optical techniques for 3D surface reconstruction in computer-assisted laparoscopic surgery. Med Image Anal 17:974–996CrossRefPubMed

15.

Mountney P, Yang GZ (2010) Motion compensated SLAM for image guided surgery. Med Image Comput Comput Assist Interv 13(Pt 2):496–504PubMed

16.

Raabe A, Krishnan R, Wolff R, Hermann E, Zimmermann M, Seifert V (2002) Laser surface scanning for patient registration in intracranial image-guided surgery. Neurosurgery 50(4):797–801CrossRefPubMed

17.

Edgcumbe P, Nguan C, Rohling R (2013) Calibration and stereo tracking of a laparoscopic ultrasound transducer for augmented reality in surgery. In: Augmented reality environments for medical imaging and computer-assisted interventions, lecture notes in computer science, pp 258–267

18.

Toti G, Garbey M, Sherman V, Dunkin B, Bass B (2015) Smart trocar for automatic tool recognition in laparoscopic intervention. SURG INNOV 22:77–82CrossRefPubMed

19.

Joerger G (2014) Operating Room Awareness and Supervision in the Context of Laparoscopy. Master Thesis CS. University of Houston. http://www.cs.uh.edu/news-events/thesis-defenses/2014/06.26-gJoerger.html

20.

Tatar F, Mollinger J, Bossche A (2003) Ultrasound system for measuring position and orientation of laparoscopic surgery tools. In: Proceedings of IEEE sensors, vol 2, pp 98–990

21.

Tatar F, Mollinger JR, Bastemeijer J, Bossche A (2004) Time of flight technique used for measuring position and orientation of laparoscopic surgery tools. In: Proceedings of IEEE sensors, vol 3, pp 1480–1483

22.

Ikuta K, Kato T, Ooe H, Ando S (2007) “ Surgery recorder system” for recording position and force of forceps during laparoscopic surgery. In: 2007 IEEE/ASME international conference on advanced intelligent mechatronics. doi:10.1109/AIM.2007.4412594

23.

Yuan JSC (1989) A general photogrammetric method for determining object position and orientation. IEEE Trans Robot Autom 5(2):129–142CrossRef

24.

Guillaume J, Albert H, Barbara B, Brian D, Marc G (2017). Global laparoscopy positioning system with a smart trocar. Comput Biol Med (in submission)

25.

Hur HC, Arden D, Dodge LE, Zheng B, Ricciotti HA (2011) Fundamentals of laparoscopic surgery: a surgical skills assessment tool in gynecology. JSLS 15(1):21–26CrossRefPubMedPubMedCentral

26.

Case R, Sonke J-J, Moseley DJ, Kim J, Brock KK, Dawson LA (2009) Inter- and intrafraction variability in liver position in non-breath-hold stereotactic body radiotherapy. Int J Radiat Oncol Biol Phys 75(1):302–308CrossRefPubMed

27.

Sahih A, Haas O, Burnham K, Mills J (2005) Organ motion modelling and prediction for adaptive radiotherapy. Proc IAR-ACD 2(89):211–216

28.

Khamene A, Warzelhan J, Vogt S, Elgort D, Chefd’Hotel C, Duerk J, Lewin J, Wacker F, Sauer F (2004) Characterization of internal organ motion using skin marker positions. MICCAI 90:526–533

29.

Yang D, Lu W, Low D, Deasy J, Hope A, El Naqa I (2008) 4d-ct motion estimation using deformable image registration and 5d respiratory motion modeling. Med Phys 35(10):4577–4590CrossRefPubMedPubMedCentral

30.

Fayad H, Pan T, Pradier O, Visvikis D (2012) Patient specific respiratory motion modeling using a 3D patient’s external surface. Med Phys 36(6):3386–3395CrossRef

31.

Tomasz B, Mengfei L, Zein S, Georg R (2014) Electromagnetic tracking system with reduced distortion using quadratic excitation. Int J Comput Assist Radiol Surg 9(2):323–332CrossRef

32.

Banz VM, Müller PC, Tinguely P, Inderbitzin D, Ribes D, Peterhans M, Candinas D, Weber S (2016) Intraoperative image-guided navigation system: development and applicability in 65 patients undergoing liver surgery. Langenbeck’s Arch Surg 401(4):495–502CrossRef

33.

Peterhans M, Vom Berg A, Dagon B, Inderbitzin D, Baur C, Candinas D, Weber S (2011) A navigation system for open liver surgery: design, workflow and first clinical applications. Int J Med Robot 7(1):7–16CrossRefPubMed

34.

Nazim H, J’er’emie D, Igor P, Erwan K, Marie-Odile B, Stephane C (2013). Image-guided simulation of heterogeneous tissue deformation for augmented reality during hepatic surgery. In: ISMAR—IEEE international symposium on mixed and augmented reality, pp 199 – 208

Titel: A method for going from 2D laparoscope to 3D acquisition of surface landmarks by a novel computer vision approach
verfasst von: Marc Garbey
Toan B. Nguyen
Albert Y. Huang
Vid Fikfak
Brian J. Dunkin
Publikationsdatum: 31.08.2017
Verlag: Springer International Publishing
Erschienen in: International Journal of Computer Assisted Radiology and Surgery / Ausgabe 2/2018
Print ISSN: 1861-6410
Elektronische ISSN: 1861-6429
DOI: https://doi.org/10.1007/s11548-017-1655-9

Neu im Fachgebiet Radiologie

23.04.2024 | Pankreaskarzinom | Nachrichten

Update Radiologie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.

Newsletter bestellen

Springer Medizin

A method for going from 2D laparoscope to 3D acquisition of surface landmarks by a novel computer vision approach

Abstract

Purpose

Method

Result

Conclusion

Neu im Fachgebiet Radiologie

S3-Leitlinie zu Pankreaskrebs aktualisiert

Fünf Dinge, die im Kindernotfall besser zu unterlassen sind

„Nur wer sich gut aufgehoben fühlt, kann auch für Patientensicherheit sorgen“

Wie toxische Männlichkeit der Gesundheit von Männern schadet

Update Radiologie

Springer Medizin

Abstract

Purpose

Method

Result

Conclusion

Bitte loggen Sie sich ein, um Zugang zu diesem Inhalt zu erhalten

Weitere Artikel der Ausgabe 2/2018

An automatic markerless registration method for neurosurgical robotics based on an optical camera

An advanced simulator for orthopedic surgical training

Computer-based radiological longitudinal evaluation of meningiomas following stereotactic radiosurgery

Highly immersive virtual reality laparoscopy simulation: development and future aspects

Breast cancer cell nuclei classification in histopathology images using deep neural networks

Augmented marker tracking for peri-acetabular osteotomy surgery

Neu im Fachgebiet Radiologie

S3-Leitlinie zu Pankreaskrebs aktualisiert

Fünf Dinge, die im Kindernotfall besser zu unterlassen sind

„Nur wer sich gut aufgehoben fühlt, kann auch für Patientensicherheit sorgen“

Wie toxische Männlichkeit der Gesundheit von Männern schadet

Update Radiologie