Skip to main content
Erschienen in: International Journal of Computer Assisted Radiology and Surgery 9/2016

01.09.2016 | Original Article

Multimodal US–gamma imaging using collaborative robotics for cancer staging biopsies

verfasst von: Marco Esposito, Benjamin Busam, Christoph Hennersperger, Julia Rackerseder, Nassir Navab, Benjamin Frisch

Erschienen in: International Journal of Computer Assisted Radiology and Surgery | Ausgabe 9/2016

Einloggen, um Zugang zu erhalten

Abstract

Purpose

The staging of female breast cancer requires detailed information about the level of cancer spread through the lymphatic system. Common practice to obtain this information for patients with early-stage cancer is sentinel lymph node (SLN) biopsy, where LNs are radioactively identified for surgical removal and subsequent histological analysis. Punch needle biopsy is a less invasive approach but suffers from the lack of combined anatomical and nuclear information. We present and evaluate a system that introduces live collaborative robotic 2D gamma imaging in addition to live 2D ultrasound to identify SLNs in the surrounding anatomy.

Methods

The system consists of a robotic arm equipped with both a gamma camera and a stereoscopic tracking system that monitors the position of an ultrasound probe operated by the physician. The arm cooperatively places the gamma camera parallel to the ultrasound imaging plane to provide live multimodal visualization and guidance. We validate the system by evaluating the target registration errors between fused nuclear and US image data in a phantom consisting of two spheres, one of which is filled with radioactivity. Medical experts perform punch biopsies on agar–gelatine phantoms with complex configurations of hot and cold lesions to provide a qualitative and quantitative evaluation of the system.

Results

The average point registration error for the overlay is \(1.12 \pm 0.57\) mm. The time of the entire procedure was reduced by 36 %, with 80v of the biopsies being successful. The users’ feedback was very positive, and the system was deemed to be very intuitive, with handling similar to classic US-guided needle biopsy.

Conclusion

We present and evaluate the first medical collaborative robotic imaging system. Feedback from potential users for SLN punch needle biopsy is encouraging. Ongoing work investigates the clinical feasibility with more complex and realistic phantoms.
Anhänge
Nur mit Berechtigung zugänglich
Literatur
1.
Zurück zum Zitat Bradski G (2000) Opencv. Dr. Dobb’s journal of software tools Bradski G (2000) Opencv. Dr. Dobb’s journal of software tools
2.
Zurück zum Zitat Bricou A, Duval MA, Charon Y, Barranger E (2013) Mobile gamma cameras in breast cancer care—a review. Eur J Surg Oncol 39(5):409–416CrossRefPubMed Bricou A, Duval MA, Charon Y, Barranger E (2013) Mobile gamma cameras in breast cancer care—a review. Eur J Surg Oncol 39(5):409–416CrossRefPubMed
3.
Zurück zum Zitat Busam B, Esposito M, Che’Rose S, Navab N, Frisch B (2015) A stereo vision approach for cooperative robotic movement therapy. In: IEEE international conference on computer vision workshop (ICCVW) Busam B, Esposito M, Che’Rose S, Navab N, Frisch B (2015) A stereo vision approach for cooperative robotic movement therapy. In: IEEE international conference on computer vision workshop (ICCVW)
4.
Zurück zum Zitat Dang J, Frisch B, Lasaygues P, Zhang D, Tavernier S, Felix N, Lecoq P, Auffray E, Varela J, Mensah S, Wan M (2011) Development of an anthropomorphic breast phantom for combined PET, B-mode ultrasound and elastographic imaging. IEEE Trans Nucl Sci 58(3):660–667CrossRef Dang J, Frisch B, Lasaygues P, Zhang D, Tavernier S, Felix N, Lecoq P, Auffray E, Varela J, Mensah S, Wan M (2011) Development of an anthropomorphic breast phantom for combined PET, B-mode ultrasound and elastographic imaging. IEEE Trans Nucl Sci 58(3):660–667CrossRef
5.
Zurück zum Zitat Esposito M, Busam B, Hennersperger C, Rackerseder J, Lu A, Navab N, Frisch B (2015) Cooperative robotic gamma imaging: enhancing US-guided needle biopsy. In: Navab N, Hornegger J, Wells WM, Frangi AF (eds) Medical image computing and computer-assisted intervention–MICCAI 2015, Lecture Notes in Computer Science, vol 9350. Springer, Berlin, pp 611–618 Esposito M, Busam B, Hennersperger C, Rackerseder J, Lu A, Navab N, Frisch B (2015) Cooperative robotic gamma imaging: enhancing US-guided needle biopsy. In: Navab N, Hornegger J, Wells WM, Frangi AF (eds) Medical image computing and computer-assisted intervention–MICCAI 2015, Lecture Notes in Computer Science, vol 9350. Springer, Berlin, pp 611–618
7.
Zurück zum Zitat Gardiazabal J, Reichl T, Okur A, Lasser T, Navab N (2013) First flexible robotic intra-operative nuclear imaging for image-guided surgery. In: Information processing in computer-assisted interventions Gardiazabal J, Reichl T, Okur A, Lasser T, Navab N (2013) First flexible robotic intra-operative nuclear imaging for image-guided surgery. In: Information processing in computer-assisted interventions
8.
Zurück zum Zitat Giammarile F, Alazraki N, Aarsvold JN, Audisio RA, Glass E, Grant SF, Kunikowska J, Leidenius M, Moncayo VM, Uren RF, Oyen WJG, Valdés Olmos RA, Vidal Sicart S (2013) The EANM and SNMMI practice guideline for lymphoscintigraphy and sentinel node localization in breast cancer. Europ J Nucl Med Mol Imaging 40(12):1932–1947CrossRef Giammarile F, Alazraki N, Aarsvold JN, Audisio RA, Glass E, Grant SF, Kunikowska J, Leidenius M, Moncayo VM, Uren RF, Oyen WJG, Valdés Olmos RA, Vidal Sicart S (2013) The EANM and SNMMI practice guideline for lymphoscintigraphy and sentinel node localization in breast cancer. Europ J Nucl Med Mol Imaging 40(12):1932–1947CrossRef
9.
Zurück zum Zitat Hermann A, Mauch F, Fischnaller K, Klemm S, Ronnau A, Dillmann R (2015) Anticipate your surroundings: predictive collision detection between dynamic obstacles and planned robot trajectories on the GPU. In: IEEE European conference on mobile robots (ECMR), pp 1–8 Hermann A, Mauch F, Fischnaller K, Klemm S, Ronnau A, Dillmann R (2015) Anticipate your surroundings: predictive collision detection between dynamic obstacles and planned robot trajectories on the GPU. In: IEEE European conference on mobile robots (ECMR), pp 1–8
11.
Zurück zum Zitat Krag DN, Anderson SJ, Julian TB, Brown AM, Harlow SP, Costantino JP, Ashikaga T, Weaver DL, Mamounas EP, Jalovec LM, Frazier TG, Noyes RD, Robidoux A, Scarth HMC, Wolmark N (2010) Sentinel-lymph-node resection compared with conventional axillary-lymph-node dissection in clinically node-negative patients with breast cancer: overall survival findings from the NSABP B-32 randomised phase 3 trial. Lancet Oncol 11(10):927–933CrossRefPubMedPubMedCentral Krag DN, Anderson SJ, Julian TB, Brown AM, Harlow SP, Costantino JP, Ashikaga T, Weaver DL, Mamounas EP, Jalovec LM, Frazier TG, Noyes RD, Robidoux A, Scarth HMC, Wolmark N (2010) Sentinel-lymph-node resection compared with conventional axillary-lymph-node dissection in clinically node-negative patients with breast cancer: overall survival findings from the NSABP B-32 randomised phase 3 trial. Lancet Oncol 11(10):927–933CrossRefPubMedPubMedCentral
14.
Zurück zum Zitat Lasso A, Heffter T, Rankin A, Pinter C, Ungi T, Fichtinger G (2014) Plus: open-source toolkit for ultrasound-guided intervention systems. IEEE Trans Biomed Eng 61(10):2527–2537CrossRefPubMedPubMedCentral Lasso A, Heffter T, Rankin A, Pinter C, Ungi T, Fichtinger G (2014) Plus: open-source toolkit for ultrasound-guided intervention systems. IEEE Trans Biomed Eng 61(10):2527–2537CrossRefPubMedPubMedCentral
15.
Zurück zum Zitat Lyman G, Giuliano A, Somerfield M, Benson A, Bodurka D, Burstein H, Cochran A, Cody H, Edge S, Galper S, Hayman J, Kim T, Perkins C, Podoloff D, Sivasubramaniam V, Turner R, Wahl R, Weaver D, Wolff A, Winer E (2005) American Society of Clinical Oncology guideline recommendations for sentinel lymph node biopsy in early-stage breast cancer. J Clin Oncol 23(30):7703–7720CrossRefPubMed Lyman G, Giuliano A, Somerfield M, Benson A, Bodurka D, Burstein H, Cochran A, Cody H, Edge S, Galper S, Hayman J, Kim T, Perkins C, Podoloff D, Sivasubramaniam V, Turner R, Wahl R, Weaver D, Wolff A, Winer E (2005) American Society of Clinical Oncology guideline recommendations for sentinel lymph node biopsy in early-stage breast cancer. J Clin Oncol 23(30):7703–7720CrossRefPubMed
16.
Zurück zum Zitat Lyman GH, Temin S, Edge SB, Newman LA, Turner RR, Weaver DL, Benson AB, Bosserman LD, Burstein HJ, Cody H, Hayman J, Perkins CL, Podoloff DA, Giuliano AE (2014) Sentinel lymph node biopsy for patients with early-stage breast cancer: American Society of Clinical Oncology clinical practice guideline update. J Clin Oncol 32(13):1365–1383CrossRefPubMed Lyman GH, Temin S, Edge SB, Newman LA, Turner RR, Weaver DL, Benson AB, Bosserman LD, Burstein HJ, Cody H, Hayman J, Perkins CL, Podoloff DA, Giuliano AE (2014) Sentinel lymph node biopsy for patients with early-stage breast cancer: American Society of Clinical Oncology clinical practice guideline update. J Clin Oncol 32(13):1365–1383CrossRefPubMed
17.
Zurück zum Zitat Marchand É, Spindler F, Chaumette F (2005) ViSP for visual servoing: a generic software platform with a wide class of robot control skills. IEEE Robot Autom Mag 12(4):40–52CrossRef Marchand É, Spindler F, Chaumette F (2005) ViSP for visual servoing: a generic software platform with a wide class of robot control skills. IEEE Robot Autom Mag 12(4):40–52CrossRef
18.
Zurück zum Zitat Matthies P, Gardiazabal J, Okur A, Vogel J, Lasser T, Navab N (2014) Mini gamma cameras for intra-operative nuclear tomographic reconstruction. Med Image Anal 18(8):1329–1336CrossRefPubMed Matthies P, Gardiazabal J, Okur A, Vogel J, Lasser T, Navab N (2014) Mini gamma cameras for intra-operative nuclear tomographic reconstruction. Med Image Anal 18(8):1329–1336CrossRefPubMed
19.
Zurück zum Zitat Okur A, Hennersperger C, Runyan B, Gardiazabal J, Keicher M, Paepke S, Wendler T, Navab N (2014) fhSPECT-US guided needle biopsy of sentinel lymph nodes in the axilla: is it feasible? In: Golland P, Hata N, Barillot C, Hornegger J, Howe R (eds) Medical image computing and computer-assisted intervention–MICCAI 2014. Lecture notes in computer science, vol 8673. Springer, Heidelberg, pp 577–584 Okur A, Hennersperger C, Runyan B, Gardiazabal J, Keicher M, Paepke S, Wendler T, Navab N (2014) fhSPECT-US guided needle biopsy of sentinel lymph nodes in the axilla: is it feasible? In: Golland P, Hata N, Barillot C, Hornegger J, Howe R (eds) Medical image computing and computer-assisted intervention–MICCAI 2014. Lecture notes in computer science, vol 8673. Springer, Heidelberg, pp 577–584
20.
Zurück zum Zitat Padoy N, Hager G (2011) Human-machine collaborative surgery using learned models. In: 2011 IEEE international conference on robotics and automation (ICRA), pp 5285–5292 Padoy N, Hager G (2011) Human-machine collaborative surgery using learned models. In: 2011 IEEE international conference on robotics and automation (ICRA), pp 5285–5292
21.
Zurück zum Zitat Quigley M, Conley K, Gerkey B, Faust J, Foote T, Leibs J, Wheeler R, Ng AY (2009) ROS: an open-source robot operating system. In: ICRA workshop on open source software, vol 3, pp 5 Quigley M, Conley K, Gerkey B, Faust J, Foote T, Leibs J, Wheeler R, Ng AY (2009) ROS: an open-source robot operating system. In: ICRA workshop on open source software, vol 3, pp 5
22.
Zurück zum Zitat Rivas-Blanco I, Estebanez B, Cuevas-Rodriguez M, Bauzano E, Munoz V (2014) Towards a cognitive camera robotic assistant. In: 5th IEEE international conference on biomedical robotics and biomechatronics, pp 739–744 Rivas-Blanco I, Estebanez B, Cuevas-Rodriguez M, Bauzano E, Munoz V (2014) Towards a cognitive camera robotic assistant. In: 5th IEEE international conference on biomedical robotics and biomechatronics, pp 739–744
23.
Zurück zum Zitat Senkus E, Kyriakides S, Ohno S, Penault-Llorca F, Poortmans P, Rutgers E, Zackrisson S, Cardoso F (2015) Primary breast cancer: ESMO Clinical Practice Guidelines for diagnosis, treatment and follow-up. Ann Oncol 26(suppl 5):v8–v30CrossRefPubMed Senkus E, Kyriakides S, Ohno S, Penault-Llorca F, Poortmans P, Rutgers E, Zackrisson S, Cardoso F (2015) Primary breast cancer: ESMO Clinical Practice Guidelines for diagnosis, treatment and follow-up. Ann Oncol 26(suppl 5):v8–v30CrossRefPubMed
24.
25.
Zurück zum Zitat Slagelse C, Petersen KL, Dahl JB, Finnerup K, Greene K, Leong SP, Levine J, Rowbotham M, Werner MU, Finnerup NB (2014) Persistent postoperative pain and sensory changes following lymph node excision in melanoma patients: a topical review. Melanoma Res 24(2):93–98CrossRefPubMed Slagelse C, Petersen KL, Dahl JB, Finnerup K, Greene K, Leong SP, Levine J, Rowbotham M, Werner MU, Finnerup NB (2014) Persistent postoperative pain and sensory changes following lymph node excision in melanoma patients: a topical review. Melanoma Res 24(2):93–98CrossRefPubMed
26.
Zurück zum Zitat Swenson KK, Nissen MJ, Ceronsky C, Swenson L, Lee MW, Tuttle TM (2002) Comparison of side effects between sentinel lymph node and axillary lymph node dissection for breast cancer. Ann Surg Oncol 9(8):745–753CrossRefPubMed Swenson KK, Nissen MJ, Ceronsky C, Swenson L, Lee MW, Tuttle TM (2002) Comparison of side effects between sentinel lymph node and axillary lymph node dissection for breast cancer. Ann Surg Oncol 9(8):745–753CrossRefPubMed
27.
Zurück zum Zitat Taylor RH (2006) A perspective on medical robotics. Proc IEEE 94(9):1652–1664CrossRef Taylor RH (2006) A perspective on medical robotics. Proc IEEE 94(9):1652–1664CrossRef
28.
Zurück zum Zitat Tokuda J, Fischer GS, Papademetris X, Yaniv Z, Ibanez L, Cheng P, Liu H, Blevins J, Arata J, Golby AJ, Kapur T, Pieper S, Burdette EC, Fichtinger G, Tempany CM, Hata N (2009) OpenIGTLink: an open network protocol for image-guided therapy environment. Int J Med Robot 5(4):423–434 Tokuda J, Fischer GS, Papademetris X, Yaniv Z, Ibanez L, Cheng P, Liu H, Blevins J, Arata J, Golby AJ, Kapur T, Pieper S, Burdette EC, Fichtinger G, Tempany CM, Hata N (2009) OpenIGTLink: an open network protocol for image-guided therapy environment. Int J Med Robot 5(4):423–434
29.
Zurück zum Zitat Tsai R, Lenz R (1989) A new technique for fully autonomous and efficient 3D robotics hand/eye calibration. IEEE Trans Robot Autom 5(3):345–358CrossRef Tsai R, Lenz R (1989) A new technique for fully autonomous and efficient 3D robotics hand/eye calibration. IEEE Trans Robot Autom 5(3):345–358CrossRef
32.
Zurück zum Zitat Wendler T, Feuerstein M, Traub J, Lasser T, Vogel J, Daghighian F, Ziegler S, Navab N (2007) Real-time fusion of ultrasound and gamma probe for navigated localization of liver metastases. In: Ayache N, Ourselin S, Maeder A (eds) Medical image computing and computer-assisted intervention MICCAI 2007, Lecture Notes in Computer Science, vol 4792. Springer, Berlin, pp 252–260 Wendler T, Feuerstein M, Traub J, Lasser T, Vogel J, Daghighian F, Ziegler S, Navab N (2007) Real-time fusion of ultrasound and gamma probe for navigated localization of liver metastases. In: Ayache N, Ourselin S, Maeder A (eds) Medical image computing and computer-assisted intervention MICCAI 2007, Lecture Notes in Computer Science, vol 4792. Springer, Berlin, pp 252–260
33.
Zurück zum Zitat Wendler T, Herrmann K, Schnelzer A, Lasser T, Traub J, Kutter O, Ehlerding A, Scheidhauer K, Schuster T, Kiechle M, Schwaiger M, Navab N, Ziegler SI, Buck AK (2010) First demonstration of 3-D lymphatic mapping in breast cancer using freehand SPECT. Eur J Nucl Med 37(8):1452–1461CrossRef Wendler T, Herrmann K, Schnelzer A, Lasser T, Traub J, Kutter O, Ehlerding A, Scheidhauer K, Schuster T, Kiechle M, Schwaiger M, Navab N, Ziegler SI, Buck AK (2010) First demonstration of 3-D lymphatic mapping in breast cancer using freehand SPECT. Eur J Nucl Med 37(8):1452–1461CrossRef
34.
Zurück zum Zitat Wilke LG, McCall LM, Posther KE, Whitworth PW, Reintgen DS, Leitch AM, Gabram SGA, Lucci A, Cox CE, Hunt KK, Herndon JE, Giuliano AE (2006) Surgical complications associated with sentinel lymph node biopsy: results from a prospective international cooperative group trial. Ann Surg Oncol 13(4):491–500. doi:10.1245/ASO.2006.05.013 CrossRefPubMed Wilke LG, McCall LM, Posther KE, Whitworth PW, Reintgen DS, Leitch AM, Gabram SGA, Lucci A, Cox CE, Hunt KK, Herndon JE, Giuliano AE (2006) Surgical complications associated with sentinel lymph node biopsy: results from a prospective international cooperative group trial. Ann Surg Oncol 13(4):491–500. doi:10.​1245/​ASO.​2006.​05.​013 CrossRefPubMed
35.
Zurück zum Zitat Zhang Z (2000) A flexible new technique for camera calibration. IEEE Trans Pattern Anal Mach Intell 22(11):1330–1334CrossRef Zhang Z (2000) A flexible new technique for camera calibration. IEEE Trans Pattern Anal Mach Intell 22(11):1330–1334CrossRef
Metadaten
Titel
Multimodal US–gamma imaging using collaborative robotics for cancer staging biopsies
verfasst von
Marco Esposito
Benjamin Busam
Christoph Hennersperger
Julia Rackerseder
Nassir Navab
Benjamin Frisch
Publikationsdatum
01.09.2016
Verlag
Springer Berlin Heidelberg
Erschienen in
International Journal of Computer Assisted Radiology and Surgery / Ausgabe 9/2016
Print ISSN: 1861-6410
Elektronische ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-016-1464-6

Weitere Artikel der Ausgabe 9/2016

International Journal of Computer Assisted Radiology and Surgery 9/2016 Zur Ausgabe

Endlich: Zi zeigt, mit welchen PVS Praxen zufrieden sind

IT für Ärzte Nachrichten

Darauf haben viele Praxen gewartet: Das Zi hat eine Liste von Praxisverwaltungssystemen veröffentlicht, die von Nutzern positiv bewertet werden. Eine gute Grundlage für wechselwillige Ärzte und Psychotherapeuten.

Akuter Schwindel: Wann lohnt sich eine MRT?

28.04.2024 Schwindel Nachrichten

Akuter Schwindel stellt oft eine diagnostische Herausforderung dar. Wie nützlich dabei eine MRT ist, hat eine Studie aus Finnland untersucht. Immerhin einer von sechs Patienten wurde mit akutem ischämischem Schlaganfall diagnostiziert.

Screening-Mammografie offenbart erhöhtes Herz-Kreislauf-Risiko

26.04.2024 Mammografie Nachrichten

Routinemäßige Mammografien helfen, Brustkrebs frühzeitig zu erkennen. Anhand der Röntgenuntersuchung lassen sich aber auch kardiovaskuläre Risikopatientinnen identifizieren. Als zuverlässiger Anhaltspunkt gilt die Verkalkung der Brustarterien.

S3-Leitlinie zu Pankreaskrebs aktualisiert

23.04.2024 Pankreaskarzinom Nachrichten

Die Empfehlungen zur Therapie des Pankreaskarzinoms wurden um zwei Off-Label-Anwendungen erweitert. Und auch im Bereich der Früherkennung gibt es Aktualisierungen.

Update Radiologie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.