Skip to main content
Erschienen in: Surgical Endoscopy 2/2014

01.02.2014

Construct validity of nine new inanimate exercises for robotic surgeon training using a standardized setup

verfasst von: Anthony M. Jarc, Myriam Curet

Erschienen in: Surgical Endoscopy | Ausgabe 2/2014

Einloggen, um Zugang zu erhalten

Abstract

Background

As more surgeons choose to complete procedures robotically, validated training tools are needed so that they can acquire and maintain the technical skills required to proficiently use robotic systems. The purpose of this study was to show construct validity of nine new inanimate training exercises for robot-assisted surgery. The inanimate training exercises were designed to span several core technical skills required to use a robotic system.

Methods

New (n = 30) and experienced (n = 11) robotic surgeons participated in the study. New robotic surgeons had not yet completed their first robotic surgery case and participated in this study before attending their robotic certification course. Experienced robotic surgeons had completed more than 200 robotic surgery cases. The raw scores from the exercises were reported so that other research groups could easily define custom proficiency levels. Example normalized scores that could be used in proficiency-based curricula were computed. These normalized scores balanced efficiency (completion time) and accuracy (exercise-specific errors) to measure performance. Finally, the setup was standardized using a custom docking model, which enabled consistent and repeatable completion of the inanimate exercises across surgeons.

Results

For all nine exercises, experienced robotic surgeons completed the exercises significantly faster than new robotic surgeons (p < 0.01). Similarly, experienced robotic surgeons achieved higher normalized scores than new robotic surgeons for all nine exercises (p < 0.01). Finally, consistent robot setup was achieved using the custom docking model based on an analysis of the robot kinematic data.

Conclusions

In summary, all nine inanimate exercises showed construct validity. The results suggest that the inanimate exercises along with the custom docking model can be used as part of proficiency-based curricula to improve robotic surgeon training.
Anhänge
Nur mit Berechtigung zugänglich
Literatur
2.
Zurück zum Zitat Finnegan KT, Meraney AM, Staff I, Shichman SJ (2012) da Vinci skills simulator construct validation study: correlation of prior robotic experience with overall score and time score simulator performance. Urology 80(2):330–335 Finnegan KT, Meraney AM, Staff I, Shichman SJ (2012) da Vinci skills simulator construct validation study: correlation of prior robotic experience with overall score and time score simulator performance. Urology 80(2):330–335
3.
Zurück zum Zitat Hung AJ, Jayaratna IS, Teruya K, Desai MM, Gill IS, Goh AC (2013) Comparative assessment of three standardized robotic surgery training methods. BJU Int 112(6):864–871PubMedCrossRef Hung AJ, Jayaratna IS, Teruya K, Desai MM, Gill IS, Goh AC (2013) Comparative assessment of three standardized robotic surgery training methods. BJU Int 112(6):864–871PubMedCrossRef
4.
Zurück zum Zitat Hung AJ, Zehnder P, Patil MB, Cai J, Ng CK, Aron M, Gill IS, Desai MM (2011) Face, content and construct validity of a novel robotic surgery simulator. J Urol 186(3):1019–1024PubMedCrossRef Hung AJ, Zehnder P, Patil MB, Cai J, Ng CK, Aron M, Gill IS, Desai MM (2011) Face, content and construct validity of a novel robotic surgery simulator. J Urol 186(3):1019–1024PubMedCrossRef
5.
Zurück zum Zitat Seixas-Mikelus SA, Stegemann AP, Kesavadas T, Srimathveeravalli G, Sathyaseelan G, Chandrasekhar R, Wilding GE, Peabody JO, Guru KA (2011) Content validation of a novel robotic surgical simulator. BJU Int 107(7):1130–1135PubMedCrossRef Seixas-Mikelus SA, Stegemann AP, Kesavadas T, Srimathveeravalli G, Sathyaseelan G, Chandrasekhar R, Wilding GE, Peabody JO, Guru KA (2011) Content validation of a novel robotic surgical simulator. BJU Int 107(7):1130–1135PubMedCrossRef
7.
Zurück zum Zitat Derossis AM, Fried GM, Abrahamowicz M, Sigman HH, Barkun JS, Meakins JL (1998) Development of a model for training and evaluation of laparoscopic skills. Am J Surg 175(6):482–487PubMedCrossRef Derossis AM, Fried GM, Abrahamowicz M, Sigman HH, Barkun JS, Meakins JL (1998) Development of a model for training and evaluation of laparoscopic skills. Am J Surg 175(6):482–487PubMedCrossRef
8.
Zurück zum Zitat Goova MT, Hollett LA, Tesfay ST, Gala RB, Puzziferri N, Kehdy FJ, Scott DJ (2008) Implementation, construct validity, and benefit of a proficiency-based knot-tying and suturing curriculum. J Surg Educ 65(4):309–315PubMedCrossRef Goova MT, Hollett LA, Tesfay ST, Gala RB, Puzziferri N, Kehdy FJ, Scott DJ (2008) Implementation, construct validity, and benefit of a proficiency-based knot-tying and suturing curriculum. J Surg Educ 65(4):309–315PubMedCrossRef
9.
Zurück zum Zitat Satava R, Smith R, Patel V (2012) Fundamentals of robotic surgery: outcomes measures and curriculum development. In: SLS, Boston, MA Satava R, Smith R, Patel V (2012) Fundamentals of robotic surgery: outcomes measures and curriculum development. In: SLS, Boston, MA
10.
Zurück zum Zitat Smith R, Chauhan S, Satava R (2013) Fundamentals of robotic surgery: outcomes measures and curriculum development. In: NextMed/MMVR 20, San Diego, CA Smith R, Chauhan S, Satava R (2013) Fundamentals of robotic surgery: outcomes measures and curriculum development. In: NextMed/MMVR 20, San Diego, CA
11.
Zurück zum Zitat Sroka G, Feldman LS, Vassiliou MC, Kaneva PA, Fayez R, Fried GM (2010) Fundamentals of laparoscopic surgery simulator training to proficiency improves laparoscopic performance in the operating room—a randomized controlled trial. Am J Surg 199(1):115–120PubMedCrossRef Sroka G, Feldman LS, Vassiliou MC, Kaneva PA, Fayez R, Fried GM (2010) Fundamentals of laparoscopic surgery simulator training to proficiency improves laparoscopic performance in the operating room—a randomized controlled trial. Am J Surg 199(1):115–120PubMedCrossRef
12.
Zurück zum Zitat Lee JY, Mucksavage P, Sundaram CP, McDougall EM (2011) Best practices for robotic surgery training and credentialing. J Urol 185(4):1191–1197PubMedCrossRef Lee JY, Mucksavage P, Sundaram CP, McDougall EM (2011) Best practices for robotic surgery training and credentialing. J Urol 185(4):1191–1197PubMedCrossRef
13.
Zurück zum Zitat Lyons C, Goldfarb D, Jones SL, Badhiwala N, Miles B, Link R, Dunkin BJ (2013) Which skills really matter? Proving face, content, and construct validity for a commercial robotic simulator. Surg Endosc 27(6):2020–2030PubMedCrossRef Lyons C, Goldfarb D, Jones SL, Badhiwala N, Miles B, Link R, Dunkin BJ (2013) Which skills really matter? Proving face, content, and construct validity for a commercial robotic simulator. Surg Endosc 27(6):2020–2030PubMedCrossRef
14.
Zurück zum Zitat Dulan G, Rege RV, Hogg DC, Gilberg-Fisher KM, Arain NA, Tesfay ST, Scott DJ (2012) Proficiency-based training for robotic surgery: construct validity, workload, and expert levels for nine inanimate exercises. Surg Endosc 26(6):1516–1521PubMedCrossRef Dulan G, Rege RV, Hogg DC, Gilberg-Fisher KM, Arain NA, Tesfay ST, Scott DJ (2012) Proficiency-based training for robotic surgery: construct validity, workload, and expert levels for nine inanimate exercises. Surg Endosc 26(6):1516–1521PubMedCrossRef
15.
Zurück zum Zitat Gallagher A, Ritter E, Satava R (2003) Fundamental principles of validation, and reliability: rigorous science for the assessment of surgical education and training. Surg Endosc 17(10):1525–1529PubMedCrossRef Gallagher A, Ritter E, Satava R (2003) Fundamental principles of validation, and reliability: rigorous science for the assessment of surgical education and training. Surg Endosc 17(10):1525–1529PubMedCrossRef
16.
17.
Zurück zum Zitat Van Nortwick SS, Lendvay TS, Jensen AR, Wright AS, Horvath KD, Kim S (2010) Methodologies for establishing validity in surgical simulation studies. Surgery 147(5):622–630PubMedCrossRef Van Nortwick SS, Lendvay TS, Jensen AR, Wright AS, Horvath KD, Kim S (2010) Methodologies for establishing validity in surgical simulation studies. Surgery 147(5):622–630PubMedCrossRef
18.
Zurück zum Zitat Goh AC, Goldfarb DW, Sander JC, Miles BJ, Dunkin BJ (2012) Global evaluative assessment of robotic skills: validation of a clinical assessment tool to measure robotic surgical skills. J Urol 187(1):247–252PubMedCrossRef Goh AC, Goldfarb DW, Sander JC, Miles BJ, Dunkin BJ (2012) Global evaluative assessment of robotic skills: validation of a clinical assessment tool to measure robotic surgical skills. J Urol 187(1):247–252PubMedCrossRef
19.
Zurück zum Zitat Martin JA, Regehr G, Reznick R, MacRae H, Murnaghan J, Hutchison C, Brown M (1997) Objective structured assessment of technical skill (OSATS) for surgical residents. Br J Surg 84(2):273–278PubMedCrossRef Martin JA, Regehr G, Reznick R, MacRae H, Murnaghan J, Hutchison C, Brown M (1997) Objective structured assessment of technical skill (OSATS) for surgical residents. Br J Surg 84(2):273–278PubMedCrossRef
20.
Zurück zum Zitat Rosen J, Brown JD, Chang L, Barreca M, Sinanan M, Hannaford B (2002) The BlueDRAGON—a system for measuring the kinematics and dynamics of minimally invasive surgical tools in-vivo. In: Proceedings of the ICRA’02 IEEE international conference on robotics and automation Rosen J, Brown JD, Chang L, Barreca M, Sinanan M, Hannaford B (2002) The BlueDRAGON—a system for measuring the kinematics and dynamics of minimally invasive surgical tools in-vivo. In: Proceedings of the ICRA’02 IEEE international conference on robotics and automation
21.
Zurück zum Zitat Gallagher AG, Ritter EM, Champion H, Higgins G, Fried MP, Moses G, Smith CD, Satava RM (2005) Virtual reality simulation for the operating room: proficiency-based training as a paradigm shift in surgical skills training. Ann Surg 241(2):364–372PubMedCentralPubMedCrossRef Gallagher AG, Ritter EM, Champion H, Higgins G, Fried MP, Moses G, Smith CD, Satava RM (2005) Virtual reality simulation for the operating room: proficiency-based training as a paradigm shift in surgical skills training. Ann Surg 241(2):364–372PubMedCentralPubMedCrossRef
22.
Zurück zum Zitat Dulan G, Rege RV, Hogg DC, Gilberg-Fisher KM, Arain NA, Tesfay ST, Scott DJ (2012) Developing a comprehensive, proficiency-based training program for robotic surgery. Surgery 152(3):477–488PubMedCrossRef Dulan G, Rege RV, Hogg DC, Gilberg-Fisher KM, Arain NA, Tesfay ST, Scott DJ (2012) Developing a comprehensive, proficiency-based training program for robotic surgery. Surgery 152(3):477–488PubMedCrossRef
23.
Zurück zum Zitat Ahmidi N, Hager GD, Ishii L, Fichtinger G, Gallia GL, Ishii M (2010) Surgical task and skill classification from eye tracking and tool motion in minimally invasive surgery. Med Image Comput Comput Assist Interv 13(Pt 3):295–302PubMed Ahmidi N, Hager GD, Ishii L, Fichtinger G, Gallia GL, Ishii M (2010) Surgical task and skill classification from eye tracking and tool motion in minimally invasive surgery. Med Image Comput Comput Assist Interv 13(Pt 3):295–302PubMed
24.
Zurück zum Zitat Tausch TJ, Kowalewski TM, White LW, McDonough PS, Brand TC, Lendvay TS (2012) Content and construct validation of a robotic surgery curriculum using an electromagnetic instrument tracker. J Urol 188(3):919–923PubMedCrossRef Tausch TJ, Kowalewski TM, White LW, McDonough PS, Brand TC, Lendvay TS (2012) Content and construct validation of a robotic surgery curriculum using an electromagnetic instrument tracker. J Urol 188(3):919–923PubMedCrossRef
Metadaten
Titel
Construct validity of nine new inanimate exercises for robotic surgeon training using a standardized setup
verfasst von
Anthony M. Jarc
Myriam Curet
Publikationsdatum
01.02.2014
Verlag
Springer US
Erschienen in
Surgical Endoscopy / Ausgabe 2/2014
Print ISSN: 0930-2794
Elektronische ISSN: 1432-2218
DOI
https://doi.org/10.1007/s00464-013-3224-9

Weitere Artikel der Ausgabe 2/2014

Surgical Endoscopy 2/2014 Zur Ausgabe

Mehr Frauen im OP – weniger postoperative Komplikationen

21.05.2024 Allgemeine Chirurgie Nachrichten

Ein Frauenanteil von mindestens einem Drittel im ärztlichen Op.-Team war in einer großen retrospektiven Studie aus Kanada mit einer signifikanten Reduktion der postoperativen Morbidität assoziiert.

„Übersichtlicher Wegweiser“: Lauterbachs umstrittener Klinik-Atlas ist online

17.05.2024 Klinik aktuell Nachrichten

Sie sei „ethisch geboten“, meint Gesundheitsminister Karl Lauterbach: mehr Transparenz über die Qualität von Klinikbehandlungen. Um sie abzubilden, lässt er gegen den Widerstand vieler Länder einen virtuellen Klinik-Atlas freischalten.

Was nützt die Kraniektomie bei schwerer tiefer Hirnblutung?

17.05.2024 Hirnblutung Nachrichten

Eine Studie zum Nutzen der druckentlastenden Kraniektomie nach schwerer tiefer supratentorieller Hirnblutung deutet einen Nutzen der Operation an. Für überlebende Patienten ist das dennoch nur eine bedingt gute Nachricht.

Klinikreform soll zehntausende Menschenleben retten

15.05.2024 Klinik aktuell Nachrichten

Gesundheitsminister Lauterbach hat die vom Bundeskabinett beschlossene Klinikreform verteidigt. Kritik an den Plänen kommt vom Marburger Bund. Und in den Ländern wird über den Gang zum Vermittlungsausschuss spekuliert.

Update Chirurgie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.

S3-Leitlinie „Diagnostik und Therapie des Karpaltunnelsyndroms“

Karpaltunnelsyndrom BDC Leitlinien Webinare
CME: 2 Punkte

Das Karpaltunnelsyndrom ist die häufigste Kompressionsneuropathie peripherer Nerven. Obwohl die Anamnese mit dem nächtlichen Einschlafen der Hand (Brachialgia parästhetica nocturna) sehr typisch ist, ist eine klinisch-neurologische Untersuchung und Elektroneurografie in manchen Fällen auch eine Neurosonografie erforderlich. Im Anfangsstadium sind konservative Maßnahmen (Handgelenksschiene, Ergotherapie) empfehlenswert. Bei nicht Ansprechen der konservativen Therapie oder Auftreten von neurologischen Ausfällen ist eine Dekompression des N. medianus am Karpaltunnel indiziert.

Prof. Dr. med. Gregor Antoniadis
Berufsverband der Deutschen Chirurgie e.V.

S2e-Leitlinie „Distale Radiusfraktur“

Radiusfraktur BDC Leitlinien Webinare
CME: 2 Punkte

Das Webinar beschäftigt sich mit Fragen und Antworten zu Diagnostik und Klassifikation sowie Möglichkeiten des Ausschlusses von Zusatzverletzungen. Die Referenten erläutern, welche Frakturen konservativ behandelt werden können und wie. Das Webinar beantwortet die Frage nach aktuellen operativen Therapiekonzepten: Welcher Zugang, welches Osteosynthesematerial? Auf was muss bei der Nachbehandlung der distalen Radiusfraktur geachtet werden?

PD Dr. med. Oliver Pieske
Dr. med. Benjamin Meyknecht
Berufsverband der Deutschen Chirurgie e.V.

S1-Leitlinie „Empfehlungen zur Therapie der akuten Appendizitis bei Erwachsenen“

Appendizitis BDC Leitlinien Webinare
CME: 2 Punkte

Inhalte des Webinars zur S1-Leitlinie „Empfehlungen zur Therapie der akuten Appendizitis bei Erwachsenen“ sind die Darstellung des Projektes und des Erstellungswegs zur S1-Leitlinie, die Erläuterung der klinischen Relevanz der Klassifikation EAES 2015, die wissenschaftliche Begründung der wichtigsten Empfehlungen und die Darstellung stadiengerechter Therapieoptionen.

Dr. med. Mihailo Andric
Berufsverband der Deutschen Chirurgie e.V.