Skip to main content
Erschienen in: Surgical Endoscopy 6/2012

01.06.2012

Proficiency-based training for robotic surgery: construct validity, workload, and expert levels for nine inanimate exercises

verfasst von: Genevieve Dulan, Robert V. Rege, Deborah C. Hogg, Kristine M. Gilberg-Fisher, Nabeel A. Arain, Seifu T. Tesfay, Daniel J. Scott

Erschienen in: Surgical Endoscopy | Ausgabe 6/2012

Einloggen, um Zugang zu erhalten

Abstract

Background

We previously developed nine inanimate training exercises as part of a comprehensive, proficiency-based robotic training curriculum that addressed 23 unique skills identified via task deconstruction of robotic operations. The purpose of this study was to evaluate construct validity, workload, and expert levels for the nine exercises.

Methods

Expert robotic surgeons (n = 8, fellows and faculty) and novice trainees (n = 4, medical students) each performed three to five consecutive repetitions of nine previously reported exercises (five FLS models with or without modifications and four custom-made models). Each task was scored for time and accuracy using modified FLS metrics; task scores were normalized to a previously established (preliminary) proficiency level and a composite score equaled the sum of the nine normalized task scores. Questionnaires were administered regarding prior experience. After each exercise, participants completed a validated NASA-TLX Workload Scale to rate the mental, physical, temporal, performance, effort, and frustration levels of each task.

Results

Experts had performed 119 (range = 15–600) robotic operations; novices had observed ≤1 robotic operation. For all nine tasks and the composite score, experts achieved significantly better performance than novices (932 ± 67 vs. 618 ± 111, respectively; P < 0.001). No significant differences in workload between experts and novices were detected (32.9 ± 3.5 vs. 32.0 ± 9.1, respectively; n.s.). Importantly, frustration ratings were relatively low for both groups (4.0 ± 0.7 vs. 3.8 ± 1.6, n.s.). The mean performance of the eight experts was deemed suitable as a revised proficiency level for each task.

Conclusion

Using objective performance metrics, all nine exercises demonstrated construct validity. Workload was similar between experts and novices and frustration was low for both groups. These data suggest that the nine structured exercises are suitable for proficiency-based robotic training.
Literatur
1.
Zurück zum Zitat Sroka G, Feldman LS, Vassiliou MC, Kaneva PA, Favez R, Fried GM (2010) Fundamentals of laparoscopic surgery simulator training to proficiency improves laparoscopic performance in the operating room—a randomized controlled trial. Am J Surg 199:115–120PubMedCrossRef Sroka G, Feldman LS, Vassiliou MC, Kaneva PA, Favez R, Fried GM (2010) Fundamentals of laparoscopic surgery simulator training to proficiency improves laparoscopic performance in the operating room—a randomized controlled trial. Am J Surg 199:115–120PubMedCrossRef
2.
Zurück zum Zitat McCluney AL, Vassiliou MC, Kaneva PA, Cao J, Stanbridge DD, Feldman LS, Fried GM (2007) FLS simulator performance predicts intraoperative laparoscopic skill. Surg Endosc 21:1991–1995PubMedCrossRef McCluney AL, Vassiliou MC, Kaneva PA, Cao J, Stanbridge DD, Feldman LS, Fried GM (2007) FLS simulator performance predicts intraoperative laparoscopic skill. Surg Endosc 21:1991–1995PubMedCrossRef
4.
Zurück zum Zitat Gallagher AG, Ritter EM, Satava RM (2003) Fundamental principles of validation, and reliability: rigorous science for the assessment of surgical education and training. Surg Endosc 17:1525–1529PubMedCrossRef Gallagher AG, Ritter EM, Satava RM (2003) Fundamental principles of validation, and reliability: rigorous science for the assessment of surgical education and training. Surg Endosc 17:1525–1529PubMedCrossRef
5.
Zurück zum Zitat Hart SG, Staveland LE (1988) Development of a multi-dimensional workload rating scale. In: Human mental workload. Amsterdam, Elsevier Hart SG, Staveland LE (1988) Development of a multi-dimensional workload rating scale. In: Human mental workload. Amsterdam, Elsevier
6.
Zurück zum Zitat Ritter EM, Scott DJ (2007) Design of a proficiency-based skills training curriculum for the fundamentals of laparoscopic surgery. Surg Innov 14:107–112PubMedCrossRef Ritter EM, Scott DJ (2007) Design of a proficiency-based skills training curriculum for the fundamentals of laparoscopic surgery. Surg Innov 14:107–112PubMedCrossRef
7.
Zurück zum Zitat Scott DJ (2006) Proficiency-based training for surgical skills. Semin Colon Rectal Surg 19:72–80CrossRef Scott DJ (2006) Proficiency-based training for surgical skills. Semin Colon Rectal Surg 19:72–80CrossRef
8.
Zurück zum Zitat Goova MT, Hollett LA, Tesfay ST, Gala RB, Puzziferri N, Kehdy FJ, Scott DJ (2008) Implementation, construct validity and benefit of a proficiency based knot-tying and suturing curriculum. J Surg Educ 65:309–315PubMedCrossRef Goova MT, Hollett LA, Tesfay ST, Gala RB, Puzziferri N, Kehdy FJ, Scott DJ (2008) Implementation, construct validity and benefit of a proficiency based knot-tying and suturing curriculum. J Surg Educ 65:309–315PubMedCrossRef
9.
Zurück zum Zitat Mashaud LB, Castellvi AO, Hollett LA, Hogg DC, Tesfay ST, Scott DJ (2010) Two-year skill retention and certification exam performance after fundamentals of laparoscopic skills training and proficiency maintenance. Surgery 2:194–201CrossRef Mashaud LB, Castellvi AO, Hollett LA, Hogg DC, Tesfay ST, Scott DJ (2010) Two-year skill retention and certification exam performance after fundamentals of laparoscopic skills training and proficiency maintenance. Surgery 2:194–201CrossRef
10.
Zurück zum Zitat Stefanidis D, Korndorffer JR, Black FW, Dunne JB, Sierra R, Touchard CL, Rice DA, Markert RJ, Kastl PR, Scott DJ (2006) Psychomotor testing predicts rate of skill acquisition for proficiency-based laparoscopic skills training. Surgery 140:252–262PubMedCrossRef Stefanidis D, Korndorffer JR, Black FW, Dunne JB, Sierra R, Touchard CL, Rice DA, Markert RJ, Kastl PR, Scott DJ (2006) Psychomotor testing predicts rate of skill acquisition for proficiency-based laparoscopic skills training. Surgery 140:252–262PubMedCrossRef
11.
Zurück zum Zitat Fried GM, Feldman LS, Vassiliou MC, Fraser SA, Stanbridge D, Ghitulescu G, Andrew CG (2004) Proving the value of simulation in laparoscopic surgery. Ann Surg 240:518–525PubMedCrossRef Fried GM, Feldman LS, Vassiliou MC, Fraser SA, Stanbridge D, Ghitulescu G, Andrew CG (2004) Proving the value of simulation in laparoscopic surgery. Ann Surg 240:518–525PubMedCrossRef
12.
Zurück zum Zitat Stefanidis D, Wang F, Korndorffer JR Jr, Dunne JB, Scott DJ (2010) Robotic assistance improves intracorporeal suturing performance and safety in the operating room while decreasing operator workload. Surg Endosc 24:377–382PubMedCrossRef Stefanidis D, Wang F, Korndorffer JR Jr, Dunne JB, Scott DJ (2010) Robotic assistance improves intracorporeal suturing performance and safety in the operating room while decreasing operator workload. Surg Endosc 24:377–382PubMedCrossRef
13.
Zurück zum Zitat Stefanidis D, Hope WW, Scott DJ (2011) Robotic suturing on the FLS model possesses construct validity, is less physically demanding, and is favored by more surgeons compared with laparoscopy. Surg Endosc 25(7):2141–2146PubMedCrossRef Stefanidis D, Hope WW, Scott DJ (2011) Robotic suturing on the FLS model possesses construct validity, is less physically demanding, and is favored by more surgeons compared with laparoscopy. Surg Endosc 25(7):2141–2146PubMedCrossRef
14.
Zurück zum Zitat Korndorffer JR Jr, Clayton JL, Tesfay ST, Brunner WC, Sierra R, Dunne JB, Jones DB, Rege RV, Touchard CL, Scott DJ (2005) Multicenter construct validity for Southwestern laparoscopic videotrainer stations. J Surg Res 128:114–119PubMedCrossRef Korndorffer JR Jr, Clayton JL, Tesfay ST, Brunner WC, Sierra R, Dunne JB, Jones DB, Rege RV, Touchard CL, Scott DJ (2005) Multicenter construct validity for Southwestern laparoscopic videotrainer stations. J Surg Res 128:114–119PubMedCrossRef
15.
Zurück zum Zitat Hamilton EC, Scott DJ, Fleming JB, Rege RV, Laycock R, Bergen PC, Tesfay ST, Jones DB (2002) Comparison of video trainer and virtual reality training systems on acquisition of laparoscopic skills. Surg Endosc 16:406–411PubMedCrossRef Hamilton EC, Scott DJ, Fleming JB, Rege RV, Laycock R, Bergen PC, Tesfay ST, Jones DB (2002) Comparison of video trainer and virtual reality training systems on acquisition of laparoscopic skills. Surg Endosc 16:406–411PubMedCrossRef
16.
Zurück zum Zitat Seixas-Mikelus SA, Stegemann AP, Kesavadas T (2011) Content validation of a novel robotic surgical simulator. BJU Int 107:1130–1135PubMedCrossRef Seixas-Mikelus SA, Stegemann AP, Kesavadas T (2011) Content validation of a novel robotic surgical simulator. BJU Int 107:1130–1135PubMedCrossRef
Metadaten
Titel
Proficiency-based training for robotic surgery: construct validity, workload, and expert levels for nine inanimate exercises
verfasst von
Genevieve Dulan
Robert V. Rege
Deborah C. Hogg
Kristine M. Gilberg-Fisher
Nabeel A. Arain
Seifu T. Tesfay
Daniel J. Scott
Publikationsdatum
01.06.2012
Verlag
Springer-Verlag
Erschienen in
Surgical Endoscopy / Ausgabe 6/2012
Print ISSN: 0930-2794
Elektronische ISSN: 1432-2218
DOI
https://doi.org/10.1007/s00464-011-2102-6

Weitere Artikel der Ausgabe 6/2012

Surgical Endoscopy 6/2012 Zur Ausgabe

Update Chirurgie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.

S3-Leitlinie „Diagnostik und Therapie des Karpaltunnelsyndroms“

CME: 2 Punkte

Prof. Dr. med. Gregor Antoniadis Das Karpaltunnelsyndrom ist die häufigste Kompressionsneuropathie peripherer Nerven. Obwohl die Anamnese mit dem nächtlichen Einschlafen der Hand (Brachialgia parästhetica nocturna) sehr typisch ist, ist eine klinisch-neurologische Untersuchung und Elektroneurografie in manchen Fällen auch eine Neurosonografie erforderlich. Im Anfangsstadium sind konservative Maßnahmen (Handgelenksschiene, Ergotherapie) empfehlenswert. Bei nicht Ansprechen der konservativen Therapie oder Auftreten von neurologischen Ausfällen ist eine Dekompression des N. medianus am Karpaltunnel indiziert.

Prof. Dr. med. Gregor Antoniadis
Berufsverband der Deutschen Chirurgie e.V.

S2e-Leitlinie „Distale Radiusfraktur“

CME: 2 Punkte

Dr. med. Benjamin Meyknecht, PD Dr. med. Oliver Pieske Das Webinar S2e-Leitlinie „Distale Radiusfraktur“ beschäftigt sich mit Fragen und Antworten zu Diagnostik und Klassifikation sowie Möglichkeiten des Ausschlusses von Zusatzverletzungen. Die Referenten erläutern, welche Frakturen konservativ behandelt werden können und wie. Das Webinar beantwortet die Frage nach aktuellen operativen Therapiekonzepten: Welcher Zugang, welches Osteosynthesematerial? Auf was muss bei der Nachbehandlung der distalen Radiusfraktur geachtet werden?

PD Dr. med. Oliver Pieske
Dr. med. Benjamin Meyknecht
Berufsverband der Deutschen Chirurgie e.V.

S1-Leitlinie „Empfehlungen zur Therapie der akuten Appendizitis bei Erwachsenen“

CME: 2 Punkte

Dr. med. Mihailo Andric
Inhalte des Webinars zur S1-Leitlinie „Empfehlungen zur Therapie der akuten Appendizitis bei Erwachsenen“ sind die Darstellung des Projektes und des Erstellungswegs zur S1-Leitlinie, die Erläuterung der klinischen Relevanz der Klassifikation EAES 2015, die wissenschaftliche Begründung der wichtigsten Empfehlungen und die Darstellung stadiengerechter Therapieoptionen.

Dr. med. Mihailo Andric
Berufsverband der Deutschen Chirurgie e.V.