Skip to main content
Erschienen in: Surgical Endoscopy 2/2013

01.02.2013

Remote evaluation of laparoscopic performance using the global operative assessment of laparoscopic skills

verfasst von: Ian Choy, Andras Fecso, Josephine Kwong, Tim Jackson, Allan Okrainec

Erschienen in: Surgical Endoscopy | Ausgabe 2/2013

Einloggen, um Zugang zu erhalten

Abstract

Background

Although numerous assessment tools currently exist to evaluate laparoscopic surgical skills, no studies have demonstrated the reliability of such tools when used with telementoring technology. This study aimed to determine the reliability of the Global Operative Assessment of Laparoscopic Skills (GOALS) rating scale for assessing laparoscopic skills remotely and to identify how factors unique to remote assessment such as bandwidth and image quality influence its reliability.

Methods

Four trained observers evaluated 19 participants for their technical performance during a laparoscopic cholecystectomy using the GOALS assessment tool. One observer assessed the study participants directly in the operating room, whereas the three remaining observers were randomly assigned and blinded to a high- (1.5 Mbps), medium- (256 kbps), or low- (64.4 kbps) bandwidth restriction and observed remotely via Skype. The Maryland Visual Comfort Scale was used to evaluate the video quality of the respective connections.

Results

The intraclass correlation coefficient (ICC) calculated for the total GOALS score demonstrated a statistically significant correlation of high, medium, and low bandwidths respectively with ICC 0.693 (95 % confidence interval [CI], 0.226–0.883), 0.518 (95 % CI 0.089–0.783), and 0.499 (95 % CI 0.025–0.781). There was a statistically significant difference in the overall perceived visual quality between the high/low (Z = −3.222; P = 0.001) and the medium/low (Z = −3.567; P < 0.001) bandwidth comparison but no difference between the high/medium bandwidths (Z = −0.610; P = 0.542).

Conclusion

The data suggest that the GOALS assessment tool retains its reliability for intraoperative assessment of laparoscopic skills when used remotely. This is a key requirement in telesimulation programs allowing for structured feedback between the mentor and the mentee. This study quantifies the effect that bandwidth has on the reliability of remote assessment, demonstrating that higher bandwidths improve the utility of these tools.
Literatur
1.
Zurück zum Zitat Vassiliou MC et al (2005) A global assessment tool for evaluation of intraoperative laparoscopic skills. Am J Surg 190:107–113PubMedCrossRef Vassiliou MC et al (2005) A global assessment tool for evaluation of intraoperative laparoscopic skills. Am J Surg 190:107–113PubMedCrossRef
2.
3.
4.
Zurück zum Zitat Martin JA et al (1997) Objective structured assessment of technical skills (OSATS) for surgical residents. Br J Surg 84:273–278PubMedCrossRef Martin JA et al (1997) Objective structured assessment of technical skills (OSATS) for surgical residents. Br J Surg 84:273–278PubMedCrossRef
5.
Zurück zum Zitat Figert PL et al (2001) Transfer of training in acquiring laparoscopic skills. J Am Coll Surg 193:533–537PubMedCrossRef Figert PL et al (2001) Transfer of training in acquiring laparoscopic skills. J Am Coll Surg 193:533–537PubMedCrossRef
6.
Zurück zum Zitat Reznick R et al (1996) Testing technical skill via an innovative “bench station” examination. Am J Surg 172:226–230 Reznick R et al (1996) Testing technical skill via an innovative “bench station” examination. Am J Surg 172:226–230
7.
Zurück zum Zitat Gumbs AA, Hogle NJ, Fowler DL (2007) Evaluation of resident laparoscopic performance using global operative assessment of laparoscopic skills. J Am Coll Surg 204:308–313PubMedCrossRef Gumbs AA, Hogle NJ, Fowler DL (2007) Evaluation of resident laparoscopic performance using global operative assessment of laparoscopic skills. J Am Coll Surg 204:308–313PubMedCrossRef
8.
Zurück zum Zitat Sebajang H et al (2005) Telementoring: an important enabling tool for the community surgeon. Surg Innov 12:327–331PubMedCrossRef Sebajang H et al (2005) Telementoring: an important enabling tool for the community surgeon. Surg Innov 12:327–331PubMedCrossRef
9.
Zurück zum Zitat Society of American Gastrointestinal and Endoscopic Surgeons (SAGES) (2004) Guidelines for the surgical practice of telemedicine. SAGES, New York Society of American Gastrointestinal and Endoscopic Surgeons (SAGES) (2004) Guidelines for the surgical practice of telemedicine. SAGES, New York
10.
Zurück zum Zitat Choy I, Okrainec A (2010) Simulation in surgery: perfecting the practice. Surg Clin North Am 90:457–473PubMedCrossRef Choy I, Okrainec A (2010) Simulation in surgery: perfecting the practice. Surg Clin North Am 90:457–473PubMedCrossRef
11.
Zurück zum Zitat Sebajang H et al (2006) The role of telementoring and telerobotic assistance in the provision of laparoscopic colorectal surgery in rural areas. Surg Endosc 20:1389–1393PubMedCrossRef Sebajang H et al (2006) The role of telementoring and telerobotic assistance in the provision of laparoscopic colorectal surgery in rural areas. Surg Endosc 20:1389–1393PubMedCrossRef
12.
Zurück zum Zitat Schlachta CM et al (2010) Mentoring and telementoring leads to effective incorporation of laparoscopic colon surgery. Surg Endosc 24:841–844PubMedCrossRef Schlachta CM et al (2010) Mentoring and telementoring leads to effective incorporation of laparoscopic colon surgery. Surg Endosc 24:841–844PubMedCrossRef
13.
Zurück zum Zitat Okrainec A, Henao O, Azzie G (2010) Telesimulation: an effective method for teaching the fundamentals of laparoscopic surgery in resource-restricted countries. Surg Endosc 24:417–422PubMedCrossRef Okrainec A, Henao O, Azzie G (2010) Telesimulation: an effective method for teaching the fundamentals of laparoscopic surgery in resource-restricted countries. Surg Endosc 24:417–422PubMedCrossRef
14.
Zurück zum Zitat Ericsson KA (2004) Deliberate practice and the acquisition and maintenance of expert performance in medicine and related domains. Acad Med 10:S1–S12 Ericsson KA (2004) Deliberate practice and the acquisition and maintenance of expert performance in medicine and related domains. Acad Med 10:S1–S12
15.
Zurück zum Zitat Stefanidis D (2010) Optimal acquisition and assessment of proficiency on simulators in surgery. Surg Clin North Am 90:475–489PubMedCrossRef Stefanidis D (2010) Optimal acquisition and assessment of proficiency on simulators in surgery. Surg Clin North Am 90:475–489PubMedCrossRef
16.
Zurück zum Zitat Organization for Economic Cooperation (2007) OECD broadband statistics to December 2006. OECD, Paris Organization for Economic Cooperation (2007) OECD broadband statistics to December 2006. OECD, Paris
17.
Zurück zum Zitat Federal Communications Commission (2010) Sixth broadband deployment report Federal Communications Commission (2010) Sixth broadband deployment report
18.
Zurück zum Zitat Seagull FJ et al (2011) A validated subjective rating of display quality: the Maryland Visual Comfort Scale. Surg Endosc 25:567–571PubMedCrossRef Seagull FJ et al (2011) A validated subjective rating of display quality: the Maryland Visual Comfort Scale. Surg Endosc 25:567–571PubMedCrossRef
19.
Zurück zum Zitat Shrout PE, Fleiss JL (1979) Intraclass correlations: uses in assessing rater reliability. Psychol Bull 86:420–428PubMedCrossRef Shrout PE, Fleiss JL (1979) Intraclass correlations: uses in assessing rater reliability. Psychol Bull 86:420–428PubMedCrossRef
20.
Zurück zum Zitat McGraw KO, Wong S (1996) Forming inferences about some intraclass correlation coefficients. Psychol Methods 1:30–46CrossRef McGraw KO, Wong S (1996) Forming inferences about some intraclass correlation coefficients. Psychol Methods 1:30–46CrossRef
21.
Zurück zum Zitat Ahmed S et al (2001) Simultaneous estimation of several intraclass correlation coefficients. Ann Inst Stat Math 53:354–369CrossRef Ahmed S et al (2001) Simultaneous estimation of several intraclass correlation coefficients. Ann Inst Stat Math 53:354–369CrossRef
22.
Zurück zum Zitat Hinton PR, Brownlow C (2004) SPSS explained. Theatre Arts Books, New York Hinton PR, Brownlow C (2004) SPSS explained. Theatre Arts Books, New York
23.
Zurück zum Zitat Mars M (2011) Telerehabilitation in South Africa: is there a way forward? Int J Telerehabilitation 3:11–18 Mars M (2011) Telerehabilitation in South Africa: is there a way forward? Int J Telerehabilitation 3:11–18
24.
Zurück zum Zitat Okrainec A, Smith L, Azzie G (2009) Surgical simulation in Africa: the feasibility and impact of a 3-day fundamentals of laparoscopic surgery course. Surg Endosc 23:2493–2498PubMedCrossRef Okrainec A, Smith L, Azzie G (2009) Surgical simulation in Africa: the feasibility and impact of a 3-day fundamentals of laparoscopic surgery course. Surg Endosc 23:2493–2498PubMedCrossRef
25.
Zurück zum Zitat Larson JL et al (2005) Feasibility, reliability, and validity of an operative performance rating system for evaluating surgery residents. Surgery 138:640–649PubMedCrossRef Larson JL et al (2005) Feasibility, reliability, and validity of an operative performance rating system for evaluating surgery residents. Surgery 138:640–649PubMedCrossRef
26.
Zurück zum Zitat Ghaderi I et al (2011) Evaluation of surgical performance during laparoscopic incisional hernia repair: a multicenter study. Surg Endosc 25:2555–2563PubMedCrossRef Ghaderi I et al (2011) Evaluation of surgical performance during laparoscopic incisional hernia repair: a multicenter study. Surg Endosc 25:2555–2563PubMedCrossRef
Metadaten
Titel
Remote evaluation of laparoscopic performance using the global operative assessment of laparoscopic skills
verfasst von
Ian Choy
Andras Fecso
Josephine Kwong
Tim Jackson
Allan Okrainec
Publikationsdatum
01.02.2013
Verlag
Springer-Verlag
Erschienen in
Surgical Endoscopy / Ausgabe 2/2013
Print ISSN: 0930-2794
Elektronische ISSN: 1432-2218
DOI
https://doi.org/10.1007/s00464-012-2456-4

Weitere Artikel der Ausgabe 2/2013

Surgical Endoscopy 2/2013 Zur Ausgabe

Update Chirurgie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.

S3-Leitlinie „Diagnostik und Therapie des Karpaltunnelsyndroms“

Karpaltunnelsyndrom BDC Leitlinien Webinare
CME: 2 Punkte

Das Karpaltunnelsyndrom ist die häufigste Kompressionsneuropathie peripherer Nerven. Obwohl die Anamnese mit dem nächtlichen Einschlafen der Hand (Brachialgia parästhetica nocturna) sehr typisch ist, ist eine klinisch-neurologische Untersuchung und Elektroneurografie in manchen Fällen auch eine Neurosonografie erforderlich. Im Anfangsstadium sind konservative Maßnahmen (Handgelenksschiene, Ergotherapie) empfehlenswert. Bei nicht Ansprechen der konservativen Therapie oder Auftreten von neurologischen Ausfällen ist eine Dekompression des N. medianus am Karpaltunnel indiziert.

Prof. Dr. med. Gregor Antoniadis
Berufsverband der Deutschen Chirurgie e.V.

S2e-Leitlinie „Distale Radiusfraktur“

Radiusfraktur BDC Leitlinien Webinare
CME: 2 Punkte

Das Webinar beschäftigt sich mit Fragen und Antworten zu Diagnostik und Klassifikation sowie Möglichkeiten des Ausschlusses von Zusatzverletzungen. Die Referenten erläutern, welche Frakturen konservativ behandelt werden können und wie. Das Webinar beantwortet die Frage nach aktuellen operativen Therapiekonzepten: Welcher Zugang, welches Osteosynthesematerial? Auf was muss bei der Nachbehandlung der distalen Radiusfraktur geachtet werden?

PD Dr. med. Oliver Pieske
Dr. med. Benjamin Meyknecht
Berufsverband der Deutschen Chirurgie e.V.

S1-Leitlinie „Empfehlungen zur Therapie der akuten Appendizitis bei Erwachsenen“

Appendizitis BDC Leitlinien Webinare
CME: 2 Punkte

Inhalte des Webinars zur S1-Leitlinie „Empfehlungen zur Therapie der akuten Appendizitis bei Erwachsenen“ sind die Darstellung des Projektes und des Erstellungswegs zur S1-Leitlinie, die Erläuterung der klinischen Relevanz der Klassifikation EAES 2015, die wissenschaftliche Begründung der wichtigsten Empfehlungen und die Darstellung stadiengerechter Therapieoptionen.

Dr. med. Mihailo Andric
Berufsverband der Deutschen Chirurgie e.V.