Skip to main content
Erschienen in: Surgical Endoscopy 9/2012

01.09.2012

A prospective study demonstrating the reliability and validity of two procedure-specific evaluation tools to assess operative competence in laparoscopic colorectal surgery

verfasst von: Vanessa N. Palter, Teodor P. Grantcharov

Erschienen in: Surgical Endoscopy | Ausgabe 9/2012

Einloggen, um Zugang zu erhalten

Abstract

Background

Laparoscopic colorectal surgery is considered an advanced minimally invasive procedure with a long, variable learning curve. Developing an evaluation tool is essential to ensure that individuals reach a certain level of competence prior to performing this procedure independently. To achieve standardization and wide implementation, an assessment tool must be reflective of practice across many institutions.

Study design

The purpose of this study is to validate two procedure-specific evaluation tools for laparoscopic colorectal surgery that were developed using innovative consensus methodology. Two procedure-specific rating scales for laparoscopic right and sigmoid colectomy were created using the Delphi method. Nine novice and nine expert laparoscopic sigmoid colectomy videos were prospectively collected, and nine novice and ten expert laparoscopic right colectomy videos were recorded. The experts rated the videos using the procedure-specific technical skills evaluation tool for either laparoscopic right colectomy or laparoscopic sigmoid colectomy.

Results

There were statistically significant differences between the expert and novice scores on the laparoscopic right colectomy evaluation tool: the median score of novices was 63.8% and the expert score was 73.1% (p = 0.02). Similarly, there was a significant difference between the median novice score on the sigmoid tool (58.6%) compared with the median expert score (70.7%) (p = 0.003). Cronbach’s alpha was 0.82 for the right colectomy evaluation tool and 0.79 for the sigmoid rating scale.

Conclusions

The procedure-specific evaluation tools for laparoscopic right and sigmoid colectomy demonstrate strong reliability and construct validity, and have the potential to be used for technical skills assessment and feedback.
Literatur
2.
Zurück zum Zitat Cuschieri (2003) Medical errors, incidents, accidents and violations. Minim Invasive Ther Allied Technol 12:111–120PubMed Cuschieri (2003) Medical errors, incidents, accidents and violations. Minim Invasive Ther Allied Technol 12:111–120PubMed
3.
Zurück zum Zitat Baker GR, Norton PG, Flintoft V, Blais R, Brown A, Cox J, Etchells E, Ghali WA, Hebert P, Majumdar SR, O’Beirne M, Palacios-Derflingher L, Reid RJ, Sheps S, Tamblyn R (2004) The Canadian adverse events study: the incidence of adverse events among hospital patients in Canada. CMAJ 170:1678–1686PubMedCrossRef Baker GR, Norton PG, Flintoft V, Blais R, Brown A, Cox J, Etchells E, Ghali WA, Hebert P, Majumdar SR, O’Beirne M, Palacios-Derflingher L, Reid RJ, Sheps S, Tamblyn R (2004) The Canadian adverse events study: the incidence of adverse events among hospital patients in Canada. CMAJ 170:1678–1686PubMedCrossRef
4.
Zurück zum Zitat Kim J, Edwards E, Bowne W, Castro A, Moon V, Gadangi P, Ferzli G (2007) Medial-to-lateral laparoscopic colon resection: a view beyond the learning curve. Surg Endosc 21:1503–1507PubMedCrossRef Kim J, Edwards E, Bowne W, Castro A, Moon V, Gadangi P, Ferzli G (2007) Medial-to-lateral laparoscopic colon resection: a view beyond the learning curve. Surg Endosc 21:1503–1507PubMedCrossRef
5.
Zurück zum Zitat Schlachta CM, Mamazza J, Seshadri PA, Cadeddu M, Gregoire R, Poulin EC (2001) Defining a learning curve for laparoscopic colorectal resections. Dis Colon Rectum 44:217–222PubMedCrossRef Schlachta CM, Mamazza J, Seshadri PA, Cadeddu M, Gregoire R, Poulin EC (2001) Defining a learning curve for laparoscopic colorectal resections. Dis Colon Rectum 44:217–222PubMedCrossRef
6.
Zurück zum Zitat Wishner JD, Baker JW Jr, Hoffman GC, Hubbard GW 2nd, Gould RJ, Wohlgemuth SD, Ruffin WK, Melick CF (1995) Laparoscopic-assisted colectomy. The learning curve. Surg Endosc 9:1179–1183PubMedCrossRef Wishner JD, Baker JW Jr, Hoffman GC, Hubbard GW 2nd, Gould RJ, Wohlgemuth SD, Ruffin WK, Melick CF (1995) Laparoscopic-assisted colectomy. The learning curve. Surg Endosc 9:1179–1183PubMedCrossRef
7.
Zurück zum Zitat Senagore AJ, Luchtefeld MA, Mackeigan JM (1995) What is the learning curve for laparoscopic colectomy? Am Surg 61:681–685PubMed Senagore AJ, Luchtefeld MA, Mackeigan JM (1995) What is the learning curve for laparoscopic colectomy? Am Surg 61:681–685PubMed
8.
Zurück zum Zitat Wexner SD, Latulippe JF (1997) Laparoscopic colorectal surgery and cancer. Swiss Surg 3:266–273PubMed Wexner SD, Latulippe JF (1997) Laparoscopic colorectal surgery and cancer. Swiss Surg 3:266–273PubMed
9.
Zurück zum Zitat Bennett CL, Stryker SJ, Ferreira MR, Adams J, Beart RW Jr (1997) The learning curve for laparoscopic colorectal surgery. Preliminary results from a prospective analysis of 1,194 laparoscopic-assisted colectomies. Arch Surg 132:41–44 discussion 45PubMedCrossRef Bennett CL, Stryker SJ, Ferreira MR, Adams J, Beart RW Jr (1997) The learning curve for laparoscopic colorectal surgery. Preliminary results from a prospective analysis of 1,194 laparoscopic-assisted colectomies. Arch Surg 132:41–44 discussion 45PubMedCrossRef
10.
Zurück zum Zitat Tekkis PP, Senagore AJ, Delaney CP, Fazio VW (2005) Evaluation of the learning curve in laparoscopic colorectal surgery: comparison of right-sided and left-sided resections. Ann Surg 242:83–91PubMedCrossRef Tekkis PP, Senagore AJ, Delaney CP, Fazio VW (2005) Evaluation of the learning curve in laparoscopic colorectal surgery: comparison of right-sided and left-sided resections. Ann Surg 242:83–91PubMedCrossRef
11.
Zurück zum Zitat Dincler S, Koller MT, Steurer J, Bachmann LM, Christen D, Buchmann P (2003) Multidimensional analysis of learning curves in laparoscopic sigmoid resection: eight-year results. Dis Colon Rectum 46:1371–1378 discussion 1378–1379PubMedCrossRef Dincler S, Koller MT, Steurer J, Bachmann LM, Christen D, Buchmann P (2003) Multidimensional analysis of learning curves in laparoscopic sigmoid resection: eight-year results. Dis Colon Rectum 46:1371–1378 discussion 1378–1379PubMedCrossRef
12.
Zurück zum Zitat Martin JA, Regehr G, Reznick R, MacRae H, Murnaghan J, Hutchison C, Brown M (1997) Objective structured assessment of technical skill (OSATS) for surgical residents. Br J Surg 84:273–278PubMedCrossRef Martin JA, Regehr G, Reznick R, MacRae H, Murnaghan J, Hutchison C, Brown M (1997) Objective structured assessment of technical skill (OSATS) for surgical residents. Br J Surg 84:273–278PubMedCrossRef
13.
Zurück zum Zitat Reznick R, Regehr G, MacRae H, Martin J, McCulloch W (1997) Testing technical skill via an innovative “bench station” examination. Am J Surg 173:226–230PubMedCrossRef Reznick R, Regehr G, MacRae H, Martin J, McCulloch W (1997) Testing technical skill via an innovative “bench station” examination. Am J Surg 173:226–230PubMedCrossRef
14.
Zurück zum Zitat Datta V, Bann S, Aggarwal R, Mandalia M, Hance J, Darzi A (2006) Technical skills examination for general surgical trainees. Br J Surg 93:1139–1146PubMedCrossRef Datta V, Bann S, Aggarwal R, Mandalia M, Hance J, Darzi A (2006) Technical skills examination for general surgical trainees. Br J Surg 93:1139–1146PubMedCrossRef
15.
Zurück zum Zitat Beard JD, Choksy S, Khan S (2007) Assessment of operative competence during carotid endarterectomy. Br J Surg 94:726–730PubMedCrossRef Beard JD, Choksy S, Khan S (2007) Assessment of operative competence during carotid endarterectomy. Br J Surg 94:726–730PubMedCrossRef
16.
Zurück zum Zitat Aggarwal R, Grantcharov T, Moorthy K, Milland T, Papasavas P, Dosis A, Bello F, Darzi A (2007) An evaluation of the feasibility, validity, and reliability of laparoscopic skills assessment in the operating room. Ann Surg 245:992–999PubMedCrossRef Aggarwal R, Grantcharov T, Moorthy K, Milland T, Papasavas P, Dosis A, Bello F, Darzi A (2007) An evaluation of the feasibility, validity, and reliability of laparoscopic skills assessment in the operating room. Ann Surg 245:992–999PubMedCrossRef
17.
Zurück zum Zitat Ault G, Reznick R, MacRae H, Leadbetter W, DaRosa D, Joehl R, Peters J, Regehr G (2001) Exporting a technical skills evaluation technology to other sites. Am J Surg 182:254–256PubMedCrossRef Ault G, Reznick R, MacRae H, Leadbetter W, DaRosa D, Joehl R, Peters J, Regehr G (2001) Exporting a technical skills evaluation technology to other sites. Am J Surg 182:254–256PubMedCrossRef
18.
Zurück zum Zitat Goff BA, Lentz GM, Lee D, Houmard B, Mandel LS (2000) Development of an objective structured assessment of technical skills for obstetric and gynecology residents. Obstet Gynecol 96:146–150PubMedCrossRef Goff BA, Lentz GM, Lee D, Houmard B, Mandel LS (2000) Development of an objective structured assessment of technical skills for obstetric and gynecology residents. Obstet Gynecol 96:146–150PubMedCrossRef
19.
Zurück zum Zitat Shah J, Munz Y, Manson J, Moorthy K, Darzi A (2006) Objective assessment of small bowel anastomosis skill in trainee general surgeons and urologists. World J Surg 30:248–251PubMedCrossRef Shah J, Munz Y, Manson J, Moorthy K, Darzi A (2006) Objective assessment of small bowel anastomosis skill in trainee general surgeons and urologists. World J Surg 30:248–251PubMedCrossRef
20.
Zurück zum Zitat Siddiqui NY, Stepp KJ, Lasch SJ, Mangel JM, Wu JM (2008) Objective structured assessment of technical skills for repair of fourth-degree perineal lacerations. Am J Obstet Gynecol 199(676):e671–e676 Siddiqui NY, Stepp KJ, Lasch SJ, Mangel JM, Wu JM (2008) Objective structured assessment of technical skills for repair of fourth-degree perineal lacerations. Am J Obstet Gynecol 199(676):e671–e676
21.
Zurück zum Zitat Vassiliou MC, Feldman LS, Andrew CG, Bergman S, Leffondre K, Stanbridge D, Fried GM (2005) A global assessment tool for evaluation of intraoperative laparoscopic skills. Am J Surg 190:107–113PubMedCrossRef Vassiliou MC, Feldman LS, Andrew CG, Bergman S, Leffondre K, Stanbridge D, Fried GM (2005) A global assessment tool for evaluation of intraoperative laparoscopic skills. Am J Surg 190:107–113PubMedCrossRef
22.
Zurück zum Zitat Grantcharov TP, Kristiansen VB, Bendix J, Bardram L, Rosenberg J, Funch-Jensen P (2004) Randomized clinical trial of virtual reality simulation for laparoscopic skills training. Br J Surg 91:146–150PubMedCrossRef Grantcharov TP, Kristiansen VB, Bendix J, Bardram L, Rosenberg J, Funch-Jensen P (2004) Randomized clinical trial of virtual reality simulation for laparoscopic skills training. Br J Surg 91:146–150PubMedCrossRef
23.
Zurück zum Zitat Dath D, Regehr G, Birch D, Schlachta C, Poulin E, Mamazza J, Reznick R, MacRae HM (2004) Toward reliable operative assessment: the reliability and feasibility of videotaped assessment of laparoscopic technical skills. Surg Endosc 18:1800–1804PubMedCrossRef Dath D, Regehr G, Birch D, Schlachta C, Poulin E, Mamazza J, Reznick R, MacRae HM (2004) Toward reliable operative assessment: the reliability and feasibility of videotaped assessment of laparoscopic technical skills. Surg Endosc 18:1800–1804PubMedCrossRef
24.
Zurück zum Zitat Sarker SK, Albrani T, Zaman A, Patel B (2008) Procedural performance in gastrointestinal endoscopy: an assessment and self-appraisal tool. Am J Surg 196:450–455PubMedCrossRef Sarker SK, Albrani T, Zaman A, Patel B (2008) Procedural performance in gastrointestinal endoscopy: an assessment and self-appraisal tool. Am J Surg 196:450–455PubMedCrossRef
25.
Zurück zum Zitat Larsen CR, Grantcharov T, Schouenborg L, Ottosen C, Soerensen JL, Ottesen B (2008) Objective assessment of surgical competence in gynaecological laparoscopy: development and validation of a procedure-specific rating scale. BJOG 115:908–916PubMedCrossRef Larsen CR, Grantcharov T, Schouenborg L, Ottosen C, Soerensen JL, Ottesen B (2008) Objective assessment of surgical competence in gynaecological laparoscopy: development and validation of a procedure-specific rating scale. BJOG 115:908–916PubMedCrossRef
26.
Zurück zum Zitat Sarker SK, Kumar I, Delaney C (2010) Assessing operative performance in advanced laparoscopic colorectal surgery. World J Surg 34:1594–1603PubMedCrossRef Sarker SK, Kumar I, Delaney C (2010) Assessing operative performance in advanced laparoscopic colorectal surgery. World J Surg 34:1594–1603PubMedCrossRef
27.
Zurück zum Zitat Palter VN, MacRae HM, Grantcharov TP (2011) Development of an objective evaluation tool to assess technical skill in laparoscopic colorectal surgery: a Delphi methodology. Am J Surg 201:251–259PubMedCrossRef Palter VN, MacRae HM, Grantcharov TP (2011) Development of an objective evaluation tool to assess technical skill in laparoscopic colorectal surgery: a Delphi methodology. Am J Surg 201:251–259PubMedCrossRef
28.
Zurück zum Zitat Regehr G, MacRae H, Reznick RK, Szalay D (1998) Comparing the psychometric properties of checklists and global rating scales for assessing performance on an OSCE-format examination. Acad Med 73:993–997PubMedCrossRef Regehr G, MacRae H, Reznick RK, Szalay D (1998) Comparing the psychometric properties of checklists and global rating scales for assessing performance on an OSCE-format examination. Acad Med 73:993–997PubMedCrossRef
29.
Zurück zum Zitat Sugden C, Aggarwal R (2010) Assessment and feedback in the skills laboratory and operating room. Surg Clin North Am 90:519–533PubMedCrossRef Sugden C, Aggarwal R (2010) Assessment and feedback in the skills laboratory and operating room. Surg Clin North Am 90:519–533PubMedCrossRef
30.
Zurück zum Zitat Gallagher AG, Ritter EM, Satava RM (2003) Fundamental principles of validation, and reliability: rigorous science for the assessment of surgical education and training. Surg Endosc 17:1525–1529PubMedCrossRef Gallagher AG, Ritter EM, Satava RM (2003) Fundamental principles of validation, and reliability: rigorous science for the assessment of surgical education and training. Surg Endosc 17:1525–1529PubMedCrossRef
31.
Zurück zum Zitat Young-Fadok TM, Nelson H (2000) Laparoscopic right colectomy: five-step procedure. Dis Colon Rectum 43:267–271 discussion 271–263PubMedCrossRef Young-Fadok TM, Nelson H (2000) Laparoscopic right colectomy: five-step procedure. Dis Colon Rectum 43:267–271 discussion 271–263PubMedCrossRef
32.
Zurück zum Zitat Senagore AJ, Delaney CP, Brady KM, Fazio VW (2004) Standardized approach to laparoscopic right colectomy: outcomes in 70 consecutive cases. J Am Coll Surg 199:675–679PubMedCrossRef Senagore AJ, Delaney CP, Brady KM, Fazio VW (2004) Standardized approach to laparoscopic right colectomy: outcomes in 70 consecutive cases. J Am Coll Surg 199:675–679PubMedCrossRef
Metadaten
Titel
A prospective study demonstrating the reliability and validity of two procedure-specific evaluation tools to assess operative competence in laparoscopic colorectal surgery
verfasst von
Vanessa N. Palter
Teodor P. Grantcharov
Publikationsdatum
01.09.2012
Verlag
Springer-Verlag
Erschienen in
Surgical Endoscopy / Ausgabe 9/2012
Print ISSN: 0930-2794
Elektronische ISSN: 1432-2218
DOI
https://doi.org/10.1007/s00464-012-2220-9

Weitere Artikel der Ausgabe 9/2012

Surgical Endoscopy 9/2012 Zur Ausgabe

Echinokokkose medikamentös behandeln oder operieren?

06.05.2024 DCK 2024 Kongressbericht

Die Therapie von Echinokokkosen sollte immer in spezialisierten Zentren erfolgen. Eine symptomlose Echinokokkose kann – egal ob von Hunde- oder Fuchsbandwurm ausgelöst – konservativ erfolgen. Wenn eine Op. nötig ist, kann es sinnvoll sein, vorher Zysten zu leeren und zu desinfizieren. 

Wie sieht der OP der Zukunft aus?

04.05.2024 DCK 2024 Kongressbericht

Der OP in der Zukunft wird mit weniger Personal auskommen – nicht, weil die Technik das medizinische Fachpersonal verdrängt, sondern weil der Personalmangel es nötig macht.

Umsetzung der POMGAT-Leitlinie läuft

03.05.2024 DCK 2024 Kongressbericht

Seit November 2023 gibt es evidenzbasierte Empfehlungen zum perioperativen Management bei gastrointestinalen Tumoren (POMGAT) auf S3-Niveau. Vieles wird schon entsprechend der Empfehlungen durchgeführt. Wo es im Alltag noch hapert, zeigt eine Umfrage in einem Klinikverbund.

Recycling im OP – möglich, aber teuer

02.05.2024 DCK 2024 Kongressbericht

Auch wenn sich Krankenhäuser nachhaltig und grün geben – sie tragen aktuell erheblich zu den CO2-Emissionen bei und produzieren jede Menge Müll. Ein Pilotprojekt aus Bonn zeigt, dass viele Op.-Abfälle wiederverwertet werden können.

Update Chirurgie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.

S3-Leitlinie „Diagnostik und Therapie des Karpaltunnelsyndroms“

Karpaltunnelsyndrom BDC Leitlinien Webinare
CME: 2 Punkte

Das Karpaltunnelsyndrom ist die häufigste Kompressionsneuropathie peripherer Nerven. Obwohl die Anamnese mit dem nächtlichen Einschlafen der Hand (Brachialgia parästhetica nocturna) sehr typisch ist, ist eine klinisch-neurologische Untersuchung und Elektroneurografie in manchen Fällen auch eine Neurosonografie erforderlich. Im Anfangsstadium sind konservative Maßnahmen (Handgelenksschiene, Ergotherapie) empfehlenswert. Bei nicht Ansprechen der konservativen Therapie oder Auftreten von neurologischen Ausfällen ist eine Dekompression des N. medianus am Karpaltunnel indiziert.

Prof. Dr. med. Gregor Antoniadis
Berufsverband der Deutschen Chirurgie e.V.

S2e-Leitlinie „Distale Radiusfraktur“

Radiusfraktur BDC Leitlinien Webinare
CME: 2 Punkte

Das Webinar beschäftigt sich mit Fragen und Antworten zu Diagnostik und Klassifikation sowie Möglichkeiten des Ausschlusses von Zusatzverletzungen. Die Referenten erläutern, welche Frakturen konservativ behandelt werden können und wie. Das Webinar beantwortet die Frage nach aktuellen operativen Therapiekonzepten: Welcher Zugang, welches Osteosynthesematerial? Auf was muss bei der Nachbehandlung der distalen Radiusfraktur geachtet werden?

PD Dr. med. Oliver Pieske
Dr. med. Benjamin Meyknecht
Berufsverband der Deutschen Chirurgie e.V.

S1-Leitlinie „Empfehlungen zur Therapie der akuten Appendizitis bei Erwachsenen“

Appendizitis BDC Leitlinien Webinare
CME: 2 Punkte

Inhalte des Webinars zur S1-Leitlinie „Empfehlungen zur Therapie der akuten Appendizitis bei Erwachsenen“ sind die Darstellung des Projektes und des Erstellungswegs zur S1-Leitlinie, die Erläuterung der klinischen Relevanz der Klassifikation EAES 2015, die wissenschaftliche Begründung der wichtigsten Empfehlungen und die Darstellung stadiengerechter Therapieoptionen.

Dr. med. Mihailo Andric
Berufsverband der Deutschen Chirurgie e.V.