Skip to main content
Erschienen in: Surgical Endoscopy 4/2011

01.04.2011

Development, validation and implementation of a monitoring tool for training in laparoscopic colorectal surgery in the English National Training Program

verfasst von: Danilo Miskovic, Susannah M. Wyles, Fiona Carter, Mark G. Coleman, George B. Hanna

Erschienen in: Surgical Endoscopy | Ausgabe 4/2011

Einloggen, um Zugang zu erhalten

Abstract

Introduction

The National Training Program for laparoscopic colorectal surgery (LCS) provides supervised training to colorectal surgeons in England. The purpose of this study was to create, validate, and implement a method for monitoring training progression in laparoscopic colorectal surgery that met the requirements of a good assessment tool.

Methods

A generic scale for different tasks in LCS was created under the guidance of a national expert group. The scores were defined by the extent to which the trainees were dependent on support (1 = unable to perform, 5 = unaided (benchmark), 6 = proficient). Trainers were asked to rate their trainees after each supervised case; trainees completed a similar self-assessment form. Construct validity was evaluated comparing scores of trainees at different experience levels (1–5, 6–10, 11–15, 16+) using the Wilcoxon signed-rank test and ANOVA. Internal consistency was determined by Crohnbach’s alpha, interrater reliability by comparing peer- and self-assessment (interclass correlation coefficient, ICC). Proficiency gain curves were plotted using CUSUM charts.

Results

Analysis included 610 assessments (333 by trainers and 277 by trainees). There was high interrater reliability (ICC = 0.867), internal consistency (α = 0.920), and construct validity [F(3,40) = 6.128, p < 0.001]. Detailed analysis of proficiency gain curves demonstrates that theater setup, exposure, and anastomosis were performed independently after 5 to 15 sessions, and the dissection of the vascular pedicle took 24 cases. Mobilization of the colon and of the splenic/hepatic flexure took more than 25 procedures. Median assessment time was 3.3 (interquartile range (IQR) 1–5) minutes and the tool was accepted as useful [median score 5 of 6 (IQR 4–5)].

Discussion

A valid and reliable monitoring tool for surgical training has been implemented successfully into the National Training Program. It provides a description of an individualized proficiency gain curve in terms of both the level of support required and the competency level achieved.
Literatur
2.
Zurück zum Zitat van der Vleuten CP, Schuwirth LW (2005) Assessing professional competence: from methods to programmes. Med Educ 39:309–317PubMedCrossRef van der Vleuten CP, Schuwirth LW (2005) Assessing professional competence: from methods to programmes. Med Educ 39:309–317PubMedCrossRef
4.
Zurück zum Zitat Black P, Wiliam D (2009) Developing the theory of formative assessment. Educ Assess Eval Account 21:5–31CrossRef Black P, Wiliam D (2009) Developing the theory of formative assessment. Educ Assess Eval Account 21:5–31CrossRef
5.
Zurück zum Zitat Sidhu RS, Vikis E, Cheifetz R, Phang T (2006) Self-assessment during a 2-day laparoscopic colectomy course: can surgeons judge how well they are learning new skills? Am J Surg 191:677–681PubMedCrossRef Sidhu RS, Vikis E, Cheifetz R, Phang T (2006) Self-assessment during a 2-day laparoscopic colectomy course: can surgeons judge how well they are learning new skills? Am J Surg 191:677–681PubMedCrossRef
6.
Zurück zum Zitat Wohaibi EM, Earle DB, Ansanitis FE, Wait RB, Fernandez G, Seymour NE (2007) A new web-based operative skills assessment tool effectively tracks progression in surgical resident performance. J Surg Educ 64:333–341PubMedCrossRef Wohaibi EM, Earle DB, Ansanitis FE, Wait RB, Fernandez G, Seymour NE (2007) A new web-based operative skills assessment tool effectively tracks progression in surgical resident performance. J Surg Educ 64:333–341PubMedCrossRef
7.
Zurück zum Zitat Munz Y, Moorthy K, Bann S, Shah J, Ivanova S, Darzi SA (2004) Ceiling effect in technical skills of surgical residents. Am J Surg 188:294–300PubMedCrossRef Munz Y, Moorthy K, Bann S, Shah J, Ivanova S, Darzi SA (2004) Ceiling effect in technical skills of surgical residents. Am J Surg 188:294–300PubMedCrossRef
8.
Zurück zum Zitat Martin JA, Regehr G, Reznick R, MacRae H, Murnaghan J, Hutchison C, Brown M (1997) Objective structured assessment of technical skill (OSATS) for surgical residents. Br J Surg 84:273–278PubMedCrossRef Martin JA, Regehr G, Reznick R, MacRae H, Murnaghan J, Hutchison C, Brown M (1997) Objective structured assessment of technical skill (OSATS) for surgical residents. Br J Surg 84:273–278PubMedCrossRef
9.
Zurück zum Zitat Vassiliou MC, Feldman LS, Andrew CG, Bergman S, Leffondre K, Stanbridge D, Fried GM (2005) A global assessment tool for evaluation of intraoperative laparoscopic skills. Am J Surg 190:107–113PubMedCrossRef Vassiliou MC, Feldman LS, Andrew CG, Bergman S, Leffondre K, Stanbridge D, Fried GM (2005) A global assessment tool for evaluation of intraoperative laparoscopic skills. Am J Surg 190:107–113PubMedCrossRef
10.
Zurück zum Zitat Tekkis PP, Senagore AJ, Delaney CP, Fazio VW (2005) Evaluation of the learning curve in laparoscopic colorectal surgery: comparison of right-sided and left-sided resections. Ann Surg 242:83–91PubMedCrossRef Tekkis PP, Senagore AJ, Delaney CP, Fazio VW (2005) Evaluation of the learning curve in laparoscopic colorectal surgery: comparison of right-sided and left-sided resections. Ann Surg 242:83–91PubMedCrossRef
11.
Zurück zum Zitat Schlachta CM, Mamazza J, Seshadri PA, Cadeddu M, Gregoire R, Poulin EC (2001) Defining a learning curve for laparoscopic colorectal resections. Dis Colon Rectum 44:217–222PubMedCrossRef Schlachta CM, Mamazza J, Seshadri PA, Cadeddu M, Gregoire R, Poulin EC (2001) Defining a learning curve for laparoscopic colorectal resections. Dis Colon Rectum 44:217–222PubMedCrossRef
12.
Zurück zum Zitat Park IJ, Choi GS, Lim KH, Kang BM, Jun SH (2009) Multidimensional analysis of the learning curve for laparoscopic colorectal surgery: lessons from 1,000 cases of laparoscopic colorectal surgery. Surg Endosc 23:839–846PubMedCrossRef Park IJ, Choi GS, Lim KH, Kang BM, Jun SH (2009) Multidimensional analysis of the learning curve for laparoscopic colorectal surgery: lessons from 1,000 cases of laparoscopic colorectal surgery. Surg Endosc 23:839–846PubMedCrossRef
13.
Zurück zum Zitat Cuschieri A (2006) Nature of human error: implications for surgical practice. Ann Surg 244:642–648PubMedCrossRef Cuschieri A (2006) Nature of human error: implications for surgical practice. Ann Surg 244:642–648PubMedCrossRef
14.
Zurück zum Zitat Bull C, Yates R, Sarkar D, Deanfield J, de Leval M (2000) Scientific, ethical, and logistical considerations in introducing a new operation: a retrospective cohort study from paediatric cardiac surgery. BMJ 320:1168–1173PubMedCrossRef Bull C, Yates R, Sarkar D, Deanfield J, de Leval M (2000) Scientific, ethical, and logistical considerations in introducing a new operation: a retrospective cohort study from paediatric cardiac surgery. BMJ 320:1168–1173PubMedCrossRef
15.
Zurück zum Zitat Dalton S, Ghosh A, Zafar N, Riyad K, Dixon A (2009) Competency in laparoscopic colorectal surgery is achievable with appropriate training but takes time: a comparison of 300 elective resections with anastomosis. Colorectal Dis, Jul 6 [Epub ahead of print] Dalton S, Ghosh A, Zafar N, Riyad K, Dixon A (2009) Competency in laparoscopic colorectal surgery is achievable with appropriate training but takes time: a comparison of 300 elective resections with anastomosis. Colorectal Dis, Jul 6 [Epub ahead of print]
16.
Zurück zum Zitat Rijbroek A, Wisselink W, Rauwerda JA (2003) The impact of training in unselected patients on mortality and morbidity in carotid endarterectomy in a vascular training center and the recommendations of the European Board of Surgery Qualification in Vascular Surgery. Eur J Vasc Endovasc Surg 26:256–261PubMedCrossRef Rijbroek A, Wisselink W, Rauwerda JA (2003) The impact of training in unselected patients on mortality and morbidity in carotid endarterectomy in a vascular training center and the recommendations of the European Board of Surgery Qualification in Vascular Surgery. Eur J Vasc Endovasc Surg 26:256–261PubMedCrossRef
17.
Zurück zum Zitat Li JC, Hon SS, Ng SS, Lee JF, Yiu RY, Leung KL (2009) The learning curve for laparoscopic colectomy: experience of a surgical fellow in an university colorectal unit. Surg Endosc 23:1603–1608PubMedCrossRef Li JC, Hon SS, Ng SS, Lee JF, Yiu RY, Leung KL (2009) The learning curve for laparoscopic colectomy: experience of a surgical fellow in an university colorectal unit. Surg Endosc 23:1603–1608PubMedCrossRef
18.
Zurück zum Zitat Miskovic D, Wyles SM, Ni M, Darzi AW, Hanna GB (2010) Mentoring and simulation in laparoscopic colorectal surgery. A systematic review. Ann Surg (in press) Miskovic D, Wyles SM, Ni M, Darzi AW, Hanna GB (2010) Mentoring and simulation in laparoscopic colorectal surgery. A systematic review. Ann Surg (in press)
19.
Zurück zum Zitat van Mook WN, van Luijk SJ, O’Sullivan H, Wass V, Schuwirth LW, van der Vleuten CP (2009) General considerations regarding assessment of professional behaviour. Eur J Intern Med 20:e90–e95PubMedCrossRef van Mook WN, van Luijk SJ, O’Sullivan H, Wass V, Schuwirth LW, van der Vleuten CP (2009) General considerations regarding assessment of professional behaviour. Eur J Intern Med 20:e90–e95PubMedCrossRef
20.
Zurück zum Zitat Streiner N, Norman G (2008) Health measurement scales. A practical guide to their development and use, 4th edn. Oxford University Press, Oxford Streiner N, Norman G (2008) Health measurement scales. A practical guide to their development and use, 4th edn. Oxford University Press, Oxford
21.
Zurück zum Zitat Evans J, Jenkins I, Kennedy RH (2009) Laparoscopic right hemicolectomy. St. Marks Multimedia, UK (20 mins) Evans J, Jenkins I, Kennedy RH (2009) Laparoscopic right hemicolectomy. St. Marks Multimedia, UK (20 mins)
22.
Zurück zum Zitat Champault G, Schimmelpenning H (2007) Laparoscopic sigmoidectomy for cancer, operation primer edn, Springer Champault G, Schimmelpenning H (2007) Laparoscopic sigmoidectomy for cancer, operation primer edn, Springer
24.
Zurück zum Zitat Bland JM, Altman DG (1986) Statistical methods for assessing agreement between two methods of clinical measurement. Lancet 1:307–310PubMed Bland JM, Altman DG (1986) Statistical methods for assessing agreement between two methods of clinical measurement. Lancet 1:307–310PubMed
25.
26.
Zurück zum Zitat Grigg OA, Farewell VT, Spiegelhalter DJ (2003) Use of risk-adjusted CUSUM and RSPRT charts for monitoring in medical contexts. Stat Methods Med Res 12:147–170PubMed Grigg OA, Farewell VT, Spiegelhalter DJ (2003) Use of risk-adjusted CUSUM and RSPRT charts for monitoring in medical contexts. Stat Methods Med Res 12:147–170PubMed
27.
Zurück zum Zitat Hoek J, Gendall P (1993) A new method of predicting voting behaviour. J Market Res Soc 35:361–373 Hoek J, Gendall P (1993) A new method of predicting voting behaviour. J Market Res Soc 35:361–373
29.
Zurück zum Zitat Sarker SK, Kumar I, Delaney C (2010) Assessing operative performance in advanced laparoscopic colorectal surgery. World J Surg 34(7):1594–1603PubMedCrossRef Sarker SK, Kumar I, Delaney C (2010) Assessing operative performance in advanced laparoscopic colorectal surgery. World J Surg 34(7):1594–1603PubMedCrossRef
30.
Zurück zum Zitat Dincler S, Koller MT, Steurer J, Bachmann LM, Christen D, Buchmann P (2003) Multidimensional analysis of learning curves in laparoscopic sigmoid resection: eight-year results. Dis Colon Rectum 46:1371–1378 discussion 1378–1379PubMedCrossRef Dincler S, Koller MT, Steurer J, Bachmann LM, Christen D, Buchmann P (2003) Multidimensional analysis of learning curves in laparoscopic sigmoid resection: eight-year results. Dis Colon Rectum 46:1371–1378 discussion 1378–1379PubMedCrossRef
31.
Zurück zum Zitat Schlachta CM, Mamazza J, Gregoire R, Burpee SE, Pace KT, Poulin EC (2003) Predicting conversion in laparoscopic colorectal surgery. Fellowship training may be an advantage. Surg Endosc 17:1288–1291PubMedCrossRef Schlachta CM, Mamazza J, Gregoire R, Burpee SE, Pace KT, Poulin EC (2003) Predicting conversion in laparoscopic colorectal surgery. Fellowship training may be an advantage. Surg Endosc 17:1288–1291PubMedCrossRef
32.
Zurück zum Zitat Birch DW, Asiri AH, de Gara CJ (2007) The impact of a formal mentoring program for minimally invasive surgery on surgeon practice and patient outcomes. Am J Surg 193:589–591 discussion 591–582PubMedCrossRef Birch DW, Asiri AH, de Gara CJ (2007) The impact of a formal mentoring program for minimally invasive surgery on surgeon practice and patient outcomes. Am J Surg 193:589–591 discussion 591–582PubMedCrossRef
33.
Zurück zum Zitat Choi DH, Jeong WK, Lim SW, Chung TS, Park JI, Lim SB, Choi HS, Nam BH, Chang HJ, Jeong SY (2009) Learning curves for laparoscopic sigmoidectomy used to manage curable sigmoid colon cancer: single-institute, three-surgeon experience. Surg Endosc 23:622–628PubMedCrossRef Choi DH, Jeong WK, Lim SW, Chung TS, Park JI, Lim SB, Choi HS, Nam BH, Chang HJ, Jeong SY (2009) Learning curves for laparoscopic sigmoidectomy used to manage curable sigmoid colon cancer: single-institute, three-surgeon experience. Surg Endosc 23:622–628PubMedCrossRef
34.
Zurück zum Zitat Crossley J, Davies H, Humphris G, Jolly B (2002) Generalisability: a key to unlock professional assessment. Med Educ 36:972–978PubMedCrossRef Crossley J, Davies H, Humphris G, Jolly B (2002) Generalisability: a key to unlock professional assessment. Med Educ 36:972–978PubMedCrossRef
35.
Zurück zum Zitat Joice P, Hanna GB, Cuschieri A (1998) Errors enacted during endoscopic surgery—a human reliability analysis. Appl Ergon 29:409–414PubMedCrossRef Joice P, Hanna GB, Cuschieri A (1998) Errors enacted during endoscopic surgery—a human reliability analysis. Appl Ergon 29:409–414PubMedCrossRef
36.
Zurück zum Zitat Talebpour M, Alijani A, Hanna GB, Moosa Z, Tang B, Cuschieri A (2009) Proficiency-gain curve for an advanced laparoscopic procedure defined by observation clinical human reliability assessment (OCHRA). Surg Endosc 23:869–875PubMedCrossRef Talebpour M, Alijani A, Hanna GB, Moosa Z, Tang B, Cuschieri A (2009) Proficiency-gain curve for an advanced laparoscopic procedure defined by observation clinical human reliability assessment (OCHRA). Surg Endosc 23:869–875PubMedCrossRef
Metadaten
Titel
Development, validation and implementation of a monitoring tool for training in laparoscopic colorectal surgery in the English National Training Program
verfasst von
Danilo Miskovic
Susannah M. Wyles
Fiona Carter
Mark G. Coleman
George B. Hanna
Publikationsdatum
01.04.2011
Verlag
Springer-Verlag
Erschienen in
Surgical Endoscopy / Ausgabe 4/2011
Print ISSN: 0930-2794
Elektronische ISSN: 1432-2218
DOI
https://doi.org/10.1007/s00464-010-1329-y

Weitere Artikel der Ausgabe 4/2011

Surgical Endoscopy 4/2011 Zur Ausgabe

Wie erfolgreich ist eine Re-Ablation nach Rezidiv?

23.04.2024 Ablationstherapie Nachrichten

Nach der Katheterablation von Vorhofflimmern kommt es bei etwa einem Drittel der Patienten zu Rezidiven, meist binnen eines Jahres. Wie sich spätere Rückfälle auf die Erfolgschancen einer erneuten Ablation auswirken, haben Schweizer Kardiologen erforscht.

Hinter dieser Appendizitis steckte ein Erreger

23.04.2024 Appendizitis Nachrichten

Schmerzen im Unterbauch, aber sonst nicht viel, was auf eine Appendizitis hindeutete: Ein junger Mann hatte Glück, dass trotzdem eine Laparoskopie mit Appendektomie durchgeführt und der Wurmfortsatz histologisch untersucht wurde.

Mehr Schaden als Nutzen durch präoperatives Aussetzen von GLP-1-Agonisten?

23.04.2024 Operationsvorbereitung Nachrichten

Derzeit wird empfohlen, eine Therapie mit GLP-1-Rezeptoragonisten präoperativ zu unterbrechen. Eine neue Studie nährt jedoch Zweifel an der Notwendigkeit der Maßnahme.

Ureterstriktur: Innovative OP-Technik bewährt sich

19.04.2024 EAU 2024 Kongressbericht

Die Ureterstriktur ist eine relativ seltene Komplikation, trotzdem bedarf sie einer differenzierten Versorgung. In komplexen Fällen wird dies durch die roboterassistierte OP-Technik gewährleistet. Erste Resultate ermutigen.

Update Chirurgie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.

S3-Leitlinie „Diagnostik und Therapie des Karpaltunnelsyndroms“

Karpaltunnelsyndrom BDC Leitlinien Webinare
CME: 2 Punkte

Das Karpaltunnelsyndrom ist die häufigste Kompressionsneuropathie peripherer Nerven. Obwohl die Anamnese mit dem nächtlichen Einschlafen der Hand (Brachialgia parästhetica nocturna) sehr typisch ist, ist eine klinisch-neurologische Untersuchung und Elektroneurografie in manchen Fällen auch eine Neurosonografie erforderlich. Im Anfangsstadium sind konservative Maßnahmen (Handgelenksschiene, Ergotherapie) empfehlenswert. Bei nicht Ansprechen der konservativen Therapie oder Auftreten von neurologischen Ausfällen ist eine Dekompression des N. medianus am Karpaltunnel indiziert.

Prof. Dr. med. Gregor Antoniadis
Berufsverband der Deutschen Chirurgie e.V.

S2e-Leitlinie „Distale Radiusfraktur“

Radiusfraktur BDC Leitlinien Webinare
CME: 2 Punkte

Das Webinar beschäftigt sich mit Fragen und Antworten zu Diagnostik und Klassifikation sowie Möglichkeiten des Ausschlusses von Zusatzverletzungen. Die Referenten erläutern, welche Frakturen konservativ behandelt werden können und wie. Das Webinar beantwortet die Frage nach aktuellen operativen Therapiekonzepten: Welcher Zugang, welches Osteosynthesematerial? Auf was muss bei der Nachbehandlung der distalen Radiusfraktur geachtet werden?

PD Dr. med. Oliver Pieske
Dr. med. Benjamin Meyknecht
Berufsverband der Deutschen Chirurgie e.V.

S1-Leitlinie „Empfehlungen zur Therapie der akuten Appendizitis bei Erwachsenen“

Appendizitis BDC Leitlinien Webinare
CME: 2 Punkte

Inhalte des Webinars zur S1-Leitlinie „Empfehlungen zur Therapie der akuten Appendizitis bei Erwachsenen“ sind die Darstellung des Projektes und des Erstellungswegs zur S1-Leitlinie, die Erläuterung der klinischen Relevanz der Klassifikation EAES 2015, die wissenschaftliche Begründung der wichtigsten Empfehlungen und die Darstellung stadiengerechter Therapieoptionen.

Dr. med. Mihailo Andric
Berufsverband der Deutschen Chirurgie e.V.