Skip to main content
Erschienen in: Surgical Endoscopy 11/2018

13.04.2018

Development and validation of surgical training tool: cystectomy assessment and surgical evaluation (CASE) for robot-assisted radical cystectomy for men

verfasst von: Ahmed A. Hussein, Kevin J. Sexton, Paul R. May, Maxwell V. Meng, Abolfazl Hosseini, Daniel D. Eun, Siamak Daneshmand, Bernard H. Bochner, James O. Peabody, Ronney Abaza, Eila C. Skinner, Richard E. Hautmann, Khurshid A. Guru

Erschienen in: Surgical Endoscopy | Ausgabe 11/2018

Einloggen, um Zugang zu erhalten

Abstract

Background

We aimed to develop a structured scoring tool: cystectomy assessment and surgical evaluation (CASE) that objectively measures and quantifies performance during robot-assisted radical cystectomy (RARC) for men.

Methods

A multinational 10-surgeon expert panel collaborated towards development and validation of CASE. The critical steps of RARC in men were deconstructed into nine key domains, each assessed by five anchors. Content validation was done utilizing the Delphi methodology. Each anchor was assessed in terms of context, score concordance, and clarity. The content validity index (CVI) was calculated for each aspect. A CVI ≥ 0.75 represented consensus, and this statement was removed from the next round. This process was repeated until consensus was achieved for all statements. CASE was used to assess de-identified videos of RARC to determine reliability and construct validity. Linearly weighted percent agreement was used to assess inter-rater reliability (IRR). A logit model for odds ratio (OR) was used to assess construct validation.

Results

The expert panel reached consensus on CASE after four rounds. The final eight domains of the CASE included: pelvic lymph node dissection, development of the peri-ureteral space, lateral pelvic space, anterior rectal space, control of the vascular pedicle, anterior vesical space, control of the dorsal venous complex, and apical dissection. IRR > 0.6 was achieved for all eight domains. Experts outperformed trainees across all domains.

Conclusion

We developed and validated a reliable structured, procedure-specific tool for objective evaluation of surgical performance during RARC. CASE may help differentiate novice from expert performances.
Literatur
1.
Zurück zum Zitat Raza SJ, Wilson T, Peabody JO et al (2015) Long-term oncologic outcomes following robot-assisted radical cystectomy: results from the International Robotic Cystectomy Consortium. Eur Urol 68(4):721–728CrossRef Raza SJ, Wilson T, Peabody JO et al (2015) Long-term oncologic outcomes following robot-assisted radical cystectomy: results from the International Robotic Cystectomy Consortium. Eur Urol 68(4):721–728CrossRef
2.
Zurück zum Zitat Leow JJ, Reese SW, Jiang W et al (2014) Propensity-matched comparison of morbidity and costs of open and robot-assisted radical cystectomies: a contemporary population-based analysis in the United States. Eur Urol 66(3):569–576CrossRef Leow JJ, Reese SW, Jiang W et al (2014) Propensity-matched comparison of morbidity and costs of open and robot-assisted radical cystectomies: a contemporary population-based analysis in the United States. Eur Urol 66(3):569–576CrossRef
3.
Zurück zum Zitat Wilson TG, Guru K, Rosen RC et al (2015) Best practices in robot-assisted radical cystectomy and urinary reconstruction: recommendations of the Pasadena Consensus Panel. Eur Urol 67(3):363–375CrossRef Wilson TG, Guru K, Rosen RC et al (2015) Best practices in robot-assisted radical cystectomy and urinary reconstruction: recommendations of the Pasadena Consensus Panel. Eur Urol 67(3):363–375CrossRef
4.
Zurück zum Zitat Lee JY, Mucksavage P, Sundaram CP, McDougall EM (2011) Best practices for robotic surgery training and credentialing. J Urol 185(4):1191–1197CrossRef Lee JY, Mucksavage P, Sundaram CP, McDougall EM (2011) Best practices for robotic surgery training and credentialing. J Urol 185(4):1191–1197CrossRef
5.
Zurück zum Zitat Polit DF, Beck CT, Owen SV (2007) Is the CVI an acceptable indicator of content validity? Appraisal and recommendations. Res Nurs Health 30(4):459–467CrossRef Polit DF, Beck CT, Owen SV (2007) Is the CVI an acceptable indicator of content validity? Appraisal and recommendations. Res Nurs Health 30(4):459–467CrossRef
6.
Zurück zum Zitat Hussein AA, Hinata N, Dibaj S et al (2017) Development, validation and clinical application of Pelvic Lymphadenectomy Assessment and Completion Evaluation: intraoperative assessment of lymph node dissection after robot-assisted radical cystectomy for bladder cancer. BJU Int 119(6):879–884CrossRef Hussein AA, Hinata N, Dibaj S et al (2017) Development, validation and clinical application of Pelvic Lymphadenectomy Assessment and Completion Evaluation: intraoperative assessment of lymph node dissection after robot-assisted radical cystectomy for bladder cancer. BJU Int 119(6):879–884CrossRef
7.
Zurück zum Zitat Schiffmann J, Gandaglia G, Larcher A et al (2014) Contemporary 90-day mortality rates after radical cystectomy in the elderly. Eur J Surg Oncol J Eur Soc Surg Oncol Br Assoc Surg Oncol 40(12):1738–1745 Schiffmann J, Gandaglia G, Larcher A et al (2014) Contemporary 90-day mortality rates after radical cystectomy in the elderly. Eur J Surg Oncol J Eur Soc Surg Oncol Br Assoc Surg Oncol 40(12):1738–1745
8.
Zurück zum Zitat Eisenberg MS, Boorjian SA, Cheville JC et al (2013) The SPARC score: a multifactorial outcome prediction model for patients undergoing radical cystectomy for bladder cancer. J Urol 190(6):2005–2010CrossRef Eisenberg MS, Boorjian SA, Cheville JC et al (2013) The SPARC score: a multifactorial outcome prediction model for patients undergoing radical cystectomy for bladder cancer. J Urol 190(6):2005–2010CrossRef
9.
Zurück zum Zitat Hussein AA, Dibaj S, Hinata N et al. Development and validation of a quality assurance score for robot-assisted radical cystectomy: a 10-year analysis. Urology 2016 Hussein AA, Dibaj S, Hinata N et al. Development and validation of a quality assurance score for robot-assisted radical cystectomy: a 10-year analysis. Urology 2016
10.
Zurück zum Zitat Herr HW, Faulkner JR, Grossman HB et al (2004) Surgical factors influence bladder cancer outcomes: a cooperative group report. J Clin Oncol 22(14):2781–2789CrossRef Herr HW, Faulkner JR, Grossman HB et al (2004) Surgical factors influence bladder cancer outcomes: a cooperative group report. J Clin Oncol 22(14):2781–2789CrossRef
11.
Zurück zum Zitat Cooperberg MR, Odisho AY, Carroll PR (2012) Outcomes for radical prostatectomy: is it the singer, the song, or both? J Clin Oncol 30(5):476–478CrossRef Cooperberg MR, Odisho AY, Carroll PR (2012) Outcomes for radical prostatectomy: is it the singer, the song, or both? J Clin Oncol 30(5):476–478CrossRef
12.
Zurück zum Zitat Rashid HH, Leung YY, Rashid MJ, Oleyourryk G, Valvo JR, Eichel L (2006) Robotic surgical education: a systematic approach to training urology residents to perform robotic-assisted laparoscopic radical prostatectomy. Urology 68(1):75–79CrossRef Rashid HH, Leung YY, Rashid MJ, Oleyourryk G, Valvo JR, Eichel L (2006) Robotic surgical education: a systematic approach to training urology residents to perform robotic-assisted laparoscopic radical prostatectomy. Urology 68(1):75–79CrossRef
13.
Zurück zum Zitat Lerner MA, Ayalew M, Peine WJ, Sundaram CP (2010) Does training on a virtual reality robotic simulator improve performance on the da Vinci surgical system? J Endourol 24(3):467–472CrossRef Lerner MA, Ayalew M, Peine WJ, Sundaram CP (2010) Does training on a virtual reality robotic simulator improve performance on the da Vinci surgical system? J Endourol 24(3):467–472CrossRef
14.
Zurück zum Zitat Abboudi H, Khan MS, Guru KA et al (2014) Learning curves for urological procedures: a systematic review. BJU Int 114(4):617–629CrossRef Abboudi H, Khan MS, Guru KA et al (2014) Learning curves for urological procedures: a systematic review. BJU Int 114(4):617–629CrossRef
15.
Zurück zum Zitat Goh AC, Goldfarb DW, Sander JC, Miles BJ, Dunkin BJ (2012) Global evaluative assessment of robotic skills: validation of a clinical assessment tool to measure robotic surgical skills. J Urol 187(1):247–252CrossRef Goh AC, Goldfarb DW, Sander JC, Miles BJ, Dunkin BJ (2012) Global evaluative assessment of robotic skills: validation of a clinical assessment tool to measure robotic surgical skills. J Urol 187(1):247–252CrossRef
16.
Zurück zum Zitat Hussein AA, Ghani KR, Peabody J et al (2017) Development and validation of an objective scoring tool for robot-assisted radical prostatectomy: prostatectomy assessment and competency evaluation. J Urol 197(5):1237–1244CrossRef Hussein AA, Ghani KR, Peabody J et al (2017) Development and validation of an objective scoring tool for robot-assisted radical prostatectomy: prostatectomy assessment and competency evaluation. J Urol 197(5):1237–1244CrossRef
17.
Zurück zum Zitat Apramian T, Cristancho S, Sener A, Lingard L (2017) How do thresholds of principle and preference influence surgeon assessments of learner performance? Ann Surg Apramian T, Cristancho S, Sener A, Lingard L (2017) How do thresholds of principle and preference influence surgeon assessments of learner performance? Ann Surg
18.
Zurück zum Zitat Frederick PJ, Szender JB, Hussein AA et al (2017) Surgical competency for robot-assisted hysterectomy: development and validation of a robotic hysterectomy assessment score (RHAS). J Minim Invasive Gynecol 24(1):55–61CrossRef Frederick PJ, Szender JB, Hussein AA et al (2017) Surgical competency for robot-assisted hysterectomy: development and validation of a robotic hysterectomy assessment score (RHAS). J Minim Invasive Gynecol 24(1):55–61CrossRef
19.
Zurück zum Zitat Diamond IR, Grant RC, Feldman BM et al (2014) Defining consensus: a systematic review recommends methodologic criteria for reporting of Delphi studies. J Clin Epidemiol 67(4):401–409CrossRef Diamond IR, Grant RC, Feldman BM et al (2014) Defining consensus: a systematic review recommends methodologic criteria for reporting of Delphi studies. J Clin Epidemiol 67(4):401–409CrossRef
20.
Zurück zum Zitat Birkmeyer JD, Finks JF, O’Reilly A et al (2013) Surgical skill and complication rates after bariatric surgery. N Engl J Med 369(15):1434–1442CrossRef Birkmeyer JD, Finks JF, O’Reilly A et al (2013) Surgical skill and complication rates after bariatric surgery. N Engl J Med 369(15):1434–1442CrossRef
21.
Zurück zum Zitat Stolzenburg JU, Rabenalt R, Do M, Horn LC, Liatsikos EN (2006) Modular training for residents with no prior experience with open pelvic surgery in endoscopic extraperitoneal radical prostatectomy. Eur Urol 49(3):491–498; discussion 499–500CrossRef Stolzenburg JU, Rabenalt R, Do M, Horn LC, Liatsikos EN (2006) Modular training for residents with no prior experience with open pelvic surgery in endoscopic extraperitoneal radical prostatectomy. Eur Urol 49(3):491–498; discussion 499–500CrossRef
22.
Zurück zum Zitat Volpe A, Ahmed K, Dasgupta P et al (2015) Pilot validation study of the European Association of Urology Robotic Training Curriculum. Eur Urol 68(2):292–299CrossRef Volpe A, Ahmed K, Dasgupta P et al (2015) Pilot validation study of the European Association of Urology Robotic Training Curriculum. Eur Urol 68(2):292–299CrossRef
23.
Zurück zum Zitat Vassiliou MC, Feldman LS, Andrew CG et al (2005) A global assessment tool for evaluation of intraoperative laparoscopic skills. Am J Surg 190(1):107–113CrossRef Vassiliou MC, Feldman LS, Andrew CG et al (2005) A global assessment tool for evaluation of intraoperative laparoscopic skills. Am J Surg 190(1):107–113CrossRef
24.
Zurück zum Zitat Ahmed N, Devitt KS, Keshet I et al (2014) A systematic review of the effects of resident duty hour restrictions in surgery: impact on resident wellness, training, and patient outcomes. Ann Surg 259(6):1041–1053CrossRef Ahmed N, Devitt KS, Keshet I et al (2014) A systematic review of the effects of resident duty hour restrictions in surgery: impact on resident wellness, training, and patient outcomes. Ann Surg 259(6):1041–1053CrossRef
25.
Zurück zum Zitat McAlister C (2015) Breaking the silence of the switch-increasing transparency about trainee participation in surgery. N Engl J Med 372(26):2477–2479CrossRef McAlister C (2015) Breaking the silence of the switch-increasing transparency about trainee participation in surgery. N Engl J Med 372(26):2477–2479CrossRef
26.
Zurück zum Zitat Tiferes J, Hussein AA, Bisantz A et al (2016) The loud surgeon behind the console: understanding team activities during robot-assisted surgery. J Surg Educ 73(3):504–512CrossRef Tiferes J, Hussein AA, Bisantz A et al (2016) The loud surgeon behind the console: understanding team activities during robot-assisted surgery. J Surg Educ 73(3):504–512CrossRef
Metadaten
Titel
Development and validation of surgical training tool: cystectomy assessment and surgical evaluation (CASE) for robot-assisted radical cystectomy for men
verfasst von
Ahmed A. Hussein
Kevin J. Sexton
Paul R. May
Maxwell V. Meng
Abolfazl Hosseini
Daniel D. Eun
Siamak Daneshmand
Bernard H. Bochner
James O. Peabody
Ronney Abaza
Eila C. Skinner
Richard E. Hautmann
Khurshid A. Guru
Publikationsdatum
13.04.2018
Verlag
Springer US
Erschienen in
Surgical Endoscopy / Ausgabe 11/2018
Print ISSN: 0930-2794
Elektronische ISSN: 1432-2218
DOI
https://doi.org/10.1007/s00464-018-6191-3

Weitere Artikel der Ausgabe 11/2018

Surgical Endoscopy 11/2018 Zur Ausgabe

Update Chirurgie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.

S3-Leitlinie „Diagnostik und Therapie des Karpaltunnelsyndroms“

Karpaltunnelsyndrom BDC Leitlinien Webinare
CME: 2 Punkte

Das Karpaltunnelsyndrom ist die häufigste Kompressionsneuropathie peripherer Nerven. Obwohl die Anamnese mit dem nächtlichen Einschlafen der Hand (Brachialgia parästhetica nocturna) sehr typisch ist, ist eine klinisch-neurologische Untersuchung und Elektroneurografie in manchen Fällen auch eine Neurosonografie erforderlich. Im Anfangsstadium sind konservative Maßnahmen (Handgelenksschiene, Ergotherapie) empfehlenswert. Bei nicht Ansprechen der konservativen Therapie oder Auftreten von neurologischen Ausfällen ist eine Dekompression des N. medianus am Karpaltunnel indiziert.

Prof. Dr. med. Gregor Antoniadis
Berufsverband der Deutschen Chirurgie e.V.

S2e-Leitlinie „Distale Radiusfraktur“

Radiusfraktur BDC Leitlinien Webinare
CME: 2 Punkte

Das Webinar beschäftigt sich mit Fragen und Antworten zu Diagnostik und Klassifikation sowie Möglichkeiten des Ausschlusses von Zusatzverletzungen. Die Referenten erläutern, welche Frakturen konservativ behandelt werden können und wie. Das Webinar beantwortet die Frage nach aktuellen operativen Therapiekonzepten: Welcher Zugang, welches Osteosynthesematerial? Auf was muss bei der Nachbehandlung der distalen Radiusfraktur geachtet werden?

PD Dr. med. Oliver Pieske
Dr. med. Benjamin Meyknecht
Berufsverband der Deutschen Chirurgie e.V.

S1-Leitlinie „Empfehlungen zur Therapie der akuten Appendizitis bei Erwachsenen“

Appendizitis BDC Leitlinien Webinare
CME: 2 Punkte

Inhalte des Webinars zur S1-Leitlinie „Empfehlungen zur Therapie der akuten Appendizitis bei Erwachsenen“ sind die Darstellung des Projektes und des Erstellungswegs zur S1-Leitlinie, die Erläuterung der klinischen Relevanz der Klassifikation EAES 2015, die wissenschaftliche Begründung der wichtigsten Empfehlungen und die Darstellung stadiengerechter Therapieoptionen.

Dr. med. Mihailo Andric
Berufsverband der Deutschen Chirurgie e.V.