Skip to main content
Erschienen in: Surgical Endoscopy 1/2010

01.01.2010

Establishing construct validity of a virtual-reality training simulator for hysteroscopy via a multimetric scoring system

verfasst von: Michael Bajka, Stefan Tuchschmid, Daniel Fink, Gábor Székely, Matthias Harders

Erschienen in: Surgical Endoscopy | Ausgabe 1/2010

Einloggen, um Zugang zu erhalten

Abstract

Background

The aims of this study are to determine construct validity for the HystSim virtual-reality (VR) training simulator for hysteroscopy via a new multimetric scoring system (MMSS) and to explore learning curves for both novices and experienced surgeons.

Methods

Fifteen relevant metrics had been identified for diagnostic hysteroscopy by means of hierarchical task decomposition. They were grouped into four modules (visualization, ergonomics, safety, and fluid handling) and individually weighted, building the MMSS for this study. In a first step, 24 novice medical students and 12 experienced gynecologists went through a self-paced teaching tutorial, in which all participants received clearly stated goals and instructions on how to carry out hysteroscopic procedures properly for this study. All subjects performed five repeated trials on two different exercises on HystSim (exploration and diagnosis exercises). After each trial the results were presented to the participants in the form of an automated objective feedback report (AOFR). Construct validity for the MMSS and learning curves were investigated by comparing the performance between novices and experienced surgeons and in between the repeated trials. To study the effect of repeated practice, 23 of the novices returned 2 weeks later for a second training session.

Results

Comparing novices with the experienced group, the ergonomics and fluid handling modules resulted in construct validity, while the visualization module did not, and for the safety module the experienced group even scored significantly lower than novices in both exercises. The overall score showed only construct validity when the safety module was excluded. Concerning learning curves, all subjects improved significantly during the training on HystSim, with clear indication that the second training session was beneficial for novice surgeons.

Conclusions

Construct validity for HystSim has been established for different modules of VR metrics on a new MMSS developed for diagnostic hysteroscopy. Careful refinement and further testing of metrics and scores is required before using them as assessment tools for operative skills.
Literatur
1.
Zurück zum Zitat Aggarwal R, Ward J, Balasundaram I, Sains P, Athanasiou T, Darzi A (2007) Proving the effectiveness of virtual reality simulation for training in laparoscopic surgery. Ann Surg 246:771–779CrossRefPubMed Aggarwal R, Ward J, Balasundaram I, Sains P, Athanasiou T, Darzi A (2007) Proving the effectiveness of virtual reality simulation for training in laparoscopic surgery. Ann Surg 246:771–779CrossRefPubMed
2.
Zurück zum Zitat Khalifa YM, Bogorad D, Gibson V, Peifer J, Nussbaum J (2006) Virtual reality in ophthalmology training. Surv Ophthalmol 51:259–273CrossRefPubMed Khalifa YM, Bogorad D, Gibson V, Peifer J, Nussbaum J (2006) Virtual reality in ophthalmology training. Surv Ophthalmol 51:259–273CrossRefPubMed
3.
Zurück zum Zitat Michelson JD (2006) Simulation in orthopaedic education: an overview of theory and practice. J Bone Joint Surg Am 88:1405–1411CrossRefPubMed Michelson JD (2006) Simulation in orthopaedic education: an overview of theory and practice. J Bone Joint Surg Am 88:1405–1411CrossRefPubMed
4.
Zurück zum Zitat Panait L, Bell RL, Roberts KE, Duffy AJ (2008) Designing and validating a customized virtual reality-based laparoscopic skills curriculum. J Surg Educ 65:413–417CrossRefPubMed Panait L, Bell RL, Roberts KE, Duffy AJ (2008) Designing and validating a customized virtual reality-based laparoscopic skills curriculum. J Surg Educ 65:413–417CrossRefPubMed
5.
Zurück zum Zitat Park J, MacRae H, Musselman LJ, Rossos P, Hamstra SJ, Wolman S, Reznick RK (2007) Randomized controlled trial of virtual reality simulator training: transfer to live patients. Am J Surg 194:205–211CrossRefPubMed Park J, MacRae H, Musselman LJ, Rossos P, Hamstra SJ, Wolman S, Reznick RK (2007) Randomized controlled trial of virtual reality simulator training: transfer to live patients. Am J Surg 194:205–211CrossRefPubMed
6.
Zurück zum Zitat Wignall GR, Denstedt JD, Preminger GM, Cadeddu JA, Pearle MS, Sweet RM, McDougall EM (2008) Surgical simulation: a urological perspective. J Urol 179:1690–1699CrossRefPubMed Wignall GR, Denstedt JD, Preminger GM, Cadeddu JA, Pearle MS, Sweet RM, McDougall EM (2008) Surgical simulation: a urological perspective. J Urol 179:1690–1699CrossRefPubMed
7.
Zurück zum Zitat Seymour NE, Gallagher AG, Roman SA, O’Brien MK, Bansal VK, Andersen DK, Satava RM (2002) Virtual reality training improves operating room performance: results of a randomized, double-blinded study. Ann Surg 236:458–463CrossRefPubMed Seymour NE, Gallagher AG, Roman SA, O’Brien MK, Bansal VK, Andersen DK, Satava RM (2002) Virtual reality training improves operating room performance: results of a randomized, double-blinded study. Ann Surg 236:458–463CrossRefPubMed
8.
Zurück zum Zitat Schijven MP, Jakimowicz JJ, Broeders IA, Tseng LN (2005) The Eindhoven laparoscopic cholecystectomy training course—improving operating room performance using virtual reality training: results from the first E.A.E.S. accredited virtual reality trainings curriculum. Surg Endosc 19:1220–1226CrossRefPubMed Schijven MP, Jakimowicz JJ, Broeders IA, Tseng LN (2005) The Eindhoven laparoscopic cholecystectomy training course—improving operating room performance using virtual reality training: results from the first E.A.E.S. accredited virtual reality trainings curriculum. Surg Endosc 19:1220–1226CrossRefPubMed
9.
Zurück zum Zitat Carter FJ, Schijven MP, Aggarwal R, Grantcharov T, Francis NK, Hanna GB, Jakimowicz JJ (2005) Consensus guidelines for validation of virtual reality surgical simulators. Work Group for Evaluation and Implementation of Simulators and Skills Training Programmes. Surg Endosc 19:1523–1532CrossRefPubMed Carter FJ, Schijven MP, Aggarwal R, Grantcharov T, Francis NK, Hanna GB, Jakimowicz JJ (2005) Consensus guidelines for validation of virtual reality surgical simulators. Work Group for Evaluation and Implementation of Simulators and Skills Training Programmes. Surg Endosc 19:1523–1532CrossRefPubMed
10.
Zurück zum Zitat Bajka M, Tuchschmid S, Streich M, Fink D, Székely G, Harders M (2008) Evaluation of a new virtual-reality training simulator for hysteroscopy. Surg Endosc 2008 Apr 24 [Epub ahead of print] Bajka M, Tuchschmid S, Streich M, Fink D, Székely G, Harders M (2008) Evaluation of a new virtual-reality training simulator for hysteroscopy. Surg Endosc 2008 Apr 24 [Epub ahead of print]
11.
Zurück zum Zitat Harders M, Bachofen D, Bajka M, Grassi M, Heidelberger B, Sierra R, Spaelter U, Steinemann D, Teschner M, Tuchschmid S, Zatonyi J, Szekely G (2008) Virtual reality based simulation of hysteroscopic interventions. Presence-Teleop Virt Environ 17(5):441–462 Harders M, Bachofen D, Bajka M, Grassi M, Heidelberger B, Sierra R, Spaelter U, Steinemann D, Teschner M, Tuchschmid S, Zatonyi J, Szekely G (2008) Virtual reality based simulation of hysteroscopic interventions. Presence-Teleop Virt Environ 17(5):441–462
12.
Zurück zum Zitat Duffy AJ, Hogle NJ, McCarthy H, Lew JI, Egan A, Christos P, Fowler DL (2005) Construct validity for the LAPSIM laparoscopic surgical simulator. Surg Endosc 19:401–405CrossRefPubMed Duffy AJ, Hogle NJ, McCarthy H, Lew JI, Egan A, Christos P, Fowler DL (2005) Construct validity for the LAPSIM laparoscopic surgical simulator. Surg Endosc 19:401–405CrossRefPubMed
13.
Zurück zum Zitat Eriksen JR, Grantcharov T (2005) Objective assessment of laparoscopic skills using a virtual reality stimulator. Surg Endosc 19:1216–1219CrossRefPubMed Eriksen JR, Grantcharov T (2005) Objective assessment of laparoscopic skills using a virtual reality stimulator. Surg Endosc 19:1216–1219CrossRefPubMed
14.
Zurück zum Zitat Gallagher AG, Richie K, McClure N, McGuigan J (2001) Objective psychomotor skills assessment of experienced, junior, and novice laparoscopists with virtual reality. World J Surg 25:1478–1483CrossRefPubMed Gallagher AG, Richie K, McClure N, McGuigan J (2001) Objective psychomotor skills assessment of experienced, junior, and novice laparoscopists with virtual reality. World J Surg 25:1478–1483CrossRefPubMed
15.
Zurück zum Zitat McCloy R, Stone R (2001) Science, medicine, and the future. Virtual reality in surgery. BMJ 323:912–915CrossRefPubMed McCloy R, Stone R (2001) Science, medicine, and the future. Virtual reality in surgery. BMJ 323:912–915CrossRefPubMed
16.
Zurück zum Zitat Satava RM (1993) Virtual reality surgical simulator. The first steps. Surg Endosc 7:203–205CrossRefPubMed Satava RM (1993) Virtual reality surgical simulator. The first steps. Surg Endosc 7:203–205CrossRefPubMed
17.
Zurück zum Zitat Schijven M, Jakimowicz J (2003) Construct validity: experts and novices performing on the Xitact LS500 laparoscopy simulator. Surg Endosc 17:803–810CrossRefPubMed Schijven M, Jakimowicz J (2003) Construct validity: experts and novices performing on the Xitact LS500 laparoscopy simulator. Surg Endosc 17:803–810CrossRefPubMed
18.
Zurück zum Zitat Sherman V, Feldman LS, Stanbridge D, Kazmi R, Fried GM (2005) Assessing the learning curve for the acquisition of laparoscopic skills on a virtual reality simulator. Surg Endosc 19:678–682CrossRefPubMed Sherman V, Feldman LS, Stanbridge D, Kazmi R, Fried GM (2005) Assessing the learning curve for the acquisition of laparoscopic skills on a virtual reality simulator. Surg Endosc 19:678–682CrossRefPubMed
19.
Zurück zum Zitat Taffinder N, Sutton C, Fishwick RJ, McManus IC, Darzi A (1998) Validation of virtual reality to teach and assess psychomotor skills in laparoscopic surgery: results from randomised controlled studies using the MIST VR laparoscopic simulator. Stud Health Technol Inform 50:124–130PubMed Taffinder N, Sutton C, Fishwick RJ, McManus IC, Darzi A (1998) Validation of virtual reality to teach and assess psychomotor skills in laparoscopic surgery: results from randomised controlled studies using the MIST VR laparoscopic simulator. Stud Health Technol Inform 50:124–130PubMed
20.
Zurück zum Zitat Gallagher AG, Satava RM (2002) Virtual reality as a metric for the assessment of laparoscopic psychomotor skills Learning curves and reliability measures. Surg Endosc 16(12):1746–1752CrossRefPubMed Gallagher AG, Satava RM (2002) Virtual reality as a metric for the assessment of laparoscopic psychomotor skills Learning curves and reliability measures. Surg Endosc 16(12):1746–1752CrossRefPubMed
21.
Zurück zum Zitat Moorthy K, Munz Y, Dosis A, Bello F, Darzi A (2003) Motion analysis in the training and assessment of minimally invasive surgery. Minim Invasive Ther Allied Technol 12:137–142PubMed Moorthy K, Munz Y, Dosis A, Bello F, Darzi A (2003) Motion analysis in the training and assessment of minimally invasive surgery. Minim Invasive Ther Allied Technol 12:137–142PubMed
22.
Zurück zum Zitat Ritter EM, McClusky DA, Gallagher AG, Smith CD (2005) Real-time objective assessment of knot quality with a portable tensiometer is superior to execution time for assessment of laparoscopic knot-tying performance. Surg Innov 12:233–237CrossRefPubMed Ritter EM, McClusky DA, Gallagher AG, Smith CD (2005) Real-time objective assessment of knot quality with a portable tensiometer is superior to execution time for assessment of laparoscopic knot-tying performance. Surg Innov 12:233–237CrossRefPubMed
23.
Zurück zum Zitat Rosen J, Hannaford B, Richards CG, Sinanan MN (2001) Markov modeling of minimally invasive surgery based on tool/tissue interaction and force/torque signatures for evaluating surgical skills. IEEE Trans Biomed Eng 48:579–591CrossRefPubMed Rosen J, Hannaford B, Richards CG, Sinanan MN (2001) Markov modeling of minimally invasive surgery based on tool/tissue interaction and force/torque signatures for evaluating surgical skills. IEEE Trans Biomed Eng 48:579–591CrossRefPubMed
24.
Zurück zum Zitat Rosen J, Brown JD, Chang L, Sinanan MN, Hannaford B (2006) Generalized approach for modeling minimally invasive surgery as a stochastic process using a discrete markov model. IEEE Trans Biomed Eng 53:399–413CrossRefPubMed Rosen J, Brown JD, Chang L, Sinanan MN, Hannaford B (2006) Generalized approach for modeling minimally invasive surgery as a stochastic process using a discrete markov model. IEEE Trans Biomed Eng 53:399–413CrossRefPubMed
25.
Zurück zum Zitat Van Dongen KW, Tournoij E, van der Zee DC, Schijven MP, Broeders IA (2007) Construct validity of the LapSim: can the LapSim virtual reality simulator distinguish between novices and experts? Surg Endosc 21:1413–1417CrossRefPubMed Van Dongen KW, Tournoij E, van der Zee DC, Schijven MP, Broeders IA (2007) Construct validity of the LapSim: can the LapSim virtual reality simulator distinguish between novices and experts? Surg Endosc 21:1413–1417CrossRefPubMed
26.
Zurück zum Zitat Mackay S, Datta V, Chang A, Shah J, Kneebone R, Darzi A (2003) Multiple Objective Measures of Skill (MOMS): a new approach to the assessment of technical ability in surgical trainees. Ann Surg 238:291–300PubMed Mackay S, Datta V, Chang A, Shah J, Kneebone R, Darzi A (2003) Multiple Objective Measures of Skill (MOMS): a new approach to the assessment of technical ability in surgical trainees. Ann Surg 238:291–300PubMed
27.
Zurück zum Zitat Heinrichs WL, Lukoff B, Youngblood P, Dev P, Shavelson R, Hasson HM, Satava RM, McDougall EM, Wetter PA (2007) Criterion-based training with surgical simulators: proficiency of experienced surgeons. JSLS 11:273–302PubMed Heinrichs WL, Lukoff B, Youngblood P, Dev P, Shavelson R, Hasson HM, Satava RM, McDougall EM, Wetter PA (2007) Criterion-based training with surgical simulators: proficiency of experienced surgeons. JSLS 11:273–302PubMed
28.
Zurück zum Zitat Cao CG, MacKenzie CL, Ibbotson JA, Turner LJ, Blair NP, Nagy AG (1999) Hierarchical decomposition of laparoscopic procedures. Stud Health Technol Inform 62:83–89PubMed Cao CG, MacKenzie CL, Ibbotson JA, Turner LJ, Blair NP, Nagy AG (1999) Hierarchical decomposition of laparoscopic procedures. Stud Health Technol Inform 62:83–89PubMed
29.
Zurück zum Zitat Tuchschmid S, Bajka M, Bachofen D, Székely G, Harders M (2007) Objective surgical performance assessment for virtual hysteroscopy. Stud Health Technol Inform 125:473–478PubMed Tuchschmid S, Bajka M, Bachofen D, Székely G, Harders M (2007) Objective surgical performance assessment for virtual hysteroscopy. Stud Health Technol Inform 125:473–478PubMed
30.
Zurück zum Zitat Gallagher AG, Ritter EM, Satava RM (2003) Fundamental principles of validation, and reliability: rigorous science for the assessment of surgical education and training. Surg Endosc 17:1525–1529CrossRefPubMed Gallagher AG, Ritter EM, Satava RM (2003) Fundamental principles of validation, and reliability: rigorous science for the assessment of surgical education and training. Surg Endosc 17:1525–1529CrossRefPubMed
31.
Zurück zum Zitat Gallagher AG, Ritter EM, Champion H, Higgins G, Fried MP, Moses G, Smith CD, Satava RM (2005) Virtual reality simulation for the operating room: proficiency-based training as a paradigm shift in surgical skills training. Ann Surg 241:364–372CrossRefPubMed Gallagher AG, Ritter EM, Champion H, Higgins G, Fried MP, Moses G, Smith CD, Satava RM (2005) Virtual reality simulation for the operating room: proficiency-based training as a paradigm shift in surgical skills training. Ann Surg 241:364–372CrossRefPubMed
32.
Zurück zum Zitat Schijven MP, Jakimowicz J (2004) The learning curve on the Xitact LS 500 laparoscopy simulator: profiles of performance. Surg Endosc 18:121–127CrossRefPubMed Schijven MP, Jakimowicz J (2004) The learning curve on the Xitact LS 500 laparoscopy simulator: profiles of performance. Surg Endosc 18:121–127CrossRefPubMed
33.
Zurück zum Zitat Hassan I, Weyers P, Maschuw K, Dick B, Gerdes B, Rothmund M, Zielke A (2006) Negative stress-coping strategies among novices in surgery correlate with poor virtual laparoscopic performance. Br J Surg 93:1554–1559CrossRefPubMed Hassan I, Weyers P, Maschuw K, Dick B, Gerdes B, Rothmund M, Zielke A (2006) Negative stress-coping strategies among novices in surgery correlate with poor virtual laparoscopic performance. Br J Surg 93:1554–1559CrossRefPubMed
34.
Zurück zum Zitat Aggarwal R, Grantcharov TP, Eriksen JR, Blirup D, Kristiansen VB, Funch-Jensen P, Darzi A (2006) An evidence-based virtual reality training program for novice laparoscopic surgeons. Ann Surg 244:310–314CrossRefPubMed Aggarwal R, Grantcharov TP, Eriksen JR, Blirup D, Kristiansen VB, Funch-Jensen P, Darzi A (2006) An evidence-based virtual reality training program for novice laparoscopic surgeons. Ann Surg 244:310–314CrossRefPubMed
35.
Zurück zum Zitat Chaudhry A, Sutton C, Wood J, Stone R, McCloy R (1999) Learning rate for laparoscopic surgical skills on MIST VR, a virtual reality simulator: quality of human-computer interface. Ann R Coll Surg Engl 81:281–286PubMed Chaudhry A, Sutton C, Wood J, Stone R, McCloy R (1999) Learning rate for laparoscopic surgical skills on MIST VR, a virtual reality simulator: quality of human-computer interface. Ann R Coll Surg Engl 81:281–286PubMed
36.
Zurück zum Zitat Gor M, McCloy R, Stone R, Smith A (2003) Virtual reality laparoscopic simulator for assessment in gynaecology. BJOG 110:181–187CrossRefPubMed Gor M, McCloy R, Stone R, Smith A (2003) Virtual reality laparoscopic simulator for assessment in gynaecology. BJOG 110:181–187CrossRefPubMed
Metadaten
Titel
Establishing construct validity of a virtual-reality training simulator for hysteroscopy via a multimetric scoring system
verfasst von
Michael Bajka
Stefan Tuchschmid
Daniel Fink
Gábor Székely
Matthias Harders
Publikationsdatum
01.01.2010
Verlag
Springer-Verlag
Erschienen in
Surgical Endoscopy / Ausgabe 1/2010
Print ISSN: 0930-2794
Elektronische ISSN: 1432-2218
DOI
https://doi.org/10.1007/s00464-009-0582-4

Weitere Artikel der Ausgabe 1/2010

Surgical Endoscopy 1/2010 Zur Ausgabe

Echinokokkose medikamentös behandeln oder operieren?

06.05.2024 DCK 2024 Kongressbericht

Die Therapie von Echinokokkosen sollte immer in spezialisierten Zentren erfolgen. Eine symptomlose Echinokokkose kann – egal ob von Hunde- oder Fuchsbandwurm ausgelöst – konservativ erfolgen. Wenn eine Op. nötig ist, kann es sinnvoll sein, vorher Zysten zu leeren und zu desinfizieren. 

Recycling im OP – möglich, aber teuer

05.05.2024 DCK 2024 Kongressbericht

Auch wenn sich Krankenhäuser nachhaltig und grün geben – sie tragen aktuell erheblich zu den CO2-Emissionen bei und produzieren jede Menge Müll. Ein Pilotprojekt aus Bonn zeigt, dass viele Op.-Abfälle wiederverwertet werden können.

Im OP der Zukunft läuft nichts mehr ohne Kollege Roboter

04.05.2024 DCK 2024 Kongressbericht

Der OP in der Zukunft wird mit weniger Personal auskommen – nicht, weil die Technik das medizinische Fachpersonal verdrängt, sondern weil der Personalmangel es nötig macht.

Nur selten Nachblutungen nach Abszesstonsillektomie

03.05.2024 Tonsillektomie Nachrichten

In einer Metaanalyse von 18 Studien war die Rate von Nachblutungen nach einer Abszesstonsillektomie mit weniger als 7% recht niedrig. Nur rund 2% der Behandelten mussten nachoperiert werden. Die Therapie scheint damit recht sicher zu sein.

Update Chirurgie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.

S3-Leitlinie „Diagnostik und Therapie des Karpaltunnelsyndroms“

Karpaltunnelsyndrom BDC Leitlinien Webinare
CME: 2 Punkte

Das Karpaltunnelsyndrom ist die häufigste Kompressionsneuropathie peripherer Nerven. Obwohl die Anamnese mit dem nächtlichen Einschlafen der Hand (Brachialgia parästhetica nocturna) sehr typisch ist, ist eine klinisch-neurologische Untersuchung und Elektroneurografie in manchen Fällen auch eine Neurosonografie erforderlich. Im Anfangsstadium sind konservative Maßnahmen (Handgelenksschiene, Ergotherapie) empfehlenswert. Bei nicht Ansprechen der konservativen Therapie oder Auftreten von neurologischen Ausfällen ist eine Dekompression des N. medianus am Karpaltunnel indiziert.

Prof. Dr. med. Gregor Antoniadis
Berufsverband der Deutschen Chirurgie e.V.

S2e-Leitlinie „Distale Radiusfraktur“

Radiusfraktur BDC Leitlinien Webinare
CME: 2 Punkte

Das Webinar beschäftigt sich mit Fragen und Antworten zu Diagnostik und Klassifikation sowie Möglichkeiten des Ausschlusses von Zusatzverletzungen. Die Referenten erläutern, welche Frakturen konservativ behandelt werden können und wie. Das Webinar beantwortet die Frage nach aktuellen operativen Therapiekonzepten: Welcher Zugang, welches Osteosynthesematerial? Auf was muss bei der Nachbehandlung der distalen Radiusfraktur geachtet werden?

PD Dr. med. Oliver Pieske
Dr. med. Benjamin Meyknecht
Berufsverband der Deutschen Chirurgie e.V.

S1-Leitlinie „Empfehlungen zur Therapie der akuten Appendizitis bei Erwachsenen“

Appendizitis BDC Leitlinien Webinare
CME: 2 Punkte

Inhalte des Webinars zur S1-Leitlinie „Empfehlungen zur Therapie der akuten Appendizitis bei Erwachsenen“ sind die Darstellung des Projektes und des Erstellungswegs zur S1-Leitlinie, die Erläuterung der klinischen Relevanz der Klassifikation EAES 2015, die wissenschaftliche Begründung der wichtigsten Empfehlungen und die Darstellung stadiengerechter Therapieoptionen.

Dr. med. Mihailo Andric
Berufsverband der Deutschen Chirurgie e.V.