Abstract
Background
The aim of this study was to establish content, face, concurrent, and the first step of construct validity of a new simulator, the SIMENDO, in order to determine its usefulness for training basic endoscopic skills.
Methods
The validation started with an explanation of the goals, content, and features of the simulator (content validity). Then, participants from eight different medical centers consisting of experts (≥100 laparoscopic procedures performed) and surgical trainees (<100) were informed of the goals and received a “hands-on tour” of the virtual reality (VR) trainer. Subsequently, they were asked to answer 28 structured questions about the simulator (face validity). Ratings were scored on a scale from 1 (very bad/useless) to 5 (excellent/very useful). Additional comments could be given as well. Furthermore, two experiments were conducted. In experiment 1, aimed at establishing concurrent validity, the training effect of a single-handed hand–eye coordination task in the simulator was compared with a similar task in a conventional box trainer and with the performance of a control group that received no training. In experiment 2 (first step of construct validity), the total score of task time, collisions, and path length of three consecutive runs in the simulator was compared between experts (>100 endoscopic procedures) and novices (no experience).
Results
A total of 75 participants (36 expert surgeons and 39 surgical trainees) filled out the questionnaire. Usefulness of tasks, features, and movement realism were scored between a mean value of 3.3 for depth perception and 4.3 for appreciation of training with the instrument. There were no significant differences between the mean values of the scores given by the experts and surgical trainees. In response to statements, 81% considered this VR trainer generally useful for training endoscopic techniques to residents, and 83% agreed that the simulator was useful to train hand–eye coordination. In experiment 1, the training effect for the single-handed task showed no significant difference between the conventional trainer and the VR simulator (concurrent validity). In experiment 2, experts scored significantly better than novices on all parameters used (construct validity).
Conclusion
Content, face, and concurrent validity of the SIMENDO is established. The simulator is considered useful for training eye–hand coordination for endoscopic surgery. The evaluated task could discriminate between the skills of experienced surgeons and novices, giving the first indication of construct validity.
Similar content being viewed by others
References
Aggarwal R, Darzi A (2004) Surgical education and training in the new millennium. Surg Endosc 18: 1409–1410
Aggarwal R, Moorthy K, Darzi A (2004) Laparoscopic skills training and assessment. Br J Surg 91: 1549–1558
Ali MR, et al. (2002) Training the novice in laparoscopy. More challenge is better. Surg Endosc 16: 1732–1736
Babineau TJ, et al. (2004) The “cost” of operative training for surgical residents. Arch Surg 139: 366–370
Bridges M, Diamond DL (1999) The financial impact of teaching surgical residents in the operating room. Am J Surg 177: 28–32
Champion HR, Gallagher AG (2003) Surgical simulation—a “good idea whose time has come.” Br J Surg 90: 767–768
Duffy AJ, et al. (2005) Construct validity for the LAPSIM laparoscopic surgical simulator. Surg Endosc 19: 401– 405
Emken JL, McDougall EM, Clayman RV (2004) Training and assessment of laparoscopic skills. J Soc Laparoendosc Surg 8: 195–199
Feldman LS, Sherman V, Fried GM (2004) Using simulators to assess laparoscopic competence: ready for widespread use? Surgery 135: 28–42
Gallagher AG, Ritter EM, Satava RM (2003) Fundamental principles of validation and reliability: rigorous science for the assessment of surgical education and training. Surg Endosc 17: 1525–1529
Gallagher AG, et al. (1999) Virtual reality training in laparoscopic surgery: a preliminary assessment of Minimally Invasive Surgical Trainer Virtual Reality (MIST VR). Endoscopy 31: 310–313
Gallagher AG, et al. (2001) Objective psychomotor skills assessment of experienced, junior, and novice laparoscopists with virtual reality. World J Surg 25: 1478–1483
Gallagher AG, et al. (2004) Discriminative validity of the Minimally Invasive Surgical Trainer in Virtual Reality (MIST-VR) using criteria levels based on expert performance. Surg Endosc 18: 660–665
Gallagher AG, et al. (2005) Virtual reality simulation for the operating room: proficiency-based training as a paradigm shift in surgical skills training. Ann Surg 241: 364–372
Grantcharov TP, et al. (2001) Virtual reality computer simulation. Surg Endosc 15: 242–244
Grantcharov TP, et al. (2004) Randomized clinical trial of virtual reality simulation for laparoscopic skills training. Br J Surg 91: 146–150
Haluck RS (2005) Computer-based surgical simulation is too expensive. Or is it? Surg Endosc 19: 159–160
Haluck RS, et al. (2001) Are surgery training programs ready for virtual reality? A survey of program directors in general surgery. J Am Coll Surg 193: 660–665
Heijnsdijk EA, et al. (2004) The influence of force feedback and visual feedback in grasping tissue laparoscopically. Surg Endosc 18: 980–985
Krummel TM (1998) Surgical simulation and virtual reality: the coming revolution. Ann Surg 228: 635–637
Lehmann KS, et al. (2005) A prospective randomized study to test the transfer of basic psychomotor skills from virtual reality to physical reality in a comparable training setting. Ann Surg 241: 442–449
Mac Fadyen BV Jr (2004) Teaching, training, and clinical surgery. Are we making a difference. Surg Endosc 18: 361–362
Marshall RL, et al. (2000) Practical training for postgraduate year 1 surgery residents. Am J Surg 179: 194–196
Pearson AM, et al. (2002) Evaluation of structured and quantitative training methods for teaching intracorporeal knot tying. Surg Endosc 16: 130–137
Schijven M, Jakimowicz J (2002) Face-, expert, and referent validity of the Xitact LS500 laparoscopy simulator. Surg Endosc 16: 1764–1770
Schijven M, Jakimowicz J (2003) Construct validity: experts and novices performing on the Xitact LS500 laparoscopy simulator. Surg Endosc 17: 803–810
Schijven M, Jakimowicz J (2003) Virtual reality surgical laparoscopic simulators. Surg Endosc 17: 1943–1950
Seymour NE, et al. (2002) Virtual reality training improves operating room performance: results of a randomized, double-blinded study. Ann Surg 236: 458–464
Taffinder N, et al. (1998) Validation of virtual reality to teach and assess psychomotor skills in laparoscopic surgery: results from randomised controlled studies using the MIST VR laparoscopic simulator. Stud Health Technol Inform 50: 124–130
Torkington J, et al. (2000) The role of simulation in surgical training. Ann R Coll Surg Engl 82: 88–94
Torkington J, et al. (2001) Skill transfer from virtual reality to a real laparoscopic task. Surg Endosc 15: 1076–1079
Villegas L, et al. (2003) Laparoscopic skills training. Surg Endosc 17: 1879–1888
Wentink M (2003) Hand–eye coordination in minimally invasive surgery. Theory, surgical practice & training. Faculty of Mechanical Engineering and Marine Technology, Delft University of Technology, Delft, The Netherlands
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Verdaasdonk, E.G.G., Stassen, L.P.S., Monteny, L.J. et al. Validation of a new basic virtual reality simulator for training of basic endoscopic skills. Surg Endosc 20, 511–518 (2006). https://doi.org/10.1007/s00464-005-0230-6
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00464-005-0230-6