Skip to main content
Erschienen in: Knee Surgery, Sports Traumatology, Arthroscopy 6/2016

08.08.2014 | Experimental Study

Validation of the PASSPORT V2 training environment for arthroscopic skills

verfasst von: J. J. Stunt, G. M. M. J. Kerkhoffs, T. Horeman, C. N. van Dijk, G. J. M. Tuijthof

Erschienen in: Knee Surgery, Sports Traumatology, Arthroscopy | Ausgabe 6/2016

Einloggen, um Zugang zu erhalten

Abstract

Purpose

Virtual reality simulators used in the education of orthopaedic residents often lack realistic haptic feedback. To solve this, the (Practice Arthroscopic Surgical Skills for Perfect Operative Real-life Treatment) PASSPORT simulator was developed, which was subjected to fundamental changes: improved realism and user interface. The purpose was to demonstrate its face and construct validity.

Methods

Thirty-one participants were divided into three groups having different levels of arthroscopic experience. Participants answered questions regarding general information and the outer appearance of the simulator for face validity. Construct validity was assessed with one standardized navigation task, which was timed. Face validity, educational value and user-friendliness were determined with two representative exercises and by asking participants to fill out the questionnaire. A value of 7 or greater was considered sufficient.

Results

Construct validity was demonstrated between experts and novices. Median task time for the fifth trial was 55 s (range 17–139 s) for the novices, 33 s (range 17–59 s) for the intermediates, and 26 s (range 14–52 s) for the experts. Median task times of three trials were not significantly different between the novices and intermediates, and none of the trials between intermediates and experts. Face validity, educational value and user-friendliness were perceived as sufficient (median >7). The presence of realistic tactile feedback was considered the biggest asset of the simulator.

Conclusion

Proper preparation for arthroscopic operations will increase the quality of real-life surgery and patients’ safety. The PASSPORT simulator can assist in achieving this, as it showed construct and face validity, and its physical nature offered adequate haptic feedback during training. This indicates that PASSPORT has potential to evolve as a valuable training modality.
Literatur
1.
Zurück zum Zitat Anastakis DJ, Regehr G, Reznick RK, Cusimano M, Murnaghan J, Brown M, Hutchison C (1999) Assessment of technical skills transfer from the bench training model to the human model. Am J Surg 177:167–170CrossRefPubMed Anastakis DJ, Regehr G, Reznick RK, Cusimano M, Murnaghan J, Brown M, Hutchison C (1999) Assessment of technical skills transfer from the bench training model to the human model. Am J Surg 177:167–170CrossRefPubMed
2.
Zurück zum Zitat Brehmer M, Swartz R (2005) Training on bench models improves dexterity in ureteroscopy. Eur Urol 48:458–463CrossRefPubMed Brehmer M, Swartz R (2005) Training on bench models improves dexterity in ureteroscopy. Eur Urol 48:458–463CrossRefPubMed
3.
Zurück zum Zitat Brehmer M, Tolley D (2002) Validation of a bench model for endoscopic surgery in the upper urinary tract. Eur Urol 42:175–179CrossRefPubMed Brehmer M, Tolley D (2002) Validation of a bench model for endoscopic surgery in the upper urinary tract. Eur Urol 42:175–179CrossRefPubMed
4.
Zurück zum Zitat Bridges M, Diamond DL (1999) The financial impact of teaching surgical residents in the operating room. Am J Surg 177:28–32CrossRefPubMed Bridges M, Diamond DL (1999) The financial impact of teaching surgical residents in the operating room. Am J Surg 177:28–32CrossRefPubMed
5.
Zurück zum Zitat Cannon WD, Eckhoff DG, Garrett WE Jr, Hunter RE, Sweeney HJ (2006) Report of a group developing a virtual reality simulator for arthroscopic surgery of the knee joint. Clin Orthop Relat Res 442:21–29CrossRefPubMed Cannon WD, Eckhoff DG, Garrett WE Jr, Hunter RE, Sweeney HJ (2006) Report of a group developing a virtual reality simulator for arthroscopic surgery of the knee joint. Clin Orthop Relat Res 442:21–29CrossRefPubMed
6.
Zurück zum Zitat Escoto A, Trejos AL, Naish MD, Patel RV, Lebel ME (2012) Force sensing-based simulator for arthroscopic skills assessment in orthopaedic knee surgery. Stud Health Technol Inform 173:129–135PubMed Escoto A, Trejos AL, Naish MD, Patel RV, Lebel ME (2012) Force sensing-based simulator for arthroscopic skills assessment in orthopaedic knee surgery. Stud Health Technol Inform 173:129–135PubMed
7.
Zurück zum Zitat Gomoll AH, O’Toole RV, Czarnecki J, Warner JJ (2007) Surgical experience correlates with performance on a virtual reality simulator for shoulder arthroscopy. Am J Sports Med 35:883–888CrossRefPubMed Gomoll AH, O’Toole RV, Czarnecki J, Warner JJ (2007) Surgical experience correlates with performance on a virtual reality simulator for shoulder arthroscopy. Am J Sports Med 35:883–888CrossRefPubMed
8.
Zurück zum Zitat Gomoll AH, Pappas G, Forsythe B, Warner JJ (2008) Individual skill progression on a virtual reality simulator for shoulder arthroscopy: a 3-year follow-up study. Am J Sports Med 36:1139–1142CrossRefPubMed Gomoll AH, Pappas G, Forsythe B, Warner JJ (2008) Individual skill progression on a virtual reality simulator for shoulder arthroscopy: a 3-year follow-up study. Am J Sports Med 36:1139–1142CrossRefPubMed
9.
Zurück zum Zitat Grantcharov TP, Kristiansen VB, Bendix J, Bardram L, Rosenberg J, Funch-Jensen P (2004) Randomized clinical trial of virtual reality simulation for laparoscopic skills training. Br J Surg 91:146–150CrossRefPubMed Grantcharov TP, Kristiansen VB, Bendix J, Bardram L, Rosenberg J, Funch-Jensen P (2004) Randomized clinical trial of virtual reality simulation for laparoscopic skills training. Br J Surg 91:146–150CrossRefPubMed
10.
Zurück zum Zitat Holm S (1979) A simple sequentially rejective multiple test procedure. Scand J Stat 6:65–70 Holm S (1979) A simple sequentially rejective multiple test procedure. Scand J Stat 6:65–70
11.
Zurück zum Zitat Horeman T, Rodrigues SP, Jansen FW, Dankelman J, van den Dobbelsteen JJ (2010) Force measurement platform for training and assessment of laparoscopic skills. Surg Endosc 24:3102–3108CrossRefPubMedPubMedCentral Horeman T, Rodrigues SP, Jansen FW, Dankelman J, van den Dobbelsteen JJ (2010) Force measurement platform for training and assessment of laparoscopic skills. Surg Endosc 24:3102–3108CrossRefPubMedPubMedCentral
12.
Zurück zum Zitat Howells NR, Gill HS, Carr AJ, Price AJ, Rees JL (2008) Transferring simulated arthroscopic skills to the operating theatre: a randomised blinded study. J Bone Joint Surg Br 90:494–499CrossRefPubMed Howells NR, Gill HS, Carr AJ, Price AJ, Rees JL (2008) Transferring simulated arthroscopic skills to the operating theatre: a randomised blinded study. J Bone Joint Surg Br 90:494–499CrossRefPubMed
13.
Zurück zum Zitat Jacomides L, Ogan K, Cadeddu JA, Pearle MS (2004) Use of a virtual reality simulator for ureteroscopy training. J Urol 171:320–323CrossRefPubMed Jacomides L, Ogan K, Cadeddu JA, Pearle MS (2004) Use of a virtual reality simulator for ureteroscopy training. J Urol 171:320–323CrossRefPubMed
14.
Zurück zum Zitat Knoll T, Trojan L, Haecker A, Alken P, Michel MS (2005) Validation of computer-based training in ureterorenoscopy. BJU Int 95:1276–1279CrossRefPubMed Knoll T, Trojan L, Haecker A, Alken P, Michel MS (2005) Validation of computer-based training in ureterorenoscopy. BJU Int 95:1276–1279CrossRefPubMed
15.
Zurück zum Zitat Leong JJ, Leff DR, Das A, Aggarwal R, Reilly P, Atkinson HD, Emery RJ, Darzi AW (2008) Validation of orthopaedic bench models for trauma surgery. J Bone Joint Surg Br 90:958–965CrossRefPubMed Leong JJ, Leff DR, Das A, Aggarwal R, Reilly P, Atkinson HD, Emery RJ, Darzi AW (2008) Validation of orthopaedic bench models for trauma surgery. J Bone Joint Surg Br 90:958–965CrossRefPubMed
16.
Zurück zum Zitat Reznek M, Harter P, Krummel T (2002) Virtual reality and simulation: training the future emergency physician. Acad Emerg Med 9:78–87CrossRefPubMed Reznek M, Harter P, Krummel T (2002) Virtual reality and simulation: training the future emergency physician. Acad Emerg Med 9:78–87CrossRefPubMed
17.
Zurück zum Zitat Matsumoto ED, Hamstra SJ, Radomski SB, Cusimano MD (2001) A novel approach to endourological training: training at the Surgical Skills Center. J Urol 166:1261–1266CrossRefPubMed Matsumoto ED, Hamstra SJ, Radomski SB, Cusimano MD (2001) A novel approach to endourological training: training at the Surgical Skills Center. J Urol 166:1261–1266CrossRefPubMed
18.
Zurück zum Zitat Matsumoto ED, Pace KT, D’A Honey RJ (2006) Virtual reality ureteroscopy simulator as a valid tool for assessing endourological skills. Int J Urol 13:896–901CrossRefPubMed Matsumoto ED, Pace KT, D’A Honey RJ (2006) Virtual reality ureteroscopy simulator as a valid tool for assessing endourological skills. Int J Urol 13:896–901CrossRefPubMed
19.
Zurück zum Zitat McCarthy AD, Moody L, Waterworth AR, Bickerstaff DR (2006) Passive haptics in a knee arthroscopy simulator: is it valid for core skills training? Clin Orthop Relat Res 442:13–20CrossRefPubMed McCarthy AD, Moody L, Waterworth AR, Bickerstaff DR (2006) Passive haptics in a knee arthroscopy simulator: is it valid for core skills training? Clin Orthop Relat Res 442:13–20CrossRefPubMed
20.
Zurück zum Zitat Michelson JD (2006) Simulation in orthopaedic education: an overview of theory and practice. J Bone Joint Surg Am 88:1405–1411CrossRefPubMed Michelson JD (2006) Simulation in orthopaedic education: an overview of theory and practice. J Bone Joint Surg Am 88:1405–1411CrossRefPubMed
21.
Zurück zum Zitat Modi CS, Morris G, Mukherjee R (2010) Computer-simulation training for knee and shoulder arthroscopic surgery. Arthroscopy 26:832–840CrossRefPubMed Modi CS, Morris G, Mukherjee R (2010) Computer-simulation training for knee and shoulder arthroscopic surgery. Arthroscopy 26:832–840CrossRefPubMed
22.
Zurück zum Zitat Moody L, Waterworth A, McCarthy AD, Harley P, Smallwood R (2008) The feasibility of a mixed reality surgical training environment. Virtual Real 12:77–86CrossRef Moody L, Waterworth A, McCarthy AD, Harley P, Smallwood R (2008) The feasibility of a mixed reality surgical training environment. Virtual Real 12:77–86CrossRef
23.
Zurück zum Zitat Muller W, Bockholt U (1998) The virtual reality arthroscopy training simulator. Stud Health Technol Inform 50:13–19PubMed Muller W, Bockholt U (1998) The virtual reality arthroscopy training simulator. Stud Health Technol Inform 50:13–19PubMed
24.
Zurück zum Zitat Naik VN, Matsumoto ED, Houston PL, Hamstra SJ, Yeung RY, Mallon JS, Martire TM (2001) Fiberoptic orotracheal intubation on anesthetized patients: do manipulation skills learned on a simple model transfer into the operating room? Anesthesiology 95:343–348CrossRefPubMed Naik VN, Matsumoto ED, Houston PL, Hamstra SJ, Yeung RY, Mallon JS, Martire TM (2001) Fiberoptic orotracheal intubation on anesthetized patients: do manipulation skills learned on a simple model transfer into the operating room? Anesthesiology 95:343–348CrossRefPubMed
25.
Zurück zum Zitat O’Neill PJ, Cosgarea AJ, Freedman JA, Queale WS, McFarland EG (2002) Arthroscopic proficiency: a survey of orthopaedic sports medicine fellowship directors and orthopaedic surgery department chairs. Arthroscopy 18:795–800CrossRefPubMed O’Neill PJ, Cosgarea AJ, Freedman JA, Queale WS, McFarland EG (2002) Arthroscopic proficiency: a survey of orthopaedic sports medicine fellowship directors and orthopaedic surgery department chairs. Arthroscopy 18:795–800CrossRefPubMed
26.
Zurück zum Zitat Ogan K, Jacomides L, Shulman MJ, Roehrborn CG, Cadeddu JA, Pearle MS (2004) Virtual ureteroscopy predicts ureteroscopic proficiency of medical students on a cadaver. J Urol 172:667–671CrossRefPubMed Ogan K, Jacomides L, Shulman MJ, Roehrborn CG, Cadeddu JA, Pearle MS (2004) Virtual ureteroscopy predicts ureteroscopic proficiency of medical students on a cadaver. J Urol 172:667–671CrossRefPubMed
28.
Zurück zum Zitat Oostema JA, Abdel MP, Gould JC (2008) Time-efficient laparoscopic skills assessment using an augmented-reality simulator. Surg Endosc 22:2621–2624CrossRefPubMed Oostema JA, Abdel MP, Gould JC (2008) Time-efficient laparoscopic skills assessment using an augmented-reality simulator. Surg Endosc 22:2621–2624CrossRefPubMed
29.
Zurück zum Zitat Pedowitz RA, Esch J, Snyder S (2002) Evaluation of a virtual reality simulator for arthroscopy skills development. Arthroscopy 18:E29CrossRefPubMed Pedowitz RA, Esch J, Snyder S (2002) Evaluation of a virtual reality simulator for arthroscopy skills development. Arthroscopy 18:E29CrossRefPubMed
30.
Zurück zum Zitat Safir O, Dubrowski A, Mirsky L, Lin C, Backstein D, Carnahan A (2008) What skills should simulation training in arthroscopy teach residents? Int J Comput Assist Radiol Surg 3:433–437CrossRef Safir O, Dubrowski A, Mirsky L, Lin C, Backstein D, Carnahan A (2008) What skills should simulation training in arthroscopy teach residents? Int J Comput Assist Radiol Surg 3:433–437CrossRef
31.
Zurück zum Zitat Seymour NE, Gallagher AG, Roman SA, O’Brien MK, Bansal VK, Andersen DK, Satava RM (2002) Virtual reality training improves operating room performance: results of a randomized, double-blinded study. Ann Surg 236:458–463CrossRefPubMedPubMedCentral Seymour NE, Gallagher AG, Roman SA, O’Brien MK, Bansal VK, Andersen DK, Satava RM (2002) Virtual reality training improves operating room performance: results of a randomized, double-blinded study. Ann Surg 236:458–463CrossRefPubMedPubMedCentral
32.
Zurück zum Zitat Slade Shantz JA, Leiter JR, Gottschalk T, MacDonald PB (2014) The internal validity of arthroscopic simulators and their effectiveness in arthroscopic education. Knee Surg Sports Traumatol Arthrosc 22:33–40CrossRefPubMed Slade Shantz JA, Leiter JR, Gottschalk T, MacDonald PB (2014) The internal validity of arthroscopic simulators and their effectiveness in arthroscopic education. Knee Surg Sports Traumatol Arthrosc 22:33–40CrossRefPubMed
33.
Zurück zum Zitat Srivastava S, Youngblood PL, Rawn C, Hariri S, Heinrichs WL, Ladd AL (2004) Initial evaluation of a shoulder arthroscopy simulator: establishing construct validity. J Shoulder Elbow Surg 13:196–205CrossRefPubMed Srivastava S, Youngblood PL, Rawn C, Hariri S, Heinrichs WL, Ladd AL (2004) Initial evaluation of a shoulder arthroscopy simulator: establishing construct validity. J Shoulder Elbow Surg 13:196–205CrossRefPubMed
34.
Zurück zum Zitat Stunt JJ, Wulms PHLM, Kerkhoffs GM, Sierevelt IN, Schafroth MU, Tuijthof GJM (2013) Variation in joint stressing magnitudes during knee arthroscopy. Knee Surg Sports Traumatol Arthrosc 22(7):1529–1535 Stunt JJ, Wulms PHLM, Kerkhoffs GM, Sierevelt IN, Schafroth MU, Tuijthof GJM (2013) Variation in joint stressing magnitudes during knee arthroscopy. Knee Surg Sports Traumatol Arthrosc 22(7):1529–1535
35.
Zurück zum Zitat Torkington J, Smith SG, Rees BI, Darzi A (2000) The role of simulation in surgical training. Ann R Coll Surg Engl 82:88–94PubMedPubMedCentral Torkington J, Smith SG, Rees BI, Darzi A (2000) The role of simulation in surgical training. Ann R Coll Surg Engl 82:88–94PubMedPubMedCentral
36.
Zurück zum Zitat Tuijthof GJM, Horeman T (2011) Training facility, surgical instruments and artificial knee with an upper limb and a lower limb for simulation and training of arthroscopic surgical techniques. Patent NL2006846 Tuijthof GJM, Horeman T (2011) Training facility, surgical instruments and artificial knee with an upper limb and a lower limb for simulation and training of arthroscopic surgical techniques. Patent NL2006846
37.
Zurück zum Zitat Tuijthof GJ, van Sterkenburg MN, Sierevelt IN, van Oldenrijk J, van Dijk CN, Kerkhoffs GM (2010) First validation of the PASSPORT training environment for arthroscopic skills. Knee Surg Sports Traumatol Arthrosc 18:218–224CrossRefPubMed Tuijthof GJ, van Sterkenburg MN, Sierevelt IN, van Oldenrijk J, van Dijk CN, Kerkhoffs GM (2010) First validation of the PASSPORT training environment for arthroscopic skills. Knee Surg Sports Traumatol Arthrosc 18:218–224CrossRefPubMed
38.
Zurück zum Zitat Tuijthof GJ, Visser P, Sierevelt IN, van Dijk CN, Kerkhoffs GM (2011) Does perception of usefulness of arthroscopic simulators differ with levels of experience? Clin Orthop Relat Res 469:1701–1708CrossRefPubMedPubMedCentral Tuijthof GJ, Visser P, Sierevelt IN, van Dijk CN, Kerkhoffs GM (2011) Does perception of usefulness of arthroscopic simulators differ with levels of experience? Clin Orthop Relat Res 469:1701–1708CrossRefPubMedPubMedCentral
39.
Zurück zum Zitat van Hove PD, Tuijthof GJ, Verdaasdonk EG, Stassen LP, Dankelman J (2010) Objective assessment of technical surgical skills. Br J Surg 97:972–987CrossRefPubMed van Hove PD, Tuijthof GJ, Verdaasdonk EG, Stassen LP, Dankelman J (2010) Objective assessment of technical surgical skills. Br J Surg 97:972–987CrossRefPubMed
40.
Zurück zum Zitat Verdaasdonk EG, Stassen LP, Monteny LJ, Dankelman J (2006) Validation of a new basic virtual reality simulator for training of basic endoscopic skills: the SIMENDO. Surg Endosc 20:511–518CrossRefPubMed Verdaasdonk EG, Stassen LP, Monteny LJ, Dankelman J (2006) Validation of a new basic virtual reality simulator for training of basic endoscopic skills: the SIMENDO. Surg Endosc 20:511–518CrossRefPubMed
41.
Zurück zum Zitat Verdaasdonk EG, Stassen LP, Schijven MP, Dankelman J (2007) Construct validity and assessment of the learning curve for the SIMENDO endoscopic simulator. Surg Endosc 21:1406–1412CrossRefPubMed Verdaasdonk EG, Stassen LP, Schijven MP, Dankelman J (2007) Construct validity and assessment of the learning curve for the SIMENDO endoscopic simulator. Surg Endosc 21:1406–1412CrossRefPubMed
42.
Zurück zum Zitat Verdaasdonk EG, Stassen LP, van Wijk RP, Dankelman J (2007) The influence of different training schedules on the learning of psychomotor skills for endoscopic surgery. Surg Endosc 21:214–219CrossRefPubMed Verdaasdonk EG, Stassen LP, van Wijk RP, Dankelman J (2007) The influence of different training schedules on the learning of psychomotor skills for endoscopic surgery. Surg Endosc 21:214–219CrossRefPubMed
43.
Zurück zum Zitat Watterson JD, Beiko DT, Kuan JK, Denstedt JD (2002) Randomized prospective blinded study validating acquisition of ureteroscopy skills using computer based virtual reality endourological simulator. J Urol 168:1928–1932CrossRefPubMed Watterson JD, Beiko DT, Kuan JK, Denstedt JD (2002) Randomized prospective blinded study validating acquisition of ureteroscopy skills using computer based virtual reality endourological simulator. J Urol 168:1928–1932CrossRefPubMed
44.
Zurück zum Zitat White MA, Dehaan AP, Stephens DD, Maes AA, Maatman TJ (2010) Validation of a high fidelity adult ureteroscopy and renoscopy simulator. J Urol 183:673–677CrossRefPubMed White MA, Dehaan AP, Stephens DD, Maes AA, Maatman TJ (2010) Validation of a high fidelity adult ureteroscopy and renoscopy simulator. J Urol 183:673–677CrossRefPubMed
45.
Zurück zum Zitat Zivanovic A, Dibble E, Davies B, Moody L, Waterworth A (2003) Engineering requirements for a haptic simulator for knee arthroscopy training. Stud Health Technol Inform 94:413–418PubMed Zivanovic A, Dibble E, Davies B, Moody L, Waterworth A (2003) Engineering requirements for a haptic simulator for knee arthroscopy training. Stud Health Technol Inform 94:413–418PubMed
Metadaten
Titel
Validation of the PASSPORT V2 training environment for arthroscopic skills
verfasst von
J. J. Stunt
G. M. M. J. Kerkhoffs
T. Horeman
C. N. van Dijk
G. J. M. Tuijthof
Publikationsdatum
08.08.2014
Verlag
Springer Berlin Heidelberg
Erschienen in
Knee Surgery, Sports Traumatology, Arthroscopy / Ausgabe 6/2016
Print ISSN: 0942-2056
Elektronische ISSN: 1433-7347
DOI
https://doi.org/10.1007/s00167-014-3213-0

Weitere Artikel der Ausgabe 6/2016

Knee Surgery, Sports Traumatology, Arthroscopy 6/2016 Zur Ausgabe

Arthropedia

Grundlagenwissen der Arthroskopie und Gelenkchirurgie. Erweitert durch Fallbeispiele, Videos und Abbildungen. 
» Jetzt entdecken

Update Orthopädie und Unfallchirurgie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.