Skip to main content
Erschienen in: Surgical Endoscopy 5/2003

01.05.2003

Construct validity

verfasst von: M. Schijven, J. Jakimowicz

Erschienen in: Surgical Endoscopy | Ausgabe 5/2003

Einloggen, um Zugang zu erhalten

Abstract

Background: This study was undertaken to establish construct validity of the Xitact LS500, a virtual reality laparoscopic cholecystectomy simulator. The primary research statement is: “The clip-and-cut task on the Xitact LS500 virtual reality laparoscopic cholecystectomy simulator mimics the surgical procedure of the clipping and cutting of the cystic duct and artery during the laparoscopic cholecystectomy adequately.” Methods: According to the level of experience of the surgeon, an “expert group opinion” was formed resulting from 37 surgeons having performed over 100 laparoscopic cholecystectomies, and a “novice group opinion” was formed resulting of 37 surgeons having no experience at all with performing laparoscopic cholecystectomy. Participants received an instructed hands-on “tour” on the Xitact simulator and performed three formal simulation runs. Results: The “novice group” is younger and more surgeons are female. Performance scores in the “expert” group are significantly higher on the second (p value 0.011) and third (p value 0.005) run, compared to the novices’ scores. Experts are significantly faster on completion of all three runs. There is an increase in score over runs in both groups, which is statistically significant in the “expert group.” Less than one-third of surgeons in either group are able to correctly predict their performance score as generated by Xitact. Both “experts” and “novices” feel it is useful to train with Xitact LS500 in the surgical curriculum. Conclusions: Three hypotheses, formulated to operationalize the primary research statement, could be answered affirmatively. Although further validation studies are needed, the Xitact LS500 simulator seems to be able to discriminate between expert and novice surgeons in this research setting, and thus the construct for this setting is considered to be valid.
Literatur
1.
Zurück zum Zitat Ault, G, et al. 2001Exporting a technical skills evaluation technology to other sites.Am J Surg182254256CrossRefPubMed Ault, G,  et al. 2001Exporting a technical skills evaluation technology to other sites.Am J Surg182254256CrossRefPubMed
2.
Zurück zum Zitat Chaudhry, A, et al. 1999Learning rate for laparoscopic surgical skills on MIST VR, a virtual reality simulator: quality of human–computer interface.Ann R Coll Surg Engl81281286 Chaudhry, A,  et al. 1999Learning rate for laparoscopic surgical skills on MIST VR, a virtual reality simulator: quality of human–computer interface.Ann R Coll Surg Engl81281286
3.
Zurück zum Zitat Coleman, J, Nduka, CC, Darzi, A 1994Virtual reality and laparoscopic surgery.Br J Surg8117091711PubMed Coleman, J, Nduka, CC, Darzi, A 1994Virtual reality and laparoscopic surgery.Br J Surg8117091711PubMed
4.
Zurück zum Zitat Derossis, AM, Antoniuk, M, Fried, GM 1999Evaluation of laparoscopic skills: a 2-year follow-up during residency training.Can J Surg42293296PubMed Derossis, AM, Antoniuk, M, Fried, GM 1999Evaluation of laparoscopic skills: a 2-year follow-up during residency training.Can J Surg42293296PubMed
5.
Zurück zum Zitat Gaberson, KB 1997Measurement reliability and validity.AORN J6610921094PubMed Gaberson, KB 1997Measurement reliability and validity.AORN J6610921094PubMed
6.
Zurück zum Zitat Gallagher, AG, et al. 1999Virtual reality training in laparoscopic surgery: a preliminary assessment of Minimally Invasive Surgical Trainer Virtual Reality (MIST VR).Endoscopy31310313CrossRefPubMed Gallagher, AG,  et al. 1999Virtual reality training in laparoscopic surgery: a preliminary assessment of Minimally Invasive Surgical Trainer Virtual Reality (MIST VR).Endoscopy31310313CrossRefPubMed
7.
Zurück zum Zitat Gallagher A, Crothers I, Satava R (2001) Comprehensive objective assessment of fundamental skills for laparoscopic surgery. In 19th International Congress of the European Association for Endoscopic Surgery, Maastricht, The Netherlands Gallagher A, Crothers I, Satava R (2001) Comprehensive objective assessment of fundamental skills for laparoscopic surgery. In 19th International Congress of the European Association for Endoscopic Surgery, Maastricht, The Netherlands
8.
Zurück zum Zitat Gallagher AG, et al. (2001) Objective psychomotor skills assessment of experienced, junior, and novice laparoscopists with virtual reality. World J Surg DOI: 10.1007/s00268-001-0133-1 Gallagher AG, et al. (2001) Objective psychomotor skills assessment of experienced, junior, and novice laparoscopists with virtual reality. World J Surg DOI: 10.1007/s00268-001-0133-1
9.
Zurück zum Zitat Gallagher AG, et al. (2002) From VR to OR: a prospective, randomized, double-blind controlled trial of virtual reality (VR) training for operating room (OR) performance of laparoscopic cholecystectomy. In 10th International Congress of the European Association for Endoscopic Surgery, Centro de Congresses, Lisboa, Portugal Gallagher AG, et al. (2002) From VR to OR: a prospective, randomized, double-blind controlled trial of virtual reality (VR) training for operating room (OR) performance of laparoscopic cholecystectomy. In 10th International Congress of the European Association for Endoscopic Surgery, Centro de Congresses, Lisboa, Portugal
10.
Zurück zum Zitat Grantcharov, TP, et al. 2001Virtual reality computer simulation: an objective method for the evaluation of laparoscopic surgical skills.Surg Endosc15242244CrossRefPubMed Grantcharov, TP,  et al. 2001Virtual reality computer simulation: an objective method for the evaluation of laparoscopic surgical skills.Surg Endosc15242244CrossRefPubMed
11.
Zurück zum Zitat Grantcharov TP (2002) Teaching and testing surgical skills on a VR laparoscopy simulator—learning curves and effect of previous operative experience on performance. In 10th International Congress of the European Association for Endoscopic Surgery, Centro de Congresses, Lisboa, Portugal Grantcharov TP (2002) Teaching and testing surgical skills on a VR laparoscopy simulator—learning curves and effect of previous operative experience on performance. In 10th International Congress of the European Association for Endoscopic Surgery, Centro de Congresses, Lisboa, Portugal
12.
Zurück zum Zitat Hyltander A et al. (2002) The transfer of basic skills learned in a laparoscopic simulator to the operating room. Surg Endosc DOI: 10.1007/s00464-001-9184-5 Hyltander A et al. (2002) The transfer of basic skills learned in a laparoscopic simulator to the operating room. Surg Endosc DOI: 10.1007/s00464-001-9184-5
13.
Zurück zum Zitat Jordan, J-A, et al. 2000A comparison between randomly alternating imaging, normal laparoscopic imaging, and virtual reality training in laparoscopic psychomotor skill acquisition.Am J Surg180208211PubMed Jordan, J-A,  et al. 2000A comparison between randomly alternating imaging, normal laparoscopic imaging, and virtual reality training in laparoscopic psychomotor skill acquisition.Am J Surg180208211PubMed
14.
Zurück zum Zitat Karras, D 1997Statistical methodology: II. Reliability and validity assessment in study design, part B.Acad Emerg Med4144147PubMed Karras, D 1997Statistical methodology: II. Reliability and validity assessment in study design, part B.Acad Emerg Med4144147PubMed
15.
Zurück zum Zitat McNatt, SS, Smith, SGT 2001A computer-based laparoscopic skills assessment device differentiates experienced from novice surgeons.Surg Endosc1510851089 McNatt, SS, Smith, SGT 2001A computer-based laparoscopic skills assessment device differentiates experienced from novice surgeons.Surg Endosc1510851089
16.
Zurück zum Zitat Nelson, AA 1980Research design: measurement, reliability and validity.Am J Hosp Pharm37851857PubMed Nelson, AA 1980Research design: measurement, reliability and validity.Am J Hosp Pharm37851857PubMed
17.
Zurück zum Zitat Ota, D, et al. 1995Virtual reality in surgical education.Comput Biol Med25127137 Ota, D,  et al. 1995Virtual reality in surgical education.Comput Biol Med25127137
18.
Zurück zum Zitat Paisly, AM, Baldwin, P, Paterson-Brown, S 2001Feasibility, reliability and validity of new assessment form for use with basic surgical trainees.Am J Surg1822429CrossRefPubMed Paisly, AM, Baldwin, P, Paterson-Brown, S 2001Feasibility, reliability and validity of new assessment form for use with basic surgical trainees.Am J Surg1822429CrossRefPubMed
19.
Zurück zum Zitat Paisly, AM, Baldwin, P, Paterson-Brown, S 2001Validity of surgical simulation for the assessment of operative skill.Br J Surg8815251532CrossRefPubMed Paisly, AM, Baldwin, P, Paterson-Brown, S 2001Validity of surgical simulation for the assessment of operative skill.Br J Surg8815251532CrossRefPubMed
20.
Zurück zum Zitat Prystowski, JB, et al. 1999A virtual reality module for intravenous catheter placement.Am J Surg177171175CrossRefPubMed Prystowski, JB,  et al. 1999A virtual reality module for intravenous catheter placement.Am J Surg177171175CrossRefPubMed
21.
Zurück zum Zitat Reznick, RK 1993Teaching and testing technical skills.Am J Surg165358361PubMed Reznick, RK 1993Teaching and testing technical skills.Am J Surg165358361PubMed
22.
Zurück zum Zitat Reznick, R, et al. 1997Testing technical skills via an innovative “Bench Examination.”Am J Surg173226230CrossRefPubMed Reznick, R,  et al. 1997Testing technical skills via an innovative “Bench Examination.”Am J Surg173226230CrossRefPubMed
23.
Zurück zum Zitat Satava, RM 2001Accomplishments and challenges of surgical simulation. Dawning of the next-generation surgical education.Surg Endosc15232241CrossRefPubMed Satava, RM 2001Accomplishments and challenges of surgical simulation. Dawning of the next-generation surgical education.Surg Endosc15232241CrossRefPubMed
24.
Zurück zum Zitat Schijven MP, Jakimowicz J (2002) Face, expert, and referent validity of the Xitact LS500 Laparoscopy Simulator. Surg Endosc DOI: 10.1007/s00464-001-9229-9 Schijven MP, Jakimowicz J (2002) Face, expert, and referent validity of the Xitact LS500 Laparoscopy Simulator. Surg Endosc DOI: 10.1007/s00464-001-9229-9
25.
Zurück zum Zitat Schijven MP, Jakimowicz J, Schot C (2002) The Advanced Dundee Endoscopic Psychomotor Tester (ADEPT) objectifying subjective psychomotor test performance. Surg Endosc DOI: 10.1007/s00464-001-9146-y Schijven MP, Jakimowicz J, Schot C (2002) The Advanced Dundee Endoscopic Psychomotor Tester (ADEPT) objectifying subjective psychomotor test performance. Surg Endosc DOI: 10.1007/s00464-001-9146-y
26.
Zurück zum Zitat Taffinder, N, et al. 1998Validation of virtual reality to teach and assess psychomotor skills in laparoscopic surgery: results from randomized controlled studies using the MIST VR laparoscopic simulator.Westwood, JD eds. Technology and Informatics 50: Proceedings of Medicine Meets Virtual Reality, 28–31 January 1998IOS Press and Ohmsha AmsterdamSan Diego Taffinder, N,  et al. 1998Validation of virtual reality to teach and assess psychomotor skills in laparoscopic surgery: results from randomized controlled studies using the MIST VR laparoscopic simulator.Westwood, JD eds. Technology and Informatics 50: Proceedings of Medicine Meets Virtual Reality, 28–31 January 1998IOS Press and Ohmsha AmsterdamSan Diego
27.
Zurück zum Zitat Taffinder, NJ, et al. 1998An objective assessment of surgeons’ psychomotor skills: validation of the MIST-VR laparoscopic simulator.Br J Surg8575PubMed Taffinder, NJ,  et al. 1998An objective assessment of surgeons’ psychomotor skills: validation of the MIST-VR laparoscopic simulator.Br J Surg8575PubMed
28.
Zurück zum Zitat Torkington, J, et al. 2001Skill transfer from virtual reality to a real laparoscopic task.Surg Endosc1510761079PubMed Torkington, J,  et al. 2001Skill transfer from virtual reality to a real laparoscopic task.Surg Endosc1510761079PubMed
29.
Zurück zum Zitat Whitney, JD 1999Notes on methodology. Validity and reliability: basic research concepts.J WOCN26240249 Whitney, JD 1999Notes on methodology. Validity and reliability: basic research concepts.J WOCN26240249
30.
Zurück zum Zitat Wilson, MS, et al. 1997MIST VR: a virtual reality trainer for laparoscopic surgery assesses performance.Ann R Coll Surg Engl79403404PubMed Wilson, MS,  et al. 1997MIST VR: a virtual reality trainer for laparoscopic surgery assesses performance.Ann R Coll Surg Engl79403404PubMed
Metadaten
Titel
Construct validity
verfasst von
M. Schijven
J. Jakimowicz
Publikationsdatum
01.05.2003
Erschienen in
Surgical Endoscopy / Ausgabe 5/2003
Print ISSN: 0930-2794
Elektronische ISSN: 1432-2218
DOI
https://doi.org/10.1007/s00464-002-9151-9

Weitere Artikel der Ausgabe 5/2003

Surgical Endoscopy 5/2003 Zur Ausgabe

Update Chirurgie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.

S3-Leitlinie „Diagnostik und Therapie des Karpaltunnelsyndroms“

Karpaltunnelsyndrom BDC Leitlinien Webinare
CME: 2 Punkte

Das Karpaltunnelsyndrom ist die häufigste Kompressionsneuropathie peripherer Nerven. Obwohl die Anamnese mit dem nächtlichen Einschlafen der Hand (Brachialgia parästhetica nocturna) sehr typisch ist, ist eine klinisch-neurologische Untersuchung und Elektroneurografie in manchen Fällen auch eine Neurosonografie erforderlich. Im Anfangsstadium sind konservative Maßnahmen (Handgelenksschiene, Ergotherapie) empfehlenswert. Bei nicht Ansprechen der konservativen Therapie oder Auftreten von neurologischen Ausfällen ist eine Dekompression des N. medianus am Karpaltunnel indiziert.

Prof. Dr. med. Gregor Antoniadis
Berufsverband der Deutschen Chirurgie e.V.

S2e-Leitlinie „Distale Radiusfraktur“

Radiusfraktur BDC Leitlinien Webinare
CME: 2 Punkte

Das Webinar beschäftigt sich mit Fragen und Antworten zu Diagnostik und Klassifikation sowie Möglichkeiten des Ausschlusses von Zusatzverletzungen. Die Referenten erläutern, welche Frakturen konservativ behandelt werden können und wie. Das Webinar beantwortet die Frage nach aktuellen operativen Therapiekonzepten: Welcher Zugang, welches Osteosynthesematerial? Auf was muss bei der Nachbehandlung der distalen Radiusfraktur geachtet werden?

PD Dr. med. Oliver Pieske
Dr. med. Benjamin Meyknecht
Berufsverband der Deutschen Chirurgie e.V.

S1-Leitlinie „Empfehlungen zur Therapie der akuten Appendizitis bei Erwachsenen“

Appendizitis BDC Leitlinien Webinare
CME: 2 Punkte

Inhalte des Webinars zur S1-Leitlinie „Empfehlungen zur Therapie der akuten Appendizitis bei Erwachsenen“ sind die Darstellung des Projektes und des Erstellungswegs zur S1-Leitlinie, die Erläuterung der klinischen Relevanz der Klassifikation EAES 2015, die wissenschaftliche Begründung der wichtigsten Empfehlungen und die Darstellung stadiengerechter Therapieoptionen.

Dr. med. Mihailo Andric
Berufsverband der Deutschen Chirurgie e.V.