Skip to main content
Erschienen in: Journal of General Internal Medicine 5/2020

01.05.2020 | Original Research

Development and Validation of a Test for Competence in Evidence-Based Medicine

verfasst von: Rushad Patell, MD, Paola Raska, PhD, Natalie Lee, MD, MPH, Gina Luciano, MD, Deborah J. DiNardo, MD, MS, Amiran Baduashvili, MD, Mel L. Anderson, MD, Frank Merritt, MD, Michael B. Rothberg, MD, MPH

Erschienen in: Journal of General Internal Medicine | Ausgabe 5/2020

Einloggen, um Zugang zu erhalten

Abstract

Background

Medical educators need valid, reliable, and efficient tools to assess evidence-based medicine (EBM) knowledge and skills. Available EBM assessment tools either do not assess skills or are laborious to grade.

Objective

To validate a multiple-choice–based EBM test—the Resident EBM Skills Evaluation Tool (RESET).

Design

Cross-sectional study.

Participants

A total of 304 medicine residents from five training programs and 33 EBM experts comprised the validation cohort.

Main Measures

Internal reliability, item difficulty, and item discrimination were assessed. Construct validity was assessed by comparing mean total scores of trainees to experts. Experts were also asked to rate importance of each test item to assess content validity.

Key Results

Experts had higher total scores than trainees (35.6 vs. 29.4, P < 0.001) and also scored significantly higher than residents on 11/18 items. Cronbach’s alpha was 0.6 (acceptable), and no items had a low item-total correlation. Item difficulty ranged from 7 to 86%. All items were deemed “important” by > 50% of experts.

Conclusions

The proposed EBM assessment tool is a reliable and valid instrument to assess competence in EBM. It is easy to administer and grade and could be used to guide and assess interventions in EBM education.
Anhänge
Nur mit Berechtigung zugänglich
Literatur
1.
Zurück zum Zitat Sackett DL SS, Richardson WS, Rosenberg W, Haynes RB. Evidence-Based Medicine: How to Practice and Teach EBM. 2 Edinburgh: Churchill Livingstone; 2000. Sackett DL SS, Richardson WS, Rosenberg W, Haynes RB. Evidence-Based Medicine: How to Practice and Teach EBM. 2 Edinburgh: Churchill Livingstone; 2000.
2.
Zurück zum Zitat Ilic D, Maloney S. Methods of teaching medical trainees evidence-based medicine: a systematic review. Med Educ. 2014;48(2):124–35.CrossRef Ilic D, Maloney S. Methods of teaching medical trainees evidence-based medicine: a systematic review. Med Educ. 2014;48(2):124–35.CrossRef
3.
Zurück zum Zitat Paulsen J, Al Achkar M. Factors associated with practicing evidence-based medicine: a study of family medicine residents. Adv Med Educ Pract. 2018;9:287–93.CrossRef Paulsen J, Al Achkar M. Factors associated with practicing evidence-based medicine: a study of family medicine residents. Adv Med Educ Pract. 2018;9:287–93.CrossRef
4.
Zurück zum Zitat Coomarasamy A, Taylor R, Khan KS. A systematic review of postgraduate teaching in evidence-based medicine and critical appraisal. Med Teach. 2003;25(1):77–81.CrossRef Coomarasamy A, Taylor R, Khan KS. A systematic review of postgraduate teaching in evidence-based medicine and critical appraisal. Med Teach. 2003;25(1):77–81.CrossRef
5.
Zurück zum Zitat Hatala R, Keitz SA, Wilson MC, Guyatt G. Beyond journal clubs. Moving toward an integrated evidence-based medicine curriculum. J Gen Intern Med. 2006;21(5):538–41.CrossRef Hatala R, Keitz SA, Wilson MC, Guyatt G. Beyond journal clubs. Moving toward an integrated evidence-based medicine curriculum. J Gen Intern Med. 2006;21(5):538–41.CrossRef
6.
Zurück zum Zitat Green ML. Evidence-based medicine training in internal medicine residency programs a national survey. J Gen Intern Med. 2000;15(2):129–33.CrossRef Green ML. Evidence-based medicine training in internal medicine residency programs a national survey. J Gen Intern Med. 2000;15(2):129–33.CrossRef
7.
Zurück zum Zitat Albarqouni L, Hoffmann T, Glasziou P. Evidence-based practice educational intervention studies: a systematic review of what is taught and how it is measured. BMC Med Educ. 2018;18(1):177.CrossRef Albarqouni L, Hoffmann T, Glasziou P. Evidence-based practice educational intervention studies: a systematic review of what is taught and how it is measured. BMC Med Educ. 2018;18(1):177.CrossRef
8.
Zurück zum Zitat Snibsoer AK, Ciliska D, Yost J, Graverholt B, Nortvedt MW, Riise T, et al. Self-reported and objectively assessed knowledge of evidence-based practice terminology among healthcare students: a cross-sectional study. PLoS One. 2018;13(7):e0200313.CrossRef Snibsoer AK, Ciliska D, Yost J, Graverholt B, Nortvedt MW, Riise T, et al. Self-reported and objectively assessed knowledge of evidence-based practice terminology among healthcare students: a cross-sectional study. PLoS One. 2018;13(7):e0200313.CrossRef
9.
Zurück zum Zitat Shaneyfelt T, Baum KD, Bell D, Feldstein D, Houston TK, Kaatz S, et al. Instruments for evaluating education in evidence-based practice: a systematic review. JAMA. 2006;296(9):1116–27.CrossRef Shaneyfelt T, Baum KD, Bell D, Feldstein D, Houston TK, Kaatz S, et al. Instruments for evaluating education in evidence-based practice: a systematic review. JAMA. 2006;296(9):1116–27.CrossRef
10.
Zurück zum Zitat Ramos KD, Schafer S, Tracz SM. Validation of the Fresno test of competence in evidence based medicine. BMJ. 2003;326(7384):319–21.CrossRef Ramos KD, Schafer S, Tracz SM. Validation of the Fresno test of competence in evidence based medicine. BMJ. 2003;326(7384):319–21.CrossRef
11.
Zurück zum Zitat Fritsche L, Greenhalgh T, Falck-Ytter Y, Neumayer HH, Kunz R. Do short courses in evidence based medicine improve knowledge and skills? Validation of Berlin questionnaire and before and after study of courses in evidence based medicine. BMJ. 2002;325(7376):1338–41.CrossRef Fritsche L, Greenhalgh T, Falck-Ytter Y, Neumayer HH, Kunz R. Do short courses in evidence based medicine improve knowledge and skills? Validation of Berlin questionnaire and before and after study of courses in evidence based medicine. BMJ. 2002;325(7376):1338–41.CrossRef
12.
Zurück zum Zitat Lai NM, Teng CL, Nalliah S. Assessing undergraduate competence in evidence based medicine: a preliminary study on the correlation between two objective instruments. Educ Health (Abingdon). 2012;25(1):33–9.CrossRef Lai NM, Teng CL, Nalliah S. Assessing undergraduate competence in evidence based medicine: a preliminary study on the correlation between two objective instruments. Educ Health (Abingdon). 2012;25(1):33–9.CrossRef
13.
Zurück zum Zitat Luciano GL, Visintainer PF, Kleppel R, Rothberg MB. Ambulatory morning report: a case-based method of teaching EBM through experiential learning. South Med J. 2016;109(2):108–11.CrossRef Luciano GL, Visintainer PF, Kleppel R, Rothberg MB. Ambulatory morning report: a case-based method of teaching EBM through experiential learning. South Med J. 2016;109(2):108–11.CrossRef
14.
Zurück zum Zitat Gordon Guyatt DR, Maureen O. Meade, Deborah J. Cook. Users’ Guides to the Medical Literature: A Manual for Evidence-Based Clinical Practice. 3: McGraw-Hill Medical, 2008. Gordon Guyatt DR, Maureen O. Meade, Deborah J. Cook. Users’ Guides to the Medical Literature: A Manual for Evidence-Based Clinical Practice. 3: McGraw-Hill Medical, 2008.
15.
Zurück zum Zitat Melovitz Vasan CA, DeFouw DO, Holland BK, Vasan NS. Analysis of testing with multiple choice versus open-ended questions: outcome-based observations in an anatomy course. Anat Sci Educ. 2018;11(3):254–61.CrossRef Melovitz Vasan CA, DeFouw DO, Holland BK, Vasan NS. Analysis of testing with multiple choice versus open-ended questions: outcome-based observations in an anatomy course. Anat Sci Educ. 2018;11(3):254–61.CrossRef
16.
Zurück zum Zitat Khan KS, Awonuga AO, Dwarakanath LS, Taylor R. Assessments in evidence-based medicine workshops: loose connection between perception of knowledge and its objective assessment. Med Teach. 2001;23(1):92–4.CrossRef Khan KS, Awonuga AO, Dwarakanath LS, Taylor R. Assessments in evidence-based medicine workshops: loose connection between perception of knowledge and its objective assessment. Med Teach. 2001;23(1):92–4.CrossRef
17.
Zurück zum Zitat Ilic D. Assessing competency in evidence based practice: strengths and limitations of current tools in practice. BMC Med Educ. 2009;9:53.CrossRef Ilic D. Assessing competency in evidence based practice: strengths and limitations of current tools in practice. BMC Med Educ. 2009;9:53.CrossRef
18.
Zurück zum Zitat Thomas RE, Kreptul D. Systematic review of evidence-based medicine tests for family physician residents. Fam Med. 2015;47(2):101–17.PubMed Thomas RE, Kreptul D. Systematic review of evidence-based medicine tests for family physician residents. Fam Med. 2015;47(2):101–17.PubMed
19.
Zurück zum Zitat Horntvedt MT, Nordsteien A, Fermann T, Severinsson E. Strategies for teaching evidence-based practice in nursing education: a thematic literature review. BMC Med Educ. 2018;18(1):172.CrossRef Horntvedt MT, Nordsteien A, Fermann T, Severinsson E. Strategies for teaching evidence-based practice in nursing education: a thematic literature review. BMC Med Educ. 2018;18(1):172.CrossRef
20.
Zurück zum Zitat Manske RC, Lehecka BJ. Evidence - based medicine/practice in sports physical therapy. Int J Sports Phys Ther. 2012;7(5):461–73.PubMedPubMedCentral Manske RC, Lehecka BJ. Evidence - based medicine/practice in sports physical therapy. Int J Sports Phys Ther. 2012;7(5):461–73.PubMedPubMedCentral
21.
Zurück zum Zitat Coppenrath V, Filosa LA, Akselrod E, Carey KM. Adaptation and validation of the Fresno test of competence in evidence-based medicine in doctor of pharmacy students. Am J Pharm Educ. 2017;81(6):106.PubMedPubMedCentral Coppenrath V, Filosa LA, Akselrod E, Carey KM. Adaptation and validation of the Fresno test of competence in evidence-based medicine in doctor of pharmacy students. Am J Pharm Educ. 2017;81(6):106.PubMedPubMedCentral
22.
Zurück zum Zitat Tilson JK. Validation of the modified Fresno test: assessing physical therapists’ evidence based practice knowledge and skills. BMC Med Educ. 2010;10:38.CrossRef Tilson JK. Validation of the modified Fresno test: assessing physical therapists’ evidence based practice knowledge and skills. BMC Med Educ. 2010;10:38.CrossRef
23.
Zurück zum Zitat Bland JM, Altman DG. Statistics notes: Cronbach’s alpha. BMJ. 1997;314(7080):572.CrossRef Bland JM, Altman DG. Statistics notes: Cronbach’s alpha. BMJ. 1997;314(7080):572.CrossRef
Metadaten
Titel
Development and Validation of a Test for Competence in Evidence-Based Medicine
verfasst von
Rushad Patell, MD
Paola Raska, PhD
Natalie Lee, MD, MPH
Gina Luciano, MD
Deborah J. DiNardo, MD, MS
Amiran Baduashvili, MD
Mel L. Anderson, MD
Frank Merritt, MD
Michael B. Rothberg, MD, MPH
Publikationsdatum
01.05.2020
Verlag
Springer International Publishing
Erschienen in
Journal of General Internal Medicine / Ausgabe 5/2020
Print ISSN: 0884-8734
Elektronische ISSN: 1525-1497
DOI
https://doi.org/10.1007/s11606-019-05595-2

Weitere Artikel der Ausgabe 5/2020

Journal of General Internal Medicine 5/2020 Zur Ausgabe

Leitlinien kompakt für die Innere Medizin

Mit medbee Pocketcards sicher entscheiden.

Seit 2022 gehört die medbee GmbH zum Springer Medizin Verlag

Update Innere Medizin

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.