Abstract
Background
No single assessment method can successfully evaluate the clinical ability of medical students in psychiatric clerkships; however, few studies have examined the efficacy of multiple assessments, especially in psychiatry. The aim of this study was to examine the relationship among different types of assessments of medical students’ clinical ability in psychiatric clerkships and whether it is reasonable to use multiple assessments.
Method
A group of 196 students were enrolled during their psychiatric clerkship between September 2008 and May 2009 in Kaohsiung, Taiwan. The mini-clinical evaluation exercise (mini-CEX) and standardized patient (SP)-based test were used to evaluate “does” and “show how” in psychiatric clinical ability. A multiple-choice examination was used to evaluate knowledge of psychiatry.
Results
There were statistically significant but weak correlations among the scores on the multiple-choice examination, SP-based test, and overall clinical competence domain on the mini-CEX.
Conclusion
A blended assessment composed of a multiple-choice examination, mini-CEX, and SP-based test can evaluate different dimensions of clinical ability. It is reasonable to use multiple methods to assess medical students’ competency in psychiatric clerkships.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Wass V, Van der Vleuten C, Shatzer J, et al: Assessment of clinical competence. Lancet 2001; 357:945–949
Miller GE: The assessment of clinical skills/competence/performance. Acad Med 1990; 65(9 Suppl):S63–67
Norcini JJ, Swanson DB, Grosso LJ, et al: A comparison of knowledge, synthesis, and clinical judgment: multiple-choice questions in the assessment of physician competence. Eval Health Prof 1984; 7:485–499
Holsgrove GJ: Guide to postgraduate exams: multiple-choice questions. Br J Hosp Med 1992; 48:757–761
Schuwirth LW, van der Vleuten CP, Donkers HH: A closer look at cueing effects in multiple-choice questions. Med Educ 1996; 30:44–49
McCloskey DI, Holland RA: A comparison of student performances in answering essay-type and multiple-choice questions. Med Educ 1976; 10:382–385
Stillman PL, Regan MB, Swanson DB, et al: An assessment of the clinical skills of fourth-year students at four New England medical schools. Acad Med 1990; 65:320–326
Barrows HS: An overview of the uses of standardized patients for teaching and evaluating clinical skills: AAMC. Acad Med 1993; 68:443–451, Discussion, 51–53
Stillman P, Swanson D, Regan MB, et al: Assessment of clinical skills of residents utilizing standardized patients: a follow-up study and recommendations for application. Ann Intern Med 1991; 114:393–401
Bennett AJ, Arnold LM, Welge JA: Use of standardized patients during a psychiatry clerkship. Acad Psychiatry 2006; 30:185–190
McNaughton N, Ravitz P, Wadell A, et al: Psychiatric education and simulation: a review of the literature. Can J Psychiatry (Revue Canadienne De Psychiatrie) 2008; 53:85–93
Rao R: OSCEs in psychiatry: The Royal College of Psychiatrists; 2005
Holmboe ES, Hawkins RE: Methods for evaluating the clinical competence of residents in internal medicine: a review. Ann Intern Med 1998; 129:42–48
Hauer KE: Enhancing feedback to students using the mini-CEX (Clinical Evaluation Exercise). Acad Med 2000; 75:524
Kogan JR, Bellini LM, Shea JA: Feasibility, reliability, and validity of the mini-Clinical Evaluation Exercise (mCEX) in a medicine core clerkship. Acad Med 2003; 78(10: Suppl): S33–35
Turnbull J, Gray J, MacFadyen J: Improving in-training evaluation programs. J Gen Intern Med 1998; 13:317–323
Hodges B, McNaughton N, Regehr G, et al: The challenge of creating new OSCE measures to capture the characteristics of expertise. Med Educ 2002; 36:742–748
Rose M, Wilkerson L: Widening the lens on standardized patient assessment: what the encounter can reveal about the development of clinical competence. Acad Med 2001; 76: 856–859
Walters K, Osborn D, Raven P: The development, validity, and reliability of a multimodality objective Structured Clinical Examination in psychiatry. Med Educ 2005; 39:292–298
Smee S: Skill-based assessment. BMJ 2003; 326:703–706
Hatala R, Ainslie M, Kassen BO, et al: Assessing the mini-Clinical Evaluation Exercise in comparison to a national specialty examination. Med Educ 2006; 40:950–956
Norcini JJ, Blank LL, Duffy FD, et al: The mini-CEX: a method for assessing clinical skills. Ann Intern Med 2003; 138:476–481
Norman GR, Tugwell P, Feightner JW, et al: Knowledge and clinical problem-solving. Med Educ 1985; 19:344–356
Sun B, McKenzie FD, Garcia HM, et al: Medical student evaluation using augmented standardized patients: new development and results. Stud Health Technol Inform 2007; 125:454–456
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Wang, PW., Cheng, CC., Chou, F.HC. et al. Using Multiple Assessments to Evaluate Medical Students’ Clinical Ability in Psychiatric Clerkships. Acad Psychiatry 35, 307–311 (2011). https://doi.org/10.1176/appi.ap.35.5.307
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1176/appi.ap.35.5.307