Skip to main content
Erschienen in: The Journal of Behavioral Health Services & Research 1/2019

11.05.2018

Reliability, Validity, and Factor Structure of the Current Assessment Practice Evaluation-Revised (CAPER) in a National Sample

verfasst von: Aaron R. Lyon, PhD, Michael D. Pullmann, PhD, Shannon Dorsey, PhD, Prerna Martin, MPH, Alexandra A. Grigore, BA, Emily M. Becker, PhD, Amanda Jensen-Doss, PhD

Erschienen in: The Journal of Behavioral Health Services & Research | Ausgabe 1/2019

Einloggen, um Zugang zu erhalten

Abstract

Measurement-based care (MBC) is an increasingly popular, evidence-based practice, but there are no tools with established psychometrics to evaluate clinician use of MBC practices in mental health service delivery. The current study evaluated the reliability, validity, and factor structure of scores generated from a brief, standardized tool to measure MBC practices, the Current Assessment Practice Evaluation-Revised (CAPER). Survey data from a national sample of 479 mental health clinicians were used to conduct exploratory and confirmatory factor analyses, as well as reliability and validity analyses (e.g., relationships between CAPER subscales and clinician MBC attitudes). Analyses revealed competing two- and three-factor models. Regardless of the model used, scores from CAPER subscales demonstrated good reliability and convergent and divergent validity with MBC attitudes in the expected directions. The CAPER appears to be a psychometrically sound tool for assessing clinician MBC practices. Future directions for development and application of the tool are discussed.
Anhänge
Nur mit Berechtigung zugänglich
Literatur
1.
Zurück zum Zitat Substance Abuse and Mental Health Services Administration. Partners for Change Outcome Management System (PCOMS): International Center for Clinical Excellence. Substance Abuse and Mental Health Services Administration. Partners for Change Outcome Management System (PCOMS): International Center for Clinical Excellence.
2.
Zurück zum Zitat Glasgow RE, Kessler RS, Ory MG, et al.. Conducting rapid, relevant research: lessons learned from the My Own Health Report project. American Journal of Preventive Medicine 2014;47(2):212–219.PubMedCrossRef Glasgow RE, Kessler RS, Ory MG, et al.. Conducting rapid, relevant research: lessons learned from the My Own Health Report project. American Journal of Preventive Medicine 2014;47(2):212–219.PubMedCrossRef
5.
Zurück zum Zitat Lewis CC, Scott K, Marti CN, et al. Implementing measurement-based care (iMBC) for depression in community mental health: a dynamic cluster randomized trial study protocol. Implementation Science. 2015;10(1):127.PubMedCrossRef Lewis CC, Scott K, Marti CN, et al. Implementing measurement-based care (iMBC) for depression in community mental health: a dynamic cluster randomized trial study protocol. Implementation Science. 2015;10(1):127.PubMedCrossRef
9.
Zurück zum Zitat Guthrie D, McIntosh M, Callaly T, et al.. Consumer attitudes towards the use of routine outcome measures in a public mental health service: A consumer-driven study. International Journal of Mental Health Nursing. 2008;17(2):92–97.PubMedCrossRef Guthrie D, McIntosh M, Callaly T, et al.. Consumer attitudes towards the use of routine outcome measures in a public mental health service: A consumer-driven study. International Journal of Mental Health Nursing. 2008;17(2):92–97.PubMedCrossRef
11.
Zurück zum Zitat Hatfield DR, Ogles BM. The use of outcome measures by psychologists in clinical practice. Professional Psychology: Research & Practice. 2004;35(5):485–491.CrossRef Hatfield DR, Ogles BM. The use of outcome measures by psychologists in clinical practice. Professional Psychology: Research & Practice. 2004;35(5):485–491.CrossRef
12.
Zurück zum Zitat Ionita G, Fitzpatrick M. Bringing science to clinical practice: A Canadian survey of psychological practice and usage of progress monitoring measures. Canadian Psychology. 2014;55(3):187.CrossRef Ionita G, Fitzpatrick M. Bringing science to clinical practice: A Canadian survey of psychological practice and usage of progress monitoring measures. Canadian Psychology. 2014;55(3):187.CrossRef
13.
Zurück zum Zitat Palmiter DJ. A survey of the assessment practices of child and adolescent clinicians. American Journal of Orthopsychiatry. 2004;74(2):122.PubMedCrossRef Palmiter DJ. A survey of the assessment practices of child and adolescent clinicians. American Journal of Orthopsychiatry. 2004;74(2):122.PubMedCrossRef
14.
Zurück zum Zitat Garland AF, Kruse M, Aarons GA. Clinicians and outcome measurement: What’s the use? Journal of Behavioral Health Services & Research. 2003;30(4):393–405.CrossRef Garland AF, Kruse M, Aarons GA. Clinicians and outcome measurement: What’s the use? Journal of Behavioral Health Services & Research. 2003;30(4):393–405.CrossRef
15.
Zurück zum Zitat Jensen-Doss A, Smith AM, Becker-Haimes EM, et al. Individualized progress measures are more acceptable to clinicians than standardized measures: Results of a national survey. under review. Jensen-Doss A, Smith AM, Becker-Haimes EM, et al. Individualized progress measures are more acceptable to clinicians than standardized measures: Results of a national survey. under review.
16.
Zurück zum Zitat Jensen-Doss A, Haimes EMB, Smith AM, et al. Monitoring treatment progress and providing feedback is viewed favorably but rarely used in practice. Administration & Policy in Mental Health & Mental Health Services Research. 2016:1–14. Jensen-Doss A, Haimes EMB, Smith AM, et al. Monitoring treatment progress and providing feedback is viewed favorably but rarely used in practice. Administration & Policy in Mental Health & Mental Health Services Research. 2016:1–14.
18.
Zurück zum Zitat Lyon AR, Pullmann MD, Whitaker K, et al. A digital feedback system to support implementation of measurement-based care by school-based mental health clinicians. Journal of Clinical Child & Adolescent Psychology. 2017:1–12. Lyon AR, Pullmann MD, Whitaker K, et al. A digital feedback system to support implementation of measurement-based care by school-based mental health clinicians. Journal of Clinical Child & Adolescent Psychology. 2017:1–12.
19.
Zurück zum Zitat Lyon AR, Dorsey S, Pullmann M, et al. Clinician use of standardized assessments following a common elements psychotherapy training and consultation program. Administration & Policy in Mental Health & Mental Health Services Research. 2015;42(1):47–60.CrossRef Lyon AR, Dorsey S, Pullmann M, et al. Clinician use of standardized assessments following a common elements psychotherapy training and consultation program. Administration & Policy in Mental Health & Mental Health Services Research. 2015;42(1):47–60.CrossRef
20.
Zurück zum Zitat Close-Goedjen JL, Saunders SM. The effect of technical support on clinician attitudes toward an outcome assessment instrument. Journal of Behavioral Health Services & Research. 2002;29(1):99–108.CrossRef Close-Goedjen JL, Saunders SM. The effect of technical support on clinician attitudes toward an outcome assessment instrument. Journal of Behavioral Health Services & Research. 2002;29(1):99–108.CrossRef
24.
Zurück zum Zitat Martinez RG, Lewis CC, Weiner BJ. Instrumentation issues in implementation science. Implementation Science. 2014;9(1):118.PubMedCrossRef Martinez RG, Lewis CC, Weiner BJ. Instrumentation issues in implementation science. Implementation Science. 2014;9(1):118.PubMedCrossRef
26.
Zurück zum Zitat Cone JD. Idiographic, nomothetic, and related perspectives in behavioral assessment. Conceptual Foundations of Behavioral Assessment. 1986:111–128. Cone JD. Idiographic, nomothetic, and related perspectives in behavioral assessment. Conceptual Foundations of Behavioral Assessment. 1986:111–128.
27.
Zurück zum Zitat Lyon AR, Connors E, Jensen-Doss A, et al. Intentional research design in implementation science: implications for the use of nomothetic and idiographic assessment. Translational Behavioral Medicine. 2017:1–14. Lyon AR, Connors E, Jensen-Doss A, et al. Intentional research design in implementation science: implications for the use of nomothetic and idiographic assessment. Translational Behavioral Medicine. 2017:1–14.
30.
Zurück zum Zitat Haynes SN, Mumma GH, Pinson C. Idiographic assessment: Conceptual and psychometric foundations of individualized behavioral assessment. Clinical Psychology Review. 2009;29(2):179–191.PubMedCrossRef Haynes SN, Mumma GH, Pinson C. Idiographic assessment: Conceptual and psychometric foundations of individualized behavioral assessment. Clinical Psychology Review. 2009;29(2):179–191.PubMedCrossRef
31.
Zurück zum Zitat Weisz JR, Chorpita BF, Frye A, et al. Youth Top Problems: Using idiographic, consumer-guided assessment to identify treatment needs and to track change during psychotherapy. Journal of Consulting & Clinical Psychology. 2011;79(3):369.CrossRef Weisz JR, Chorpita BF, Frye A, et al. Youth Top Problems: Using idiographic, consumer-guided assessment to identify treatment needs and to track change during psychotherapy. Journal of Consulting & Clinical Psychology. 2011;79(3):369.CrossRef
34.
35.
Zurück zum Zitat Lindhiem O, Bennett CB, Orimoto TE, et al. A meta-analysis of personalized treatment goals in psychotherapy: A preliminary report and call for more studies. Clinical Psychology: Science & Practice. 2016;23(2):165–176. Lindhiem O, Bennett CB, Orimoto TE, et al. A meta-analysis of personalized treatment goals in psychotherapy: A preliminary report and call for more studies. Clinical Psychology: Science & Practice. 2016;23(2):165–176.
36.
Zurück zum Zitat Becker EM, Smith AM, Jensen-Doss A. Who’s using treatment manuals? A national survey of practicing therapists. Behaviour Resesarch & Therapy. 2013;51(10):706–710.CrossRef Becker EM, Smith AM, Jensen-Doss A. Who’s using treatment manuals? A national survey of practicing therapists. Behaviour Resesarch & Therapy. 2013;51(10):706–710.CrossRef
37.
Zurück zum Zitat Brookman-Frazee L, Haine RA, Baker-Ericzén M, et al. Factors associated with use of evidence-based practice strategies in usual care youth psychotherapy. Administration & Policy in Mental Health & Mental Health Services Research. 2010;37(3):254–269.CrossRef Brookman-Frazee L, Haine RA, Baker-Ericzén M, et al. Factors associated with use of evidence-based practice strategies in usual care youth psychotherapy. Administration & Policy in Mental Health & Mental Health Services Research. 2010;37(3):254–269.CrossRef
38.
Zurück zum Zitat Hatfield DR, Ogles BM. Why some clinicians use outcome measures and others do not. Administration & Policy in Mental Health & Mental Health Services Research. 2007;34(3):283–291.CrossRef Hatfield DR, Ogles BM. Why some clinicians use outcome measures and others do not. Administration & Policy in Mental Health & Mental Health Services Research. 2007;34(3):283–291.CrossRef
40.
Zurück zum Zitat Hawley KM, Cook JR, Jensen-Doss A. Do noncontingent incentives increase survey response rates among mental health providers? A randomized trial comparison. Administration & Policy in Mental Health & Mental Health Services Research. 2009;36(5):343–348.CrossRef Hawley KM, Cook JR, Jensen-Doss A. Do noncontingent incentives increase survey response rates among mental health providers? A randomized trial comparison. Administration & Policy in Mental Health & Mental Health Services Research. 2009;36(5):343–348.CrossRef
41.
42.
Zurück zum Zitat Dillman DA, Smyth JD, Christian LM. Internet, Mail, and Mixed Mode Survey: The Tailored Design Method. Hoboken. NJ: John Wiley & Sons; 2009. Dillman DA, Smyth JD, Christian LM. Internet, Mail, and Mixed Mode Survey: The Tailored Design Method. Hoboken. NJ: John Wiley & Sons; 2009.
43.
Zurück zum Zitat Tabachnick BG, Fidell LS. Using Multivariate Statistics (5th Edition). Needham Heights: Allyn & Bacon, Inc.; 2007. Tabachnick BG, Fidell LS. Using Multivariate Statistics (5th Edition). Needham Heights: Allyn & Bacon, Inc.; 2007.
44.
Zurück zum Zitat Hooper D, Coughlan J, Mullen M. Structural equation modelling: Guidelines for determining model fit. Electronic Journal of Business Research Methods. 2008;6(1):53–60. Hooper D, Coughlan J, Mullen M. Structural equation modelling: Guidelines for determining model fit. Electronic Journal of Business Research Methods. 2008;6(1):53–60.
45.
Zurück zum Zitat Hu L, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling Multidisciplinary Journal. 1999;6(1):1–55.CrossRef Hu L, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling Multidisciplinary Journal. 1999;6(1):1–55.CrossRef
50.
Zurück zum Zitat Kataoka SH, Zhang L, Wells KB. Unmet need for mental health care among US children: Variation by ethnicity and insurance status. American Journal of Psychiatry. 2002;159(9):1548–1555.PubMedCrossRef Kataoka SH, Zhang L, Wells KB. Unmet need for mental health care among US children: Variation by ethnicity and insurance status. American Journal of Psychiatry. 2002;159(9):1548–1555.PubMedCrossRef
51.
Zurück zum Zitat Cabassa LJ, Baumann AA. A two-way street: Bridging implementation science and cultural adaptations of mental health treatments. Implementation Science. 2013;8(1):90.PubMedCrossRef Cabassa LJ, Baumann AA. A two-way street: Bridging implementation science and cultural adaptations of mental health treatments. Implementation Science. 2013;8(1):90.PubMedCrossRef
54.
Zurück zum Zitat Chapman JE, McCart MR, Letourneau EJ, et al. Comparison of youth, caregiver, therapist, trained, and treatment expert raters of therapist adherence to a substance abuse treatment protocol. Journal of Consulting & Clinical Psychology. 2013;81(4):674.CrossRef Chapman JE, McCart MR, Letourneau EJ, et al. Comparison of youth, caregiver, therapist, trained, and treatment expert raters of therapist adherence to a substance abuse treatment protocol. Journal of Consulting & Clinical Psychology. 2013;81(4):674.CrossRef
55.
Zurück zum Zitat Hogue A, Dauber S, Henderson CE, et al. Reliability of therapist self-report on treatment targets and focus in family-based intervention. Administration & Policy in Mental Health & Mental Health Services Research. 2014;41(5):697–705.CrossRef Hogue A, Dauber S, Henderson CE, et al. Reliability of therapist self-report on treatment targets and focus in family-based intervention. Administration & Policy in Mental Health & Mental Health Services Research. 2014;41(5):697–705.CrossRef
Metadaten
Titel
Reliability, Validity, and Factor Structure of the Current Assessment Practice Evaluation-Revised (CAPER) in a National Sample
verfasst von
Aaron R. Lyon, PhD
Michael D. Pullmann, PhD
Shannon Dorsey, PhD
Prerna Martin, MPH
Alexandra A. Grigore, BA
Emily M. Becker, PhD
Amanda Jensen-Doss, PhD
Publikationsdatum
11.05.2018
Verlag
Springer US
Erschienen in
The Journal of Behavioral Health Services & Research / Ausgabe 1/2019
Print ISSN: 1094-3412
Elektronische ISSN: 2168-6793
DOI
https://doi.org/10.1007/s11414-018-9621-z

Weitere Artikel der Ausgabe 1/2019

The Journal of Behavioral Health Services & Research 1/2019 Zur Ausgabe

Update Psychiatrie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.