Skip to main content
Erschienen in: Administration and Policy in Mental Health and Mental Health Services Research 5/2015

01.09.2015 | Original Article

Clinicians’ Attitudes Towards Outcome and Process Monitoring: A Validation of the Outcome Measurement Questionnaire

verfasst von: Dave F. Smits, Laurence Claes, Nele Stinckens, Dirk J. M. Smits

Erschienen in: Administration and Policy in Mental Health and Mental Health Services Research | Ausgabe 5/2015

Einloggen, um Zugang zu erhalten

Abstract

Valid and reliable instruments to measure monitoring attitudes of clinicians are scarce. The influence of sociodemographics and professional characteristics on monitoring attitudes is largely unknown. First, we investigated the factor structure and reliability of the Outcome Measurement Questionnaire among a sample of Flemish mental health professionals (n = 170). Next, we examined the relationship between clinicians’ sociodemographic and professional characteristics and monitoring attitudes. Construct validity was determined using a confirmatory factor analysis. Internal consistency was ascertained using Cronbach’s alpha. Mean level differences in monitoring attitudes related to clinicians’ gender, work setting, level of education and psychotherapeutic training, were investigated using ANOVAs. The relationships between clinicians’ age, clinical experience and attitudes were calculated using the Pearson correlation coefficient. A model with one general factor and a method factor referring to reverse-worded items best fitted our data. Internal consistency was good. Clinicians with psychotherapeutic training reported more favorable monitoring attitudes than those without such training. Compared to clinicians working in subsidized outpatient services, private practitioners and clinicians from inpatient mental health clinics had more positive attitudes. Results highlight the need for sustained and targeted training, with particular focus on transforming measurement data into meaningful clinical support tools.
Fußnoten
1
The first and fourth author are experienced trainers and implementation coaches of monitoring systems in multiple Flemish mental health centres.
 
2
In Flanders, both bachelor and master’s graduates can become psychotherapists. Prior to a 4 year psychotherapy training course, bachelor graduates need to attend a bridging program. Without attending this bridging program, a 4-year counseling course leads to a Counselor certificate. Both groups are subsequently referred to as a group with ‘psychotherapeutic training’.
 
Literatur
Zurück zum Zitat Allen, A., Montgomery, M., Tubman, J., Frazier, L., & Escovar, L. (2003). The effects of assessment feedback on rapport-building and self-enhancement processes. Journal of Mental Health Counseling, 25, 165–181.CrossRef Allen, A., Montgomery, M., Tubman, J., Frazier, L., & Escovar, L. (2003). The effects of assessment feedback on rapport-building and self-enhancement processes. Journal of Mental Health Counseling, 25, 165–181.CrossRef
Zurück zum Zitat Bentler, P. M. (2007). On tests and indices for evaluating structural models. Personality and Individual Differences, 42, 825–829.CrossRef Bentler, P. M. (2007). On tests and indices for evaluating structural models. Personality and Individual Differences, 42, 825–829.CrossRef
Zurück zum Zitat Bollen, K. A. (1989). Structural equations with latent variables. New York: Wiley.CrossRef Bollen, K. A. (1989). Structural equations with latent variables. New York: Wiley.CrossRef
Zurück zum Zitat Bowman, J., Lannin, N., Cook, C., & McCluskey, A. (2009). Development and psychometric testing of the clinician readiness for measuring outcomes scale. Journal of Evaluation in Clinical Practice, 15, 76–84.CrossRefPubMed Bowman, J., Lannin, N., Cook, C., & McCluskey, A. (2009). Development and psychometric testing of the clinician readiness for measuring outcomes scale. Journal of Evaluation in Clinical Practice, 15, 76–84.CrossRefPubMed
Zurück zum Zitat Callaly, T., & Hallebone, E. L. (2001). Introducing the routine use of outcomes measurement to mental health services. Australian Health Review, 24, 43–50.CrossRefPubMed Callaly, T., & Hallebone, E. L. (2001). Introducing the routine use of outcomes measurement to mental health services. Australian Health Review, 24, 43–50.CrossRefPubMed
Zurück zum Zitat Close-Goedjen, J. L., & Saunders, S. M. (2002). The effect of technical support on clinician attitudes toward an outcome assessment instrument. Journal of Behavioral Health Service and Research, 29, 99–108.CrossRef Close-Goedjen, J. L., & Saunders, S. M. (2002). The effect of technical support on clinician attitudes toward an outcome assessment instrument. Journal of Behavioral Health Service and Research, 29, 99–108.CrossRef
Zurück zum Zitat Cronbach, L. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16, 297–334.CrossRef Cronbach, L. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16, 297–334.CrossRef
Zurück zum Zitat De Jong, K., Van Sluis, P., Nugter, M. A., Heiser, W. J., & Spinhoven, P. (2012). Understanding the differential impact of outcome monitoring: therapist variables that moderate feedback effects in a randomized clinical trial. Psychotherapy Research, 22, 464–474.CrossRefPubMed De Jong, K., Van Sluis, P., Nugter, M. A., Heiser, W. J., & Spinhoven, P. (2012). Understanding the differential impact of outcome monitoring: therapist variables that moderate feedback effects in a randomized clinical trial. Psychotherapy Research, 22, 464–474.CrossRefPubMed
Zurück zum Zitat Dekker, J. (2011). Monitoring als therapeutisch instrument. Een exploratieve studie naar intermediërende processen, geïnitieerd door systematische evaluatie en feedback in psychotherapie. Unpublished Master’s thesis, KU Leuven, Leuven. Dekker, J. (2011). Monitoring als therapeutisch instrument. Een exploratieve studie naar intermediërende processen, geïnitieerd door systematische evaluatie en feedback in psychotherapie. Unpublished Master’s thesis, KU Leuven, Leuven.
Zurück zum Zitat Flora, D. B., & Curran, P. J. (2004). An empirical evaluation of alternative methods of estimation for confirmatory factor analysis with ordinal data. Psychological Methods, 9, 466–491.PubMedCentralCrossRefPubMed Flora, D. B., & Curran, P. J. (2004). An empirical evaluation of alternative methods of estimation for confirmatory factor analysis with ordinal data. Psychological Methods, 9, 466–491.PubMedCentralCrossRefPubMed
Zurück zum Zitat Guthrie, D., McIntosh, M., Callaly, T., Trauer, T., & Coombs, T. (2008). Consumer attitudes towards the use of routine outcome measures in a public mental health service: A consumer-driven study. International Journal of Mental Health Nursing, 17, 92–97.CrossRefPubMed Guthrie, D., McIntosh, M., Callaly, T., Trauer, T., & Coombs, T. (2008). Consumer attitudes towards the use of routine outcome measures in a public mental health service: A consumer-driven study. International Journal of Mental Health Nursing, 17, 92–97.CrossRefPubMed
Zurück zum Zitat Hilsenroth, M. J., Peters, E. J., & Ackerman, S. J. (2004). The development of therapeutic alliance during psychological assessment: Patient and therapist perspectives across treatment. Journal of Personality Assessment, 83, 332–344.CrossRefPubMed Hilsenroth, M. J., Peters, E. J., & Ackerman, S. J. (2004). The development of therapeutic alliance during psychological assessment: Patient and therapist perspectives across treatment. Journal of Personality Assessment, 83, 332–344.CrossRefPubMed
Zurück zum Zitat Howard, K. I., Moras, K., Brill, P. L., Martinovich, Z., & Lutz, W. (1996). Evaluation of psychotherapy: Efficacy, effectiveness, and patient progress. American Psychologist, 51, 1059–1064.CrossRefPubMed Howard, K. I., Moras, K., Brill, P. L., Martinovich, Z., & Lutz, W. (1996). Evaluation of psychotherapy: Efficacy, effectiveness, and patient progress. American Psychologist, 51, 1059–1064.CrossRefPubMed
Zurück zum Zitat Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1–55.CrossRef Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1–55.CrossRef
Zurück zum Zitat Huffman, L. C., Martin, J., Botcheva, L., Williams, S. E., & Dyer-Friedman, J. P. (2004). Practitioners’ attitudes toward the use of treatment progress and outcomes data in child mental health services. Evaluation and the Health Professions, 27, 165–188.CrossRefPubMed Huffman, L. C., Martin, J., Botcheva, L., Williams, S. E., & Dyer-Friedman, J. P. (2004). Practitioners’ attitudes toward the use of treatment progress and outcomes data in child mental health services. Evaluation and the Health Professions, 27, 165–188.CrossRefPubMed
Zurück zum Zitat Jöreskog, K., & Sörbom, D. (2012). LISREL 8.8 (computer program). Lincolnwood: Scientific Software International. Jöreskog, K., & Sörbom, D. (2012). LISREL 8.8 (computer program). Lincolnwood: Scientific Software International.
Zurück zum Zitat Kline, R. B. (2005). Principles and practices of structural equation modeling. New York: Guilford. Kline, R. B. (2005). Principles and practices of structural equation modeling. New York: Guilford.
Zurück zum Zitat Knaup, C., Koesters, M., Schoefer, D., Becker, T., & Puschner, B. (2009). Effect of feedback of treatment outcome in specialist mental healthcare: meta-analysis. The British Journal of Psychiatry, 195, 15–22.CrossRefPubMed Knaup, C., Koesters, M., Schoefer, D., Becker, T., & Puschner, B. (2009). Effect of feedback of treatment outcome in specialist mental healthcare: meta-analysis. The British Journal of Psychiatry, 195, 15–22.CrossRefPubMed
Zurück zum Zitat Lambert, M. J. (2010a). Yes, it is time for clinicians to routinely track treatment outcome. In B. L. Duncan, S.D. Miller, B. E. Wampold, & M. A. Hubble (Eds.), The heart and soul of change. Delivering what works (pp. 239–268). Washington, DC: American Psychological Association. Lambert, M. J. (2010a). Yes, it is time for clinicians to routinely track treatment outcome. In B. L. Duncan, S.D. Miller, B. E. Wampold, & M. A. Hubble (Eds.), The heart and soul of change. Delivering what works (pp. 239–268). Washington, DC: American Psychological Association.
Zurück zum Zitat Lambert, M. J. (2010b). Prevention of treatment failure: The use of measuring, monitoring, and feedback in clinical practice. Washington, DC: American Psychological Association. Lambert, M. J. (2010b). Prevention of treatment failure: The use of measuring, monitoring, and feedback in clinical practice. Washington, DC: American Psychological Association.
Zurück zum Zitat Lambert, M. J., Hansen, N. B., & Finch, A. E. (2001). Patient-focused research: using patient outcome data to enhance treatment effects. Journal of Consulting and Clinical Psychology, 69, 159.CrossRefPubMed Lambert, M. J., Hansen, N. B., & Finch, A. E. (2001). Patient-focused research: using patient outcome data to enhance treatment effects. Journal of Consulting and Clinical Psychology, 69, 159.CrossRefPubMed
Zurück zum Zitat Lei, P.-W. (2009). Evaluating estimation methods for ordinal data in structural equation modeling. Quality & Quantity, 43, 495–507.CrossRef Lei, P.-W. (2009). Evaluating estimation methods for ordinal data in structural equation modeling. Quality & Quantity, 43, 495–507.CrossRef
Zurück zum Zitat Podsakoff, P. M., MacKensie, S. B., Lee, J.-Y., & Posdakoff, N. P. (2003). Common method biases in behavioral research: A critical review of the literature and recommended remedies. Journal of Applied Psychology, 88, 879–903.CrossRefPubMed Podsakoff, P. M., MacKensie, S. B., Lee, J.-Y., & Posdakoff, N. P. (2003). Common method biases in behavioral research: A critical review of the literature and recommended remedies. Journal of Applied Psychology, 88, 879–903.CrossRefPubMed
Zurück zum Zitat Prochaska, J. M., Prochaska, J. O., & Levesque, D. A. (2001). A transtheortical approach to changing organizations. Administration and Policy in Mental Health, 28, 247–261.CrossRefPubMed Prochaska, J. M., Prochaska, J. O., & Levesque, D. A. (2001). A transtheortical approach to changing organizations. Administration and Policy in Mental Health, 28, 247–261.CrossRefPubMed
Zurück zum Zitat Sapyta, J., Riemer, M., & Bickman, L. (2005). Feedback to clinicians: Theory, research, and practice. Journal of Clinical Psychology, 61, 145–153.CrossRefPubMed Sapyta, J., Riemer, M., & Bickman, L. (2005). Feedback to clinicians: Theory, research, and practice. Journal of Clinical Psychology, 61, 145–153.CrossRefPubMed
Zurück zum Zitat Schweizer, K. (2010). Some guidelines concerning the modeling of traits and abilities in test construction. European Journal of Psychological Assessment, 26, 1–2.CrossRef Schweizer, K. (2010). Some guidelines concerning the modeling of traits and abilities in test construction. European Journal of Psychological Assessment, 26, 1–2.CrossRef
Zurück zum Zitat Shimokawa, K., Lambert, M. J., & Smart, D. W. (2010). Enhancing treatment outcome of patients at risk of treatment failure: meta-analytic and Mega-analytic review of a psychotherapy quality assurance system. Journal of Consulting and Clinical Psychology, 78, 298.CrossRefPubMed Shimokawa, K., Lambert, M. J., & Smart, D. W. (2010). Enhancing treatment outcome of patients at risk of treatment failure: meta-analytic and Mega-analytic review of a psychotherapy quality assurance system. Journal of Consulting and Clinical Psychology, 78, 298.CrossRefPubMed
Zurück zum Zitat Trauer, T., Gill, L., Pedwell, G., & Slattery, P. (2006). Routine outcome measurement in public mental health—what do clinicians think?. Australian Health Review, 30, 144–147.CrossRefPubMed Trauer, T., Gill, L., Pedwell, G., & Slattery, P. (2006). Routine outcome measurement in public mental health—what do clinicians think?. Australian Health Review, 30, 144–147.CrossRefPubMed
Zurück zum Zitat Walter, G., Cleary, M., & Rey, J. M. (1998). Attitudes of mental health personnel towards rating outcome. Journal of Quality in Clinical Practice, 18, 109–115.PubMed Walter, G., Cleary, M., & Rey, J. M. (1998). Attitudes of mental health personnel towards rating outcome. Journal of Quality in Clinical Practice, 18, 109–115.PubMed
Zurück zum Zitat Willis, A., Deane, F. P., & Coombs, T. (2009). Improving clinicians’ attitudes toward providing feedback on routine outcome assessments. International Journal of Mental Health Nursing, 18, 211–215.CrossRefPubMed Willis, A., Deane, F. P., & Coombs, T. (2009). Improving clinicians’ attitudes toward providing feedback on routine outcome assessments. International Journal of Mental Health Nursing, 18, 211–215.CrossRefPubMed
Metadaten
Titel
Clinicians’ Attitudes Towards Outcome and Process Monitoring: A Validation of the Outcome Measurement Questionnaire
verfasst von
Dave F. Smits
Laurence Claes
Nele Stinckens
Dirk J. M. Smits
Publikationsdatum
01.09.2015
Verlag
Springer US
Erschienen in
Administration and Policy in Mental Health and Mental Health Services Research / Ausgabe 5/2015
Print ISSN: 0894-587X
Elektronische ISSN: 1573-3289
DOI
https://doi.org/10.1007/s10488-014-0597-6

Weitere Artikel der Ausgabe 5/2015

Administration and Policy in Mental Health and Mental Health Services Research 5/2015 Zur Ausgabe

Demenzkranke durch Antipsychotika vielfach gefährdet

23.04.2024 Demenz Nachrichten

Wenn Demenzkranke aufgrund von Symptomen wie Agitation oder Aggressivität mit Antipsychotika behandelt werden, sind damit offenbar noch mehr Risiken verbunden als bislang angenommen.

Weniger postpartale Depressionen nach Esketamin-Einmalgabe

Bislang gibt es kein Medikament zur Prävention von Wochenbettdepressionen. Das Injektionsanästhetikum Esketamin könnte womöglich diese Lücke füllen.

„Psychotherapie ist auch bei sehr alten Menschen hochwirksam!“

22.04.2024 DGIM 2024 Kongressbericht

Die Kombination aus Medikamenten und Psychotherapie gilt als effektivster Ansatz bei Depressionen. Das ist bei betagten Menschen nicht anders, trotz Besonderheiten.

Auf diese Krankheiten bei Geflüchteten sollten Sie vorbereitet sein

22.04.2024 DGIM 2024 Nachrichten

Um Menschen nach der Flucht aus einem Krisengebiet bestmöglich medizinisch betreuen zu können, ist es gut zu wissen, welche Erkrankungen im jeweiligen Herkunftsland häufig sind. Dabei hilft eine Internetseite der CDC (Centers for Disease Control and Prevention).

Update Psychiatrie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.