Skip to main content
Erschienen in: Community Mental Health Journal 4/2020

01.05.2020 | Original Article

Validation of a Comprehensive Patient Experience Survey for Addiction and Mental Health that was Co-designed with Service Users

verfasst von: Shawn R. Currie, Priscilla Liu, Jassandre Adamyk-Simpson, Jesse Stanich

Erschienen in: Community Mental Health Journal | Ausgabe 4/2020

Einloggen, um Zugang zu erhalten

Abstract

A rigorous survey development process was undertaken to design and test a novel, comprehensive patient experience measure that can be used across the full continuum of addiction and mental health programs. Service users were involved in all aspects of the measure’s development, including the selection of items, pre-testing, naming of the scales, and interpretation of the results. Survey data was collected from 1222 patients in treatment in a variety of service settings across Alberta, Canada (89% outpatients; 60% female). An exploratory factor analysis identified five subscales—patient-centred care, treatment effectiveness, staff behaviour, availability and coordination of care, and communication. The subscales had high internal reliability (Cronbach’s alpha = 0.77 to 0.85) and test–retest reliability ranged from 0.53 to 0.82 across the five scales. Scores on the new instrument were correlated with treatment outcomes. The assessment of patient experience should be integrated into a continuous, sustainable quality improvement process to be truly effective.
Literatur
Zurück zum Zitat Barker, D. A., & Orrell, M. W. (1999). The Psychiatric Care Satisfaction Questionnaire: A reliability and validity study. Social Psychiatry and Psychiatric Epidemiology,34, 111–116.CrossRef Barker, D. A., & Orrell, M. W. (1999). The Psychiatric Care Satisfaction Questionnaire: A reliability and validity study. Social Psychiatry and Psychiatric Epidemiology,34, 111–116.CrossRef
Zurück zum Zitat Bjorngaard, J. H., Ruud, T., & Friis, S. (2007). The impact of mental illness on patient satisfaction with the therapeutic relationship: A multilevel analysis. Social Psychiatry and Psychiatric Epidemiology: The International Journal for Research in Social and Genetic Epidemiology and Mental Health Services,42, 803–809. https://doi.org/10.1007/s00127-007-0229-5.CrossRef Bjorngaard, J. H., Ruud, T., & Friis, S. (2007). The impact of mental illness on patient satisfaction with the therapeutic relationship: A multilevel analysis. Social Psychiatry and Psychiatric Epidemiology: The International Journal for Research in Social and Genetic Epidemiology and Mental Health Services,42, 803–809. https://​doi.​org/​10.​1007/​s00127-007-0229-5.CrossRef
Zurück zum Zitat Costello, A. B., & Osborne, J. W. (2016). Best practices in exploratory factor analysis: Four recommendations for getting the most from your analysis. Practical Assessment, Research & Evaluation,10, 173–178. Costello, A. B., & Osborne, J. W. (2016). Best practices in exploratory factor analysis: Four recommendations for getting the most from your analysis. Practical Assessment, Research & Evaluation,10, 173–178.
Zurück zum Zitat Daniels, A. S., Shaul, J. A., Greenberg, P., & Cleary, P. D. (2004). The experience of care and health outcomes survey (ECHO): A consumer survey to collect ratings of behavioral health care treatment, outcomes and plans. In M. E. Maruish (Ed.), The use of psychological testing for treatment planning and outcomes assessment: Instruments for adults, Volume 3 (3rd ed., pp. 839–866). Mahwah, NJ: Lawrence Erlbaum Associates Publishers. Daniels, A. S., Shaul, J. A., Greenberg, P., & Cleary, P. D. (2004). The experience of care and health outcomes survey (ECHO): A consumer survey to collect ratings of behavioral health care treatment, outcomes and plans. In M. E. Maruish (Ed.), The use of psychological testing for treatment planning and outcomes assessment: Instruments for adults, Volume 3 (3rd ed., pp. 839–866). Mahwah, NJ: Lawrence Erlbaum Associates Publishers.
Zurück zum Zitat Davies, E., & Cleary, P. D. (2005). Hearing the patient's voice? Factors affecting the use of patient survey data in quality improvement. Quality & Safety in Health Care,14, 428–432.CrossRef Davies, E., & Cleary, P. D. (2005). Hearing the patient's voice? Factors affecting the use of patient survey data in quality improvement. Quality & Safety in Health Care,14, 428–432.CrossRef
Zurück zum Zitat De Winter, J., & Dodou, D. (2012). Factor recovery by principal axis factoring and maximum likelihood factor analysis as a function of factor pattern and sample size. Journal of Applied Statistics,39, 695–710.CrossRef De Winter, J., & Dodou, D. (2012). Factor recovery by principal axis factoring and maximum likelihood factor analysis as a function of factor pattern and sample size. Journal of Applied Statistics,39, 695–710.CrossRef
Zurück zum Zitat Eisen, S. V., Shaul, J. A., Clarridge, B., Nelson, D., Spink, J., & Cleary, P. D. (1999). Development of a consumer survey for behavioral health services. Psychiatric Services,50, 793–798.CrossRef Eisen, S. V., Shaul, J. A., Clarridge, B., Nelson, D., Spink, J., & Cleary, P. D. (1999). Development of a consumer survey for behavioral health services. Psychiatric Services,50, 793–798.CrossRef
Zurück zum Zitat Gagliardi, A., Lemieux-Charles, L., Brown, A., Sullivan, T., & Goel, V. (2008). Stakeholder preferences for cancer care performance indicators. International journal of health care quality assurance,21, 175–189.CrossRef Gagliardi, A., Lemieux-Charles, L., Brown, A., Sullivan, T., & Goel, V. (2008). Stakeholder preferences for cancer care performance indicators. International journal of health care quality assurance,21, 175–189.CrossRef
Zurück zum Zitat Greenfield, T. K. & Attkisson, C. C. (1999). The UCSF Client Satisfaction Scales: II. The Service Satisfaction Scale-30. The Use of Psychological Testing for Treatment Planning and Outcomes Assessment (2nd edn., pp. 1347–1367). Mahwah, NJ: Lawrence Erlbaum Associates Publishers. Greenfield, T. K. & Attkisson, C. C. (1999). The UCSF Client Satisfaction Scales: II. The Service Satisfaction Scale-30. The Use of Psychological Testing for Treatment Planning and Outcomes Assessment (2nd edn., pp. 1347–1367). Mahwah, NJ: Lawrence Erlbaum Associates Publishers.
Zurück zum Zitat Jerrell, J. M. (2006). Psychometrics of the MHSIP Adult Consumer Survey. Journal of Behavioral Health Services and Research,33, 483–488.CrossRef Jerrell, J. M. (2006). Psychometrics of the MHSIP Adult Consumer Survey. Journal of Behavioral Health Services and Research,33, 483–488.CrossRef
Zurück zum Zitat Kolb, S., Race, K., & Seibert, J. (2000). Psychometric evaluation of an inpatient psychiatric care consumer satisfaction survey. Journal of Behavioral Health Services and Research,27, 75–86.CrossRef Kolb, S., Race, K., & Seibert, J. (2000). Psychometric evaluation of an inpatient psychiatric care consumer satisfaction survey. Journal of Behavioral Health Services and Research,27, 75–86.CrossRef
Zurück zum Zitat LaVela, S., & Gallan, A. (2014). Evaluation and measurement of patient experience. Patient Experience Journal,1, 28–36.CrossRef LaVela, S., & Gallan, A. (2014). Evaluation and measurement of patient experience. Patient Experience Journal,1, 28–36.CrossRef
Zurück zum Zitat Lelliott, P., Beevor, A., Hogman, G., Hyslop, J., Lathlean, J., & Ward, M. (2001). Carer’s and Users’ Expectations of Services—User version (CUES-U): A new instrument to measure the experience of users of mental health services. The British Journal of Psychiatry,179, 67–72.CrossRef Lelliott, P., Beevor, A., Hogman, G., Hyslop, J., Lathlean, J., & Ward, M. (2001). Carer’s and Users’ Expectations of Services—User version (CUES-U): A new instrument to measure the experience of users of mental health services. The British Journal of Psychiatry,179, 67–72.CrossRef
Zurück zum Zitat Liu, P., Currie, S., & Adamyk-Simpson, J. (2018). What are the most important dimensions of quality for addiction and mental health services from the perspective of its users? Patient Experience Journal,5, 106–114.CrossRef Liu, P., Currie, S., & Adamyk-Simpson, J. (2018). What are the most important dimensions of quality for addiction and mental health services from the perspective of its users? Patient Experience Journal,5, 106–114.CrossRef
Zurück zum Zitat Parabiaghi, A., Barbato, A., D’Avanzo, B., Erlicher, A., & Lora, A. (2005). Assessing reliable and clinically significant change on Health of the Nation Outcome Scales: Method for displaying longitudinal data. Australian and New Zealand Journal of Psychiatry,39, 719–725.CrossRef Parabiaghi, A., Barbato, A., D’Avanzo, B., Erlicher, A., & Lora, A. (2005). Assessing reliable and clinically significant change on Health of the Nation Outcome Scales: Method for displaying longitudinal data. Australian and New Zealand Journal of Psychiatry,39, 719–725.CrossRef
Zurück zum Zitat Stevens, J. P. (2002). Applied multivariate statistics for the social sciences (4th ed.). Hillsdale, NS: Erlbaum. Stevens, J. P. (2002). Applied multivariate statistics for the social sciences (4th ed.). Hillsdale, NS: Erlbaum.
Zurück zum Zitat Tabachnick, B. G., & Fidell, L. S. (2012). Using multivariate statistics (6th ed.). Don Mills, Ontario: Pearson. Tabachnick, B. G., & Fidell, L. S. (2012). Using multivariate statistics (6th ed.). Don Mills, Ontario: Pearson.
Zurück zum Zitat Yong, A., & Pearce, S. (2013). A beginner’s guide to factor analysis: Focusing on exploratory factor analysis. Tutorials in Quantitative Methods for Psychology,9, 79–94.CrossRef Yong, A., & Pearce, S. (2013). A beginner’s guide to factor analysis: Focusing on exploratory factor analysis. Tutorials in Quantitative Methods for Psychology,9, 79–94.CrossRef
Metadaten
Titel
Validation of a Comprehensive Patient Experience Survey for Addiction and Mental Health that was Co-designed with Service Users
verfasst von
Shawn R. Currie
Priscilla Liu
Jassandre Adamyk-Simpson
Jesse Stanich
Publikationsdatum
01.05.2020
Verlag
Springer US
Erschienen in
Community Mental Health Journal / Ausgabe 4/2020
Print ISSN: 0010-3853
Elektronische ISSN: 1573-2789
DOI
https://doi.org/10.1007/s10597-019-00534-1

Weitere Artikel der Ausgabe 4/2020

Community Mental Health Journal 4/2020 Zur Ausgabe

Update Psychiatrie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.