Abstract
Despite increasing interest in supervision as a leverage point for bolstering public mental health services, the potential influence of supervisory alliance on organizations and direct service providers remains understudied, particularly in the context of supporting evidence-based treatment (EBT) use. This study examined agreement and discrepancy between supervisor and clinician ratings of alliance associated with clinicians’ perceptions of psychological climate and emotional exhaustion. Results indicated that discrepancies in alliance ratings were common and associated with clinicians’ perceptions of psychological climate. These findings have important implications for collaboration among supervisors and clinicians within a community mental health organizational context and the provision of EBTs.
Similar content being viewed by others
References
Aarons, G. A., Ehrhart, M. G., Farahnak, L. R., & Hurlburt, M. S. (2015). Leadership and Organizational Change for Implementation (LOCI): A randomized mixed method pilot study of a leadership and organization development intervention for evidence-based practice implementation. Implementation Science, 10, 1–12.
Aarons, G. A., Ehrhart, M. G., Farahnak, L. R., Sklar, M., & Horowitz, J. (2017). Discrepancies in leader and follower ratings of transformational leadership: Relationship with organizational culture in mental health. Administration and Policy in Mental Health and Mental Health Services, 44, 480–491.
Aarons, G. A., Ehrhart, M. G., Torres, E. M., Finn, N. L., & Beidas, R. (2016). The humble leader: Association of discrepancies in leader and follower ratings of implementation leadership with organizational climate in mental health. Psychiatric Services, 68, 115–122.
Aarons, G. A., Fettes, D. L., Flores, L. E. Jr., & Sommerfled, D. H. (2009). Evidence-based practice implementation and staff emotional exhaustion in children’s services. Behaviour Research and Therapy, 47, 954–960.
Aarons, G. A., & Sawitzky, A. C. (2006a). Organizational climate partially mediates the effect of culture on work attitudes and staff turnover in mental health services. Administration and Policy in Mental Health and Mental Health Services, 33, 289–301.
Aarons, G. A., & Sawtizky, A. C. (2006b). Organizational culture and climate and mental health provider attitudes toward evidence-based practice. Psychological Services, 3, 61–72.
Accurso, E. C., Taylor, R. M., & Garland, A. F. (2011). Evidence-based practices addressed in community-based children’s mental health clinical supervision. Training and Education in Professional Psychology, 5, 88–96.
Arches, J. (1991). Social structure, burnout, and job satisfaction. Social Work, 36, 202–206.
Atwater, L. E., Ostroff, C., Yammarino, F. J., & Fleenor, J. W. (1998). Self-other agreement: Does it really matter? Personnel Psychology, 51, 577–598.
Atwater, L. E., & Yammarino, F. J. (1997). Does self-other agreement on leadership perceptions moderate the validity of leadership and performance predictions?. Personnel Psychology, 45, 141–164.
Bakker, A. B., Demerouti, E., & Euwema, M. C. (2005). Job resources buffer the impact of job demands on burnout. Journal of Occupational Health Psychology, 10, 170–180.
Baltes, B. B., Zhdanova, L. S., & Parker, C. P. (2009). Psychological climate: A comparison of organizational and individual level referents. Human Relations, 62, 669–700.
Bearman, S. K., Schneiderman, R. L., & Zoloth, E. (2016). Building an evidence base for effective supervision practices: An analogue experiment of supervision to increase EBT fidelity. Administration and Policy in Mental Health and Mental Health Services Research, 44, 293–307.
Bearman, S. K., Weisz, J. R., Chorpita, B. F., Hoagwood, K., Ward, A., Ugueto, A. M., & Bernstein, A. & Research Network of Youth Mental Health (2013). More practice, less preach? The role of supervision processes and therapist characteristics in EBP implementation. Administration and Policy in Mental Health and Mental Health Services Research, 40, 518–529.
Beidas, R. S., & Kendall, P. C. (2010). Training therapists in evidence-based practice: A critical review of studies from a systems-contextual perspective. Clinical Psychology: Science and Practice, 17, 1–30.
Beidas, R. S., Williams, N. J., Green, P. D., Aarons, G. A., Becker-Haimes, E. M., Evans, A. C.,… Marcus, S. C. (2016). Concordance between administrator and clinician ratings of organizational culture and climate. Administration and Policy in Mental Health. https://doi.org/10.1007/s10488-016-0776-8.
Biemann, T., Cole, M. S., & Voelpel, S. (2012). Within-group agreement: On the use (and misuse) of rWG and rWG(J) in leadership research and some best practice guidelines. The Leadership Quarterly, 23, 66–80.
Birken, S. A., DiMartino, L. D., Kirk, M. A., Lee, S. D., McClelland, M., & Albert, N. M. (2016). Elaborating on theory with middle managers’ experience implementing healthcare innovations in practice. Implementation Science, 1, 2.
Birken, S. A., Lee, S. D., & Weiner, B. J. (2012). Uncovering middle mangers’ role in healthcare innovation implementation. Implementation Science, 7, 28.
Bordin, E. S. (1979). The generalizability of the psychoanalytic concept of the working alliance. Psychotherapy: Theory, Research & Practice, 16, 252–260.
Cohen, J. A., Mannarino, A. P., & Deblinger, E. (2006). Treating trauma and traumatic grief in children and adolescents. New York: Guildford.
Dorsey, S., Pullmann, M. D., Deblinger, E., Berliner, L., Kerns, S. E., Thompson, K., Unützer, J., Weisz, J. R., & Garland, A. F. (2013). Improving practice in community-based settings: A randomized trial of supervision—Study protocol. Implementation Science, 8, 1–11.
Dorsey, S., Pullmann, M. D., Kerns, S. E., Jungbluth, N., Meza, R., Thompson, K., & Berliner, L. (2017). The juggling act of supervision in community mental health: Implications for supporting evidence-based treatment. Administration and Policy in Mental Health and Mental Health Services Research, 44, 838–852.
Efstation, J. F., Patton, M. J., & Kardash, C. M. (1990). Measuring the working alliance in counselor supervision. Journal of Counseling Psychology, 37, 322–329.
Fleenor, J. W., McCauley, C. D., & Brutus, S. (1996). Self-other rating agreement and leader effectiveness. Leadership Quarterly, 7, 487–506.
Glisson, C. (2002). The organizational context of children’s mental health services. Clinical Child and Family Psychology Review, 5, 233–253.
Glisson, C., & Green, P. (2011). Organizational climate, services, and outcomes in child welfare systems. Child Abuse & Neglect, 35, 582–591.
Glisson, C., & Hemmelgarn, A. (1998). The effects of organizational climate and interorganizational coordination on the quality and outcomes of children’s service systems. Child Abuse & Neglect, 22, 401–421.
Glisson, C., & James, L. R. (2002). The cross-level effects of culture and climate in human service teams. Journal of Organizational Behavior, 23, 767–794.
Glisson, C., Landsverk, J., Schoenwald, S., Kelleher, K., Hoagwood, K. E., Mayberg, S., & Green, P. (2008). Assessing the organizational social context (OSC) of mental health services: Implications for research and practice. Administration and Policy in Mental Health and Mental Health Services Research, 35, 98–113.
Gnilka, P. B., Chang, C. Y., & Dew, B. J. (2012). The relationship between supervisee stress, coping resources, the working alliance, and the supervisory working alliance. Journal of Counseling & Development, 90, 63–70.
Green, A. E., Albanese, B. J., Cafri, G., & Aarons, G. A. (2014). Leadership, organizational climate, and working alliance in a children’s mental health service system. Community Mental Health Journal, 50, 771–777.
Green, A. E., Miller, E. A., & Aarons, G. A. (2013). Transformational leadership moderates the relationship between emotional exhaustion and turnover intention among community mental health providers. Community Mental Health Journal, 49, 373–379.
Greenson, R. R. (1967). The technique and practice of psychoanalysis. New York: International Universities Press, Inc.
Herschell, A. D., Kolko, D. J., Baumann, B. L., & Davis, A. C. (2010). The role of therapist training in the implementation of psychosocial treatments: A review and critique with recommendations. Clinical Psychology Review, 30, 448–466.
Holloway, E. L. (1979). The effects of conceptual level on clinical hypothesis formation and the supervision interview (Doctoral dissertation, University of Wisconsin, Madison).
Holloway, E. L., & Wampold, B. E. (1983). Patterns of verbal behavior and judgments of satisfaction in the supervision interview. Journal of Counseling Psychology, 30, 227–234.
Holloway, E. L., & Wampold, B. E. (1984). Dimensions of satisfaction in the supervision interview. Paper presented at the annual meeting of the American Psychological Association, Toronto, Canada.
James, L. R., Choi, C. C., Ko, C. H. E., McNeil, P. K., Minton, M. K., Wright, M. A., & Kim, K. I. (2008). Organizational and psychological climate: A review of theory and research. European Journal of Work and Organizational Psychology, 17, 5–32.
Kavanagh, D. J., Spence, S. H., Strong, J., Wilson, J., Sturk, H., & Crow, N. (2003). Supervision practices in allied mental health: Relationships of supervision characteristics to perceived impact and job satisfaction. Mental Health Services Research, 5, 187–195.
Kim, H., & Lee, S. Y. (2009). Supervisory communication, burnout, and turnover intention among social workers in health care Settings. Social Work in Health Care, 48, 364–385.
Knudsen, H. K., Ducharme, L. J., & Roman, P. M. (2006). Counselor emotional exhaustion and turnover intention in therapeutic communities. Journal of Substance Abuse Treatment, 31, 173–180.
Ladany, N., Ellis, M. V., & Friedlander, M. L. (1999). The supervisory working alliance, trainee self-efficacy, and satisfaction. Journal of Counseling and Development, 77, 447–455.
Lehman, W. E. K., Greener, J. M., & Simpson, D. D. (2002). Assessing organizational readiness for change. Journal of Substance Abuse Treatment, 22, 197–209.
Liao, E. Y., & Chun, H. (2016). Supervisor monitoring and subordinate innovation. Journal of Organizational Behavior, 37, 168–192.
Marsh, H. W., Ludtke, O., Nagengast, B., Trautwein, U., Morin, A. J. S., Abduljabbar, A. S., & Koller, O. (2012). Classroom climate and contextual effects: Conceptual and methodological issues in the evaluation of group-level effects. Educational Psychologist, 47, 106–124.
Maslach, C., & Jackson, S. E. (1981). The measurement of experienced burnout. Journal of Organizational Behavior, 2, 99–113.
Maslach, C., Jackson, S. E., & Leiter, M. P. (1996). Maslach burnout inventory manual (3rd ed.). Palo Alto, CA: Consulting Psychologists Press, Inc.
Mena, K. C., & Bailey, J. D. (2007). The effects of the supervisory working alliance on worker outcomes. Journal of Social Service Research, 34, 55–65.
Morse, G., Salyers, M. P., Rollins, A. L., Monroe-DeVita, M., & Pfahler, C. (2012). Burnout in mental health services: A review of the problem and its remediation. Administration and Policy in Mental Health and Mental Health Services Research, 39, 341–352.
Pepinsky, H. B., & Patton, M. J. (1971). The psychological experiment: A practical accomplishment. New York: Pergamon.
Podsakoff, P. M., MacKenzie, S. B., & Podsakoff, N. P. (2003). Common method biases in behavioral research: A critical review of the literature and recommended remedies. Journal of Applied Psychology, 88, 879–903.
Schoenwald, S. K., Mehta, T. G., Frazier, S. L., & Shernoff, E. S. (2013). Clinical supervision in effectiveness and implementation research. Clinical Psychology Science and Practice, 20, 44–59.
Shanock, L. R., Baran, B. E., Gentry, W. A., Pattison, S. C., & Heggestad, E. D. (2010). Polynomial regression with response surface analysis: A powerful approach for examining moderation and overcoming limitations of difference scores. Journal of Business and Psychology, 25, 543–554.
Shanock, L. R., Baran, B. E., Gentry, W. A., Pattison, S. C., & Heggestad, E. D. (2014). Erratum to: Polynomial regression with response surface analysis: A powerful approach for examining moderation and overcoming limitations of difference scores. Journal of Business and Psychology, 29, 161.
Sterner, W. (2009). Influence of the supervisory working alliance on supervisee work satisfaction and work-related stress. Journal of Mental Health Counseling, 31, 249–263.
Toegel, G., & Conger, J. A. (2003). 360-degree assessment: Time for reinvention. Learning and Education, 2, 297–311.
Watkins, C. E. Jr. (2014). The supervisory alliance: A half century of theory, practice, and research in critical perspective. American Journal of Psychotherapy, 68, 19–55.
Webster, L., & Hackett, R. K. (1999). Burnout and leadership in community mental health systems. Administration and Policy in Mental Health, 26, 387–399.
Zhang, X., & Bartol, K. M. (2010). Linking empowering leadership and employee creativity: The influence of psychological empowerment, intrinsic motivation, and creative process engagement. Academy of Management Journal, 53, 107–128.
Acknowledgements
We also are grateful for the support and collaboration from the Washington State Department of Social and Health Services, Division of Behavioral Health and Recovery and participating mental health organizations across Washington State.
Funding
Funding for this study was supported by the National Institute of Mental Health (R01 MH095749; Dorsey, PI). Additionally, the preparation of this article was supported in part by NIMH K01MH100199 awarded to the first author.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Ethics Approval
The University of Washington Institutional Review Board approved this study. All procedures performed were in accordance with the ethical standards of the University of Washington Institutional Review Board.
Informed Consent
Informed consent was obtained from all individual participants included in the study.
Rights and permissions
About this article
Cite this article
Locke, J., Violante, S., Pullmann, M.D. et al. Agreement and Discrepancy Between Supervisor and Clinician Alliance: Associations with Clinicians’ Perceptions of Psychological Climate and Emotional Exhaustion. Adm Policy Ment Health 45, 505–517 (2018). https://doi.org/10.1007/s10488-017-0841-y
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10488-017-0841-y