Skip to main content
Erschienen in: The Journal of Behavioral Health Services & Research 3/2017

05.04.2016

Sustained Implementation Support Scale: Validation of a Measure of Program Characteristics and Workplace Functioning for Sustained Program Implementation

verfasst von: Lauren M. Hodge, BSc, Karen M. T. Turner, PhD, Matthew R. Sanders, PhD, Ania Filus, PhD

Erschienen in: The Journal of Behavioral Health Services & Research | Ausgabe 3/2017

Einloggen, um Zugang zu erhalten

Abstract

An evaluation measure of enablers and inhibitors to sustained evidence-based program (EBP) implementation may provide a useful tool to enhance organizations’ capacity. This paper outlines preliminary validation of such a measure. An expert informant and consumer feedback approach was used to tailor constructs from two existing measures assessing key domains associated with sustained implementation. Validity and reliability were evaluated for an inventory composed of five subscales: Program benefits, Program burden, Workplace support, Workplace cohesion, and Leadership style. Exploratory and confirmatory factor analysis with a sample of 593 Triple P—Positive Parenting Program—practitioners led to a 28-item scale with good reliability and good convergent, discriminant, and predictive validity. Practitioners sustaining implementation at least 3 years post-training were more likely to have supervision/peer support, reported higher levels of program benefit, workplace support, and positive leadership style, and lower program burden compared to practitioners who were non-sustainers.
Anhänge
Nur mit Berechtigung zugänglich
Fußnoten
1
The CFI, RMSEA, and SRMR fit indices were all affected by the Satorra–Bentler scaling correction for the chi-square statistic.
 
2
The AVE estimate represents the average amount of variation that a latent construct is able to explain in the observed variables that theoretically relate to the construct. It is calculated by averaging the sum of squared factor loadings for each latent construct. The squared factor loading represents the amount of variation in each observed variable that the latent construct accounts for. When this variance is averaged across all observed variables that relate theoretically to the latent construct, the authors generate the AVE.
 
3
For the chi-square difference test, a constrained model, in which the correlation between the factors is fixed at 1.00, is compared to the original model’s χ 2 where the correlation between the constructs is estimated freely. Significantly lower chi-square value of the unconstrained model implies good discriminant validity.
 
4
The supervision/peer support variable was a binary predictor coded 0 if there was no supervision and peer support and 1 if the practitioner received some supervision/peer support. Since it was desirable to estimate the intercept and the slope for the group coded 0, no mean centering was applied for this predictor.103
 
5
FIML procedure is not available for logistic regression (FIML can only be used with maximum likelihood estimation).
 
6
The Bartlett’s test of sphericity is sensitive to deviations from normality, and, since the first sample was non-normally distributed, the results of this test should be interpreted with caution.
 
7
Results based on multiple imputations present a range of Cox and Snell R 2 across five imputed samples.
 
Literatur
1.
Zurück zum Zitat American Psychological Association. Effective Strategies to Support Positive Parenting in Community Health Centers. Washington, D.C.: Report of the Working Group on Child Maltreatment Prevention in Community Health Centers; 2009. American Psychological Association. Effective Strategies to Support Positive Parenting in Community Health Centers. Washington, D.C.: Report of the Working Group on Child Maltreatment Prevention in Community Health Centers; 2009.
2.
Zurück zum Zitat United Nations Office on Drugs and Crime. Compilation of evidence-based family skills training programmes. Vienna, Austria: United Nations; 2010. United Nations Office on Drugs and Crime. Compilation of evidence-based family skills training programmes. Vienna, Austria: United Nations; 2010.
3.
Zurück zum Zitat World Health Organization. Violence Prevention: The evidence. Geneva, Switzerland: Departement of Violence and Injury Prevention and Disability; 2010. World Health Organization. Violence Prevention: The evidence. Geneva, Switzerland: Departement of Violence and Injury Prevention and Disability; 2010.
4.
Zurück zum Zitat Odgen T, Fixsen DL. Implementation science: A brief overview and a look ahead. Zeitschrift Für Psychologie. 2014;222(1):4–11.CrossRef Odgen T, Fixsen DL. Implementation science: A brief overview and a look ahead. Zeitschrift Für Psychologie. 2014;222(1):4–11.CrossRef
5.
Zurück zum Zitat LaPelle NR, Zapka J, Ockene JK. Sustainability of public health programs: The example of tobacco treatment services in Massachusetts. American Journal of Public Health. 2006;96(8):1363–1369.CrossRefPubMedPubMedCentral LaPelle NR, Zapka J, Ockene JK. Sustainability of public health programs: The example of tobacco treatment services in Massachusetts. American Journal of Public Health. 2006;96(8):1363–1369.CrossRefPubMedPubMedCentral
6.
Zurück zum Zitat Goodman RM, Steckler A. A model for the institutionalization of health promotion programs. Journal of Family and Community Health. 1989;11(4):63–78.CrossRef Goodman RM, Steckler A. A model for the institutionalization of health promotion programs. Journal of Family and Community Health. 1989;11(4):63–78.CrossRef
7.
Zurück zum Zitat Gaven S, Schorer J. From training to practice transformation: Implementing a public health parenting program. Australian Institute of Family Studies. 2013(93):50–57. Gaven S, Schorer J. From training to practice transformation: Implementing a public health parenting program. Australian Institute of Family Studies. 2013(93):50–57.
8.
Zurück zum Zitat World Health Organization. From Evidence to Policy: Expanding Access to Family Planning. Geneva, Switzerland: Department of Reproductive Health and Research; 2012. World Health Organization. From Evidence to Policy: Expanding Access to Family Planning. Geneva, Switzerland: Department of Reproductive Health and Research; 2012.
9.
Zurück zum Zitat Scheirer MA. Is sustainability possible? A review and commentary on empirical studies of program sustainability. American Journal of Evaluation. 2005;26(3):320–346.CrossRef Scheirer MA. Is sustainability possible? A review and commentary on empirical studies of program sustainability. American Journal of Evaluation. 2005;26(3):320–346.CrossRef
10.
Zurück zum Zitat Wiltsey Stirman S, Kimberly J, Cook N, et al. The sustainability of new programs and innovations: a review of the empirical literature and recommendations for future research. Implementation Science. 2012;7(1):17–36.CrossRefPubMedPubMedCentral Wiltsey Stirman S, Kimberly J, Cook N, et al. The sustainability of new programs and innovations: a review of the empirical literature and recommendations for future research. Implementation Science. 2012;7(1):17–36.CrossRefPubMedPubMedCentral
11.
Zurück zum Zitat Fixsen D, Blase KA, Naoom SF, et al. Implementation Drivers: Assessing Best Practices. Chapel Hill, NC: Creative Commons License; 2015. Fixsen D, Blase KA, Naoom SF, et al. Implementation Drivers: Assessing Best Practices. Chapel Hill, NC: Creative Commons License; 2015.
12.
Zurück zum Zitat Durlak JA, Dupre EP. Implementation matters: A review of research on the influence of implementation on program outcomes and the factors affecting implementation. American Journal of Community Psychology. 2008;41(3–4):327–350.CrossRefPubMed Durlak JA, Dupre EP. Implementation matters: A review of research on the influence of implementation on program outcomes and the factors affecting implementation. American Journal of Community Psychology. 2008;41(3–4):327–350.CrossRefPubMed
13.
Zurück zum Zitat Greenhalgh T, Robert G, Macfarlane F, et al. Diffusion of innovations in service organizations: Systematic review and recommendations. The Milbank Quarterly. 2004;82(4):581–629.CrossRefPubMedPubMedCentral Greenhalgh T, Robert G, Macfarlane F, et al. Diffusion of innovations in service organizations: Systematic review and recommendations. The Milbank Quarterly. 2004;82(4):581–629.CrossRefPubMedPubMedCentral
14.
Zurück zum Zitat Scheirer MA, Dearing JW. An agenda for research on the sustainability of public health programs. American Journal of Public Health. 2011;101(11):2059–2067.CrossRefPubMedPubMedCentral Scheirer MA, Dearing JW. An agenda for research on the sustainability of public health programs. American Journal of Public Health. 2011;101(11):2059–2067.CrossRefPubMedPubMedCentral
15.
Zurück zum Zitat Aarons GA, Hurlburt M, McCue Horwitz S. Advancing a conceptual model of evidence-based practice implementation in public service sectors. Journal of Administration and Policy in Mental Health. 2011;38(1):4–23.CrossRefPubMed Aarons GA, Hurlburt M, McCue Horwitz S. Advancing a conceptual model of evidence-based practice implementation in public service sectors. Journal of Administration and Policy in Mental Health. 2011;38(1):4–23.CrossRefPubMed
16.
Zurück zum Zitat Damschroder LJ, Aron DC, Keith RE, et al. Fostering implementation of health services research findings into practice: A consolidated framework for advancing implementation science. Implementation Science. 2009;4(1):50–65.CrossRefPubMedPubMedCentral Damschroder LJ, Aron DC, Keith RE, et al. Fostering implementation of health services research findings into practice: A consolidated framework for advancing implementation science. Implementation Science. 2009;4(1):50–65.CrossRefPubMedPubMedCentral
17.
Zurück zum Zitat Meyers DC, Durlak JA, Wandersman A. The quality implementation framework: A synthesis of critical steps in the implementation process. American Journal of Community Psychology. 2012;50(3–4):462–480.CrossRefPubMed Meyers DC, Durlak JA, Wandersman A. The quality implementation framework: A synthesis of critical steps in the implementation process. American Journal of Community Psychology. 2012;50(3–4):462–480.CrossRefPubMed
18.
Zurück zum Zitat Sanders MR, Turner KMT, McWilliam J. The Triple P- Positive Parenting Program: A community wide approach to parenting and family support. In: MJ Van Ryzin, KL Kumpfer, GM Fosco, MT Greenberg (Eds). Family-Based Prevention Programs for Children and Adolescents: Theory, Research, and Large-scale Dissemination. New York: Psychology Press; 2015: pp. 130–155. Sanders MR, Turner KMT, McWilliam J. The Triple P- Positive Parenting Program: A community wide approach to parenting and family support. In: MJ Van Ryzin, KL Kumpfer, GM Fosco, MT Greenberg (Eds). Family-Based Prevention Programs for Children and Adolescents: Theory, Research, and Large-scale Dissemination. New York: Psychology Press; 2015: pp. 130–155.
19.
Zurück zum Zitat Marquez L, Holschneider S, Broughton E, et al. Improving Health Care: The Results and Legacy of the USAID Health Care Improvement Project. Bethesda, MD: University Research Co., LLC (URC);2014. Marquez L, Holschneider S, Broughton E, et al. Improving Health Care: The Results and Legacy of the USAID Health Care Improvement Project. Bethesda, MD: University Research Co., LLC (URC);2014.
20.
Zurück zum Zitat Hodge LM & Turner KMT. Sustained Implementation of Evidence-based Programs in Disadvantaged Communities: A Conceptual Framework of Supporting Factors 2015. Hodge LM & Turner KMT. Sustained Implementation of Evidence-based Programs in Disadvantaged Communities: A Conceptual Framework of Supporting Factors 2015.
21.
Zurück zum Zitat Rogers EM. Diffusion of Innovations. 5th ed. New York: Free Press; 2003. Rogers EM. Diffusion of Innovations. 5th ed. New York: Free Press; 2003.
23.
Zurück zum Zitat Glasgow RE, Vogt TM, Boles SM. Evaluating the public health impact of health promotion interventions: The RE-AIM framework. American Journal of Public Health. 1999;89(9):1322–1327.CrossRefPubMedPubMedCentral Glasgow RE, Vogt TM, Boles SM. Evaluating the public health impact of health promotion interventions: The RE-AIM framework. American Journal of Public Health. 1999;89(9):1322–1327.CrossRefPubMedPubMedCentral
24.
Zurück zum Zitat Fixsen D, Naoom SF, Blase KA, et al. Implementation Research: A Synthesis of the Literature. Tampa, FL: Louis de la Parte Florida Mental Health Institute; 2005. Fixsen D, Naoom SF, Blase KA, et al. Implementation Research: A Synthesis of the Literature. Tampa, FL: Louis de la Parte Florida Mental Health Institute; 2005.
25.
Zurück zum Zitat Spoth R, Greenberg MT, Bierman K, et al. PROSPER community-university partnership model for public education systems: Capacity building for evidence-based, competence-building prevention. Prevention Science. 2004;5(1):31–39.CrossRefPubMed Spoth R, Greenberg MT, Bierman K, et al. PROSPER community-university partnership model for public education systems: Capacity building for evidence-based, competence-building prevention. Prevention Science. 2004;5(1):31–39.CrossRefPubMed
26.
Zurück zum Zitat Simpson DD, Flynn PM. Moving innovations into treatment: A stage-based approach to program change. Journal of Substance Abuse Treatment. 2007;33(2):111–120.CrossRefPubMedPubMedCentral Simpson DD, Flynn PM. Moving innovations into treatment: A stage-based approach to program change. Journal of Substance Abuse Treatment. 2007;33(2):111–120.CrossRefPubMedPubMedCentral
27.
Zurück zum Zitat Ilott I, Gerrish K, Laker S, et al. Bridging the gap between knowledge and practice: Using theories, models and conceptual frameworks. Getting Started: Naming and Framing the Problem. 2013;10(2):1–4. Ilott I, Gerrish K, Laker S, et al. Bridging the gap between knowledge and practice: Using theories, models and conceptual frameworks. Getting Started: Naming and Framing the Problem. 2013;10(2):1–4.
28.
Zurück zum Zitat Proctor EK, Landsverk J, Aarons GA, et al. Implementation research in mental health services: An emerging science with conceptual, methodological, and training challenges. Journal of Administration and Policy in Mental Health. 2009;36(1):24–34.CrossRefPubMed Proctor EK, Landsverk J, Aarons GA, et al. Implementation research in mental health services: An emerging science with conceptual, methodological, and training challenges. Journal of Administration and Policy in Mental Health. 2009;36(1):24–34.CrossRefPubMed
29.
Zurück zum Zitat Spoth R, Guyll M, Redmond C, et al. Six-year sustainability of evidence-based intervention implementation quality by community-university partnerships: The PROSPER study. American Journal of Community Psychology. 2011;48(3–4):412–425.CrossRefPubMedPubMedCentral Spoth R, Guyll M, Redmond C, et al. Six-year sustainability of evidence-based intervention implementation quality by community-university partnerships: The PROSPER study. American Journal of Community Psychology. 2011;48(3–4):412–425.CrossRefPubMedPubMedCentral
30.
Zurück zum Zitat Schell SF, Luke DA, Schooley MW, et al. Public health program capacity for sustainability: A new framework. Implementation Science. 2013;8(1):15–24.CrossRefPubMedPubMedCentral Schell SF, Luke DA, Schooley MW, et al. Public health program capacity for sustainability: A new framework. Implementation Science. 2013;8(1):15–24.CrossRefPubMedPubMedCentral
31.
Zurück zum Zitat Feldstein AC, Glasgow RE. A practical, robust implementation and sustainability model (PRISM) for integrating research findings into practice. Joint Commission Journal on Quality and Patient Safety. 2008;34(4):228–243.CrossRefPubMed Feldstein AC, Glasgow RE. A practical, robust implementation and sustainability model (PRISM) for integrating research findings into practice. Joint Commission Journal on Quality and Patient Safety. 2008;34(4):228–243.CrossRefPubMed
32.
Zurück zum Zitat Proctor EK, Silmere H, Raghavan R, et al. Outcomes for implementation research: Conceptual distinctions, measurement challenges, and research agenda. Journal of Administration and Policy in Mental Health. 2011;38(2). Proctor EK, Silmere H, Raghavan R, et al. Outcomes for implementation research: Conceptual distinctions, measurement challenges, and research agenda. Journal of Administration and Policy in Mental Health. 2011;38(2).
33.
Zurück zum Zitat Armstrong R, Waters E, Moore L, et al. Improving the reporting of public health intervention research: Advancing TREND and CONSORT. Journal of Public Health. 2008;30(1):103–109.CrossRefPubMed Armstrong R, Waters E, Moore L, et al. Improving the reporting of public health intervention research: Advancing TREND and CONSORT. Journal of Public Health. 2008;30(1):103–109.CrossRefPubMed
34.
Zurück zum Zitat Southam-Gerow M, Arnold C, Rodriguez A, et al. Acting locally and globally: Dissemination implementation around the world and next door. Journal of Cognitive and Behavioral Practice. 2014;21:127–133.CrossRefPubMed Southam-Gerow M, Arnold C, Rodriguez A, et al. Acting locally and globally: Dissemination implementation around the world and next door. Journal of Cognitive and Behavioral Practice. 2014;21:127–133.CrossRefPubMed
35.
Zurück zum Zitat Fixsen D, Blase K, Naoom S, et al. Stage-based measures of implementation components. National Implementation Research Network. 2010:1–43. Fixsen D, Blase K, Naoom S, et al. Stage-based measures of implementation components. National Implementation Research Network. 2010:1–43.
36.
Zurück zum Zitat Brown LD, Feinberg ME, Greenberg MT. Measuring coalition functioning: Refining constructs through factor analysis. Health Education & Behavior. 2012;39(4):486–497.CrossRef Brown LD, Feinberg ME, Greenberg MT. Measuring coalition functioning: Refining constructs through factor analysis. Health Education & Behavior. 2012;39(4):486–497.CrossRef
37.
Zurück zum Zitat Savaya R, Spiro SE. Predictors of sustainability of social programs. American Journal of Evaluation. 2012;33(1):26–43.CrossRef Savaya R, Spiro SE. Predictors of sustainability of social programs. American Journal of Evaluation. 2012;33(1):26–43.CrossRef
38.
Zurück zum Zitat Aarons GA. Mental health provider attitudes toward adoption of evidence-based practice: The evidence-based practice attitude scale (EBPAS). Journal of Mental Health Services Research. 2004;6:61–67.CrossRefPubMed Aarons GA. Mental health provider attitudes toward adoption of evidence-based practice: The evidence-based practice attitude scale (EBPAS). Journal of Mental Health Services Research. 2004;6:61–67.CrossRefPubMed
39.
Zurück zum Zitat Bartholomew LK, Parcel GS, Kok G, et al. Diffusion of innovations theory (Eds). Planning Health Promotion Programs: An Intervention Mapping Approach, Third Edition. California Jossey-Bass; 2011:108–111. Bartholomew LK, Parcel GS, Kok G, et al. Diffusion of innovations theory (Eds). Planning Health Promotion Programs: An Intervention Mapping Approach, Third Edition. California Jossey-Bass; 2011:108–111.
40.
Zurück zum Zitat Cook JM, Schnurr PP, Biyanova T, et al. Apples don't fall far from the tree: Influences on psychotherapists’ adoption and sustained use of new therapies. Psychiatric Services. 2009;60(5):671–676.CrossRefPubMedPubMedCentral Cook JM, Schnurr PP, Biyanova T, et al. Apples don't fall far from the tree: Influences on psychotherapists’ adoption and sustained use of new therapies. Psychiatric Services. 2009;60(5):671–676.CrossRefPubMedPubMedCentral
41.
Zurück zum Zitat Cohen LH, Sargent MM, Sechrest LB. Use of psychotherapy research by professional psychologists. American Psychologist. 1986;41(2):198–206.CrossRefPubMed Cohen LH, Sargent MM, Sechrest LB. Use of psychotherapy research by professional psychologists. American Psychologist. 1986;41(2):198–206.CrossRefPubMed
42.
Zurück zum Zitat Reding MEJ, Chorpita BF, Lau AS, et al. Provider’ attitudes toward evidence-based practices: Is it just about providers, or do practices matter, too? Journal of Administration and Policy in Mental Health. 2014;41(6):767–776.CrossRefPubMed Reding MEJ, Chorpita BF, Lau AS, et al. Provider’ attitudes toward evidence-based practices: Is it just about providers, or do practices matter, too? Journal of Administration and Policy in Mental Health. 2014;41(6):767–776.CrossRefPubMed
43.
Zurück zum Zitat Shapiro CJ, Prinz RJ, Sanders MR. Sustaining use of an evidence-based parenting intervention: Practitioner perspectives. Journal of Child and Family Studies. 2014;24(6):1615–1624.CrossRef Shapiro CJ, Prinz RJ, Sanders MR. Sustaining use of an evidence-based parenting intervention: Practitioner perspectives. Journal of Child and Family Studies. 2014;24(6):1615–1624.CrossRef
44.
Zurück zum Zitat Glisson C. The organizational context of children's mental health services. Clinical Child and Family Psychology Review. 2002;5(4):233–253.CrossRefPubMed Glisson C. The organizational context of children's mental health services. Clinical Child and Family Psychology Review. 2002;5(4):233–253.CrossRefPubMed
45.
Zurück zum Zitat Beidas RS, Marcus S, Aarons GA, et al. Predictors of community therapists’ use of therapy techniques in a large public mental health system. Journal of American Medical Association Pediatrics. 2015;169(4):374–382. Beidas RS, Marcus S, Aarons GA, et al. Predictors of community therapists’ use of therapy techniques in a large public mental health system. Journal of American Medical Association Pediatrics. 2015;169(4):374–382.
46.
Zurück zum Zitat Aarons GA, Green AE, Willging CE, et al. Mixed-method study of a conceptual model of evidence-based intervention sustainment across multiple public-sector service settings. Implementation Science. 2014;9(1):183.CrossRefPubMedPubMedCentral Aarons GA, Green AE, Willging CE, et al. Mixed-method study of a conceptual model of evidence-based intervention sustainment across multiple public-sector service settings. Implementation Science. 2014;9(1):183.CrossRefPubMedPubMedCentral
47.
Zurück zum Zitat Ehrhart MG, Aarons GA, Farahnak LR. Assessing the organizational context for EBP implementation: The development and validity testing of the Implementation Climate Scale (ICS). Implementation Science. 2014;9(1):157–168.CrossRefPubMedPubMedCentral Ehrhart MG, Aarons GA, Farahnak LR. Assessing the organizational context for EBP implementation: The development and validity testing of the Implementation Climate Scale (ICS). Implementation Science. 2014;9(1):157–168.CrossRefPubMedPubMedCentral
48.
Zurück zum Zitat Jacobs S, Weiner B, Bunger A. Context matters: Measuring implementation climate among individuals and groups. Implementation Science. 2014;9(1):46–60.CrossRefPubMedPubMedCentral Jacobs S, Weiner B, Bunger A. Context matters: Measuring implementation climate among individuals and groups. Implementation Science. 2014;9(1):46–60.CrossRefPubMedPubMedCentral
49.
Zurück zum Zitat Aarons GA, Sommerfeld DH, Walrath-Greene CM. Evidence-based practice implementation: The impact of public versus private sector organization type on organizational support, provider attitudes, and adoption of evidence-based practice. Implementation Science. 2009;4(1):83–83.CrossRefPubMedPubMedCentral Aarons GA, Sommerfeld DH, Walrath-Greene CM. Evidence-based practice implementation: The impact of public versus private sector organization type on organizational support, provider attitudes, and adoption of evidence-based practice. Implementation Science. 2009;4(1):83–83.CrossRefPubMedPubMedCentral
50.
Zurück zum Zitat Gruen RL, Elliott JH, Nolan ML, et al. Sustainability science: An integrated approach for health-programme planning. The Lancet. 2008;372(9649):1579–1589.CrossRef Gruen RL, Elliott JH, Nolan ML, et al. Sustainability science: An integrated approach for health-programme planning. The Lancet. 2008;372(9649):1579–1589.CrossRef
51.
Zurück zum Zitat Simpson DD. A conceptual framework for transferring research to practice. Journal of Substance Abuse Treatment. 2002;22(4):171–182.CrossRefPubMed Simpson DD. A conceptual framework for transferring research to practice. Journal of Substance Abuse Treatment. 2002;22(4):171–182.CrossRefPubMed
52.
Zurück zum Zitat Lehman WEK, Greener JM, Simpson DD. Assessing organizational readiness for change. Journal of Substance Abuse Treatment. 2002;22(4):197–209.CrossRefPubMed Lehman WEK, Greener JM, Simpson DD. Assessing organizational readiness for change. Journal of Substance Abuse Treatment. 2002;22(4):197–209.CrossRefPubMed
53.
Zurück zum Zitat Edmondson AC. Speaking up in the operating room: How team leaders promote learning in interdisciplinary action teams. Journal of Management Studies. 2003;40(6):1419–1452.CrossRef Edmondson AC. Speaking up in the operating room: How team leaders promote learning in interdisciplinary action teams. Journal of Management Studies. 2003;40(6):1419–1452.CrossRef
54.
Zurück zum Zitat Mancini JA, Marek LI. Sustaining community-based programs for families: Conceptualization and measurement. Family Relations. 2004;53(4):339–347.CrossRef Mancini JA, Marek LI. Sustaining community-based programs for families: Conceptualization and measurement. Family Relations. 2004;53(4):339–347.CrossRef
55.
Zurück zum Zitat Schneider B, Ehrhart MG, Mayer DM, et al. Understanding organization-customer links in service settings. Academy of Management Journal. 2005;48(6):1017–1032.CrossRef Schneider B, Ehrhart MG, Mayer DM, et al. Understanding organization-customer links in service settings. Academy of Management Journal. 2005;48(6):1017–1032.CrossRef
56.
Zurück zum Zitat Van de Ven A, Douglas P, Garud R, et al. The Innovation Journey. New York, NY: Oxford University Press; 1999. Van de Ven A, Douglas P, Garud R, et al. The Innovation Journey. New York, NY: Oxford University Press; 1999.
57.
Zurück zum Zitat Spence SH, Jill W, Kavanagh D, et al. Clinical supervision in four mental health professions: A review of the evidence. Behaviour Change. 2001;18(3):135–155.CrossRef Spence SH, Jill W, Kavanagh D, et al. Clinical supervision in four mental health professions: A review of the evidence. Behaviour Change. 2001;18(3):135–155.CrossRef
58.
Zurück zum Zitat Marquez L, Kean L. Making supervision supportive and sustainable: New approaches to old problems. Maxamizing Access and Quality Initiative. 2002(4). Marquez L, Kean L. Making supervision supportive and sustainable: New approaches to old problems. Maxamizing Access and Quality Initiative. 2002(4).
59.
Zurück zum Zitat Turner KMT, Sanders MR. Dissemination of evidence-based parenting and family support strategies: Learning from the Triple P – Positive Parenting Program system approach. Aggression and Violent Behavior, A Review Journal. 2006;11(2):176–193.CrossRef Turner KMT, Sanders MR. Dissemination of evidence-based parenting and family support strategies: Learning from the Triple P – Positive Parenting Program system approach. Aggression and Violent Behavior, A Review Journal. 2006;11(2):176–193.CrossRef
60.
Zurück zum Zitat Sanders MR, Turner KMT. Reflections on the challenges of effective dissemination of behavioural family intervention: Our experience with the Triple P – Positive Parenting Program. Journal of Child and Adolescent Mental Health. 2005;10(4):158–169.CrossRef Sanders MR, Turner KMT. Reflections on the challenges of effective dissemination of behavioural family intervention: Our experience with the Triple P – Positive Parenting Program. Journal of Child and Adolescent Mental Health. 2005;10(4):158–169.CrossRef
61.
Zurück zum Zitat Pallas SW, Minhas D, Pérez-Escamilla R, et al. Community health workers in low- and middle-income countries: What do we know about scaling up and sustainability. American Journal of Public Health. 2013;103(7):e74-e82.CrossRefPubMedPubMedCentral Pallas SW, Minhas D, Pérez-Escamilla R, et al. Community health workers in low- and middle-income countries: What do we know about scaling up and sustainability. American Journal of Public Health. 2013;103(7):e74-e82.CrossRefPubMedPubMedCentral
62.
Zurück zum Zitat Beidas RS, Kendall PC. Training therapists in evidence-based practice: A critical review of studies from a systems-contextual perspective. Journal of Clinical Psychology: Science and Practice. 2010;17(1):1–30. Beidas RS, Kendall PC. Training therapists in evidence-based practice: A critical review of studies from a systems-contextual perspective. Journal of Clinical Psychology: Science and Practice. 2010;17(1):1–30.
63.
Zurück zum Zitat Chaudoir SR, Dugan AG, Barr CH. Measuring factors affecting implementation of health innovations: A systematic review of structural, organizational, provider, patient, and innovation level measures. Implementation Science. 2013;8(22). Chaudoir SR, Dugan AG, Barr CH. Measuring factors affecting implementation of health innovations: A systematic review of structural, organizational, provider, patient, and innovation level measures. Implementation Science. 2013;8(22).
64.
Zurück zum Zitat Weiner BJ, Amick H, Lee SD. Conceptualization and measurement of organizational readiness for change: A review of the literature in health services research and other fields. Journal of Medical Care Research and Review. 2008;65(4):379–436.CrossRefPubMed Weiner BJ, Amick H, Lee SD. Conceptualization and measurement of organizational readiness for change: A review of the literature in health services research and other fields. Journal of Medical Care Research and Review. 2008;65(4):379–436.CrossRefPubMed
65.
Zurück zum Zitat Emmons KM, Weiner B, Fernandez Eulalia M, et al. Systems antecedents for dissemination and implementation: A review and analysis of measures. Health Education and Behavior. 2012;39:87–105.CrossRefPubMed Emmons KM, Weiner B, Fernandez Eulalia M, et al. Systems antecedents for dissemination and implementation: A review and analysis of measures. Health Education and Behavior. 2012;39:87–105.CrossRefPubMed
66.
Zurück zum Zitat Lewis CC, Stanick CF, Martinez RG, et al. The society for implementation research collaboration instrument review project: A methodology to promote rigorous evaluation. Implementation Science. 2015;10(2). Lewis CC, Stanick CF, Martinez RG, et al. The society for implementation research collaboration instrument review project: A methodology to promote rigorous evaluation. Implementation Science. 2015;10(2).
67.
Zurück zum Zitat Brehaut JC, Graham ID, Wood TJ, et al. Measuring acceptability of clinical decision rules: validation of the Ottawa acceptability of decision rules instrument (OADRI) in four countries. Medical Decision Making. 2010;30(3):398–408.CrossRefPubMed Brehaut JC, Graham ID, Wood TJ, et al. Measuring acceptability of clinical decision rules: validation of the Ottawa acceptability of decision rules instrument (OADRI) in four countries. Medical Decision Making. 2010;30(3):398–408.CrossRefPubMed
68.
Zurück zum Zitat Bolman C, De Vries H, Mesters I. Factors determining cardiac nurses’ intentions to continue using a smoking cessation protocol. Heart & Lung: The Journal of Acute and Critical Care. 2002;31(1):15–24.CrossRefPubMed Bolman C, De Vries H, Mesters I. Factors determining cardiac nurses’ intentions to continue using a smoking cessation protocol. Heart & Lung: The Journal of Acute and Critical Care. 2002;31(1):15–24.CrossRefPubMed
69.
Zurück zum Zitat Whittingham K, Sofronoff K, Sheffield JK. Stepping Stones Triple P: A pilot study to evaluate acceptability of the program by parents of a child diagnosed with an Autism Spectrum Disorder. Research in Developmental Disabilities. 2006;27:364–380.CrossRefPubMed Whittingham K, Sofronoff K, Sheffield JK. Stepping Stones Triple P: A pilot study to evaluate acceptability of the program by parents of a child diagnosed with an Autism Spectrum Disorder. Research in Developmental Disabilities. 2006;27:364–380.CrossRefPubMed
70.
Zurück zum Zitat Steckler A, Goodman RM, McLeroy KR, et al. Measuring the diffusion of innovative health promotion programs. American Journal of Health Promotion. 1992;6(3):214–224.CrossRefPubMed Steckler A, Goodman RM, McLeroy KR, et al. Measuring the diffusion of innovative health promotion programs. American Journal of Health Promotion. 1992;6(3):214–224.CrossRefPubMed
71.
Zurück zum Zitat Trent LR. Development of a Measure of Disseminability (MOD) [Dissertation]: Psychology, University of Mississippi; 2010. Trent LR. Development of a Measure of Disseminability (MOD) [Dissertation]: Psychology, University of Mississippi; 2010.
73.
Zurück zum Zitat Cohen RJ, Swerdlik M, Sturman E. Psychological Testing and Assessment: An Introduction to Tests and Measurement. 8th ed. Boston, MA: McGraw-Hill Higher Education; 2013. Cohen RJ, Swerdlik M, Sturman E. Psychological Testing and Assessment: An Introduction to Tests and Measurement. 8th ed. Boston, MA: McGraw-Hill Higher Education; 2013.
74.
Zurück zum Zitat Klein KJ, Conn AB, Sorra JS. Implementing computerized technology: An organizational analysis. Journal of Applied Psychology. 2001;86(5):811–824.CrossRefPubMed Klein KJ, Conn AB, Sorra JS. Implementing computerized technology: An organizational analysis. Journal of Applied Psychology. 2001;86(5):811–824.CrossRefPubMed
75.
Zurück zum Zitat Sanders MR. Development, evaluation, and multinational dissemination of the Triple P-Positive Parenting Program. Annual Review of Clinical Psychology. 2012;8:345–379.CrossRefPubMed Sanders MR. Development, evaluation, and multinational dissemination of the Triple P-Positive Parenting Program. Annual Review of Clinical Psychology. 2012;8:345–379.CrossRefPubMed
76.
Zurück zum Zitat Sanders MR, Kirby JN, Tellegen CL, et al. The Triple P-Positive Parenting Program: A systematic review and meta-analysis of a multi-level system of parenting support. Clinical Psychology Review. 2014;34(4):337–357.CrossRefPubMed Sanders MR, Kirby JN, Tellegen CL, et al. The Triple P-Positive Parenting Program: A systematic review and meta-analysis of a multi-level system of parenting support. Clinical Psychology Review. 2014;34(4):337–357.CrossRefPubMed
77.
Zurück zum Zitat Turner KMT, Nicholson JM, Sanders MR. The role of practitioner self-efficacy, training, program and workplace factors on the implementation of an evidence-based parenting intervention in primary care. Journal of Primary Prevention. 2011;32(2):95–112.CrossRefPubMed Turner KMT, Nicholson JM, Sanders MR. The role of practitioner self-efficacy, training, program and workplace factors on the implementation of an evidence-based parenting intervention in primary care. Journal of Primary Prevention. 2011;32(2):95–112.CrossRefPubMed
78.
Zurück zum Zitat Turner KMT, Sanders MR, Hodge L. Issues in professional training to implement evidence-based parenting programs: The preferences of Indigenous practitioners. Australian Psychologist. 2014;49(6):384–394.CrossRef Turner KMT, Sanders MR, Hodge L. Issues in professional training to implement evidence-based parenting programs: The preferences of Indigenous practitioners. Australian Psychologist. 2014;49(6):384–394.CrossRef
79.
Zurück zum Zitat Turner KMT, Markie-Dadds C, Sanders MR. Facilitator’s manual for Group Triple P (3rd ed.). Brisbane, QLD, Australia: Triple P International; 2010. Turner KMT, Markie-Dadds C, Sanders MR. Facilitator’s manual for Group Triple P (3rd ed.). Brisbane, QLD, Australia: Triple P International; 2010.
80.
Zurück zum Zitat Turner KMT, Sanders MR, Markie-Dadds C. Practitioner's manual for Primary Care Triple P (2nd ed.). Brisbane, QLD, Australia: Triple P International; 2010. Turner KMT, Sanders MR, Markie-Dadds C. Practitioner's manual for Primary Care Triple P (2nd ed.). Brisbane, QLD, Australia: Triple P International; 2010.
81.
Zurück zum Zitat Feinberg ME, Chilenski SM, Greenberg MT, et al. Community and team member factors that influence the operations phase of local prevention teams: The PROSPER project. Prevention Science. 2007;8(3):214–226.CrossRefPubMedPubMedCentral Feinberg ME, Chilenski SM, Greenberg MT, et al. Community and team member factors that influence the operations phase of local prevention teams: The PROSPER project. Prevention Science. 2007;8(3):214–226.CrossRefPubMedPubMedCentral
82.
Zurück zum Zitat Shapiro CJ, Prinz RJ, Sanders MR. Facilitators and barriers to implementation of an evidence-based parenting intervention to prevent child maltreatment: The Triple P - Positive Parenting Program. Journal of Child Maltreatment. 2012;17(1):86–95.CrossRefPubMed Shapiro CJ, Prinz RJ, Sanders MR. Facilitators and barriers to implementation of an evidence-based parenting intervention to prevent child maltreatment: The Triple P - Positive Parenting Program. Journal of Child Maltreatment. 2012;17(1):86–95.CrossRefPubMed
83.
Zurück zum Zitat Muthén LK, Muthen BO. Mplus user's guide. 7th ed. Los Angeles, CA: Muthén & Muthén 1998–2012. Muthén LK, Muthen BO. Mplus user's guide. 7th ed. Los Angeles, CA: Muthén & Muthén 1998–2012.
84.
Zurück zum Zitat Schmidt TA. Current Methodological Considerations in Exploratory and Confirmatory Analysis. Journal for Psychoeducational Assessment. 2011;29:304–321.CrossRef Schmidt TA. Current Methodological Considerations in Exploratory and Confirmatory Analysis. Journal for Psychoeducational Assessment. 2011;29:304–321.CrossRef
85.
Zurück zum Zitat Stevens JP. Applied multivariate statistics for the social sciences. 4th ed. New York, NY: Taylor & Francis Group; 2002. Stevens JP. Applied multivariate statistics for the social sciences. 4th ed. New York, NY: Taylor & Francis Group; 2002.
86.
Zurück zum Zitat Satorra A, Bentler PM. Corrections to test statistics and standard errors in covariance structure analysis. In: von Eye A, Clogg CC, (Eds). Latent variables analysis: Applications for Developmental Research. Thousand Oaks, CA: Sage; 1994. Satorra A, Bentler PM. Corrections to test statistics and standard errors in covariance structure analysis. In: von Eye A, Clogg CC, (Eds). Latent variables analysis: Applications for Developmental Research. Thousand Oaks, CA: Sage; 1994.
87.
Zurück zum Zitat Browne MW, Cudeck R. Single sample cross-validation indexes for covariance-structrures. Multivariate Behavioral Research. 1989;24(4):445–455.CrossRefPubMed Browne MW, Cudeck R. Single sample cross-validation indexes for covariance-structrures. Multivariate Behavioral Research. 1989;24(4):445–455.CrossRefPubMed
88.
Zurück zum Zitat Hu LT, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling - A Multidisciplinary Journal. 2009;6(1):1–55.CrossRef Hu LT, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling - A Multidisciplinary Journal. 2009;6(1):1–55.CrossRef
89.
Zurück zum Zitat Churchill, Jr GA. A paradigm for developing better measures of marketing constructs. Journal of Marketing Research. 1979;16(1):64–73.CrossRef Churchill, Jr GA. A paradigm for developing better measures of marketing constructs. Journal of Marketing Research. 1979;16(1):64–73.CrossRef
90.
Zurück zum Zitat Gerbing DW, Anderson JC. An updated paradigm for scale development incorporating unidimensionality and its assessment. Journal of Marketing Research. 1988;25(2):186–192.CrossRef Gerbing DW, Anderson JC. An updated paradigm for scale development incorporating unidimensionality and its assessment. Journal of Marketing Research. 1988;25(2):186–192.CrossRef
91.
Zurück zum Zitat Fornell C, Larcker DF. Evaluating structural equation models with unobservable variables and measurement error. Journal of Marketing Research. 1981;18(1):39–50.CrossRef Fornell C, Larcker DF. Evaluating structural equation models with unobservable variables and measurement error. Journal of Marketing Research. 1981;18(1):39–50.CrossRef
92.
Zurück zum Zitat Bollen KA. Structural Equations with Latent Variables. New York, NY: Wiley; 1989.CrossRef Bollen KA. Structural Equations with Latent Variables. New York, NY: Wiley; 1989.CrossRef
93.
Zurück zum Zitat Afshartous D, Perston RA. Key results of interaction models with centering. Journal of Statistics Education. 2011;19:1–23. Afshartous D, Perston RA. Key results of interaction models with centering. Journal of Statistics Education. 2011;19:1–23.
94.
Zurück zum Zitat De Vaus DA. Analyzing Social Science Data. London, England: SAGE; 2002. De Vaus DA. Analyzing Social Science Data. London, England: SAGE; 2002.
95.
Zurück zum Zitat Bentler PM. EQS 6 Structural Equations Program Manual. Encino, CA: Multivariate Software, Inc.; 2006. Bentler PM. EQS 6 Structural Equations Program Manual. Encino, CA: Multivariate Software, Inc.; 2006.
96.
Zurück zum Zitat Enders CK. Applied Missing Data Analysis: Methodology in Social Sciences. New York, NY: Guilford Press; 2010. Enders CK. Applied Missing Data Analysis: Methodology in Social Sciences. New York, NY: Guilford Press; 2010.
97.
Zurück zum Zitat Van Prooijen J-W, Van der Kloot WA. Confirmatory analysis of exploratively obtained factor structures. Journal of Educational and Psychological Measurement. 2001;61(5):777–792.CrossRef Van Prooijen J-W, Van der Kloot WA. Confirmatory analysis of exploratively obtained factor structures. Journal of Educational and Psychological Measurement. 2001;61(5):777–792.CrossRef
98.
Zurück zum Zitat Child D. The Essentials of Factor Analysis, Second Edition. London: Cassel Educational Limited; 1990. Child D. The Essentials of Factor Analysis, Second Edition. London: Cassel Educational Limited; 1990.
99.
Zurück zum Zitat Jasuja GK, Chou C-P, Bernstein K, et al. Using structural characteristics of community coalitions to predict progress in adopting evidence-based prevention programs. Journal of Evaluation and Program Planning. 2005;28:173–184.CrossRef Jasuja GK, Chou C-P, Bernstein K, et al. Using structural characteristics of community coalitions to predict progress in adopting evidence-based prevention programs. Journal of Evaluation and Program Planning. 2005;28:173–184.CrossRef
100.
Zurück zum Zitat Grol R, Grimshaw J. From best evidence to best practice: Effective implementation of change in patients’ care. Lancet. 2003;362:1225–1230.CrossRefPubMed Grol R, Grimshaw J. From best evidence to best practice: Effective implementation of change in patients’ care. Lancet. 2003;362:1225–1230.CrossRefPubMed
101.
Zurück zum Zitat Pluye P, Potvin L, Denis J, et al. Program sustainability begins with the first events. Evaluation and Program Planning. 2005;28(2):123–137.CrossRef Pluye P, Potvin L, Denis J, et al. Program sustainability begins with the first events. Evaluation and Program Planning. 2005;28(2):123–137.CrossRef
102.
Zurück zum Zitat Langley A, JL. D. Beyond evidence: the micropolitics of improvement. British Medical Journal. 2011;20(Supp 1):i43-i46. Langley A, JL. D. Beyond evidence: the micropolitics of improvement. British Medical Journal. 2011;20(Supp 1):i43-i46.
103.
Zurück zum Zitat Aiken LS, West SG, Reno RR. Multiple regression: Testing and interpreting interactions. Newbury Park, CA: Sage Publications; 1991. Aiken LS, West SG, Reno RR. Multiple regression: Testing and interpreting interactions. Newbury Park, CA: Sage Publications; 1991.
104.
Zurück zum Zitat Rubin DB. Multiple Imputation from Nonresponse Survey. New York, NY: Wiley, 1987.CrossRef Rubin DB. Multiple Imputation from Nonresponse Survey. New York, NY: Wiley, 1987.CrossRef
Metadaten
Titel
Sustained Implementation Support Scale: Validation of a Measure of Program Characteristics and Workplace Functioning for Sustained Program Implementation
verfasst von
Lauren M. Hodge, BSc
Karen M. T. Turner, PhD
Matthew R. Sanders, PhD
Ania Filus, PhD
Publikationsdatum
05.04.2016
Verlag
Springer US
Erschienen in
The Journal of Behavioral Health Services & Research / Ausgabe 3/2017
Print ISSN: 1094-3412
Elektronische ISSN: 2168-6793
DOI
https://doi.org/10.1007/s11414-016-9505-z

Weitere Artikel der Ausgabe 3/2017

The Journal of Behavioral Health Services & Research 3/2017 Zur Ausgabe

Update Psychiatrie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.