Skip to main content
Erschienen in: Prevention Science 6/2020

20.04.2020

The User-Program Interaction: How Teacher Experience Shapes the Relationship Between Intervention Packaging and Fidelity to a State-Adopted Health Curriculum

verfasst von: Andria B. Eisman, Amy M. Kilbourne, Dana Greene Jr, Maureen Walton, Rebecca Cunningham

Erschienen in: Prevention Science | Ausgabe 6/2020

Einloggen, um Zugang zu erhalten

Abstract

Intervention effects observed in efficacy trials are rarely seen when programs are broadly disseminated, underscoring the need to better understand factors influencing fidelity. The Michigan Model for Health™ (MMH) is an evidence-based health curriculum disseminated in schools throughout Michigan that is widely adopted but delivered with limited fidelity. Understanding implementation determinants and how they influence fidelity is essential to achieving desired implementation and behavioral outcomes. The study surveyed health teachers throughout Michigan (n = 171) on MMH implementation, guided by the Consolidated Framework for Implementation Research. We investigated relationships between context, intervention and provider factors and dose delivered (i.e., the proportion of curriculum delivered by teachers), a fidelity dimension. We also examined whether intervention factors were moderated by provider factors to influence fidelity. Our results indicated that program packaging ratings were associated with dose delivered (fidelity). We also found that this relationship was moderated by teacher experience. The strength of this relationship diminished with increasing levels of experience, with no relationship among the most experienced teachers. Intervention adaptability was also associated with dose delivered. We found no association between health education policies (context), provider beliefs, and dose delivered. Intervention factors are important determinants of fidelity. Our results suggest that providers with more experience may need materials tailored to their knowledge and skill level to support materials’ continued usefulness and fidelity long-term. Our results also suggest that promoting adaptability may help enhance fidelity. Implementation strategies that focus on systematically adapting evidence-based health programs may be well suited to enhancing the fidelity of the MMH curriculum across levels of teacher experience.
Literatur
Zurück zum Zitat Allen, J., Linnan, L., & Emmons, K. (2018). Fidelity and its relationship to implementation effectiveness, adaptation, and dissemination. In R. Brownson, G. Colditz, & E. Proctor (Eds.), Dissemination and implementation research in health: Translating science to practice (2nd ed., pp. 281–304). Oxford University Press. Allen, J., Linnan, L., & Emmons, K. (2018). Fidelity and its relationship to implementation effectiveness, adaptation, and dissemination. In R. Brownson, G. Colditz, & E. Proctor (Eds.), Dissemination and implementation research in health: Translating science to practice (2nd ed., pp. 281–304). Oxford University Press.
Zurück zum Zitat Bandura, A. (1977). Social learning theory. Prentice Hall. Bandura, A. (1977). Social learning theory. Prentice Hall.
Zurück zum Zitat Barrera, M., Berkel, C., & Castro, F. (2017). Directions for the advancement of culturally adapted preventive interventions: Local adaptations, engagement, and sustainability. Prevention Science, 18, 640–648.CrossRef Barrera, M., Berkel, C., & Castro, F. (2017). Directions for the advancement of culturally adapted preventive interventions: Local adaptations, engagement, and sustainability. Prevention Science, 18, 640–648.CrossRef
Zurück zum Zitat Bennett, D. (2001). How can I deal with missing data in my study? Australian and New Zealand Journal of Public Health, 25, 464–469.CrossRef Bennett, D. (2001). How can I deal with missing data in my study? Australian and New Zealand Journal of Public Health, 25, 464–469.CrossRef
Zurück zum Zitat Castro, F., & Yasui, M. (2017). Advances in EBI development for diverse populations: Towards a science of intervention adaptation. Prevention Science, 18, 623–629.CrossRef Castro, F., & Yasui, M. (2017). Advances in EBI development for diverse populations: Towards a science of intervention adaptation. Prevention Science, 18, 623–629.CrossRef
Zurück zum Zitat Chafouleas, S., Koriakin, T., Roundfield, K., & Overstreet, S. (2019). Addressing childhood trauma in school settings: A framework for evidence-based practice. School Mental Health, 11, 40–53.CrossRef Chafouleas, S., Koriakin, T., Roundfield, K., & Overstreet, S. (2019). Addressing childhood trauma in school settings: A framework for evidence-based practice. School Mental Health, 11, 40–53.CrossRef
Zurück zum Zitat Chambers, D., & Azrin, S. (2013). Research and services partnerships: Partnership: A fundamental component of dissemination and implementation research. Psychiatric Services, 64, 509–511.CrossRef Chambers, D., & Azrin, S. (2013). Research and services partnerships: Partnership: A fundamental component of dissemination and implementation research. Psychiatric Services, 64, 509–511.CrossRef
Zurück zum Zitat Chambers, D., Glasgow, R., & Stange, K. C. (2013). The dynamic sustainability framework: Addressing the paradox of sustainment amid ongoing change. Implementation Science, 8, 117.CrossRef Chambers, D., Glasgow, R., & Stange, K. C. (2013). The dynamic sustainability framework: Addressing the paradox of sustainment amid ongoing change. Implementation Science, 8, 117.CrossRef
Zurück zum Zitat Damschroder, L., Aron, D., Keith, R., Kirsh, S., Alexander, J., & Lowery, J. (2009). Fostering implementation of health services research findings into practice: A consolidated framework for advancing implementation science. Implementation Science, 4, 1–15.CrossRef Damschroder, L., Aron, D., Keith, R., Kirsh, S., Alexander, J., & Lowery, J. (2009). Fostering implementation of health services research findings into practice: A consolidated framework for advancing implementation science. Implementation Science, 4, 1–15.CrossRef
Zurück zum Zitat Dee, T. (2006). Teachers and the gender gaps in student achievement. Journal of Human Resources, 42, 27. Dee, T. (2006). Teachers and the gender gaps in student achievement. Journal of Human Resources, 42, 27.
Zurück zum Zitat Dusenbury, L., Brannigan, R., Falco, M., & Hansen, W. (2003). A review of research on fidelity of implementation: Implications for drug abuse prevention in school settings. Health Education Research, 18, 237–256.CrossRef Dusenbury, L., Brannigan, R., Falco, M., & Hansen, W. (2003). A review of research on fidelity of implementation: Implications for drug abuse prevention in school settings. Health Education Research, 18, 237–256.CrossRef
Zurück zum Zitat Eccles, M., & Mittman, B. (2006). Welcome to Implementation Science. Implementation Science, 1, 1.CrossRef Eccles, M., & Mittman, B. (2006). Welcome to Implementation Science. Implementation Science, 1, 1.CrossRef
Zurück zum Zitat Enders, C. (2010). Applied missing data analysis. Guilford Press. Enders, C. (2010). Applied missing data analysis. Guilford Press.
Zurück zum Zitat Garland, A. F., Accurso, E. C., Haine-Schlagel, R., Brookman-Frazee, L., Roesch, S., & Zhang, J. J. (2014). Searching for elements of evidence-based practices in children’s usual care and examining their impact. Journal of Clinical Child and Adolescent Psychology, 43, 201–215.CrossRef Garland, A. F., Accurso, E. C., Haine-Schlagel, R., Brookman-Frazee, L., Roesch, S., & Zhang, J. J. (2014). Searching for elements of evidence-based practices in children’s usual care and examining their impact. Journal of Clinical Child and Adolescent Psychology, 43, 201–215.CrossRef
Zurück zum Zitat Gusky, T. (1986). Staff development and the process of teacher change. Educational Researcher, 15, 5–12.CrossRef Gusky, T. (1986). Staff development and the process of teacher change. Educational Researcher, 15, 5–12.CrossRef
Zurück zum Zitat Hall, G. E., & Hord, S. M. (1987). Change in schools: Facilitating the process (Vol. 1–viii, 393 p). State University of New York Press. Hall, G. E., & Hord, S. M. (1987). Change in schools: Facilitating the process (Vol. 1–viii, 393 p). State University of New York Press.
Zurück zum Zitat Harrell, Jr., FE. (2015). Regression modeling strategies with applications to linear models, logistic and ordinal regression, and survival analysis (2nd ed. 2015). Springer International Publishing. Harrell, Jr., FE. (2015). Regression modeling strategies with applications to linear models, logistic and ordinal regression, and survival analysis (2nd ed. 2015). Springer International Publishing.
Zurück zum Zitat Jose, P. (2013). Doing statistical mediation and moderation. The Guilford Press. Jose, P. (2013). Doing statistical mediation and moderation. The Guilford Press.
Zurück zum Zitat Laxer, R., Dubin, J., Brownson, R., Cooke, M., Chaurasia, A., & Leatherdale, S. (2019). Noncomprehensive and intermittent obesity-related school programs and policies may not work: Evidence from the COMPASS study. Journal of School Health, 89, 818–828.CrossRef Laxer, R., Dubin, J., Brownson, R., Cooke, M., Chaurasia, A., & Leatherdale, S. (2019). Noncomprehensive and intermittent obesity-related school programs and policies may not work: Evidence from the COMPASS study. Journal of School Health, 89, 818–828.CrossRef
Zurück zum Zitat Lee, R., & Gortmaker, S. (2018). Health dissemination and implementation within schools. In R. Brownson, G. Colditz, & E. Proctor (Eds.), Dissemination and implementation research in health: Translating science to practice (2nd ed., pp. 401–416). Oxford University Press. Lee, R., & Gortmaker, S. (2018). Health dissemination and implementation within schools. In R. Brownson, G. Colditz, & E. Proctor (Eds.), Dissemination and implementation research in health: Translating science to practice (2nd ed., pp. 401–416). Oxford University Press.
Zurück zum Zitat Lewallen, T., Hunt, H., Potts-Datema, W., Zaza, S., & Giles, W. (2015). The whole school, whole community, whole child model: A new approach for improving educational attainment and healthy development for students. The Journal of School Health, 85, 729–739.CrossRef Lewallen, T., Hunt, H., Potts-Datema, W., Zaza, S., & Giles, W. (2015). The whole school, whole community, whole child model: A new approach for improving educational attainment and healthy development for students. The Journal of School Health, 85, 729–739.CrossRef
Zurück zum Zitat Lyon, A., & Bruns, E. (2019a). User-centered redesign of evidence-based psychosocial interventions to enhance implementation—hospitable soil or better seeds? JAMA Psychiatry, 76, 3.CrossRef Lyon, A., & Bruns, E. (2019a). User-centered redesign of evidence-based psychosocial interventions to enhance implementation—hospitable soil or better seeds? JAMA Psychiatry, 76, 3.CrossRef
Zurück zum Zitat Lyon, A., & Bruns, E. (2019b). From evidence to impact: Joining our best school mental health practices with our best implementation strategies. School Mental Health, 11, 106–114.CrossRef Lyon, A., & Bruns, E. (2019b). From evidence to impact: Joining our best school mental health practices with our best implementation strategies. School Mental Health, 11, 106–114.CrossRef
Zurück zum Zitat Lyon, A., Cook, C., Brown, E., Locke, J., Davis, C., Ehrhart, M., & Aarons, G. (2018). Assessing organizational implementation context in the education sector: Confirmatory factor analysis of measures of implementation leadership, climate, and citizenship. Implementation Science, 13, 5.CrossRef Lyon, A., Cook, C., Brown, E., Locke, J., Davis, C., Ehrhart, M., & Aarons, G. (2018). Assessing organizational implementation context in the education sector: Confirmatory factor analysis of measures of implementation leadership, climate, and citizenship. Implementation Science, 13, 5.CrossRef
Zurück zum Zitat Mihalic, S., Fagan, A., & Argamaso, S. (2008). Implementing the life skills training drug prevention program: Factors related to implementation fidelity. Implementation Science, 3. Mihalic, S., Fagan, A., & Argamaso, S. (2008). Implementing the life skills training drug prevention program: Factors related to implementation fidelity. Implementation Science, 3.
Zurück zum Zitat O’neill, J., Clark, J., & Jones, J. (2011). Promoting mental health and preventing substance abuse and violence in elementary students: A randomized control study of the Michigan Model for Health. Journal of School Health, 81, 320–330.CrossRef O’neill, J., Clark, J., & Jones, J. (2011). Promoting mental health and preventing substance abuse and violence in elementary students: A randomized control study of the Michigan Model for Health. Journal of School Health, 81, 320–330.CrossRef
Zurück zum Zitat Proctor, E., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G., Bunger, A., Griffey, R., & Hensley, M. (2011). Outcomes for implementation research: Conceptual distinctions, measurement challenges, and research agenda. Administration and Policy in Mental Health and Mental Health Services Research, 38, 65–76.CrossRef Proctor, E., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G., Bunger, A., Griffey, R., & Hensley, M. (2011). Outcomes for implementation research: Conceptual distinctions, measurement challenges, and research agenda. Administration and Policy in Mental Health and Mental Health Services Research, 38, 65–76.CrossRef
Zurück zum Zitat Quinn, D., & Kim, J. (2017). Scaffolding fidelity and adaptation in educational program implementation: Experimental evidence from a literacy intervention. American Educational Research Journal, 54, 1187–1220.CrossRef Quinn, D., & Kim, J. (2017). Scaffolding fidelity and adaptation in educational program implementation: Experimental evidence from a literacy intervention. American Educational Research Journal, 54, 1187–1220.CrossRef
Zurück zum Zitat Rasberry, C. N., Slade, S., Lohrmann, D. K., & Valois, R. F. (2015). Lessons learned from the whole child and coordinated school health approaches. Journal of School Health, 85, 759–765.CrossRef Rasberry, C. N., Slade, S., Lohrmann, D. K., & Valois, R. F. (2015). Lessons learned from the whole child and coordinated school health approaches. Journal of School Health, 85, 759–765.CrossRef
Zurück zum Zitat Ringwalt, C. L., Pankratz, M. M., Jackson-Newsom, J., Gottfredson, N. C., Hansen, W. B., Giles, S. M., & Dusenbury, L. (2010). Three-year trajectory of teachers’ fidelity to a drug prevention curriculum. Prevention Science, 11, 67–76.CrossRef Ringwalt, C. L., Pankratz, M. M., Jackson-Newsom, J., Gottfredson, N. C., Hansen, W. B., Giles, S. M., & Dusenbury, L. (2010). Three-year trajectory of teachers’ fidelity to a drug prevention curriculum. Prevention Science, 11, 67–76.CrossRef
Zurück zum Zitat Rockhill, S. (2017). Use of the Michigan Model for Health curriculum among Michigan public schools: 2017. Michigan Department of Health and Human Services, Lifecourse Epidemiology and Genomics Division, Child Health Epidemiology Section. Rockhill, S. (2017). Use of the Michigan Model for Health curriculum among Michigan public schools: 2017. Michigan Department of Health and Human Services, Lifecourse Epidemiology and Genomics Division, Child Health Epidemiology Section.
Zurück zum Zitat Rohrbach, L., Sun, P., & Sussman, S. (2010). One-year follow-up evaluation of the Project Towards No Drug Abuse (TND) dissemination trial. Preventive Medicine, 51, 313–319.CrossRef Rohrbach, L., Sun, P., & Sussman, S. (2010). One-year follow-up evaluation of the Project Towards No Drug Abuse (TND) dissemination trial. Preventive Medicine, 51, 313–319.CrossRef
Zurück zum Zitat Rosenstock, I. M. (1974). Historical origins of the health belief model. Health Education Monographs, 2, 328–335.CrossRef Rosenstock, I. M. (1974). Historical origins of the health belief model. Health Education Monographs, 2, 328–335.CrossRef
Zurück zum Zitat SAMHSA (2018). National Registry of Evidence-Based Programs and Practices (NREPP). Substance Abuse and Mental Health Services Administration (SAMHSA). www.nrepp.samhsa.gov SAMHSA (2018). National Registry of Evidence-Based Programs and Practices (NREPP). Substance Abuse and Mental Health Services Administration (SAMHSA). www.​nrepp.​samhsa.​gov
Zurück zum Zitat Stirman, S. W., Miller, C. J., Toder, K., & Calloway, A. (2013). Development of a framework and coding system for modifications and adaptations of evidence-based interventions. Implementation Science, 8. Stirman, S. W., Miller, C. J., Toder, K., & Calloway, A. (2013). Development of a framework and coding system for modifications and adaptations of evidence-based interventions. Implementation Science, 8.
Zurück zum Zitat Weisz, J., Kuppens, S., Eckshtain, D., Ugueto, A., Hawley, K., & Jensen-Doss, A. (2013). Performance of evidence-based youth psychotherapies compared with usual clinical care: A multilevel meta-analysis. JAMA Psychiatry, 70, 750–761.CrossRef Weisz, J., Kuppens, S., Eckshtain, D., Ugueto, A., Hawley, K., & Jensen-Doss, A. (2013). Performance of evidence-based youth psychotherapies compared with usual clinical care: A multilevel meta-analysis. JAMA Psychiatry, 70, 750–761.CrossRef
Metadaten
Titel
The User-Program Interaction: How Teacher Experience Shapes the Relationship Between Intervention Packaging and Fidelity to a State-Adopted Health Curriculum
verfasst von
Andria B. Eisman
Amy M. Kilbourne
Dana Greene Jr
Maureen Walton
Rebecca Cunningham
Publikationsdatum
20.04.2020
Verlag
Springer US
Erschienen in
Prevention Science / Ausgabe 6/2020
Print ISSN: 1389-4986
Elektronische ISSN: 1573-6695
DOI
https://doi.org/10.1007/s11121-020-01120-8

Weitere Artikel der Ausgabe 6/2020

Prevention Science 6/2020 Zur Ausgabe