Skip to main content
Erschienen in: Prevention Science 5/2014

01.10.2014

A Framework for Testing and Promoting Expanded Dissemination of Promising Preventive Interventions That Are Being Implemented in Community Settings

verfasst von: W. Alex Mason, Charles B. Fleming, Ronald W. Thompson, Kevin P. Haggerty, James J. Snyder

Erschienen in: Prevention Science | Ausgabe 5/2014

Einloggen, um Zugang zu erhalten

Abstract

Many evidence-based preventive interventions have been developed in recent years, but few are widely used. With the current focus on efficacy trials, widespread dissemination and implementation of evidence-based interventions are often afterthoughts. One potential strategy for reversing this trend is to find a promising program with a strong delivery vehicle in place and improve and test the program’s efficacy through rigorous evaluation. If the program is supported by evidence, the dissemination vehicle is already in place and potentially can be expanded. This strategy has been used infrequently and has met with limited success to date, in part, because the field lacks a framework for guiding such research. To address this gap, we outline a framework for moving promising preventive interventions that are currently being implemented in community settings through a process of rigorous testing and, if needed, program modification in order to promote expanded dissemination. The framework is guided by RE-AIM (Reach, Efficacy/Effectiveness, Adoption, Implementation, and Maintenance) (Glasgow et al., Am J Publ Health 89:1322–1327, 1999), which focuses attention on external as well as internal validity in program tests, and is illustrated with examples. Challenges, such as responding to negative and null results, and opportunities inherent in the framework are discussed.
Literatur
Zurück zum Zitat Barth, R. P., Landsverk, J., Chamberlain, P., Reid, J. B., Rolls, J. A., Hurlburt, M. S., et al. (2005). Parent-training programs in child welfare services: Planning for a more evidence-based approach to serving biological parents. Research on Social Work Practice, 15, 353–371. doi:10.1177/1049731505276321.CrossRef Barth, R. P., Landsverk, J., Chamberlain, P., Reid, J. B., Rolls, J. A., Hurlburt, M. S., et al. (2005). Parent-training programs in child welfare services: Planning for a more evidence-based approach to serving biological parents. Research on Social Work Practice, 15, 353–371. doi:10.​1177/​1049731505276321​.CrossRef
Zurück zum Zitat Beauchaine, T. P., Webster-Stratton, C., & Reid, M. J. (2005). Mediators, moderators, and predictors of one-year outcomes among children treated for early-onset conduct problems: A latent growth curve analysis. Journal of Consulting and Clinical Psychology, 73, 371–388. doi:10.1037/0022-006X.73.3.371.CrossRefPubMed Beauchaine, T. P., Webster-Stratton, C., & Reid, M. J. (2005). Mediators, moderators, and predictors of one-year outcomes among children treated for early-onset conduct problems: A latent growth curve analysis. Journal of Consulting and Clinical Psychology, 73, 371–388. doi:10.​1037/​0022-006X.​73.​3.​371.CrossRefPubMed
Zurück zum Zitat Burke, R. V., Herron, R., & Barnes, B. A. (2006). Common sense parenting: Using your head as well as your heart to raise school-aged children (3rd ed.). Boys Town: Father Flanagan’s Boys’ Home. Burke, R. V., Herron, R., & Barnes, B. A. (2006). Common sense parenting: Using your head as well as your heart to raise school-aged children (3rd ed.). Boys Town: Father Flanagan’s Boys’ Home.
Zurück zum Zitat Coie, J. D., Watt, N. F., West, S. G., Hawkins, J. D., Asarnow, J. R., Markman, H. J., et al. (1993). The science of prevention: A conceptual framework and some directions for a national research program. The American Psychologist, 48, 1013–1022. doi:10.1037/0003-066X.48.10.1013.CrossRefPubMed Coie, J. D., Watt, N. F., West, S. G., Hawkins, J. D., Asarnow, J. R., Markman, H. J., et al. (1993). The science of prevention: A conceptual framework and some directions for a national research program. The American Psychologist, 48, 1013–1022. doi:10.​1037/​0003-066X.​48.​10.​1013.CrossRefPubMed
Zurück zum Zitat Cook, T. D., Shadish, W. R., & Wong, V. C. (2008). Three conditions under which experiments and observational studies produce comparable causal estimates: New findings from within-study comparisons. Journal of Policy Analysis and Management, 27, 724–750. doi:10.1002/pam.20375.CrossRef Cook, T. D., Shadish, W. R., & Wong, V. C. (2008). Three conditions under which experiments and observational studies produce comparable causal estimates: New findings from within-study comparisons. Journal of Policy Analysis and Management, 27, 724–750. doi:10.​1002/​pam.​20375.CrossRef
Zurück zum Zitat DeMarsh, J., & Kumpfer, K. L. (1985). Family-oriented interventions for the prevention of chemical dependency in children and adolescents. Journal of Children in a Contemporary Society, 18, 117–151. doi:10.1300/J274v18n01_07.CrossRef DeMarsh, J., & Kumpfer, K. L. (1985). Family-oriented interventions for the prevention of chemical dependency in children and adolescents. Journal of Children in a Contemporary Society, 18, 117–151. doi:10.​1300/​J274v18n01_​07.CrossRef
Zurück zum Zitat Duppong Hurley, K., Trout, A., Griffith, A., Epstein, M., Thompson, R., Mason, W. A., et al. (2010). Creating and sustaining effective partnerships to advance research on youth with serious emotional and behavioral disorders. Journal of Disability Policy Studies, 21, 141–151. doi:10.1177/1044207310376738.CrossRef Duppong Hurley, K., Trout, A., Griffith, A., Epstein, M., Thompson, R., Mason, W. A., et al. (2010). Creating and sustaining effective partnerships to advance research on youth with serious emotional and behavioral disorders. Journal of Disability Policy Studies, 21, 141–151. doi:10.​1177/​1044207310376738​.CrossRef
Zurück zum Zitat Durlak, J. A., & DuPre, E. P. (2008). Implementation matters: A review of research on the influence of implementation on program outcomes and the factors affecting implementation. American Journal of Community Psychology, 41, 327–350. doi:10.1007/s10464-008-9165-0.CrossRefPubMed Durlak, J. A., & DuPre, E. P. (2008). Implementation matters: A review of research on the influence of implementation on program outcomes and the factors affecting implementation. American Journal of Community Psychology, 41, 327–350. doi:10.​1007/​s10464-008-9165-0.CrossRefPubMed
Zurück zum Zitat Durlak, J. A., Weissberg, R. P., Dymnicki, A. B., Taylor, R. D., & Schellinger, K. B. (2011). The impact of enhancing students’ social and emotional learning: A meta-analysis of school-based universal interventions. Child Development, 82, 405–432. doi:10.1111/j.1467-8624.2010.01564.x.CrossRefPubMed Durlak, J. A., Weissberg, R. P., Dymnicki, A. B., Taylor, R. D., & Schellinger, K. B. (2011). The impact of enhancing students’ social and emotional learning: A meta-analysis of school-based universal interventions. Child Development, 82, 405–432. doi:10.​1111/​j.​1467-8624.​2010.​01564.​x.CrossRefPubMed
Zurück zum Zitat Eischens, A., Komro, K. A., Perry, C. L., & Bosma, L. M. (2004). The association of extracurricular activity participation with substance use among youth in the D.A.R.E. Plus project. American Journal of Public Health Education, 35, 68–75.CrossRef Eischens, A., Komro, K. A., Perry, C. L., & Bosma, L. M. (2004). The association of extracurricular activity participation with substance use among youth in the D.A.R.E. Plus project. American Journal of Public Health Education, 35, 68–75.CrossRef
Zurück zum Zitat Ennett, S. T., Tobler, N. S., Ringwalt, C. L., & Flewelling, R. L. (1994). How effective is drug abuse resistance education? A meta-analysis of Project D.A.R.E. outcome evaluations. American Journal of Public Health, 85, 1394–1401. doi:10.2105/AJPH.84.9.1394.CrossRef Ennett, S. T., Tobler, N. S., Ringwalt, C. L., & Flewelling, R. L. (1994). How effective is drug abuse resistance education? A meta-analysis of Project D.A.R.E. outcome evaluations. American Journal of Public Health, 85, 1394–1401. doi:10.​2105/​AJPH.​84.​9.​1394.CrossRef
Zurück zum Zitat Fixsen, D. L., Naoom, S. F., Blase, K. A., Friedman, R. M., & Wallace, F. (2005). Implementation research: A synthesis of the literature (FMHI #231) University of South Florida, Louis de la Parte Florida Mental Health Institute. Tampa: The National Implementation Research Network. Fixsen, D. L., Naoom, S. F., Blase, K. A., Friedman, R. M., & Wallace, F. (2005). Implementation research: A synthesis of the literature (FMHI #231) University of South Florida, Louis de la Parte Florida Mental Health Institute. Tampa: The National Implementation Research Network.
Zurück zum Zitat Flay, B. R., Biglan, A., Boruch, R. F., Castro, F. G., Gottfredson, D., Kellam, S., et al. (2005). Standards of evidence: Criteria for efficacy, effectiveness and dissemination. Prevention Science, 6, 151–175. doi:10.1007/s11121-005-55543-y.CrossRefPubMed Flay, B. R., Biglan, A., Boruch, R. F., Castro, F. G., Gottfredson, D., Kellam, S., et al. (2005). Standards of evidence: Criteria for efficacy, effectiveness and dissemination. Prevention Science, 6, 151–175. doi:10.​1007/​s11121-005-55543-y.CrossRefPubMed
Zurück zum Zitat Glasgow, R. E., Klesges, L. M., Dzewaltowski, D. A., Bull, S. S., & Estabrooks, P. (2004). The future of health behavior change research: What is needed to improve translation of research into health promotion practice? Annals of Behavioral Medicine, 27, 3–12. doi:10.1207/s15324796abm2701_2.CrossRefPubMed Glasgow, R. E., Klesges, L. M., Dzewaltowski, D. A., Bull, S. S., & Estabrooks, P. (2004). The future of health behavior change research: What is needed to improve translation of research into health promotion practice? Annals of Behavioral Medicine, 27, 3–12. doi:10.​1207/​s15324796abm2701​_​2.CrossRefPubMed
Zurück zum Zitat Gregory, H., Jr., Van Orden, O., Jordan, L., Portnoy, G. A., Welsh, E., Betkowski, J., et al. (2012). New directions in capacity building: Incorporating cultural competence into the Interactive Systems Framework. American Journal of Community Psychology, 50, 321–333. doi:10.1007/s10464-012-9508-8.CrossRefPubMed Gregory, H., Jr., Van Orden, O., Jordan, L., Portnoy, G. A., Welsh, E., Betkowski, J., et al. (2012). New directions in capacity building: Incorporating cultural competence into the Interactive Systems Framework. American Journal of Community Psychology, 50, 321–333. doi:10.​1007/​s10464-012-9508-8.CrossRefPubMed
Zurück zum Zitat Hansen, K., Romens, K., & LaFleur, S. (2011). Final report on the enhanced school-based mentoring pilot: Developing and substantiating an evidence-based model. Big Brothers Big Sisters of America. Hansen, K., Romens, K., & LaFleur, S. (2011). Final report on the enhanced school-based mentoring pilot: Developing and substantiating an evidence-based model. Big Brothers Big Sisters of America.
Zurück zum Zitat Hawkins, J. D., Oesterle, S., Brown, E. C., Arthur, M. W., Abbott, R. D., Fagan, A. A., et al. (2009). Results of a type 2 translational research trial to prevent adolescent drug use and delinquency: A test of Communities That Care. Archives of Pediatrics & Adolescent Medicine, 163, 789–798. doi:10.1001/archpediatrics.2009.141.CrossRef Hawkins, J. D., Oesterle, S., Brown, E. C., Arthur, M. W., Abbott, R. D., Fagan, A. A., et al. (2009). Results of a type 2 translational research trial to prevent adolescent drug use and delinquency: A test of Communities That Care. Archives of Pediatrics & Adolescent Medicine, 163, 789–798. doi:10.​1001/​archpediatrics.​2009.​141.CrossRef
Zurück zum Zitat Hirschi, T. (1969). Causes of delinquency. Berkeley, CA: University of California Press. Hirschi, T. (1969). Causes of delinquency. Berkeley, CA: University of California Press.
Zurück zum Zitat Kalton, G. (1983). Introduction to survey sampling. Beverly Hills: Sage Publications, Inc. Kalton, G. (1983). Introduction to survey sampling. Beverly Hills: Sage Publications, Inc.
Zurück zum Zitat Kaminski, J. W., Valle, L. A., Filene, J. H., & Boyle, C. L. (2008). A meta-analytic review of components associated with parent training program effectiveness. Journal of Abnormal Child Psychology, 36, 567–589. doi:10.1007/s10802-007-9201-9.CrossRefPubMed Kaminski, J. W., Valle, L. A., Filene, J. H., & Boyle, C. L. (2008). A meta-analytic review of components associated with parent training program effectiveness. Journal of Abnormal Child Psychology, 36, 567–589. doi:10.​1007/​s10802-007-9201-9.CrossRefPubMed
Zurück zum Zitat Kazdin, A. E., Siegel, T. C., & Bass, D. (1992). Cognitive problem-solving skills training and parent management training in the treatment of antisocial behavior in children. Journal of Consulting and Clinical Psychology, 60, 733–747. doi:10.1037/0022-006X.60.5.733.CrossRefPubMed Kazdin, A. E., Siegel, T. C., & Bass, D. (1992). Cognitive problem-solving skills training and parent management training in the treatment of antisocial behavior in children. Journal of Consulting and Clinical Psychology, 60, 733–747. doi:10.​1037/​0022-006X.​60.​5.​733.CrossRefPubMed
Zurück zum Zitat Kish, L. (1965). Survey sampling. New York: Wiley. Kish, L. (1965). Survey sampling. New York: Wiley.
Zurück zum Zitat Klesges, L. M., Estabrooks, P. A., Dzewaltowski, D. A., Bull, S. S., & Glasgow, R. E. (2005). Beginning with the application in mind: Designing and planning health behavior change interventions to enhance dissemination. Annals of Behavioral Medicine, 29, 66–75. doi:10.1207/s15324796abm2902s_10.CrossRefPubMed Klesges, L. M., Estabrooks, P. A., Dzewaltowski, D. A., Bull, S. S., & Glasgow, R. E. (2005). Beginning with the application in mind: Designing and planning health behavior change interventions to enhance dissemination. Annals of Behavioral Medicine, 29, 66–75. doi:10.​1207/​s15324796abm2902​s_​10.CrossRefPubMed
Zurück zum Zitat McGill, D. E., Mihalic, S. F., & Grotpeter, J. K. (1998). Big Brothers Big Sisters of America: Blueprints for Violence Prevention, Book Two. Boulder, CO: Center for the Study and Prevention of Violence, Institute of Behavioral Science, University of Colorado. McGill, D. E., Mihalic, S. F., & Grotpeter, J. K. (1998). Big Brothers Big Sisters of America: Blueprints for Violence Prevention, Book Two. Boulder, CO: Center for the Study and Prevention of Violence, Institute of Behavioral Science, University of Colorado.
Zurück zum Zitat Patterson, G. R., Reid, J. B., & Dishion, T. J. (1992). A social interactional approach. Antisocial boys (Vol. 4). Eugene: Castalia. Patterson, G. R., Reid, J. B., & Dishion, T. J. (1992). A social interactional approach. Antisocial boys (Vol. 4). Eugene: Castalia.
Zurück zum Zitat Perry, C. L., Komro, K. A., Veblen-Mortenson, S., Bosma, L. M., Farbakhsh, K., Munson, K. A., et al. (2003). A randomized controlled trial of the middle and junior high school D.A.R.E. and D.A.R.E. Plus programs. Archives of Pediatrics & Adolescent Medicine, 157, 178–184. doi:10.1001/archpedi.157.2.178.CrossRef Perry, C. L., Komro, K. A., Veblen-Mortenson, S., Bosma, L. M., Farbakhsh, K., Munson, K. A., et al. (2003). A randomized controlled trial of the middle and junior high school D.A.R.E. and D.A.R.E. Plus programs. Archives of Pediatrics & Adolescent Medicine, 157, 178–184. doi:10.​1001/​archpedi.​157.​2.​178.CrossRef
Zurück zum Zitat Ringwalt, C. L., Ennett, S., Vincus, A., Thorne, J., Rohrbach, L. A., & Simons-Rudolph, A. (2002). The prevalence of effective substance use prevention curricula in U.S. middle schools. Prevention Science, 3, 257–265. doi:10.1023/A:1020872424136.CrossRefPubMed Ringwalt, C. L., Ennett, S., Vincus, A., Thorne, J., Rohrbach, L. A., & Simons-Rudolph, A. (2002). The prevalence of effective substance use prevention curricula in U.S. middle schools. Prevention Science, 3, 257–265. doi:10.​1023/​A:​1020872424136.CrossRefPubMed
Zurück zum Zitat Small, S. A., Cooney, S. M., & O’Connor, C. (2009). Evidence-informed program improvement: Using principles of effectiveness to enhance the quality and impact of family-based prevention programs. Family Relations, 58, 1–13. doi:10.1111/j.1741-3729.2008.00530.x.CrossRef Small, S. A., Cooney, S. M., & O’Connor, C. (2009). Evidence-informed program improvement: Using principles of effectiveness to enhance the quality and impact of family-based prevention programs. Family Relations, 58, 1–13. doi:10.​1111/​j.​1741-3729.​2008.​00530.​x.CrossRef
Zurück zum Zitat Smith, M. F. (1989). Evaluability assessment: A practical approach. Boston: Kluwer Academic Publishers.CrossRef Smith, M. F. (1989). Evaluability assessment: A practical approach. Boston: Kluwer Academic Publishers.CrossRef
Zurück zum Zitat Steiner, P. M., Cook, T. D., Shadish, W. R., & Clark, M. H. (2010). The importance of covariate selection in controlling for selection bias in observational studies. Psychological Methods, 15, 250–267. doi:10.1037/a0018719.CrossRefPubMed Steiner, P. M., Cook, T. D., Shadish, W. R., & Clark, M. H. (2010). The importance of covariate selection in controlling for selection bias in observational studies. Psychological Methods, 15, 250–267. doi:10.​1037/​a0018719.CrossRefPubMed
Zurück zum Zitat Thompson, R., Ruma, P. R., Schuchmann, L. F., & Burke, R. V. (1996). A cost-effectiveness evaluation of parent training. Journal of Child and Family Studies, 5, 415–429. doi:10.1007/BF02233863.CrossRef Thompson, R., Ruma, P. R., Schuchmann, L. F., & Burke, R. V. (1996). A cost-effectiveness evaluation of parent training. Journal of Child and Family Studies, 5, 415–429. doi:10.​1007/​BF02233863.CrossRef
Zurück zum Zitat Thompson, R. W., Ruma, P. R., Brewster, A. L., Besetsney, L. K., & Burke, R. V. (1997). Evaluation of an Air Force child physical abuse prevention project using the reliable change index. Journal of Child and Family Studies, 6, 421–434. doi:10.1023/A:1025093328618.CrossRef Thompson, R. W., Ruma, P. R., Brewster, A. L., Besetsney, L. K., & Burke, R. V. (1997). Evaluation of an Air Force child physical abuse prevention project using the reliable change index. Journal of Child and Family Studies, 6, 421–434. doi:10.​1023/​A:​1025093328618.CrossRef
Zurück zum Zitat Tierney, J. P., Grossman, J. B., & Resch, N. L. (1995). Making a difference: An impact study of Big Brothers Big Sisters. Philadelphia: Public/Private Ventures. Tierney, J. P., Grossman, J. B., & Resch, N. L. (1995). Making a difference: An impact study of Big Brothers Big Sisters. Philadelphia: Public/Private Ventures.
Zurück zum Zitat Wandersman, A., Duffy, J., Flaspohler, P., Noonan, R., Lubell, K., Stillman, L., et al. (2008). Bridging the gap between prevention research and practice: The interactive systems framework for dissemination and implementation. American Journal of Community Psychology, 41, 171–181. doi:10.1007/s10464-008-9174-2.CrossRefPubMed Wandersman, A., Duffy, J., Flaspohler, P., Noonan, R., Lubell, K., Stillman, L., et al. (2008). Bridging the gap between prevention research and practice: The interactive systems framework for dissemination and implementation. American Journal of Community Psychology, 41, 171–181. doi:10.​1007/​s10464-008-9174-2.CrossRefPubMed
Zurück zum Zitat Werner, E. E., & Smith, R. S. (1992). Overcoming the odds: High risk children from birth to adulthood. Ithaca: Cornell University Press. Werner, E. E., & Smith, R. S. (1992). Overcoming the odds: High risk children from birth to adulthood. Ithaca: Cornell University Press.
Zurück zum Zitat Wolf, M. M., Phillips, E. F., Fixsen, D. L., Braukman, C. J., Kirigin, K. A., Willner, A. G., et al. (1976). Achievement place: The teaching-family model. Child Care Quarterly, 5, 92–103. doi:10.1007/BF01555232.CrossRef Wolf, M. M., Phillips, E. F., Fixsen, D. L., Braukman, C. J., Kirigin, K. A., Willner, A. G., et al. (1976). Achievement place: The teaching-family model. Child Care Quarterly, 5, 92–103. doi:10.​1007/​BF01555232.CrossRef
Metadaten
Titel
A Framework for Testing and Promoting Expanded Dissemination of Promising Preventive Interventions That Are Being Implemented in Community Settings
verfasst von
W. Alex Mason
Charles B. Fleming
Ronald W. Thompson
Kevin P. Haggerty
James J. Snyder
Publikationsdatum
01.10.2014
Verlag
Springer US
Erschienen in
Prevention Science / Ausgabe 5/2014
Print ISSN: 1389-4986
Elektronische ISSN: 1573-6695
DOI
https://doi.org/10.1007/s11121-013-0409-3

Weitere Artikel der Ausgabe 5/2014

Prevention Science 5/2014 Zur Ausgabe