Skip to main content
Erschienen in: Prevention Science 7/2021

08.06.2021

Can Policy Promote Adoption or Outcomes of Evidence-based Prevention Programming?: a Case Illustration of Positive Behavioral Interventions and Supports

verfasst von: Catherine P. Bradshaw, Elise T. Pas, Rashelle J. Musci, Joseph M. Kush, Ji Hoon Ryoo

Erschienen in: Prevention Science | Ausgabe 7/2021

Einloggen, um Zugang zu erhalten

Abstract

This study examined the impact of a state policy requiring that any school with a habitual truancy rate of 8% or higher to be trained in Tier 1 school-wide Positive Behavioral Interventions and Supports (SW-PBIS). A regression discontinuity (RD) design was used to examine how the schools’ mandate status related to SW-PBIS training as well as student suspensions, truancy, and achievement in 410 public middle and high schools, of which 261 were affected by the mandate. We further examined the growth trajectories (i.e., improvement) of implementation fidelity over time using growth mixture modeling (GMM). Contrary to the intent of the policy to improve student outcomes, the RD results suggested that the mandate did not significantly impact reading and math achievement, truancy rates, or SW-PBIS training in 2010–2011 through 2013–2014. Mandated schools had higher suspension rates in 2010–2011 through 2013–2014 than the non-mandated schools; however, these differences in the suspension rates appear to have persisted from years prior to the mandate. Descriptive analyses suggested that mandated schools had statistically significantly higher rates of training, and the GMM analyses on the fidelity data indicated that mandated schools were significantly more likely to be in an improving implementation growth trajectory over time. Taken together, results suggested that the policy showed some promise for improving SW-PBIS training and fidelity over time, but it had little to no impact on student outcomes.
Anhänge
Nur mit Berechtigung zugänglich
Literatur
Zurück zum Zitat Barrett, S. B., Bradshaw, C. P., & Lewis-Palmer, T. (2008). Maryland statewide PBIS initiative: Systems, evaluation, and next steps. Journal of Positive Behavior Interventions, 10, 105–114.CrossRef Barrett, S. B., Bradshaw, C. P., & Lewis-Palmer, T. (2008). Maryland statewide PBIS initiative: Systems, evaluation, and next steps. Journal of Positive Behavior Interventions, 10, 105–114.CrossRef
Zurück zum Zitat Bradshaw, C. P., Debnam, K. J., Koth, C. W., & Leaf, P. J. (2009). Preliminary validation of the Implementation Phases Inventory for assessing fidelity of schoolwide positive behavior supports. Journal of Positive Behavior Interventions, 11, 145–160. https://doi.org/10.1177/1098300708319126 Bradshaw, C. P., Debnam, K. J., Koth, C. W., & Leaf, P. J. (2009). Preliminary validation of the Implementation Phases Inventory for assessing fidelity of schoolwide positive behavior supports. Journal of Positive Behavior Interventions, 11, 145–160. https://​doi.​org/​10.​1177/​1098300708319126​
Zurück zum Zitat Bradshaw, C. P., Debnam, K. J., Lindstrom Johnson, S., Pas, E. T., Hershfeldt, P., Alexander, A., et al. (2014). Maryland’s evolving system of social, emotional, and behavioral interventions in the public schools: The Maryland Safe and Supportive Schools Project. Adolescent Psychiatry, 4, 194–206. https://doi.org/10.2174/221067660403140912163120CrossRef Bradshaw, C. P., Debnam, K. J., Lindstrom Johnson, S., Pas, E. T., Hershfeldt, P., Alexander, A., et al. (2014). Maryland’s evolving system of social, emotional, and behavioral interventions in the public schools: The Maryland Safe and Supportive Schools Project. Adolescent Psychiatry, 4, 194–206. https://​doi.​org/​10.​2174/​2210676604031409​12163120CrossRef
Zurück zum Zitat Bradshaw, C. P., Koth, C. W., Bevans, K. B., Ialongo, N. S., & Leaf, P. J. (2008a). The impact of school-wide Positive Behavioral Interventions and Supports (PBIS) on the organizational health of elementary schools. School Psychology Quarterly, 23, 462–473.CrossRef Bradshaw, C. P., Koth, C. W., Bevans, K. B., Ialongo, N. S., & Leaf, P. J. (2008a). The impact of school-wide Positive Behavioral Interventions and Supports (PBIS) on the organizational health of elementary schools. School Psychology Quarterly, 23, 462–473.CrossRef
Zurück zum Zitat Bradshaw, C. P., Mitchell, M. M., & Leaf, P. J. (2010). Examining the effects of schoolwide Positive Behavioral Interventions and Supports on student outcomes: Results from a randomized controlled effectiveness trial in elementary schools. Journal of Positive Behavior Interventions, 12, 133–148.CrossRef Bradshaw, C. P., Mitchell, M. M., & Leaf, P. J. (2010). Examining the effects of schoolwide Positive Behavioral Interventions and Supports on student outcomes: Results from a randomized controlled effectiveness trial in elementary schools. Journal of Positive Behavior Interventions, 12, 133–148.CrossRef
Zurück zum Zitat Bradshaw, C. P., & Pas, E. T. (2011). A state-wide scale-up of Positive Behavioral Interventions and Supports (PBIS): A description of the development of systems of support and analysis of adoption and implementation. School Psychology Review, 40, 530–548.CrossRef Bradshaw, C. P., & Pas, E. T. (2011). A state-wide scale-up of Positive Behavioral Interventions and Supports (PBIS): A description of the development of systems of support and analysis of adoption and implementation. School Psychology Review, 40, 530–548.CrossRef
Zurück zum Zitat Bradshaw, C. P., Pas, E., Bloom, J., Barrett, S., Hershfeldt, P., Alexander, A. C., & A. E., & Leaf, P. . (2012a). A state-wide collaboration to promote safe and supportive schools: The PBIS Maryland Initiative. Administration and Policy in Mental Health and Mental Health Services Research, 39(4), 225–237. https://doi.org/10.1007/s10488-011-0384-6CrossRefPubMed Bradshaw, C. P., Pas, E., Bloom, J., Barrett, S., Hershfeldt, P., Alexander, A. C., & A. E., & Leaf, P. . (2012a). A state-wide collaboration to promote safe and supportive schools: The PBIS Maryland Initiative. Administration and Policy in Mental Health and Mental Health Services Research, 39(4), 225–237. https://​doi.​org/​10.​1007/​s10488-011-0384-6CrossRefPubMed
Zurück zum Zitat Bradshaw, C. P., Reinke, W. M., Brown, L. D., Bevans, K. B., & Leaf, P. J. (2008b). Implementation of school-wide Positive Behavioral Interventions and Supports (PBIS) in elementary schools: Observations from a randomized trial. Education and Treatment of Children, 31, 1–26. https://doi.org/10.1353/etc.0.0025CrossRef Bradshaw, C. P., Reinke, W. M., Brown, L. D., Bevans, K. B., & Leaf, P. J. (2008b). Implementation of school-wide Positive Behavioral Interventions and Supports (PBIS) in elementary schools: Observations from a randomized trial. Education and Treatment of Children, 31, 1–26. https://​doi.​org/​10.​1353/​etc.​0.​0025CrossRef
Zurück zum Zitat Gage, N. A., Grasley-Boy, N., George, H. P., Childs, K., & Kincaid, D. (2019). A quasi-experimental design analysis of the effects of school-wide Positive Behavior Interventions and Supports on discipline in Florida. Journal of Positive Behavior Interventions, 21, 50–61. https://doi.org/10.1177/1098300718768208CrossRef Gage, N. A., Grasley-Boy, N., George, H. P., Childs, K., & Kincaid, D. (2019). A quasi-experimental design analysis of the effects of school-wide Positive Behavior Interventions and Supports on discipline in Florida. Journal of Positive Behavior Interventions, 21, 50–61. https://​doi.​org/​10.​1177/​1098300718768208​CrossRef
Zurück zum Zitat Gage, N. A., Lee, A., Grasley-Boy, N., & Peshak George, H. (2018). The impact of school-wide positive behavior interventions and supports on school suspensions: A statewide quasi-experimental analysis. Journal of Positive Behavior Interventions, 20, 217–226.CrossRef Gage, N. A., Lee, A., Grasley-Boy, N., & Peshak George, H. (2018). The impact of school-wide positive behavior interventions and supports on school suspensions: A statewide quasi-experimental analysis. Journal of Positive Behavior Interventions, 20, 217–226.CrossRef
Zurück zum Zitat Glasgow, R. E., Vinson, C., Chambers, D., Khoury, M. J., Kaplan, R. M., & Hunter, C. (2012). National Institutes of Health approaches to dissemination and implementation science: Current and future directions. American Journal of Public Health, 102, 1274–1281.CrossRef Glasgow, R. E., Vinson, C., Chambers, D., Khoury, M. J., Kaplan, R. M., & Hunter, C. (2012). National Institutes of Health approaches to dissemination and implementation science: Current and future directions. American Journal of Public Health, 102, 1274–1281.CrossRef
Zurück zum Zitat Horner, R. H., Sugai, G., & Anderson, C. M. (2010). Examining the evidence base for schoolwide positive behavior support. Focus on Exceptional Children, 42, 1–14.CrossRef Horner, R. H., Sugai, G., & Anderson, C. M. (2010). Examining the evidence base for schoolwide positive behavior support. Focus on Exceptional Children, 42, 1–14.CrossRef
Zurück zum Zitat Horner, R. H., Sugai, G., Smolkowski, K., Eber, L., Nakasato, J., Todd, A. W., & Esperanza, J. (2009). A randomized, wait-list controlled effectiveness trial assessing school-wide Positive Behavior Support in elementary schools. Journal of Positive Behavior Interventions, 11, 133–144.CrossRef Horner, R. H., Sugai, G., Smolkowski, K., Eber, L., Nakasato, J., Todd, A. W., & Esperanza, J. (2009). A randomized, wait-list controlled effectiveness trial assessing school-wide Positive Behavior Support in elementary schools. Journal of Positive Behavior Interventions, 11, 133–144.CrossRef
Zurück zum Zitat Imbens, G. W., & Kalyanaraman, K. (2009). Optimal Bandwidth Choice for the Regression Discontinuity Estimator (NBER Working Paper 14726). Cambridge, MA: National Bureau of Economic Research. Imbens, G. W., & Kalyanaraman, K. (2009). Optimal Bandwidth Choice for the Regression Discontinuity Estimator (NBER Working Paper 14726). Cambridge, MA: National Bureau of Economic Research.
Zurück zum Zitat Kittelman, A., McIntosh, K., & Hoselton, R. (2019). Adoption of PBIS within school districts. Journal of School Psychology, 76, 159–167.CrossRef Kittelman, A., McIntosh, K., & Hoselton, R. (2019). Adoption of PBIS within school districts. Journal of School Psychology, 76, 159–167.CrossRef
Zurück zum Zitat Lane, K. L., Kalberg, J. R., Bruhn, A. L., Driscoll, S. A., Wehby, J. H., & Elliott, S. (2009). Assessing social validity of school-wide positive behavior support plans: Evidence for the reliability and structure of the Primary Intervention Rating Scale. School Psychology Review, 38, 135–144.CrossRef Lane, K. L., Kalberg, J. R., Bruhn, A. L., Driscoll, S. A., Wehby, J. H., & Elliott, S. (2009). Assessing social validity of school-wide positive behavior support plans: Evidence for the reliability and structure of the Primary Intervention Rating Scale. School Psychology Review, 38, 135–144.CrossRef
Zurück zum Zitat Lindstrom Johnson, S., Alfonso, Y. N., Pas, E. T., Debnam, K. J., & Bradshaw, C. P. (in press). Scaling-up PBIS: The distribution of costs across educational stakeholders. School Psychology Review. Lindstrom Johnson, S., Alfonso, Y. N., Pas, E. T., Debnam, K. J., & Bradshaw, C. P. (in press). Scaling-up PBIS: The distribution of costs across educational stakeholders. School Psychology Review.
Zurück zum Zitat Mercer, S. H., McIntosh, K., & Hoselton, R. (2017). Comparability of fidelity measures for assessing Tier 1 school-wide Positive Behavioral Interventions and Supports. Journal of Positive Behavior Interventions, 19(4), 195–204.CrossRef Mercer, S. H., McIntosh, K., & Hoselton, R. (2017). Comparability of fidelity measures for assessing Tier 1 school-wide Positive Behavioral Interventions and Supports. Journal of Positive Behavior Interventions, 19(4), 195–204.CrossRef
Zurück zum Zitat Nylund, K. L., Asparouhov, T., & Muthén, B. O. (2007). Deciding on the number of latent classes in latent class analysis and growth mixture modeling: A Monte Carlo simulation study. Structural Equation Modeling: A Multidisciplinary Journal, 14(4), 535–569. Nylund, K. L., Asparouhov, T., & Muthén, B. O. (2007). Deciding on the number of latent classes in latent class analysis and growth mixture modeling: A Monte Carlo simulation study. Structural Equation Modeling: A Multidisciplinary Journal, 14(4), 535–569.
Zurück zum Zitat OSEP Technical Assistance Center on Positive Behavioral Interventions and Supports (2019). Positive Behavioral Interventions & Supports [Website]. Retrieved from www.pbis.org. OSEP Technical Assistance Center on Positive Behavioral Interventions and Supports (2019). Positive Behavioral Interventions & Supports [Website]. Retrieved from www.​pbis.​org.
Zurück zum Zitat Positive Behavioral Interventions and Support Program, Title 13A Maryland State Board of Education § 2–205 and 7–304.1 (2008). Positive Behavioral Interventions and Support Program, Title 13A Maryland State Board of Education § 2–205 and 7–304.1 (2008).
Zurück zum Zitat Ramaswamy, V., Desarbo, W. S., Reibstein, D. J., & Robinson, W. T. (1993). An empirical pooling approach for estimating marketing mix elasticities with PIMS data. Marketing Science, 12, 103–124. Ramaswamy, V., Desarbo, W. S., Reibstein, D. J., & Robinson, W. T. (1993). An empirical pooling approach for estimating marketing mix elasticities with PIMS data. Marketing Science, 12, 103–124.
Zurück zum Zitat R Core Team. (2018). R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. R Core Team. (2018). R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria.
Zurück zum Zitat Ryoo, J. H., & Pullen, P. C. (2017). Regression discontinuity design for longitudinal data, cross-sectional data, and intervention research. In J. M. Kauffman, D. P. Hallahan, & P. C. Pullen (Eds.), Handbook of special education. (2nd ed., pp. 137–150). Routledge. Ryoo, J. H., & Pullen, P. C. (2017). Regression discontinuity design for longitudinal data, cross-sectional data, and intervention research. In J. M. Kauffman, D. P. Hallahan, & P. C. Pullen (Eds.), Handbook of special education. (2nd ed., pp. 137–150). Routledge.
Zurück zum Zitat Ryoo, J. H., Wang, C., Swearer, S., Hull, M., & Shi, D. (2018). Longitudinal model building using latent transition analysis: an example of using school bullying data. Frontiers in Psychology – Quantitative Psychology and Measurement, 9, 675. https://doi.org/10.3389/fpsyg.2018.00675 Ryoo, J. H., Wang, C., Swearer, S., Hull, M., & Shi, D. (2018). Longitudinal model building using latent transition analysis: an example of using school bullying data. Frontiers in Psychology – Quantitative Psychology and Measurement, 9, 675. https://​doi.​org/​10.​3389/​fpsyg.​2018.​00675
Zurück zum Zitat Spoth, R. L., Rohrbach, L. A., Greenberg, M. T., Leaf, P., Brown, C. H., Fagan, A. A., … Society for Prevention Research Type 2 Translational Task Force. (2013). Addressing core challenges for the next generation of Type 2 translation research and systems: The translation science to population impact (TSci Impact) framework. Prevention Science, 14, 319–351.CrossRef Spoth, R. L., Rohrbach, L. A., Greenberg, M. T., Leaf, P., Brown, C. H., Fagan, A. A., … Society for Prevention Research Type 2 Translational Task Force. (2013). Addressing core challenges for the next generation of Type 2 translation research and systems: The translation science to population impact (TSci Impact) framework. Prevention Science, 14, 319–351.CrossRef
Zurück zum Zitat Sugai, G., & Horner, R. H. (2006). A promising approach for expanding and sustaining school-wide Positive Behavior Support. School Psychology Review, 35(2), 245–259.CrossRef Sugai, G., & Horner, R. H. (2006). A promising approach for expanding and sustaining school-wide Positive Behavior Support. School Psychology Review, 35(2), 245–259.CrossRef
Zurück zum Zitat Thistlewaite, D. L., & Campbell, D. T. (1960). Regression-discontinuity analysis: An alternative to the ex-post facto experiment. Journal of Educational Psychology, 51, 309–317.CrossRef Thistlewaite, D. L., & Campbell, D. T. (1960). Regression-discontinuity analysis: An alternative to the ex-post facto experiment. Journal of Educational Psychology, 51, 309–317.CrossRef
Zurück zum Zitat Trochim, W. (2001). Regression-discontinuity design. International Encyclopedia of the Social and Behavioral Sciences, 19, 12940–12945.CrossRef Trochim, W. (2001). Regression-discontinuity design. International Encyclopedia of the Social and Behavioral Sciences, 19, 12940–12945.CrossRef
Zurück zum Zitat Waasdorp, T. E., Bradshaw, C. P., & Leaf, P. J. (2012). The impact of school-wide Positive Behavioral Interventions and Supports (SWPBIS) on bullying and peer rejection: A randomized controlled effectiveness trial. Archives of Child and Adolescent Medicine, 116, 149–156.CrossRef Waasdorp, T. E., Bradshaw, C. P., & Leaf, P. J. (2012). The impact of school-wide Positive Behavioral Interventions and Supports (SWPBIS) on bullying and peer rejection: A randomized controlled effectiveness trial. Archives of Child and Adolescent Medicine, 116, 149–156.CrossRef
Metadaten
Titel
Can Policy Promote Adoption or Outcomes of Evidence-based Prevention Programming?: a Case Illustration of Positive Behavioral Interventions and Supports
verfasst von
Catherine P. Bradshaw
Elise T. Pas
Rashelle J. Musci
Joseph M. Kush
Ji Hoon Ryoo
Publikationsdatum
08.06.2021
Verlag
Springer US
Erschienen in
Prevention Science / Ausgabe 7/2021
Print ISSN: 1389-4986
Elektronische ISSN: 1573-6695
DOI
https://doi.org/10.1007/s11121-021-01257-0

Weitere Artikel der Ausgabe 7/2021

Prevention Science 7/2021 Zur Ausgabe