Skip to main content
Erschienen in: Prevention Science 1/2017

05.12.2016

Testing an Integrated Model of Program Implementation: the Food, Health & Choices School-Based Childhood Obesity Prevention Intervention Process Evaluation

verfasst von: Marissa Burgermaster, Heewon Lee Gray, Elizabeth Tipton, Isobel Contento, Pamela Koch

Erschienen in: Prevention Science | Ausgabe 1/2017

Einloggen, um Zugang zu erhalten

Abstract

Childhood obesity is a complex, worldwide problem. Significant resources are invested in its prevention, and high-quality evaluations of these efforts are important. Conducting trials in school settings is complicated, making process evaluations useful for explaining results. Intervention fidelity has been demonstrated to influence outcomes, but others have suggested that other aspects of implementation, including participant responsiveness, should be examined more systematically. During Food, Health & Choices (FHC), a school-based childhood obesity prevention trial designed to test a curriculum and wellness policy taught by trained FHC instructors to fifth grade students in 20 schools during 2012–2013, we assessed relationships among facilitator behaviors (i.e., fidelity and teacher interest); participant behaviors (i.e., student satisfaction and recall); and program outcomes (i.e., energy balance-related behaviors) using hierarchical linear models, controlling for student, class, and school characteristics. We found positive relationships between student satisfaction and recall and program outcomes, but not fidelity and program outcomes. We also found relationships between teacher interest and fidelity when teachers participated in implementation. Finally, we found a significant interaction between fidelity and satisfaction on behavioral outcomes. These findings suggest that individual students in the same class responded differently to the same intervention. They also suggest the importance of teacher buy-in for successful intervention implementation. Future studies should examine how facilitator and participant behaviors together are related to both outcomes and implementation. Assessing multiple aspects of implementation using models that account for contextual influences on behavioral outcomes is an important step forward for prevention intervention process evaluations.
Anhänge
Nur mit Berechtigung zugänglich
Literatur
Zurück zum Zitat Berkel, C., Mauricio, A. M., Schoenfelder, E., & Sandler, I. N. (2011). Putting the pieces together: an integrated model of program implementation. Prevention Science, 12(1), 23–33.CrossRefPubMed Berkel, C., Mauricio, A. M., Schoenfelder, E., & Sandler, I. N. (2011). Putting the pieces together: an integrated model of program implementation. Prevention Science, 12(1), 23–33.CrossRefPubMed
Zurück zum Zitat Christian, M. S., Evans, C. E., Ransley, J. K., Greenwood, D. C., Thomas, J. D., & Cade, J. E. (2012). Process evaluation of a cluster randomised controlled trial of a school-based fruit and vegetable intervention: project tomato. Public Health Nutrition, 15(03), 459–465.CrossRefPubMed Christian, M. S., Evans, C. E., Ransley, J. K., Greenwood, D. C., Thomas, J. D., & Cade, J. E. (2012). Process evaluation of a cluster randomised controlled trial of a school-based fruit and vegetable intervention: project tomato. Public Health Nutrition, 15(03), 459–465.CrossRefPubMed
Zurück zum Zitat Carroll, C., Patterson, M., Wood, S., Booth, A., Rick, J., & Balain, S. (2007). A conceptual framework for implementation fidelity. Implementation Science, 2(1), 40.CrossRefPubMedPubMedCentral Carroll, C., Patterson, M., Wood, S., Booth, A., Rick, J., & Balain, S. (2007). A conceptual framework for implementation fidelity. Implementation Science, 2(1), 40.CrossRefPubMedPubMedCentral
Zurück zum Zitat Chen, H. T. (2010). The bottom up approach to integrative validity: a new perspective for program evaluation. Evaluation and Program Planning, 33, 205–214.CrossRefPubMed Chen, H. T. (2010). The bottom up approach to integrative validity: a new perspective for program evaluation. Evaluation and Program Planning, 33, 205–214.CrossRefPubMed
Zurück zum Zitat Cohen, J., Cohen, P., West, S. G., & Aiken, L. S. (2002). Applied multiple regression/correlation analysis for the behavioral sciences (3rd ed.). Mahwah: Lawrence Erlbaum. Cohen, J., Cohen, P., West, S. G., & Aiken, L. S. (2002). Applied multiple regression/correlation analysis for the behavioral sciences (3rd ed.). Mahwah: Lawrence Erlbaum.
Zurück zum Zitat Contento, I. R. (2015). Nutrition education: Linking research, theory, and practice (3rd ed.). Burlington: Jones & Bartlett Learning. Contento, I. R. (2015). Nutrition education: Linking research, theory, and practice (3rd ed.). Burlington: Jones & Bartlett Learning.
Zurück zum Zitat Contento, I., Koch, P., & Gray, H. L. (2015). Reducing childhood obesity: an innovative curriculum with wellness policy support. Journal of Nutrition Education and Behavior, 47(4), S98.CrossRef Contento, I., Koch, P., & Gray, H. L. (2015). Reducing childhood obesity: an innovative curriculum with wellness policy support. Journal of Nutrition Education and Behavior, 47(4), S98.CrossRef
Zurück zum Zitat Contento, I. R., Koch, P. A., Lee, H., & Calabrese-Barton, A. (2010). Adolescents demonstrate improvement in obesity risk behaviors after completion of Choice, Control & Change, a curriculum addressing personal agency and autonomous motivation. Journal of the American Dietetic Association, 110(12), 1830–1839.CrossRefPubMedPubMedCentral Contento, I. R., Koch, P. A., Lee, H., & Calabrese-Barton, A. (2010). Adolescents demonstrate improvement in obesity risk behaviors after completion of Choice, Control & Change, a curriculum addressing personal agency and autonomous motivation. Journal of the American Dietetic Association, 110(12), 1830–1839.CrossRefPubMedPubMedCentral
Zurück zum Zitat Cote, A. T., Harris, K. C., Panagiotopoulos, C., Sandor, G. G., & Devlin, A. M. (2013). Childhood obesity and cardiovascular dysfunction. Journal of the American College of Cardiology, 62, 1309–19.CrossRefPubMed Cote, A. T., Harris, K. C., Panagiotopoulos, C., Sandor, G. G., & Devlin, A. M. (2013). Childhood obesity and cardiovascular dysfunction. Journal of the American College of Cardiology, 62, 1309–19.CrossRefPubMed
Zurück zum Zitat de Onis, M., Blossner, M., & Borghi, E. (2010). Global prevalence and trends of overweight and obesity among preschool children. American Journal of Clinical Nutrition, 92, 1257–1264.CrossRefPubMed de Onis, M., Blossner, M., & Borghi, E. (2010). Global prevalence and trends of overweight and obesity among preschool children. American Journal of Clinical Nutrition, 92, 1257–1264.CrossRefPubMed
Zurück zum Zitat Durlak, J., & DuPre, E. (2008). Implementation matters: a review of research on the influence of implementation on program outcomes and the factors affecting implementation. American Journal of Community Psychology, 41, 327–350.CrossRefPubMed Durlak, J., & DuPre, E. (2008). Implementation matters: a review of research on the influence of implementation on program outcomes and the factors affecting implementation. American Journal of Community Psychology, 41, 327–350.CrossRefPubMed
Zurück zum Zitat Dusenbury, L., Brannigan, R., Falco, M., & Hansen, W. B. (2003). A review of research on fidelity of implementation: implications for drug abuse prevention in school settings. Health Education Research, 18(2), 237–256.CrossRefPubMed Dusenbury, L., Brannigan, R., Falco, M., & Hansen, W. B. (2003). A review of research on fidelity of implementation: implications for drug abuse prevention in school settings. Health Education Research, 18(2), 237–256.CrossRefPubMed
Zurück zum Zitat Fisher, J. O., Johnson, R. K., Lindquist, C., Birch, L. L., & Goran, M. I. (2000). Influence of body composition on the accuracy of reported energy intake in children. Obesity Research, 8, 597–603.CrossRefPubMed Fisher, J. O., Johnson, R. K., Lindquist, C., Birch, L. L., & Goran, M. I. (2000). Influence of body composition on the accuracy of reported energy intake in children. Obesity Research, 8, 597–603.CrossRefPubMed
Zurück zum Zitat Gray, H. L., Burgermaster, M., Tipton, E., Contento, I. R., Koch, P. A., & Di Noia, J. (2015a). Intraclass correlation coefficients for obesity indicators and energy balance–related behaviors among New York City public elementary schools. Health Education & Behavior, 43(2), 172–181.CrossRef Gray, H. L., Burgermaster, M., Tipton, E., Contento, I. R., Koch, P. A., & Di Noia, J. (2015a). Intraclass correlation coefficients for obesity indicators and energy balance–related behaviors among New York City public elementary schools. Health Education & Behavior, 43(2), 172–181.CrossRef
Zurück zum Zitat Gray, H. L., Contento, I. R., & Koch, P. A. (2015b). Linking implementation process to intervention outcomes in a middle school obesity prevention curriculum, Choice, Control and Change. Health Education Research, 30(2), 248–261.CrossRefPubMedPubMedCentral Gray, H. L., Contento, I. R., & Koch, P. A. (2015b). Linking implementation process to intervention outcomes in a middle school obesity prevention curriculum, Choice, Control and Change. Health Education Research, 30(2), 248–261.CrossRefPubMedPubMedCentral
Zurück zum Zitat Gray, H. L., Koch, P. A., Contento, I. R., Bandelli, L. N., Ang, I., & Di Noia, J. (2016). Validity and reliability of behavior and theory-based psychosocial determinants measures, using audience response system technology in urban upper-elementary schoolchildren. Journal of Nutrition Education and Behavior, 48(7), 437–452.CrossRefPubMed Gray, H. L., Koch, P. A., Contento, I. R., Bandelli, L. N., Ang, I., & Di Noia, J. (2016). Validity and reliability of behavior and theory-based psychosocial determinants measures, using audience response system technology in urban upper-elementary schoolchildren. Journal of Nutrition Education and Behavior, 48(7), 437–452.CrossRefPubMed
Zurück zum Zitat Greaney, M.L., Hardwick, C.K., Spadano-Gasbaro, J.L., Mezgebu, S., Horan, C.M., Schlotterbeck, S., …Peterson, K.E. (2014). Implementing a multicomponent school-based obesity prevention intervention: A qualitative study. Journal of Nutrition Education and Behavior, 46, 576–582. Greaney, M.L., Hardwick, C.K., Spadano-Gasbaro, J.L., Mezgebu, S., Horan, C.M., Schlotterbeck, S., …Peterson, K.E. (2014). Implementing a multicomponent school-based obesity prevention intervention: A qualitative study. Journal of Nutrition Education and Behavior, 46, 576–582.
Zurück zum Zitat Griffin, T. L., Pallan, M. J., Clarke, J. L., Lancashire, E. R., Lyon, A., Parry, J. M., & Adab, P. (2014). Process evaluation design in a cluster randomised controlled childhood obesity prevention trial: the WAVES study. International Journal of Behavioral Nutrition and Physical Activity, 11, 112.CrossRefPubMedPubMedCentral Griffin, T. L., Pallan, M. J., Clarke, J. L., Lancashire, E. R., Lyon, A., Parry, J. M., & Adab, P. (2014). Process evaluation design in a cluster randomised controlled childhood obesity prevention trial: the WAVES study. International Journal of Behavioral Nutrition and Physical Activity, 11, 112.CrossRefPubMedPubMedCentral
Zurück zum Zitat Herouvil, D., Karanasios, D., Karayianni, C., & Karavanaki, K. (2013). Review: cardiovascular disease in childhood: the role of obesity. European Journal of Pediatrics, 172, 721–732.CrossRef Herouvil, D., Karanasios, D., Karayianni, C., & Karavanaki, K. (2013). Review: cardiovascular disease in childhood: the role of obesity. European Journal of Pediatrics, 172, 721–732.CrossRef
Zurück zum Zitat Kam, C. M., Greenberg, M. T., & Walls, C. T. (2003). Examining the role of implementation quality in school-based prevention using the PATHS curriculum. Prevention Science, 4(1), 55–63.CrossRefPubMed Kam, C. M., Greenberg, M. T., & Walls, C. T. (2003). Examining the role of implementation quality in school-based prevention using the PATHS curriculum. Prevention Science, 4(1), 55–63.CrossRefPubMed
Zurück zum Zitat Koth, C. W., Bradshaw, C. P., & Leaf, P. J. (2008). A multilevel study of predictors of student perceptions of school climate: the effect of classroom-level factors. Journal of Educational Psychology, 100(1), 96–104.CrossRef Koth, C. W., Bradshaw, C. P., & Leaf, P. J. (2008). A multilevel study of predictors of student perceptions of school climate: the effect of classroom-level factors. Journal of Educational Psychology, 100(1), 96–104.CrossRef
Zurück zum Zitat Kuczmarski, R.J., Ogden, C.L., Grummer-Strawn, M., Flegal, K.M., Guo, S.S., Wei, R. …Johnson, C.L. (2000). CDC growth charts: United States. Advance Data, 314, 1–27. Kuczmarski, R.J., Ogden, C.L., Grummer-Strawn, M., Flegal, K.M., Guo, S.S., Wei, R. …Johnson, C.L. (2000). CDC growth charts: United States. Advance Data, 314, 1–27.
Zurück zum Zitat Lee, H., Contento, I. R., & Koch, P. (2013). Using a systematic conceptual model for a process evaluation of a middle school obesity risk-reduction nutrition curriculum intervention: choice, control & change. Journal of Nutrition Education and Behavior, 45, 126–136.CrossRefPubMedPubMedCentral Lee, H., Contento, I. R., & Koch, P. (2013). Using a systematic conceptual model for a process evaluation of a middle school obesity risk-reduction nutrition curriculum intervention: choice, control & change. Journal of Nutrition Education and Behavior, 45, 126–136.CrossRefPubMedPubMedCentral
Zurück zum Zitat Little, R. J. A. (1988). A test of missing completely at random for multivariate data with missing values. Journal of the American Statistical Association, 83(404), 1198–1202.CrossRef Little, R. J. A. (1988). A test of missing completely at random for multivariate data with missing values. Journal of the American Statistical Association, 83(404), 1198–1202.CrossRef
Zurück zum Zitat Martens, M., van Assema, P., Paulussen, T., Schaalma, H., & Brug, J. (2006). Krachtvoer: process evaluation of a Dutch programme for lower vocational schools to promote healthful diet. Health Education Research, 21(5), 695–704.CrossRefPubMed Martens, M., van Assema, P., Paulussen, T., Schaalma, H., & Brug, J. (2006). Krachtvoer: process evaluation of a Dutch programme for lower vocational schools to promote healthful diet. Health Education Research, 21(5), 695–704.CrossRefPubMed
Zurück zum Zitat Paulson, D. S. (2006). Handbook of regression and modeling: applications for the clinical and pharmaceutical industries. Boca Raton: Chapman and Hall/CRC.CrossRef Paulson, D. S. (2006). Handbook of regression and modeling: applications for the clinical and pharmaceutical industries. Boca Raton: Chapman and Hall/CRC.CrossRef
Zurück zum Zitat Peets, K., Pöyhönen, V., Juvonen, J., & Salmivalli, C. (2015). Classroom norms of bullying alter the degree to which children defend in response to their affective empathy and power. Developmental Psychology, 51(7), 913.CrossRefPubMed Peets, K., Pöyhönen, V., Juvonen, J., & Salmivalli, C. (2015). Classroom norms of bullying alter the degree to which children defend in response to their affective empathy and power. Developmental Psychology, 51(7), 913.CrossRefPubMed
Zurück zum Zitat Pettigrew, J., Graham, J. W., Miller-Day, M., Hecht, M. L., Krieger, J. L., & Shin, Y. J. (2015). Adherence and delivery: implementation quality and program outcomes for the seventh-grade keepin’ it REAL program. Prevention Science, 16(1), 90–99.CrossRefPubMedPubMedCentral Pettigrew, J., Graham, J. W., Miller-Day, M., Hecht, M. L., Krieger, J. L., & Shin, Y. J. (2015). Adherence and delivery: implementation quality and program outcomes for the seventh-grade keepin’ it REAL program. Prevention Science, 16(1), 90–99.CrossRefPubMedPubMedCentral
Zurück zum Zitat Pratt, C. A., Arteaga, S., & Loria, C. (2014). Forging a future of better cardiovascular health: addressing childhood obesity. Journal of the American College of Cardiology, 63, 369–371.CrossRefPubMed Pratt, C. A., Arteaga, S., & Loria, C. (2014). Forging a future of better cardiovascular health: addressing childhood obesity. Journal of the American College of Cardiology, 63, 369–371.CrossRefPubMed
Zurück zum Zitat Proctor, E., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G., Bunger, A., … & Hensley, M. (2011). Outcomes for implementation research: Conceptual distinctions, measurement challenges, and research agenda. Administration and Policy in Mental Health and Mental Health Services Research, 38(2), 65–76. Proctor, E., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G., Bunger, A., … & Hensley, M. (2011). Outcomes for implementation research: Conceptual distinctions, measurement challenges, and research agenda. Administration and Policy in Mental Health and Mental Health Services Research, 38(2), 65–76.
Zurück zum Zitat Raudenbrush, S. W., & Byrk, A. S. (2002). Hierarchical linear models: applications and data analysis methods (2nd ed.). Thousand Oaks: Sage. Raudenbrush, S. W., & Byrk, A. S. (2002). Hierarchical linear models: applications and data analysis methods (2nd ed.). Thousand Oaks: Sage.
Zurück zum Zitat Raudenbush, S. W., Bryk, A. S., Cheong, A. S., Fai, Y. F., Congdon, R. T., & du Toit, M. (2011). HLM 7: Hierarchical linear and nonlinear modeling. Lincolnwood: Scientific Software International. Raudenbush, S. W., Bryk, A. S., Cheong, A. S., Fai, Y. F., Congdon, R. T., & du Toit, M. (2011). HLM 7: Hierarchical linear and nonlinear modeling. Lincolnwood: Scientific Software International.
Zurück zum Zitat Rohrbach, L. A., Dent, C. W., Skara, S., Sun, P., & Sussman, S. (2007). Fidelity of implementation in project towards No drug abuse (TND): a comparison of classroom teachers and program specialists. Prevention Science, 8(2), 125–132.CrossRefPubMed Rohrbach, L. A., Dent, C. W., Skara, S., Sun, P., & Sussman, S. (2007). Fidelity of implementation in project towards No drug abuse (TND): a comparison of classroom teachers and program specialists. Prevention Science, 8(2), 125–132.CrossRefPubMed
Zurück zum Zitat Sánchez, V., Steckler, A., Nitirat, P., Hallfors, D., Cho, H., & Brodish, P. (2007). Fidelity of implementation in a treatment effectiveness trial of reconnecting youth. Health Education Research, 22, 95–107.CrossRefPubMed Sánchez, V., Steckler, A., Nitirat, P., Hallfors, D., Cho, H., & Brodish, P. (2007). Fidelity of implementation in a treatment effectiveness trial of reconnecting youth. Health Education Research, 22, 95–107.CrossRefPubMed
Zurück zum Zitat Saunders, R. P., Ward, D., Felton, G. M., Dowda, M., & Pate, R. R. (2006). Examining the link between program implementation and behavior outcomes in the lifestyle education for activity program (LEAP). Evaluation and Program Planning, 29(4), 352–364.CrossRefPubMed Saunders, R. P., Ward, D., Felton, G. M., Dowda, M., & Pate, R. R. (2006). Examining the link between program implementation and behavior outcomes in the lifestyle education for activity program (LEAP). Evaluation and Program Planning, 29(4), 352–364.CrossRefPubMed
Zurück zum Zitat Schmied, E., Parada, H., Horton, L., Ibarra, L., & Ayala, G. (2015). A process evaluation of an efficacious family-based intervention to promote healthy eating: the Entre Familia: Reflejos de Salud study. Health Education and Behavior, 42, 583–592.CrossRefPubMed Schmied, E., Parada, H., Horton, L., Ibarra, L., & Ayala, G. (2015). A process evaluation of an efficacious family-based intervention to promote healthy eating: the Entre Familia: Reflejos de Salud study. Health Education and Behavior, 42, 583–592.CrossRefPubMed
Zurück zum Zitat Schneider, M., Hall, W.J., Hernandez, A.E., Hindes, K., Montez, G., Pham, T., … & Zeveloff, A. (2009). Rationale, design and methods for process evaluation in the HEALTHY study. International Journal of Obesity, 33, S60-S67. Schneider, M., Hall, W.J., Hernandez, A.E., Hindes, K., Montez, G., Pham, T., … & Zeveloff, A. (2009). Rationale, design and methods for process evaluation in the HEALTHY study. International Journal of Obesity, 33, S60-S67.
Zurück zum Zitat Shadish, W. R., Cook, T. D., & Campbell, D. T. (2001). Experimental and quasi-experimental designs for generalized causal inference (2nd ed.). Independence: Cengage. Shadish, W. R., Cook, T. D., & Campbell, D. T. (2001). Experimental and quasi-experimental designs for generalized causal inference (2nd ed.). Independence: Cengage.
Zurück zum Zitat Singh, A. S., Chinapaw, M. J. M., Brug, J., & Van Mechelen, W. (2009). Process evaluation of a school-based weight gain prevention program: the Dutch Obesity Intervention in Teenagers (DOiT). Health Education Research. doi:10.1093/her/cyp011.PubMed Singh, A. S., Chinapaw, M. J. M., Brug, J., & Van Mechelen, W. (2009). Process evaluation of a school-based weight gain prevention program: the Dutch Obesity Intervention in Teenagers (DOiT). Health Education Research. doi:10.​1093/​her/​cyp011.PubMed
Zurück zum Zitat van Stralen, M. M., de Meij, J., Te Velde, S. J., Van der Wal, M. F., Van Mechelen, W., Knol, D. L., & Chinapaw, M. J. (2012). Mediators of the effect of the JUMP-in intervention on physical activity and sedentary behavior in Dutch primary schoolchildren from disadvantaged neighborhoods. International Journal of Behavioral Nutrition and Physical Activity, 9(1), 131.CrossRefPubMedPubMedCentral van Stralen, M. M., de Meij, J., Te Velde, S. J., Van der Wal, M. F., Van Mechelen, W., Knol, D. L., & Chinapaw, M. J. (2012). Mediators of the effect of the JUMP-in intervention on physical activity and sedentary behavior in Dutch primary schoolchildren from disadvantaged neighborhoods. International Journal of Behavioral Nutrition and Physical Activity, 9(1), 131.CrossRefPubMedPubMedCentral
Zurück zum Zitat Waters, E., de Silva-Sanigorski, A., Hall, B.J., Brown, T., Campbell, K.J., Gao, Y. … Summerbell, C. D. (2011). Interventions for preventing obesity in children. Cochrane Database Systematic Reviews, 12, CD001871. Waters, E., de Silva-Sanigorski, A., Hall, B.J., Brown, T., Campbell, K.J., Gao, Y. … Summerbell, C. D. (2011). Interventions for preventing obesity in children. Cochrane Database Systematic Reviews, 12, CD001871.
Metadaten
Titel
Testing an Integrated Model of Program Implementation: the Food, Health & Choices School-Based Childhood Obesity Prevention Intervention Process Evaluation
verfasst von
Marissa Burgermaster
Heewon Lee Gray
Elizabeth Tipton
Isobel Contento
Pamela Koch
Publikationsdatum
05.12.2016
Verlag
Springer US
Erschienen in
Prevention Science / Ausgabe 1/2017
Print ISSN: 1389-4986
Elektronische ISSN: 1573-6695
DOI
https://doi.org/10.1007/s11121-016-0736-2

Weitere Artikel der Ausgabe 1/2017

Prevention Science 1/2017 Zur Ausgabe