Skip to main content
Erschienen in: Prevention Science 4/2008

01.12.2008

Estimating Intervention Effects of Prevention Programs: Accounting for Noncompliance

verfasst von: Elizabeth A. Stuart, Deborah F. Perry, Huynh-Nhu Le, Nicholas S. Ialongo

Erschienen in: Prevention Science | Ausgabe 4/2008

Einloggen, um Zugang zu erhalten

Abstract

Individuals not fully complying with their assigned treatments is a common problem encountered in randomized evaluations of behavioral interventions. Treatment group members rarely attend all sessions or do all “required” activities; control group members sometimes find ways to participate in aspects of the intervention. As a result, there is often interest in estimating both the effect of being assigned to participate in the intervention, as well as the impact of actually participating and doing all of the required activities. Methods known broadly as “complier average causal effects” (CACE) or “instrumental variables” (IV) methods have been developed to estimate this latter effect, but they are more commonly applied in medical and treatment research. Since the use of these statistical techniques in prevention trials has been less widespread, many prevention scientists may not be familiar with the underlying assumptions and limitations of CACE and IV approaches. This paper provides an introduction to these methods, described in the context of randomized controlled trials of two preventive interventions: one for perinatal depression among at-risk women and the other for aggressive disruptive behavior in children. Through these case studies, the underlying assumptions and limitations of these methods are highlighted.
Fußnoten
1
The exact line of code for R is “tsls(outcome~D + x1 + x2, ~T + x1 + x2, data = dataset).”
 
2
The exact line of code for Stata is “ivregress 2sls outcome x1 x2 (D = T).”
 
Literatur
Zurück zum Zitat Angrist, J., & Imbens, G. W. (1995). Two-stage least squares estimation of average causal effects in models with variable treatment intensity. Journal of the American Statistical Association, 90, 431–442. doi:10.2307/2291054.CrossRef Angrist, J., & Imbens, G. W. (1995). Two-stage least squares estimation of average causal effects in models with variable treatment intensity. Journal of the American Statistical Association, 90, 431–442. doi:10.​2307/​2291054.CrossRef
Zurück zum Zitat Angrist, J., Imbens, G. W., & Rubin, D. B. (1996). Identification of causal effects using instrumental variables. Journal of the American Statistical Association, 91, 444–472. doi:10.2307/2291629.CrossRef Angrist, J., Imbens, G. W., & Rubin, D. B. (1996). Identification of causal effects using instrumental variables. Journal of the American Statistical Association, 91, 444–472. doi:10.​2307/​2291629.CrossRef
Zurück zum Zitat Baker, S. G., & Kramer, B. S. (2005). Simple maximum likelihood estimates of efficacy in randomized trials and before-and-after studies, with implications for meta-analysis. Statistical Methods in Medical Research, 14, 349–367. doi:10.1191/0962280205sm404oa.PubMedCrossRef Baker, S. G., & Kramer, B. S. (2005). Simple maximum likelihood estimates of efficacy in randomized trials and before-and-after studies, with implications for meta-analysis. Statistical Methods in Medical Research, 14, 349–367. doi:10.​1191/​0962280205sm404o​a.PubMedCrossRef
Zurück zum Zitat Beck, A. T., Steer, R. A., & Brown, G. K. (1996). Manual for the Beck Depression Inventory (2nd ed.). San Antonio, TX: The Psychological Corporation. Beck, A. T., Steer, R. A., & Brown, G. K. (1996). Manual for the Beck Depression Inventory (2nd ed.). San Antonio, TX: The Psychological Corporation.
Zurück zum Zitat Black, M. M., Bentley, M. E., Papas, M. A., Oberlander, S., Teti, L. O., McNary, S., et al. (2006). Delaying second births among adolescent mothers: A randomized, controlled trial of a home-based mentoring program. Pediatrics, 118, e1087–e1099. doi:10.1542/peds.2005-2318.PubMedCrossRef Black, M. M., Bentley, M. E., Papas, M. A., Oberlander, S., Teti, L. O., McNary, S., et al. (2006). Delaying second births among adolescent mothers: A randomized, controlled trial of a home-based mentoring program. Pediatrics, 118, e1087–e1099. doi:10.​1542/​peds.​2005-2318.PubMedCrossRef
Zurück zum Zitat Connell, A. M., Dishion, T. J., Yasui, M., & Kavanagh, K. (2007). An adaptive approach to family intervention: Linking engagement in family-centered intervention to reductions in adolescent problem behavior. Journal of Consulting and Clinical Psychology, 75, 568–579. doi:10.1037/0022-006X.75.4.568.PubMedCrossRef Connell, A. M., Dishion, T. J., Yasui, M., & Kavanagh, K. (2007). An adaptive approach to family intervention: Linking engagement in family-centered intervention to reductions in adolescent problem behavior. Journal of Consulting and Clinical Psychology, 75, 568–579. doi:10.​1037/​0022-006X.​75.​4.​568.PubMedCrossRef
Zurück zum Zitat Dunn, G., Maracy, M., Dowrick, C., Ayuso-Mateos, J. L., Dalgard, O. S., Page, H., et al. (2003). Estimating psychological treatment effects from a randomised controlled trial with both non-compliance and loss to follow-up. The British Journal of Psychiatry, 183, 323–331. doi:10.1192/bjp.183.4.323.PubMedCrossRef Dunn, G., Maracy, M., Dowrick, C., Ayuso-Mateos, J. L., Dalgard, O. S., Page, H., et al. (2003). Estimating psychological treatment effects from a randomised controlled trial with both non-compliance and loss to follow-up. The British Journal of Psychiatry, 183, 323–331. doi:10.​1192/​bjp.​183.​4.​323.PubMedCrossRef
Zurück zum Zitat Dunn, G., Maracy, M., & Tomenson, B. (2005). Estimating treatment effects from randomized controlled trials with noncompliance and loss to follow-up: The role of instrumental variables methods. Statistical Methods in Medical Research, 14, 369–395. doi:10.1191/0962280205sm403oa.PubMedCrossRef Dunn, G., Maracy, M., & Tomenson, B. (2005). Estimating treatment effects from randomized controlled trials with noncompliance and loss to follow-up: The role of instrumental variables methods. Statistical Methods in Medical Research, 14, 369–395. doi:10.​1191/​0962280205sm403o​a.PubMedCrossRef
Zurück zum Zitat Foster, E. M. (2000). Is more better than less? An analysis of children’s mental health services. Health Services Research, 35, 1135–1158.PubMed Foster, E. M. (2000). Is more better than less? An analysis of children’s mental health services. Health Services Research, 35, 1135–1158.PubMed
Zurück zum Zitat Frangakis, C. E., & Rubin, D. B. (1999). Addressing complications of intention-to-treat analysis in the combined presence of all-or-none treatment noncompliance and subsequent missing outcomes. Biometrika, 86, 365–379. doi:10.1093/biomet/86.2.365.CrossRef Frangakis, C. E., & Rubin, D. B. (1999). Addressing complications of intention-to-treat analysis in the combined presence of all-or-none treatment noncompliance and subsequent missing outcomes. Biometrika, 86, 365–379. doi:10.​1093/​biomet/​86.​2.​365.CrossRef
Zurück zum Zitat Hirano, K., Imbens, G. W., Rubin, D. B., & Zhou, X. (2000). Assessing the effect of influenza vaccine in an encouragement design with covariates. Biostatistics (Oxford, England), 1, 69–88. doi:10.1093/biostatistics/1.1.69. Hirano, K., Imbens, G. W., Rubin, D. B., & Zhou, X. (2000). Assessing the effect of influenza vaccine in an encouragement design with covariates. Biostatistics (Oxford, England), 1, 69–88. doi:10.​1093/​biostatistics/​1.​1.​69.
Zurück zum Zitat Ialongo, N., Werthamer, L., Brown, C. H., Kellam, S., & Wai, S. B. (1999). The proximal impact of two first grade preventive interventions on the early risk behaviors for later substance abuse, depression and antisocial behavior. American Journal of Community Psychology, 27, 599–642. doi:10.1023/A:1022137920532.PubMedCrossRef Ialongo, N., Werthamer, L., Brown, C. H., Kellam, S., & Wai, S. B. (1999). The proximal impact of two first grade preventive interventions on the early risk behaviors for later substance abuse, depression and antisocial behavior. American Journal of Community Psychology, 27, 599–642. doi:10.​1023/​A:​1022137920532.PubMedCrossRef
Zurück zum Zitat Lin, J. Y., Ten Have, T. R., & Elliott, M. R. (2008). Longitudinal nested compliance class model in the presence of time-varying noncompliance. Journal of the American Statistical Association, 103, 462–473.CrossRef Lin, J. Y., Ten Have, T. R., & Elliott, M. R. (2008). Longitudinal nested compliance class model in the presence of time-varying noncompliance. Journal of the American Statistical Association, 103, 462–473.CrossRef
Zurück zum Zitat Muñoz, R. F., Le, H. N., Ghosh Ippen, C., Diaz, M. A., Urizar Jr, G. G., Soto, J., et al. (2007). Prevention of postpartum depression in low-income women: Development of the Mamás y Bebés/Mothers and Babies Course. Cognitive and Behavioral Practice, 14, 70–83. doi:10.1016/j.cbpra.2006.04.021.CrossRef Muñoz, R. F., Le, H. N., Ghosh Ippen, C., Diaz, M. A., Urizar Jr, G. G., Soto, J., et al. (2007). Prevention of postpartum depression in low-income women: Development of the Mamás y Bebés/Mothers and Babies Course. Cognitive and Behavioral Practice, 14, 70–83. doi:10.​1016/​j.​cbpra.​2006.​04.​021.CrossRef
Zurück zum Zitat Muthén, L. K., & Muthén, B. O. (1998–2007). Mplus user’s guide (5th ed.). Los Angeles, CA: Author. Muthén, L. K., & Muthén, B. O. (1998–2007). Mplus user’s guide (5th ed.). Los Angeles, CA: Author.
Zurück zum Zitat R Core Development Team. (2007). R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing. ISBN 3-900051-07-0. www.r-project.org. R Core Development Team. (2007). R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing. ISBN 3-900051-07-0. www.​r-project.​org.
Zurück zum Zitat Rosenbaum, P. R. (2002). Observational studies (2nd ed.). New York: Springer. Rosenbaum, P. R. (2002). Observational studies (2nd ed.). New York: Springer.
Zurück zum Zitat SPSS Inc. (2007). SPSS Base 16.0 for Windows. Chicago, IL: Author. SPSS Inc. (2007). SPSS Base 16.0 for Windows. Chicago, IL: Author.
Zurück zum Zitat Stata Corp. (2007). Stata statistical software: Release 10. College Station, TX: Author. Stata Corp. (2007). Stata statistical software: Release 10. College Station, TX: Author.
Zurück zum Zitat Werthamer-Larsson, L., Kellam, S. G., & Wheeler, L. (1991). Effect of first-grade classroom environment on child shy behavior, aggressive behavior, and concentration problems. American Journal of Community Psychology, 19, 585–602. doi:10.1007/BF00937993.PubMedCrossRef Werthamer-Larsson, L., Kellam, S. G., & Wheeler, L. (1991). Effect of first-grade classroom environment on child shy behavior, aggressive behavior, and concentration problems. American Journal of Community Psychology, 19, 585–602. doi:10.​1007/​BF00937993.PubMedCrossRef
Metadaten
Titel
Estimating Intervention Effects of Prevention Programs: Accounting for Noncompliance
verfasst von
Elizabeth A. Stuart
Deborah F. Perry
Huynh-Nhu Le
Nicholas S. Ialongo
Publikationsdatum
01.12.2008
Verlag
Springer US
Erschienen in
Prevention Science / Ausgabe 4/2008
Print ISSN: 1389-4986
Elektronische ISSN: 1573-6695
DOI
https://doi.org/10.1007/s11121-008-0104-y

Weitere Artikel der Ausgabe 4/2008

Prevention Science 4/2008 Zur Ausgabe