Skip to main content
Erschienen in: Prevention Science 5/2017

22.04.2017

Beyond the Primary Endpoint Paradigm: A Test of Intervention Effect in HIV Behavioral Intervention Trials with Numerous Correlated Outcomes

verfasst von: Jessica M. Harwood, Robert E. Weiss, W. Scott Comulada

Erschienen in: Prevention Science | Ausgabe 5/2017

Einloggen, um Zugang zu erhalten

Abstract

Behavioral interventions are increasingly based on holistic approaches to health with an understanding that health-related behaviors are linked. A motivating example is provided by the Philani study, an intervention trial conducted to improve the health of South African mothers and their children. Inter-related health problems around maternal alcohol use, malnutrition, and HIV were addressed; multiple endpoints were targeted. The traditional hypothesis testing paradigm that tests significance on one primary outcome did not suffice. Past multiple endpoint studies have utilized a sign test on the number of estimated differences between treatment and control that favor the intervention. However, in order to preserve type 1 error, one must account for correlations among the outcomes. We propose an alternative approach that counts the number of significant treatment-control differences. Monte Carlo simulation is used to adjust for correlation, providing updated critical values and p values. Our method is implemented through an R package and applied to the Philani data to test the intervention’s overall effect.
Literatur
Zurück zum Zitat Aral, S. O., & Peterman, T. A. (1996). Measuring outcomes of behavioural interventions for STD/HIV prevention. International Journal of STD & AIDS, 7(Suppl 2), 30–38.CrossRef Aral, S. O., & Peterman, T. A. (1996). Measuring outcomes of behavioural interventions for STD/HIV prevention. International Journal of STD & AIDS, 7(Suppl 2), 30–38.CrossRef
Zurück zum Zitat Benjamini, Y., & Hochberg, Y. (1995). Controlling the false discovery rate: A practical and powerful approach to multiple testing. Journal of the Royal Statistical Society. Series B (Methodological), 57(1), 289–300. Benjamini, Y., & Hochberg, Y. (1995). Controlling the false discovery rate: A practical and powerful approach to multiple testing. Journal of the Royal Statistical Society. Series B (Methodological), 57(1), 289–300.
Zurück zum Zitat Benjamini, Y., & Yekutieli, D. (2001). The control of the false discovery rate in multiple testing under dependency. The Annals of Statistics, 29(4), 1165–1188.CrossRef Benjamini, Y., & Yekutieli, D. (2001). The control of the false discovery rate in multiple testing under dependency. The Annals of Statistics, 29(4), 1165–1188.CrossRef
Zurück zum Zitat Brozek, J., & Tiede, K. (1952). Reliable and questionable significance in a series of statistical tests. Psychological Bulletin, 49(4:1), 339–341.CrossRefPubMed Brozek, J., & Tiede, K. (1952). Reliable and questionable significance in a series of statistical tests. Psychological Bulletin, 49(4:1), 339–341.CrossRefPubMed
Zurück zum Zitat Cordoba, G., Schwartz, L., Woloshin, S., Bae, H., & Gøtzsche, P. C. (2010). Definition, reporting, and interpretation of composite outcomes in clinical trials: Systematic review. BMJ (Clinical Research Ed.), 341, c3920.CrossRef Cordoba, G., Schwartz, L., Woloshin, S., Bae, H., & Gøtzsche, P. C. (2010). Definition, reporting, and interpretation of composite outcomes in clinical trials: Systematic review. BMJ (Clinical Research Ed.), 341, c3920.CrossRef
Zurück zum Zitat Daniel, W. W. (2009). Biostatistics: A foundation for analysis in the health sciences. Hoboken, NJ: Wiley. Daniel, W. W. (2009). Biostatistics: A foundation for analysis in the health sciences. Hoboken, NJ: Wiley.
Zurück zum Zitat Fishbein, M., & Pequegnat, W. (2000). Evaluating AIDS prevention interventions using behavioral and biological outcome measures. Sexually Transmitted Diseases, 27(2), 101–110.CrossRefPubMed Fishbein, M., & Pequegnat, W. (2000). Evaluating AIDS prevention interventions using behavioral and biological outcome measures. Sexually Transmitted Diseases, 27(2), 101–110.CrossRefPubMed
Zurück zum Zitat Gibson, D. R., & Young, M. (1994). Importance of appropriate outcome measures in HIV behavioral research. Journal of Acquired Immune Deficiency Syndromes, 7(6), 631–632.PubMed Gibson, D. R., & Young, M. (1994). Importance of appropriate outcome measures in HIV behavioral research. Journal of Acquired Immune Deficiency Syndromes, 7(6), 631–632.PubMed
Zurück zum Zitat Grønhaug, K., Heide, M., & Gitlesen, J. P. (2000). Sign tests when observations are correlated: A simulation study. Scandinavian Journal of Educational Research, 44(3), 325–334. doi:10.1080/713696672.CrossRef Grønhaug, K., Heide, M., & Gitlesen, J. P. (2000). Sign tests when observations are correlated: A simulation study. Scandinavian Journal of Educational Research, 44(3), 325–334. doi:10.​1080/​713696672.CrossRef
Zurück zum Zitat Hartwell, T. D., Pequegnat, W., Moore, J. L., Parker, C. B., Strader, L. C., Green, A. M., & NIMH Collaborative HIV/STD Prevention Trial Group. (2013). The utility of a composite biological endpoint in HIV/STI prevention trials. AIDS and Behavior, 17(9), 2893–2901. doi:10.1007/s10461-013-0501-5.CrossRefPubMedPubMedCentral Hartwell, T. D., Pequegnat, W., Moore, J. L., Parker, C. B., Strader, L. C., Green, A. M., & NIMH Collaborative HIV/STD Prevention Trial Group. (2013). The utility of a composite biological endpoint in HIV/STI prevention trials. AIDS and Behavior, 17(9), 2893–2901. doi:10.​1007/​s10461-013-0501-5.CrossRefPubMedPubMedCentral
Zurück zum Zitat Jones, L. V., & Fiske, D. W. (1953). Models for testing the significance of combined results. Psychological Bulletin, 50(5), 375–382.CrossRefPubMed Jones, L. V., & Fiske, D. W. (1953). Models for testing the significance of combined results. Psychological Bulletin, 50(5), 375–382.CrossRefPubMed
Zurück zum Zitat le Roux, I. M., Tomlinson, M., Harwood, J. M., O’Connor, M. J., Worthman, C. M., Mbewu, N., et al. (2013). Outcomes of home visits for pregnant mothers and their infants: A cluster randomized controlled trial. AIDS (London, England), 27(9), 1461–1471. doi:10.1097/QAD.0b013e3283601b53.CrossRef le Roux, I. M., Tomlinson, M., Harwood, J. M., O’Connor, M. J., Worthman, C. M., Mbewu, N., et al. (2013). Outcomes of home visits for pregnant mothers and their infants: A cluster randomized controlled trial. AIDS (London, England), 27(9), 1461–1471. doi:10.​1097/​QAD.​0b013e3283601b53​.CrossRef
Zurück zum Zitat Onwuegbuzie, A. J., Levin, J. R., & Ferron, J. M. (2011). A binomial test of group differences with correlated outcome measures. Journal of Experimental Education, 79(2), 127–142.CrossRef Onwuegbuzie, A. J., Levin, J. R., & Ferron, J. M. (2011). A binomial test of group differences with correlated outcome measures. Journal of Experimental Education, 79(2), 127–142.CrossRef
Zurück zum Zitat R Development Core Team. (2006). BINOMCORR.TEST. R: A language and environment for statistical computing, Vienna, Austria: R Foundation for Statistical Computing. Retrieved from http://www.R-project.org R Development Core Team. (2006). BINOMCORR.TEST. R: A language and environment for statistical computing, Vienna, Austria: R Foundation for Statistical Computing. Retrieved from http://​www.​R-project.​org
Zurück zum Zitat Sakoda, J. M., Cohen, B. H., & Beall, G. (1954). Test of significance for a series of statistical tests. Psychological Bulletin, 51(2:1), 172–175.CrossRefPubMed Sakoda, J. M., Cohen, B. H., & Beall, G. (1954). Test of significance for a series of statistical tests. Psychological Bulletin, 51(2:1), 172–175.CrossRefPubMed
Zurück zum Zitat Siegel, S. (1988). Nonparametric statistics for the behavioral sciences (2nd ed.). New York: McGraw-Hill. Siegel, S. (1988). Nonparametric statistics for the behavioral sciences (2nd ed.). New York: McGraw-Hill.
Zurück zum Zitat Turk, D. C., Dworkin, R. H., McDermott, M. P., Bellamy, N., Burke, L. B., Chandler, J. M., et al. (2008). Analyzing multiple endpoints in clinical trials of pain treatments: IMMPACT recommendations. Initiative on methods, measurement, and pain assessment in clinical trials. Pain, 139(3), 485–493. doi:10.1016/j.pain.2008.06.025.CrossRefPubMed Turk, D. C., Dworkin, R. H., McDermott, M. P., Bellamy, N., Burke, L. B., Chandler, J. M., et al. (2008). Analyzing multiple endpoints in clinical trials of pain treatments: IMMPACT recommendations. Initiative on methods, measurement, and pain assessment in clinical trials. Pain, 139(3), 485–493. doi:10.​1016/​j.​pain.​2008.​06.​025.CrossRefPubMed
Zurück zum Zitat Westfall, PH. (2005). Combining P values. In: Encyclopedia of Biostatistics. New York: Wiley. Westfall, PH. (2005). Combining P values. In: Encyclopedia of Biostatistics. New York: Wiley.
Zurück zum Zitat Wilkinson, B. (1951). A statistical consideration in psychological research. Psychological Bulletin, 48(3), 156–158.CrossRefPubMed Wilkinson, B. (1951). A statistical consideration in psychological research. Psychological Bulletin, 48(3), 156–158.CrossRefPubMed
Metadaten
Titel
Beyond the Primary Endpoint Paradigm: A Test of Intervention Effect in HIV Behavioral Intervention Trials with Numerous Correlated Outcomes
verfasst von
Jessica M. Harwood
Robert E. Weiss
W. Scott Comulada
Publikationsdatum
22.04.2017
Verlag
Springer US
Erschienen in
Prevention Science / Ausgabe 5/2017
Print ISSN: 1389-4986
Elektronische ISSN: 1573-6695
DOI
https://doi.org/10.1007/s11121-017-0788-y

Weitere Artikel der Ausgabe 5/2017

Prevention Science 5/2017 Zur Ausgabe