Skip to main content
Erschienen in: Trials 1/2019

Open Access 01.12.2019 | Update

Protocol update and statistical analysis plan for CADENCE-BZ: a randomized clinical trial to assess the efficacy of sodium benzoate as an adjunctive treatment in early psychosis

verfasst von: Carmen Lim, Andrea Baker, Sukanta Saha, Sharon Foley, Anne Gordon, David Ward, Bjorn Burgher, Frances Dark, Martin Beckmann, Stephen Stathis, George Bruxner, Alex Ryan, Drew Richardson, Sean Hatherill, Michael Berk, Olivia Dean, John McGrath, James Scott, Cadence Working Group

Erschienen in: Trials | Ausgabe 1/2019

Abstract

Background

CADENCE-BZ is a multi-centre, parallel-group, double-blind randomized controlled trial designed to examine the clinical efficacy and safety of an accessible food preservative, sodium benzoate, as an add-on treatment for patients with early psychosis. The original study protocol was published in 2017. Here, we describe the updated protocol along with the Statistical Analysis Plan (SAP) for the CADENCE-BZ trial prior to study completion.

Methods and materials

Two important changes were made to the original protocol: (1) improvements to our statistical analysis plan permitted a reduction in sample size; and (2) a revision in the secondary outcomes with the intent of reducing redundancy and excluding those measures that were not appropriate as outcomes.

Conclusions

We provide the updated SAP prior to the completion of the study with the intent of increasing the transparency of the data analyses for CADENCE-BZ. The final participants are currently completing the study and the results will be published in the near future.

Trial registration

Australian New Zealand Clinical Trials Registry (ACTRN12615000187​549). Registered on 26th February 2015.
Abkürzungen
AQoL
Assessment of Quality of Life
AR (1)
First order autoregressive
CGI
Clinical Global Impression (CGI)
CONSORT
Consolidated standards of reporting trials
GAF
Global Assessment of Functioning
GLMM
Generalized linear mixed model
HDRS
Hamilton Depression Rating Scale
IPAQ
International Physical Activity Questionnaire
MMRM
Mixed-effects model repeated measures
OTI
Opiate Treatment Index
PANSS
Positive and Negative Syndrome Scale
PAQ
Physical Activity Questionnaire
PGI-I
Patient global impression
SAP
Statistical analysis plan
SAS
Statistical analysis system
SIMPAQ
Simple Physical Activity Questionnaire

Background

This paper provides the detailed statistical analysis plan (SAP) and outlines changes to the CADENCE–BZ study protocol. The original detailed protocol has been previously published [1]. CADENCE-BZ is a multi-centre, parallel-group, double-blind randomized controlled trial designed to examine the clinical efficacy and safety of an accessible food preservative, sodium benzoate, as an add-on treatment for patients with early psychosis. The trial was approved by the Metro South Hospital and Health Services Human Research Ethics Committee (HREC reference number HREC/14/QPAH/598). The primary objective was to determine if 12-week treatment with 1000 mg (500 mg twice daily (BD)) of sodium benzoate improves the Positive and Negative Syndrome Scale (PANSS) total score [2] compared to placebo.
The last participant was recruited in August 2018 with the final follow-up visit anticipated to be completed in October 2018. This protocol update and SAP were written to prevent outcome reporting bias [3], selective reporting [4], and data-driven results.

Revised secondary outcomes

Eleven outcomes were listed in the original study protocol. This includes the primary outcome, the PANSS total score, and the secondary outcomes: (1) the Global Assessment of Functioning (GAF), (2) the Clinical Global Impression (CGI), (3) the Hamilton Depression Rating Scale (HDRS), (4) the Assessment of Quality of Life (AQoL), (5) the Opiate Treatment Index (OTI), (6) the Activity and Participation Questionnaire (APQ-6), (7) the International Physical Activity Questionnaire (IPAQ), (8) the Simple Physical Activity Questionnaire (SIMPAQ), (9) the Physical Activity Questionnaire (PAQ), and (10) the Patient Global Impression (PGI-I).
The following secondary outcomes will be excluded from the protocol: (i) APQ6, which is a measure of vocational activity and community participation—no studies have demonstrated the APQ6 has sensitivity to change [5]. By contrast, the AQoL, a 12-item measure of functioning and quality of life which was included in the original protocol, was used previously in a study of sodium benzoate in participants with chronic schizophrenia [6]. As both the AQoL and the APQ6 measure similar domains, it was decided to exclude the APQ6. (ii) IPAQ, SIMPAQ, PAQ—these three scales measure physical activity and were only collected at baseline. They are therefore unable to be used as outcomes and have thus been excluded. (iii) The Opiate Treatment Index (OTI) is a comprehensive evaluation tool that assesses drug and alcohol use over the previous month. Drug and alcohol use were considered as confounding variables rather than outcomes and the OTI was therefore excluded.

Updated sample size and power

Our original sample size was based on two-sample t-test and utilised the conservative assumptions that there are few or no correlations between the baseline and follow-up measures, and that there are perfect correlations between follow-up measures [7]. Our sample size was reduced from 160 to 100 after we adjusted our SAP. We recalculated our sample size by revising our assumptions regarding the correlations for a variety of covariance structures and the number of repeated measures. This strategy has advantages from an ethical perspective (i.e., fewer patients need to be randomized, less exposure to potential adverse events or lack of efficacy) and with regard to cost-effectiveness (the study can be completed earlier). Using a two-tailed test with alpha set at 0.05 and 90% power, to detect a minimum clinical meaningful difference in total PANSS score of at least 5 units (SD = 14.3) between both treatment arms, we determined that we needed a sample of 39 persons in each group. This assumes the correlation between baseline and follow-up measurements is at least 0.6 and the correlation between various follow-up measurements is at most 0.5. Over a 12-week period, we predicted an attrition rate of 20%. Thus, we revised our sample size down to randomize 100 subjects and this amendment was recorded in the Australian New Zealand Clinical Trials Registry.

Statistical analysis plan

Data analysis and reporting

Data analysis and reporting will be done in accordance to the CONSORT guideline [8]. The CONSORT diagram comprising the number of participants who were screened, eligible, randomized, receiving their allocated treatment, withdrawn from/lost to follow-up along with reasons will be provided. All statistical tests will be carried out at the 5% (two-sided) significance level unless otherwise specified. Estimates along with 95% confidence intervals and associated p values will be reported. All analysis will be carried out using the SAS software version 9.4. Other software such as R may be used if required.

Definition of intention-to-treat and per-protocol population

The analysis will be performed based on intention-to-treat. This will include all randomized participants who complied with the study protocol through the duration of the clinical trial, as well as participants who deviated from the study protocol. We defined treatment compliance as the average number of pills taken per day divided by daily protocol dosage (in this case, two pills per day). The analysis will be performed in the per-protocol population by including participants (1) that stayed on the trial for 12 weeks and (2) whose treatment compliance was ≥ 80% (3) with absence of major protocol violation.

Missing values

A recent simulation study has revealed that mixed-effects model repeated measures (MMRM) analysis is robust in maintaining statistical properties of a test when compared to the multiple imputation method in handling missing values [9], assuming that participants dropping out of the study is unrelated to outcome conditioned on the study covariates (missing at random assumption). We will not be imputing missing data in the study outcomes.

Comparison of characteristics at baseline

Comparisons of participants at baseline will be undertaken for the outcome measures and for the following characteristics: sex, age, living situation, waist circumference, height, blood pressure, and body mass index. Continuous data will be summarized by means and standard deviation. Categorical data will be summarized by number and percentages. Significant test (χ2, t-test) will be computed to compare both treatment groups for each baseline characteristic. These baseline characteristics will be included as a covariate in the multivariable analysis to account for any imbalance that may have occurred by chance between the treatment groups. It is recommended that these variables are adjusted in assessing the primary outcome [10, 11].

Analysis of primary outcome

The primary outcome measure is the total score of PANSS. Primary outcome will be analysed using MMRM [12]. We will include treatment group, week, and treatment–week interaction as fixed effects and intercept as random effects in the model. We will use the first order autoregressive (AR) as the covariance structure of the MMRM model. The AR structure has the following characteristics: (1) it has homogenous variances and correlations that decline exponentially with time (i.e., two measurements that are in closer proximity in time are more strongly correlated (conditioned on ρ) than those that are more distant in time); and (2) it is appropriate when time periods are evenly spaced. We will also examine the residual to assess model assumptions and goodness-of-fit.

Analysis of secondary outcomes

Table 1 provides a summary of methods of analysis for each secondary outcome. We will use the Bonferroni method [13] to appropriately adjust for the overall level of significance for multiple secondary outcomes. There are no pre-planned subgroup analyses.
Table 1
Variables/measures and method of analysis
Secondary outcomes Variable/outcome
Hypothesis
Outcome measure
Method of analysis
PANSS subscales
Improvement occurred
Score [continuous]
MMRM
GAF
Score [continuous]
MMRM
CGI
Scale [categorical]: Normal–moderate (1–4) vs severe (> 5)
Generalized linear mixed model (GLMM)
HDRS
Score [continuous]
MMRM
AQoL
Score [continuous]
MMRM
PGI-I
Scale [categorical]
Chi-squared test

Safety outcomes

The number of treatment-related adverse events (AE) and serious adverse events (SAE) will be reported by their relationship as ‘definitely’, ‘probably’, and ‘possibly’ related to treatment. The number (and percentage) of participants with each AE/SAE will be presented for each treatment arm categorised by (1) preferred term (2), body system, (3) severity. The number (and percentage) of occurrences of each AE/SAE will also be presented for each treatment arm. No formal statistical testing will be undertaken.

Conclusions

This update contains the SAP for the CADENCE-BZ trial to avoid the risk of outcome reporting bias and data-driven results. By publishing this where we pre-specify our methods and analyses, it is hoped that the results will be as robust and transparent as possible.

Acknowledgements

We acknowledge contributions from members of the Cadence Working Group: Justin Chapman, Susan Patterson, Saveena Singh, Bryan Mowry, Linda Tracy, Michael Duhig, Amy Machin, Elizabeth Troman, Shuichi Suetani, Thomas Dinala, Lucinda Burton, Peter Cosgrove and Clare Gamble. We also acknowledge the support of Alison Bowers (West Moreton Human Research Ethics Committee) and Rebecca Lacey (Metro South Human Research Ethics Committee).

Funding

JJM received the John Cade Fellowship APP1056929 from the National Health and Medical Research Council and the Niels Bohr Professorship from the Danish National Research Foundation. JGS is supported by a National Health and Medical Research Council Practitioner Fellowship (Grant APP1105807). MB is supported by a NHMRC Senior Principal Research Fellowship (1059660 and 1156072).

Availability of data and materials

No additional data available.
This amendment to the statistical analysis was approved by the Metro South Human Research Ethics Committee and by the independent Data Safety Monitoring Board established for the conduct of the trial. The trial was funded by the National Health and Medical Research Council (NHMRC) John Cade Fellowship APP1056929 who did not require us to submit a protocol. The NHMRC are updated of the study progress in annual progress reports of the studies. Consent was not applicable for this amendment.
Not applicable.

Competing interests

MB has received grant support from NIH, Simons Autism Foundation, Cancer Council of Victoria, CRC for Mental Health, Stanley Medical Research Foundation, MBF, NHMRC, Beyond Blue, Geelong Medical Research Foundation, Bristol Myers Squibb, Eli Lilly, GlaxoSmithKline, Organon, Novartis, Mayne Pharma, and Servier. MB has been a speaker for Astra Zeneca, Bristol Myers Squibb, Eli Lilly, GlaxoSmithKline, Janssen Cilag, Lundbeck, Merck, Pfizer, Sanofi Synthelabo, Servier, and Solvay and Wyeth and served as a consultant to Astra Zeneca, Bristol Myers Squibb, Eli Lilly, GlaxoSmithKline, Janssen Cilag, Lundbeck, and Servier. JGS has served on advisory boards of Roche, Lundbeck, Otsuka, and Janssen Cilag. JGS has been a speaker for Lundbeck, Otsuka, Servier, and Janssen Cilag. OMD is a R.D. Wright NHMRC Biomedical Research Fellow and has received grant support from the Brain and Behavior Foundation, Simons Autism Foundation, Stanley Medical Research Institute, Deakin University, Lilly, NHMRC, and ASBDD/Servier. She has also received kind support from BioMedica Nutracuticals, NutritionCare, and Bioceuticals. FD has no conflict of interest for this protocol but she received honoraria from Lundbeck and Janssen in the last 2 years. The other authors have no conflicts to declare.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://​creativecommons.​org/​licenses/​by/​4.​0/​), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://​creativecommons.​org/​publicdomain/​zero/​1.​0/​) applies to the data made available in this article, unless otherwise stated.
Literatur
1.
Zurück zum Zitat Ryan A, Baker A, Dark F, et al. The efficacy of sodium benzoate as an adjunctive treatment in early psychosis - CADENCE-BZ: study protocol for a randomized controlled trial. Trials. 2017;18:165.CrossRef Ryan A, Baker A, Dark F, et al. The efficacy of sodium benzoate as an adjunctive treatment in early psychosis - CADENCE-BZ: study protocol for a randomized controlled trial. Trials. 2017;18:165.CrossRef
2.
Zurück zum Zitat Kay SR, Fiszbein A, Opler LA. The Positive and Negative Syndrome Scale (PANSS) for schizophrenia. Schizophr Bull. 1987;13:261–76.CrossRef Kay SR, Fiszbein A, Opler LA. The Positive and Negative Syndrome Scale (PANSS) for schizophrenia. Schizophr Bull. 1987;13:261–76.CrossRef
3.
Zurück zum Zitat Ioannidis JP, Caplan AL, Dal-Ré R. Outcome reporting bias in clinical trials: why monitoring matters. BMJ. 2017;356:j408. Ioannidis JP, Caplan AL, Dal-Ré R. Outcome reporting bias in clinical trials: why monitoring matters. BMJ. 2017;356:j408.
4.
Zurück zum Zitat Jones CW, Keil LG, Holland WC, et al. Comparison of registered and published outcomes in randomized controlled trials: a systematic review. BMC Med. 2015;13:282.CrossRef Jones CW, Keil LG, Holland WC, et al. Comparison of registered and published outcomes in randomized controlled trials: a systematic review. BMC Med. 2015;13:282.CrossRef
5.
Zurück zum Zitat Coombs T, Nicholas A, Pirkis J. A review of social inclusion measures. Aust N Z J Psychiatry. 2013;47:906–19.CrossRef Coombs T, Nicholas A, Pirkis J. A review of social inclusion measures. Aust N Z J Psychiatry. 2013;47:906–19.CrossRef
6.
Zurück zum Zitat Lane HY, Lin CH, Green MF, et al. Add-on treatment of benzoate for schizophrenia: a randomized, double-blind, placebo-controlled trial of D-amino acid oxidase inhibitor. JAMA Psychiatry. 2013;70:1267–75.CrossRef Lane HY, Lin CH, Green MF, et al. Add-on treatment of benzoate for schizophrenia: a randomized, double-blind, placebo-controlled trial of D-amino acid oxidase inhibitor. JAMA Psychiatry. 2013;70:1267–75.CrossRef
7.
Zurück zum Zitat Morgan TM, Case LD. Conservative sample size determination for repeated measures analysis of covariance. Ann Biom Biostat. 2013;1:1002.PubMedPubMedCentral Morgan TM, Case LD. Conservative sample size determination for repeated measures analysis of covariance. Ann Biom Biostat. 2013;1:1002.PubMedPubMedCentral
8.
Zurück zum Zitat Schulz KF, Altman DG, Moher D, et al. CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials. PLoS Med. 2010;7:e1000251.CrossRef Schulz KF, Altman DG, Moher D, et al. CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials. PLoS Med. 2010;7:e1000251.CrossRef
9.
Zurück zum Zitat Siddiqui O. MMRM versus MI in dealing with missing data--a comparison based on 25 NDA data sets. J Biopharm Stat. 2011;21:423–36.CrossRef Siddiqui O. MMRM versus MI in dealing with missing data--a comparison based on 25 NDA data sets. J Biopharm Stat. 2011;21:423–36.CrossRef
10.
Zurück zum Zitat Steyerberg EW, Bossuyt PM, Lee KL. Clinical trials in acute myocardial infarction: should we adjust for baseline characteristics? Am Heart J. 2000;139:745–51.CrossRef Steyerberg EW, Bossuyt PM, Lee KL. Clinical trials in acute myocardial infarction: should we adjust for baseline characteristics? Am Heart J. 2000;139:745–51.CrossRef
11.
Zurück zum Zitat Moher D, Hopewell S, Schulz KF, et al. CONSORT 2010 Explanation and Elaboration: updated guidelines for reporting parallel group randomised trials. BMJ. 2010;340:c869 Moher D, Hopewell S, Schulz KF, et al. CONSORT 2010 Explanation and Elaboration: updated guidelines for reporting parallel group randomised trials. BMJ. 2010;340:c869
12.
Zurück zum Zitat Detry MA, Ma Y. Analyzing repeated measurements using mixed models. JAMA. 2016;315:407–8.CrossRef Detry MA, Ma Y. Analyzing repeated measurements using mixed models. JAMA. 2016;315:407–8.CrossRef
13.
Zurück zum Zitat Armstrong RA. When to use the Bonferroni correction. Ophthalmic Physiol Opt. 2014;34:502–8.CrossRef Armstrong RA. When to use the Bonferroni correction. Ophthalmic Physiol Opt. 2014;34:502–8.CrossRef
Metadaten
Titel
Protocol update and statistical analysis plan for CADENCE-BZ: a randomized clinical trial to assess the efficacy of sodium benzoate as an adjunctive treatment in early psychosis
verfasst von
Carmen Lim
Andrea Baker
Sukanta Saha
Sharon Foley
Anne Gordon
David Ward
Bjorn Burgher
Frances Dark
Martin Beckmann
Stephen Stathis
George Bruxner
Alex Ryan
Drew Richardson
Sean Hatherill
Michael Berk
Olivia Dean
John McGrath
James Scott
Cadence Working Group
Publikationsdatum
01.12.2019
Verlag
BioMed Central
Erschienen in
Trials / Ausgabe 1/2019
Elektronische ISSN: 1745-6215
DOI
https://doi.org/10.1186/s13063-019-3232-8

Weitere Artikel der Ausgabe 1/2019

Trials 1/2019 Zur Ausgabe