Skip to main content
Erschienen in: Trials 1/2018

Open Access 01.12.2018 | Update

Statistical analysis plan for a cluster-randomized crossover trial comparing the effectiveness and safety of a flexible family visitation model for delirium prevention in adult intensive care units (the ICU Visits Study)

verfasst von: Daniel Sganzerla, Cassiano Teixeira, Caroline Cabral Robinson, Renata Kochhann, Mariana Martins Siqueira Santos, Rafaela Moraes de Moura, Mirceli Goulart Barbosa, Daiana Barbosa da Silva, Tarissa Ribeiro, Cláudia Eugênio, Daniel Schneider, Débora Mariani, Rodrigo Wiltgen Jeffman, Fernando Bozza, Alexandre Biasi Cavalcanti, Luciano Cesar Pontes Azevedo, Flávia Ribeiro Machado, Jorge Ibrain Salluh, José Augusto Santos Pellegrini, Rafael Barberena Moraes, Lucas Petri Damiani, Nilton Brandão da Silva, Maicon Falavigna, Regis Goulart Rosa

Erschienen in: Trials | Ausgabe 1/2018

Abstract

Background

Most adult intensive care units (ICUs) worldwide adopt restrictive family visitation models (RFVMs). However, evidence, mostly from non-randomized studies, suggests that flexible adult ICU visiting hours are safe policies that can result in benefits such as prevention of delirium and increase in satisfaction with care. Accordingly, the ICU Visits Study was designed to compare the effectiveness and safety of a flexible family visitation model (FFVM) vs. an RFVM on delirium prevention among ICU patients, and also to analyze its potential effects on family members and ICU professionals.

Methods/design

The ICU Visits Study is a cluster-randomized crossover trial which compares an FFVM (12 consecutive ICU visiting hours per day) with an RFVM (< 4.5 ICU visiting hours per day) in 40 Brazilian adult ICUs. Participant ICUs are randomly assigned to either an FFVM or RFVM in a 1:1 ratio. After enrollment and follow-up of 25 patients, each ICU is crossed over to the other visitation model, until 25 more patients per site are enrolled and followed. The primary outcome is the cumulative incidence of delirium measured by the Confusion Assessment Method for the ICU. Secondary and tertiary outcomes include relevant measures of effectiveness and safety of ICU visiting policies among patients, family members, and ICU professionals. Herein, we describe all primary statistical procedures that will be used to evaluate the results and perform exploratory and sensitivity analyses of this study. This pre-specified statistical analysis plan was written and submitted without knowledge of the study data.

Discussion

This a priori statistical analysis plan aims to enhance the transparency of our study, facilitating unbiased analyses of ICU visit study data, and provide guidance for statistical analysis for groups conducting studies in the same field.

Trial registration

ClinicalTrials.gov, NCT02932358. Registered on 11 October 2016.
Abkürzungen
APACHE-II
Acute Physiology and Chronic Health Evaluation-II
BSI
Bloodstream infection
CAM-ICU
Confusion Assessment Method for the Intensive Care Unit
CCFNI
Critical Care Family Needs Inventory
CDC
Centers for Disease Control and Prevention
CI
Confidence interval
CONSORT
Consolidated Standards of Reporting Trials
FFVM
Flexible family visitation model
HADS
Hospital Anxiety and Depression Scale
HR
Hazard ratio
ICU
Intensive care unit
IQR
Interquartile range
MBI
Maslach Burnout Inventory
MD
Mean difference
PR
Prevalence ratio
PRE-DELIRIC
PREdiction of DELIRium in ICU patients
RASS
Richmond Agitation-Sedation Scale
RFVM
Restrictive family visitation model
RR
Risk ratio
SAP
Statistical analysis plan
SD
Standard deviation
SOFA
Sequential Organ Failure Assessment
USD
United States dollars
UTI
Urinary tract infection

Background

The recognition of the important role of family members in the intensive care unit (ICU) is the cornerstone of patient-centered care [1]. Beyond the justification of humanization, this strategy is proposed as a means to improve patient and family member outcomes [2]. In this context, small studies with a predominant before and after design have shown an association between flexible ICU visiting hours and reduced incidence of delirium in patients and increased satisfaction with care in family members [35]. Despite the growing recognition of the importance of family presence in the ICU, most ICUs around the world still adopt restricted visiting hours motivated by the ICU professionals’ perceptions of increased risk of disorganization of care, infection transmission, and burnout [69]. Unfortunately, few randomized studies have focused on the evaluation of the impact of different ICU visiting models on patients, family members, and ICU professionals, and this lack of evidence may constitute a barrier to the implementation of patient-centered care interventions in the ICU. The ICU Visits Study aims to investigate the effectiveness and safety of a flexible family visitation model (FFVM) vs. a restrictive family visitation model (RFVM) on delirium prevention among ICU patients, and to evaluate its potential benefits and hazards for family members and ICU professionals.
The present statistical analysis plan (SAP) aims to describe the trial’s analytical objectives and procedures before the end of the study recruitment and locking of the trial database to start analyses to comply with good clinical practice and avoid outcome reporting bias. This SAP was drafted without knowledge of any of the results of the investigators.

Trial overview

The ICU Visits Study is a cluster-randomized, crossover trial comparing an FFVM (12 consecutive ICU visiting hours per day) with an RFVM (< 4.5 ICU visiting hours per day) in Brazilian adult ICUs. The study background, design, rationale, eligibility criteria, and sample size have been previously published [10]. In brief, mixed adult ICUs of public and private philanthropic hospitals with a restrictive policy of ICU visiting hours (< 4.5 h/day) are randomly assigned to either an FFVM or RFVM in a 1:1 ratio until the recruitment and follow-up of 25 patients (phase 1) (Fig. 1). After a 30-day washout period without subject recruitment, each ICU is switched over to the other visitation model (phase 2) until 25 more patients per site are enrolled and followed. The randomization is stratified by the number of ICU beds (1 to 10 or > 10 ICU beds) and performed using random block sizes of 2, 4, and 6. Consecutive patients aged ≥18 years admitted to the ICU, their closest family members, and bedside ICU professionals in each cluster are considered eligible for the present trial. A complete description of the inclusion and exclusion criteria is shown in Table 1.
Table 1
Eligibility criteria
 
Inclusion criteria
Exclusion criteria
Cluster
Adult medical-surgical ICUs of public and philanthropic hospitals with at least six beds; restrictive policy of ICU visiting hours (< 4.5 h/day)
Structural or organizational impediments to flexible family visitation, according to the Brazilian resolution of minimal operational requirements for ICUsa
Patients
ICU patients aged ≥18 years
Coma (RASS − 4 or − 5) lasting > 96 h from the moment of first evaluation for recruitment; delirium at baseline (positive CAM-ICU); cerebral death; aphasia; severe hearing deficit; predicted ICU length of stay < 48 h; exclusive palliative treatment at ICU admission; unavailability of a family member to participate in the flexible family visits; unlikelihood to survive > 24 h; prisoner status; readmission to the ICU after enrollment in the study
Family members
Closest family member of a patient enrolled in the study
Family members who do not speak Portuguese or have serious difficulty in answering the self-applied questionnaires (e.g., due to illiteracy or severe visual or hearing limitations); having another family member already enrolled in the study
ICU professionals
Bedside ICU professionals (physicians, nurses, nursing technicians, and physiotherapists) who assist patients during daytime for at least 20 h/week at the enrolled ICU
ICU professionals who have a planned leave of absence of > 15 days during phase 1 of the study
CAM-ICU Confusion Assessment Method for the Intensive Care Unit, ICU intensive care unit, RASS Richmond Agitation-Sedation Scale
In the FFVM, patients are allowed to receive visits from one or two close family members for up to 12 consecutive hours each day. Family members who agree to join the family visits have to attend a structured meeting at the ICU in which they receive guidance about the ICU environment, common ICU treatments, rehabilitation and basic infection control practices, multidisciplinary work at the ICU, and information on palliative care and delirium prevention. Additionally, family members receive an information brochure and are encouraged to access a website, both of which are designed to explain what happens during and after an ICU stay to legitimize emotions and improve cooperation with relatives without increasing the ICU staff workload. In addition to family visitation, patients in the FFVM are allowed to receive social visits at specific time intervals (according to the local ICU policies) from friends or other family members who did not qualify for flexible family visitation. In the RFVM, patients are allowed visitors according to routine ICU practices, but limited to the maximum of 4.5 h of visitation per day. Visitors are not required to attend the structured meeting in the RFVM.
The study primary outcome is the cumulative incidence of delirium during the ICU stay measured by trained researchers using the Confusion Assessment Method for the ICU (CAM-ICU) [11]. Secondary outcomes include daily hazard of delirium, ventilator-free days at day 7, any ICU-acquired infections according to the Centers for Disease Control and Prevention (CDC) criteria [1214], ICU length of stay, and hospital mortality among the patients; symptoms of anxiety and depression measured by the Hospital Anxiety and Depression Scale (HADS) [15] and satisfaction measured by the Critical Care Family Needs Inventory (CCFNI) [16] among the family members; and prevalence of burnout syndrome evaluated by the Maslach Burnout Inventory (MBI) [17] among the ICU professionals. Tertiary outcomes include need for antipsychotic agents, need for mechanical restraints, unplanned loss of invasive devices (venous catheter, enteral tube, or urinary catheter), coma-free days at day 7, and ICU-acquired pneumonia, urinary tract infection, or bloodstream infection among the patients; self-perception of involvement in patient care among the family members; and satisfaction among the ICU professionals.

Statistical analysis plan

Overall principles

The main analysis for each outcome will be performed at the subject level using the intention-to-treat (ITT) principle, meaning that all participants with a recorded outcome will be included in the analysis and will be analyzed according to the treatment group to which they were randomized (FFVM or RFVM), independent of actual visiting hours. Moreover, all analyses will account for the cluster-randomized crossover design to ensure correct type I error rates and confidence intervals (CIs). A significance level of 0.05, adjusted for multiple comparisons when appropriate, will be used for all statistical comparisons. Analysis will start once all data to discharge for the last included patient have been obtained, the database has been cleaned and locked, and the SAP has been submitted for publication. The R Development Core Team software will be used for analysis [18].

Handling of missing data

We anticipate minimal missing values, given that the study variables will be determined during hospital stay by trained researchers. Nevertheless, the coordinator center will contact site investigators to retrieve any missing data values.
ICUs with incomplete subject recruitment (e.g., less than 50 patients) will be included in the primary analysis for the study outcomes considering all subjects available in the cluster. To assess the risk of bias related to ICUs that did not achieve the patient recruitment goal, multiple imputation techniques will be performed for the primary outcome and presented as sensitivity analyses. The missing values for the variables that compose the HADS, CCFNI, and MBI will be imputed, replacing the missing items with the mean of the answered items in the same subscale, if at least half of that subscale has been answered. The missing values for the variables that compose the PREdiction of DELIRium in ICU patients (PRE-DELIRIC) score will be imputed in a similar way as in the original study [19]. We will assume that if a variable is not determined, most likely the missing variable has a normal or negative value (e.g., no infection, no metabolic acidosis) or a mean value (e.g., Acute Physiology and Chronic Health Evaluation-II [APACHE-II] score) of the study population. We will not perform any imputation for the length of ICU visits per patient per day.

Definition of analysis sets

At the cluster level, the ITT population includes all randomized ICUs that recruited subjects, regardless of the degree of adherence to the study interventions or achievement of the patient recruitment goal (50 patients per ICU). At the subject level, the ITT population includes all participants, regardless of protocol deviations. This includes patients who did not receive any ICU visits and family members who did not visit patients during the ICU stay, as well as patients who received visits longer than the maximum limit of visiting hours in both study periods (FFVM and RFVM).

Statistical analyses

Patient flow

The flow of participants will be displayed in accordance with the Consolidated Standards of Reporting Trials (CONSORT) flow diagram (CONSORT 2010 statement: extension to cluster-randomized trials) [20]. This description will include information about eligibility criteria and follow-up losses at both cluster and subject levels.

Adherence to study interventions

The total length of visits per patient per day will be evaluated as the primary adherence variable to the study interventions. We will consider the length of stay of all visitors (whether family members or not) at the bedside of an enrolled patient during the ICU stay. For analytical purposes, we will not consider overlapping visiting hours in the total length of visits per patient per day (i.e., only the period in which there was at least one visitor [apart from the number of visitors] will be considered). The differences in the means of length of visits per patient per day between the FFVM and the RFVM groups will be compared using generalized estimating equations with adjustment for the cluster effect, period effect, and interaction between cluster and period. Additionally, we will describe the FFVM family members’ adherence to the website, and the healthcare professionals’ perception of effectiveness and barriers for implementation of the FFVM.
To assess the fidelity of FFVM implementation, we will perform on-site monitoring visits in all participant ICUs. During these visits, the ICU staff perception about adherence to proposed FFVM processes will be assessed by the coordinating center researchers using semi-structured interviews. During the FFVM period, each ICU will be rated from 0 to 100% (with higher percentages indicating higher levels of adherence to intended FFVM processes) in the following domains: (1) Visiting hours - adherence to visiting hours according to the study protocol; (2) Dissemination - dissemination of the FFVM to family members of ICU patients; (3) Structured meetings - frequency and quality of structured meetings; (4) Staff training - education of the ICU staff about the FFVM procedures. The total fidelity of the FFVM implementation score represents the mean of the four evaluated domains. We plan to perform sensitivity and exploratory analyses considering the effects of FFVM implementation on outcomes.

Baseline characteristics

The baseline characteristics of all participants will be presented by study arm in a table (see Table 2), but no formal statistical hypothesis testing will be performed to avoid unnecessary testing.
Table 2
Baseline characteristics of study participants
 
FFVM
RFVM
Patients
 Age, years: mean (SD)
xx.x (xx.x)
xx.x (xx.x)
 Age ≥ 65 years: n/total n (%)
x/x (xx.x)
x/x (xx.x)
 Female gender: n/total n (%)
x/x (xx.x)
x/x (xx.x)
 Charlson comorbidity index: median (IQR)
xx.x (xx.x-xx.x)
xx.x (xx.x-xx.x)
 History of dementia: n/total n (%)
x/x (xx.x)
x/x (xx.x)
 Hazardous alcohol consumption:a n/total n (%)
x/x (xx.x)
x/x (xx.x)
ICU admission type
 Medical: n/total n (%)
x/x (xx.x)
x/x (xx.x)
 Emergency surgery: n/total n (%)
x/x (xx.x)
x/x (xx.x)
 Elective surgery: n/total n (%)
x/x (xx.x)
x/x (xx.x)
 PRE-DELIRIC score: mean (SD)
xx.x (xx.x)
xx.x (xx.x)
 APACHE-II score:b mean (SD)
xx.x (xx.x)
xx.x (xx.x)
 SOFA score:b mean (SD)
xx.x (xx.x)
xx.x (xx.x)
 Mechanically ventilated: n/total n (%)
x/x (xx.x)
x/x (xx.x)
 Use of vasopressor: n/total n (%)
x/x (xx.x)
x/x (xx.x)
 Use of corticosteroids: n/total n (%)
x/x (xx.x)
x/x (xx.x)
 Use of parenteral sedative:b n/total n (%)
x/x (xx.x)
x/x (xx.x)
 Use of benzodiazepine:b n/total n (%)
x/x (xx.x)
x/x (xx.x)
 Use of opioid:b n/total n (%)
x/x (xx.x)
x/x (xx.x)
 Indwelling central venous catheter: n/total n (%)
x/x (xx.x)
x/x (xx.x)
 Urinary catheter: n/total n (%)
x/x (xx.x)
x/x (xx.x)
Family members
 Age, years: mean (SD)
xx.x (xx.x)
xx.x (xx.x)
 Female gender: n/total n (%)
x/x (xx.x)
x/x (xx.x)
 Years of education: mean (SD)
xx.x (xx.x)
xx.x (xx.x)
 Household income, USD: median (IQR)
xx.x (xx.x-xx.x)
xx.x (xx.x-xx.x)
 Unemployed: n/total n (%)
x/x (xx.x)
x/x (xx.x)
 Living with care recipient: n/total n (%)
x/x (xx.x)
x/x (xx.x)
 Surrogate decision maker: n/total n (%)
x/x (xx.x)
x/x(xx.x)
 History of anxiety: n/total n (%)
x/x (xx.x)
x/x (xx.x)
 History of depression: n/total n (%)
x/x (xx.x)
x/x (xx.x)
ICU professionals
 Age, years: mean (SD)
xx.x (xx.x)
xx.x (xx.x)
 Female gender: n/total n (%)
x/x (xx.x)
x/x (xx.x)
Type of ICU professional
 Physician: n/total n (%)
x/x (xx.x)
x/x (xx.x)
 Nurse: n/total n (%)
x/x (xx.x)
x/x (xx.x)
 Nurse technician: n/total n (%)
x/x (xx.x)
x/x (xx.x)
 Physiotherapist: n/total n (%)
x/x (xx.x)
x/x (xx.x)
 Years of experience in ICU: mean (SD)
xx.x (xx.x)
xx.x (xx.x)
 Hours of work per week: mean (SD)
xx.x (xx.x)
xx.x (xx.x)
Number of patients per professional
  Physician: mean (SD)
xx.x (xx.x)
xx.x (xx.x)
  Nurse: mean (SD)
xx.x (xx.x)
xx.x (xx.x)
  Nurse technician: mean (SD)
xx.x (xx.x)
xx.x (xx.x)
  Physiotherapist: mean (SD)
xx.x (xx.x)
xx.x (xx.x)
 Burnout syndrome at baseline:c n/total n (%)
x/x (xx.x)
x/x (xx.x)
APACHE-II Acute Physiology and Chronic Health Evaluation-II, FFVM flexible family visitation model, ICU intensive care unit, IQR interquartile range (P25–P75), PRE-DELIRIC PREdiction of DELIRium in ICU patients, RFVM restrictive family visitation model, SD standard deviation, SOFA Sequential Organ Failure Assessment, USD United States dollars
aAlcohol consumption greater than or equal to 14 units per week for women and greater than or equal to 21 units per week for men
bWithin the first 24 h of inclusion in the study
cMaslach Burnout Inventory total score > − 9

Inter-rater reliability of the CAM-ICU

Inter-rater reliability measures of the CAM-ICU will be performed before study initiation to evaluate the quality of assessment. In each participant ICU, we will assess the concordance and agreement in diagnostic classification between trained intensive care physicians (reference diagnosis) and local outcome evaluators.

Primary outcome

All the pre-specified study outcomes are described in Table 3. The primary outcome is the cumulative incidence of delirium during ICU stay determined by the CAM-ICU, which was validated for the Brazilian population of critical care patients [21]. The cumulative incidence of delirium is defined as the presence of delirium (at least one positive CAM-ICU score) during the ICU stay. The differences in the incidences of delirium between the FFVM and the RFVM groups will be compared using generalized estimating equations with adjustment for the cluster effect, period effect, and interaction between intervention and period and presented as risk ratio (RR) and 95% CI.
Table 3
Study outcomes
Outcomes
FFVM
RFVM
Type of effect estimate
Effect estimate (CI)
p valuea
Primary
 Cumulative incidence of delirium:b n/total n (%)
x/x (xx.x)
x/x (xx.x)
RR
x.xx (x.xx-x.xx)*
x.xx
Secondary
 Patients
  Daily hazard of delirium:b mean (SD)
xx.x (xx.x)
xx.x (xx.x)
HR
x.xx (x.xx-x.xx)**
x.xx
  Any ICU-acquired infection:c n/total n (%)
x/x (xx.x)
x/x (xx.x)
RR
x.xx (x.xx-x.xx)*
x.xx
  Proportion of ventilator free-days: mean (SD)
xx.x (xx.x)
xx.x (xx.x)
MD
x.xx (x.xx-x.xx)**
x.xx
  ICU length of stay: mean (SD)
xx.x (xx.x)
xx.x (xx.x)
MD
x.xx (x.xx-x.xx)**
x.xx
  Hospital mortality: n/total n (%)
x/x (xx.x)
x/x (xx.x)
RR
x.xx (x.xx-x.xx)**
x.xx
 Family members
  HADS anxiety score: mean (SD)
xx.x (xx.x)
xx.x (xx.x)
MD
x.xx (x.xx-x.xx)***
x.xx
  HADS depression score: mean (SD)
xx.x (xx.x)
xx.x (xx.x)
MD
x.xx (x.xx-x.xx)***
x.xx
  CCFNI satisfaction score: mean (SD)
xx.x (xx.x)
xx.x (xx.x)
MD
x.xx (x.xx-x.xx)***
x.xx
 ICU professionals
  Burnout syndrome:d n/total n (%)
x/x (xx.x)
x/x (xx.x)
PR
x.xx (x.xx-x.xx)*
x.xx
Tertiary
 Patients
  Need for antipsychotic agents: n/total n (%)
x/x (xx.x)
x/x (xx.x)
RR
x.xx (x.xx-x.xx)*
x.xx
  Need for mechanical restraints: n/total n (%)
x/x (xx.x)
x/x (xx.x)
RR
x.xx (x.xx-x.xx)*
x.xx
  Unplanned loss of invasive devices: n/total n (%)
x/x (xx.x)
x/x (xx.x)
RR
x.xx (x.xx-x.xx)*
x.xx
  Proportion of coma-free days: mean (SD)
xx.x (xx.x)
xx. (xx.x)
MD
x.xx (x.xx-x.xx)*
x.xx
  ICU-acquired pneumonia:c n/total n (%)
x/x (xx.x)
x/x (xx.x)
RR
x.xx (x.xx-x.xx)*
x.xx
  ICU-acquired UTI:c n/total n (%)
x/x (xx.x)
x/x (xx.x)
RR
x.xx (x.xx-x.xx)*
x.xx
  ICU-acquired BSI:c n/total n (%)
x/x (xx.x)
x/x (xx.x)
RR
x.xx (x.xx-x.xx)*
x.xx
 Family members
  Self-perception of involvement in patient care
   Score:e mean (SD)
xx.x (xx.x)
xx.x (xx.x)
MD
x.xx (x.xx-x.xx)*
x.xx
  ICU professionals
   Satisfaction of ICU professionals with the ICU visiting policy score:f mean (SD)
xx.x (xx.x)
xx.x (xx.x)
MD
x.xx (x.xx-x.xx)*
x.xx
BSI bloodstream infection, CCFNI Critical Care Family Needs Inventory, CI confidence interval, FFVM flexible family visitation model, HADS Hospital Anxiety and Depression Scale, HR hazard ratio, ICU intensive care unit, MD mean difference, PR prevalence ratio, RFVM restrictive family visitation model, RR risk ratio, SD standard deviation, UTI urinary tract infection
aAdjusted for multiple comparisons with Bonferroni correction when appropriate
bAccording to the Confusion Assessment Method for the Intensive Care Unit (CAM-ICU) criteria
cAccording to the Centers for Disease Control and Prevention (CDC) criteria
dMaslach Burnout Inventory (MBI) total score > − 9
eThe self-perception of involvement in patient care score varies from 0 (no involvement) to 27 (maximum degree of involvement)
fThe satisfaction of ICU professionals with the ICU visiting policy score varies from 0 (unsatisfied) to 4 (very satisfied)
*95% confidence interval
**99% confidence interval
***98.3% confidence interval

Sensitivity analyses for the primary outcome

We aim to conduct the following sensitivity analyses for the primary outcome to assess consistency and the risk of bias:
1.
Evaluation of study intervention effects adjusted by the baseline risk of delirium according to the PRE-DELIRIC score.
 
2.
Evaluation of study intervention effects considering the cluster adherence to FFVM implementation. In this analysis, the study intervention effects will be adjusted by the total fidelity of FFVM implementation score.
 
3.
Evaluation of study intervention effects considering the potential confounding effect of sedation on the delirium diagnosis. In this analysis, the study intervention effects will be evaluated, considering patients with positive CAM-ICU during ICU stay in the context of Richmond Agitation-Sedation Scale (RASS) score – 2 or − 3 as non-delirious subjects.
 
4.
Evaluation of effects of study interventions, considering a best plausible scenario/worst plausible scenario imputation of outcomes among ICUs that did not complete the patient recruitment as follows:
a)
Best plausible scenario: Imputation of the lowest study cluster/phase incidence of delirium for missing FFVM patients and the highest study cluster/phase incidence of delirium for missing RFVM patients
 
b)
Worst plausible scenario: Imputation of the lowest study cluster/phase incidence of delirium for missing RFVM patients and the highest study cluster/phase incidence of delirium for missing FFVM patients.
 
 

Subgroup analyses for the primary outcome

There will be three a priori defined subgroup analyses for the primary endpoint: (1) effectiveness of the FFVM vs. RFVM in ICUs according to the PRE-DELIRIC score (patients with a predicted risk < 25%, 25–50%, 50–75%, and > 75%); (2) effectiveness of the FFVM vs. RFVM according to patient group (medical vs. surgical and neurocritical vs. non-neurocritical); and (3) effectiveness of the FFVM vs. RFVM in ICUs according to APACHE-II scores (≤15 vs. > 15 points). The consistency of intervention effects across the above-mentioned subgroups will be assessed by means of tests for interaction. The Bonferroni correction will be applied to adjust the subgroup analyses for multiple comparisons.

Secondary outcomes

We will use the following statistical procedures to evaluate the study secondary outcomes:
1.
Daily hazard of delirium: The daily hazard of delirium will be analyzed using a joint survival model that accounts for the treatment effect (with adjustment for the cluster effect, period effect, and interaction between cluster and period) on repeated daily indicator of delirium within each patient and terminating event (death or discharge from the ICU) [22]. This outcome will be presented as hazard ratio (HR) and 95% CI.
 
2.
Any ICU-acquired infections: The differences in the cumulative incidence of any ICU-acquired infection between the FFVM and RFVM groups will be compared using generalized estimating equations with adjustment for the cluster effect, period effect, and interaction between intervention and period. This outcome will be presented as RR and 95% CI.
 
3.
Ventilator-free days: The number of ventilator-free days will be evaluated using the 7-day time horizon. Ventilator-free days will be set to 0 for patients who have died. The differences in the mean ventilator-free days between the FFVM and RFVM groups will be compared using generalized estimating equations with adjustment for the cluster effect, period effect, and interaction between intervention and period. This outcome will be presented as mean difference (MD) and 95% CI.
 
4.
ICU length of stay: The differences in the mean ICU length of stay between the FFVM and RFVM groups will be compared using generalized estimating equations with adjustment for the cluster effect, period effect, and interaction between intervention and period. This outcome will be presented as MD and 95% CI.
 
5.
Hospital mortality: The differences in hospital mortality rates between the FFVM and RFVM groups will be compared using generalized estimating equations with adjustment for the cluster effect, period effect, and interaction between intervention and period. This outcome will be presented as RR and 95% CI.
 
6.
Symptoms of anxiety and depression among family members: The differences in the mean HADS scores for anxiety and depression between the FFVM and RFVM groups will be compared using generalized estimating equations with adjustment for the cluster effect, period effect, and interaction between intervention and period. These outcomes will be presented as MD and 95% CI.
 
7.
Satisfaction among family members: The differences in the mean CCFNI satisfaction scores between the FFVM and RFVM groups will be compared using generalized estimating equations with adjustment for the cluster effect, period effect, and interaction between intervention and period. This outcome will be presented as MD and 95% CI.
 
8.
Prevalence of burnout among the ICU professionals: Burnout is defined as a cumulative MBI score greater than − 9. The differences in the prevalence of burnout between the FFVM and RFVM groups will be compared using generalized estimating equations with adjustment for the cluster effect and baseline MBI total scores. This outcome will be presented as prevalence ratio and 95% CI.
 
Given that the main safety outcomes of the present study are any ICU-acquired infections and burnout, we will not adjust these outcomes for multiple comparisons. For other secondary outcomes, the Bonferroni correction will be applied to adjust the analyses for multiple comparisons when appropriate, taking into consideration the number of comparisons within each population of interest (patients, family members, and ICU professionals).
We will perform sensitivity analyses to check the consistency of intervention effects on family members and ICU professionals as follows:
1.
Evaluation of study intervention effects on HADS subscale scores among family members, considering HADS scores as categorical variables with established cutoff points (> 10 points for both anxiety and depression subscales)
 
2.
Evaluation of study intervention effects on HADS subscale scores among family members adjusted by previous history of anxiety (for anxiety HADS subscale) and depression (for depression HADS subscale)
 
3.
Evaluation of study intervention effects on CCFNI subscale domains (information, proximity, reassurance, support, and comfort)
 
4.
Evaluation of study intervention effects on incidence (excluding individuals with burnout at baseline) and prevalence of burnout among ICU professionals, considering the following alternative MBI criteria:
a)
Alternative criteria 1: An emotional exhaustion subscale score ≥ 27, OR a depersonalization subscale score ≥ 10, OR a personal accomplishment subscale score ≤ 33
 
b)
Alternative criteria 2: An emotional exhaustion subscale score ≥ 27, OR a depersonalization subscale score ≥ 10
 
c)
Alternative criteria 3: An emotional exhaustion subscale score ≥ 27, AND a depersonalization subscale score ≥ 10, AND a personal accomplishment subscale score ≤ 33.
 
 

Tertiary outcomes

We will use the following statistical procedures to evaluate the study tertiary outcomes:
1.
Need for antipsychotic agents: The differences in the cumulative incidence of need for antipsychotic agents during ICU stay between the FFVM and RFVM groups will be compared using generalized estimating equations with adjustment for the cluster effect, period effect, and interaction between intervention and period. This outcome will be presented as RR and 95% CI.
 
2.
Need for mechanical restraints: The differences in the cumulative incidence of need for mechanical restraints during ICU stay between the FFVM and RFVM groups will be compared using generalized estimating equations with adjustment for the cluster effect, period effect, and interaction between intervention and period. This outcome will be presented as RR and 95% CI.
 
3.
Unplanned loss of invasive devices: The differences in the cumulative incidence of any unplanned loss of invasive devices (venous catheter, enteral tube, or urinary catheter) during the ICU stay between the FFVM and RFVM groups will be compared using generalized estimating equations with adjustment for the cluster effect, period effect, and interaction between intervention and period. This outcome will be presented as RR and 95% CI.
 
4.
Coma-free days at day 7: The number of coma-free days will be evaluated using the 7-day time horizon. Coma-free days will be set to 0 for patients who have died. The differences in the mean proportion of days free of coma (RASS [23] – 4 or − 5) between the FFVM and RFVM groups will be compared using generalized estimating equations with adjustment for the cluster effect, period effect, and interaction between intervention and period. This outcome will be presented as MD and 95% CI.
 
5.
ICU-acquired pneumonia: The differences in the cumulative incidence of ICU-acquired pneumonia between the FFVM and RFVM groups will be compared using generalized estimating equations with adjustment for the cluster effect, period effect, and interaction between intervention and period. This outcome will be presented as RR and 95% CI.
 
6.
ICU-acquired urinary tract infection: The differences in the cumulative incidence of urinary tract infection between the FFVM and RFVM groups will be compared using generalized estimating equations with adjustment for the cluster effect, period effect, and interaction between intervention and period. This outcome will be presented as RR and 95% CI.
 
7.
ICU-acquired bloodstream infection: The differences in the cumulative incidence of bloodstream infection between the FFVM and RFVM groups will be compared using generalized estimating equations with adjustment for the cluster effect, period effect, and interaction between intervention and period. This outcome will be presented as RR and 95% CI.
 
8.
Self-perception of involvement in patient care among the family members: The self-perception of involvement in patient care will be evaluated using a score developed for the present study, which is composed of 9 questions related to the self-perception of involvement of the family member in the care of the patient in the following domains: (1) re-orientation activities, (2) pain control, (3) mobilization, (4) feeding, (5) hygiene, (6) emotional support, (7) helping patients to interpret ICU staff orientations, (8) helping the ICU professionals to understand patient needs, and (9) helping to create a patient-friendly environment in the patient room. The score of each question ranges from 0 (never involved in the activity) to 3 (very frequently involved in the activity). The total score, which varies from 0 (no involvement) to 27 (maximum degree of involvement), will be obtained by the sum of the scores of each question. The differences in the mean total scores of self-perception of involvement in patient care between the FFVM and RFVM groups will be compared using generalized estimating equations with adjustment for the cluster effect, period effect, and interaction between intervention and period. This outcome will be presented as MD and 95% CI.
 
9.
Satisfaction among ICU professionals: The satisfaction of ICU professionals will be evaluated through the score of the following question: Are you satisfied with the current visiting policy of your ICU? The responses to this 5-option Likert scale question may be one of the following: 0 - unsatisfied, 1- somewhat dissatisfied, 2 - indifferent, 3 - somewhat satisfied, 4 - very satisfied. The differences in the mean score values between the FFVM and RFVM groups will be compared using generalized estimating equations with adjustment for the cluster effect. This outcome will be presented as MD and 95% CI.
 
No adjustment for multiple comparisons will be made for tertiary outcomes. Therefore, the results of tertiary outcomes should be considered exploratory.

Differences between the study protocol and statistical analysis plan

There are no differences between the study protocol and this SAP in relation to the proposed outcomes or statistical procedures.

Discussion and trial status

In this SAP, we present the statistical procedures that will allow the comparison of effectiveness and safety outcomes between the FFVM and RFVM in the ICU Visits Study. The present publication aims to avoid risks of outcome reporting bias and data-driven results and provide guidance for statistical analysis for future studies in this field. As of March 2018, 40 ICUs were randomized. Currently, 1591 patients, 1192 family members, and 829 ICU professionals were included in the study. We expect that the recruitment of subjects will be completed in June 2018.

Acknowledgements

The authors thank Hospital Moinhos de Vento and the Brazilian Ministry of Health for their support in conducting the study.

Funding

The present study was funded by the Brazilian Ministry of Health through the Program of Institutional Development of the Brazilian Unified Health System (PROADI-SUS). The trial is coordinated by Hospital Moinhos de Vento and endorsed by the Brazilian Research in Intensive Care Network (BRICNet).

Availability of data and materials

The datasets used and/or analyzed during the current study will be available from the corresponding author on reasonable request.
This study will be conducted according to Resolution No. 466/12 of the Brazilian National Health Council (http://​bvsms.​saude.​gov.​br/​bvs/​saudelegis/​cns/​2013/​res0466_​12_​12_​2012.​html). The present study protocol version (version 3, from 22 February 2017) has been approved by the research ethics committee of the coordinating site (approval No. CAAE 57717516.3.1001.5330) and the research ethics committees of all participating institutions. The need for patients’ written informed consent was waived in 37 of 40 participating ICUs, because the standard of care encompasses both study interventions. In 3 of 40 ICUs informed consent will be required for patients or proxies. Informed consent will be required for family members and ICU professionals in all ICUs.
Not applicable.

Competing interests

The authors declare that they have no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://​creativecommons.​org/​licenses/​by/​4.​0/​), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://​creativecommons.​org/​publicdomain/​zero/​1.​0/​) applies to the data made available in this article, unless otherwise stated.
Literatur
1.
Zurück zum Zitat Gerritsen RT, Hartog CS, Curtis JR. New developments in the provision of family-centered care in the intensive care unit. Intensive Care Med. 2017;43:550–3.CrossRef Gerritsen RT, Hartog CS, Curtis JR. New developments in the provision of family-centered care in the intensive care unit. Intensive Care Med. 2017;43:550–3.CrossRef
2.
Zurück zum Zitat Goldfarb MJ, Bibas L, Bartlett V, Jones H, Khan N. Outcomes of patient- and family-centered care interventions in the ICU: a systematic review and meta-analysis. Crit Care Med. 2017;45:1751–61.CrossRef Goldfarb MJ, Bibas L, Bartlett V, Jones H, Khan N. Outcomes of patient- and family-centered care interventions in the ICU: a systematic review and meta-analysis. Crit Care Med. 2017;45:1751–61.CrossRef
3.
Zurück zum Zitat Rosa RG, Tonietto TF, da Silva DB, Gutierres FA, Ascoli AM, Madeira LC, et al. Effectiveness and safety of an extended ICU visitation model for delirium prevention: a before and after study. Crit Care Med. 2017;45:1660–7.CrossRef Rosa RG, Tonietto TF, da Silva DB, Gutierres FA, Ascoli AM, Madeira LC, et al. Effectiveness and safety of an extended ICU visitation model for delirium prevention: a before and after study. Crit Care Med. 2017;45:1660–7.CrossRef
6.
Zurück zum Zitat Ramos FJ, Fumis RR, de Azevedo LC, Schettino G. Intensive care unit visitation policies in Brazil: a multicenter survey. Rev Bras Ter Intensiva. 2014;26:339–46.CrossRef Ramos FJ, Fumis RR, de Azevedo LC, Schettino G. Intensive care unit visitation policies in Brazil: a multicenter survey. Rev Bras Ter Intensiva. 2014;26:339–46.CrossRef
7.
Zurück zum Zitat Garrouste-Orgeas M, Vinatier I, Tabah A, Misset B, Timsit JF. Reappraisal of visiting policies and procedures of patient’s family information in 188 French ICUs: a report of the Outcomerea Research Group. Ann Intensive Care. 2016;6:82.CrossRef Garrouste-Orgeas M, Vinatier I, Tabah A, Misset B, Timsit JF. Reappraisal of visiting policies and procedures of patient’s family information in 188 French ICUs: a report of the Outcomerea Research Group. Ann Intensive Care. 2016;6:82.CrossRef
8.
Zurück zum Zitat Noordermeer K, Rijpstra TA, Newhall D, Pelle AJ, van der Meer NJ. Visiting policies in the adult intensive care units in the Netherlands: survey among ICU directors. ISRN Critical Care. 2013;137045:1–6.CrossRef Noordermeer K, Rijpstra TA, Newhall D, Pelle AJ, van der Meer NJ. Visiting policies in the adult intensive care units in the Netherlands: survey among ICU directors. ISRN Critical Care. 2013;137045:1–6.CrossRef
9.
Zurück zum Zitat Lee MD, Friedenberg AS, Mukpo DH, Conray K, Palmisciano A, Levy MM. Visiting hours policies in New England intensive care units: strategies for improvement. Crit Care Med. 2007;35:497–501.CrossRef Lee MD, Friedenberg AS, Mukpo DH, Conray K, Palmisciano A, Levy MM. Visiting hours policies in New England intensive care units: strategies for improvement. Crit Care Med. 2007;35:497–501.CrossRef
10.
Zurück zum Zitat Rosa RG, Falavigna M, Robinson CC, da Silva DB, Kochhann R, de Moura RM, et al. Study protocol to assess the effectiveness and safety of a flexible family visitation model for delirium prevention in adult intensive care units: a cluster-randomised, crossover trial (The ICU Visits Study). BMJ Open. 2018;8:e021193.CrossRef Rosa RG, Falavigna M, Robinson CC, da Silva DB, Kochhann R, de Moura RM, et al. Study protocol to assess the effectiveness and safety of a flexible family visitation model for delirium prevention in adult intensive care units: a cluster-randomised, crossover trial (The ICU Visits Study). BMJ Open. 2018;8:e021193.CrossRef
11.
Zurück zum Zitat Ely EW, Margolin R, Francis J, May L, Truman B, Dittus R, et al. Evaluation of delirium in critically ill patients: validation of the Confusion Assessment Method for the Intensive Care Unit (CAM-ICU). Crit Care Med. 2001;29:1370–9.CrossRef Ely EW, Margolin R, Francis J, May L, Truman B, Dittus R, et al. Evaluation of delirium in critically ill patients: validation of the Confusion Assessment Method for the Intensive Care Unit (CAM-ICU). Crit Care Med. 2001;29:1370–9.CrossRef
15.
Zurück zum Zitat Botega NJ, Bio MR, Zomignani MA, Garcia C Jr, Pereira WA. Mood disorders among medical in-patients: a validation study of the hospital anxiety and depression scale (HAD). Rev Saude Publica. 1995;29:355–63.CrossRef Botega NJ, Bio MR, Zomignani MA, Garcia C Jr, Pereira WA. Mood disorders among medical in-patients: a validation study of the hospital anxiety and depression scale (HAD). Rev Saude Publica. 1995;29:355–63.CrossRef
16.
Zurück zum Zitat Fumis RR, Nishimoto IN, Deheinzelin D. Measuring satisfaction in family members of critically ill cancer patients in Brazil. Intensive Care Med. 2006;32:124–8.CrossRef Fumis RR, Nishimoto IN, Deheinzelin D. Measuring satisfaction in family members of critically ill cancer patients in Brazil. Intensive Care Med. 2006;32:124–8.CrossRef
17.
Zurück zum Zitat Campos JA, Maroco J. Maslach Burnout Inventory - Student Survey: Portugal-Brazil cross-cultural adaptation. Rev Saude Publica. 2012;46:816–24.CrossRef Campos JA, Maroco J. Maslach Burnout Inventory - Student Survey: Portugal-Brazil cross-cultural adaptation. Rev Saude Publica. 2012;46:816–24.CrossRef
18.
19.
Zurück zum Zitat van den Boogaard M, Pickkers P, Slooter AJ, Kuiper MA, Spronk PE, van der Voort PH, et al. Development and validation of PRE-DELIRIC (PREdiction of DELIRium in ICu patients) delirium prediction model for intensive care patients: observational multicentre study. BMJ. 2012;344:e420.CrossRef van den Boogaard M, Pickkers P, Slooter AJ, Kuiper MA, Spronk PE, van der Voort PH, et al. Development and validation of PRE-DELIRIC (PREdiction of DELIRium in ICu patients) delirium prediction model for intensive care patients: observational multicentre study. BMJ. 2012;344:e420.CrossRef
20.
Zurück zum Zitat Campbell MK, Piaggio G, Elbourne DR, Altman DG. Consort 2010 statement: extension to cluster randomised trials. BMJ. 2012;345:e5661.CrossRef Campbell MK, Piaggio G, Elbourne DR, Altman DG. Consort 2010 statement: extension to cluster randomised trials. BMJ. 2012;345:e5661.CrossRef
21.
Zurück zum Zitat Gusmao-Flores D, Salluh JI, dal-Pizzol F, Santana LR, Lins RM, Lemos PP, et al. Validity and reliability of the Brazilian-Portuguese version of three tools to diagnose delirium: CAM-ICU, CAM-ICU Flowsheet and ICDSC. Crit Care. 2011;15(Suppl 2):P50.CrossRef Gusmao-Flores D, Salluh JI, dal-Pizzol F, Santana LR, Lins RM, Lemos PP, et al. Validity and reliability of the Brazilian-Portuguese version of three tools to diagnose delirium: CAM-ICU, CAM-ICU Flowsheet and ICDSC. Crit Care. 2011;15(Suppl 2):P50.CrossRef
22.
Zurück zum Zitat Colantuoni E, Dinglas VD, Ely EW, Hopkins RO, Needham DM. Statistical methods for evaluating delirium in the ICU. Lancet Repir Med. 2016;4(7):534–6.CrossRef Colantuoni E, Dinglas VD, Ely EW, Hopkins RO, Needham DM. Statistical methods for evaluating delirium in the ICU. Lancet Repir Med. 2016;4(7):534–6.CrossRef
23.
Zurück zum Zitat Sessler CN, Gosnell MS, Grap MJ, Brophy GM, O'Neal PV, Keane KA, et al. The Richmond Agitation-Sedation Scale: validity and reliability in adult intensive care unit patients. Am J Respir Crit Care Med. 2002;166:1338–44.CrossRef Sessler CN, Gosnell MS, Grap MJ, Brophy GM, O'Neal PV, Keane KA, et al. The Richmond Agitation-Sedation Scale: validity and reliability in adult intensive care unit patients. Am J Respir Crit Care Med. 2002;166:1338–44.CrossRef
Metadaten
Titel
Statistical analysis plan for a cluster-randomized crossover trial comparing the effectiveness and safety of a flexible family visitation model for delirium prevention in adult intensive care units (the ICU Visits Study)
verfasst von
Daniel Sganzerla
Cassiano Teixeira
Caroline Cabral Robinson
Renata Kochhann
Mariana Martins Siqueira Santos
Rafaela Moraes de Moura
Mirceli Goulart Barbosa
Daiana Barbosa da Silva
Tarissa Ribeiro
Cláudia Eugênio
Daniel Schneider
Débora Mariani
Rodrigo Wiltgen Jeffman
Fernando Bozza
Alexandre Biasi Cavalcanti
Luciano Cesar Pontes Azevedo
Flávia Ribeiro Machado
Jorge Ibrain Salluh
José Augusto Santos Pellegrini
Rafael Barberena Moraes
Lucas Petri Damiani
Nilton Brandão da Silva
Maicon Falavigna
Regis Goulart Rosa
Publikationsdatum
01.12.2018
Verlag
BioMed Central
Erschienen in
Trials / Ausgabe 1/2018
Elektronische ISSN: 1745-6215
DOI
https://doi.org/10.1186/s13063-018-3006-8

Weitere Artikel der Ausgabe 1/2018

Trials 1/2018 Zur Ausgabe