Background
Heart Failure (HF) causes significant morbidity and mortality. Multiple trials have shown that self-care training can reduce HF-related hospitalizations [
1]. Weight monitoring is an important element of HF self-care that enables patients to monitor their volume status [
2]. Weight gain can often be the first sign of volume overload in patients with HF; if such weight gains are treated promptly, clinically significant HF exacerbations can be avoided. In clinical practice, self-reported measures are frequently used to assess whether patients perform components of HF self-care, including weight monitoring [
3‐
5]. However, the most clinically meaningful way to evaluate adherence to weight monitoring is unclear. Using weight monitoring adherence measures to determine which patients are optimally performing HF self-care could help identify which patients may benefit from more intensive HF self-care training and support.
In a prior case–control analysis, we identified that optimal diary-recorded adherence to weight monitoring (≥80% adherence) measured over seven days was associated with a lower odds of HF-related ED visits or hospitalizations [
6]. However, tracking adherence to weight monitoring by diary may be cumbersome for both patients and providers, leading us to speculate how a self-reported measure of weighing frequency that more closely approximates what is commonly used in practice might compare to a diary-recorded measure of weight monitoring adherence. We conducted this study to compare the association of self-reported and diary-recorded measures of weight monitoring adherence with HF-related hospitalizations. Since the optimal frequency to define weight monitoring adherence has not been established, we performed additional analyses to explore thresholds for weight monitoring adherence.
Methods
Study design
We performed a prospective cohort study that was nested in the intensive self-care intervention arm of a randomized clinical trial that compared different levels of HF self-care training [
7]. Details of this trial have been described previously and will be summarized here. Patients in this study had either diastolic or systolic HF with New York Heart Association (NYHA) class II-IV symptoms within the prior 6 months, adequate cognitive function, were on a loop diuretic, and were fluent in either English or Spanish. Patients were recruited between 2006 and 2009 from Internal Medicine and Cardiology clinics at the University of North Carolina (UNC) at Chapel Hill, Northwestern University, Olive View – UCLA Medical Center, and UCSF – San Francisco General Hospital. Institutional Review Boards (IRB) from UNC, Northwestern University, Olive View-UCLA, and UCSF approved the protocol and all patients provided informed consent. The investigation conformed to the principles outlined in the Declaration of Helsinki.
Intervention description
All patients in the intensive self-care intervention arm received an in-person 40-minute education session followed by a series of educator calls (median of 15) over 1 year. The education session and calls reinforced the importance of daily weight monitoring, taking proper diuretic doses, medication adherence, salt reduction, and exercise. Most patients (72% of intervention arm patients) were taught how to adjust their diuretic doses based on their daily weights. Among the four educators who delivered the intervention, two were registered dieticians with experience counseling patients in clinical settings; the other two had bachelor’s degrees and experience working as health educators. The educators convened for a one-day training prior to enrollment and participated in weekly calls with an investigator to develop the educational protocol and ensure similar education delivery across sites.
All patients were provided a digital bathroom scale and a diary in which they were to record their daily weights. Patients were instructed to mail weight diaries back to their educator on a monthly basis in self-addressed, stamped envelopes. The educator reviewed the diaries to assess how well a patient was following the protocol and incorporated that information in their ongoing interactions with that patient. At the conclusion of the study period (12 months after enrollment), trained study personnel collected the diaries from each site and entered them into a central database for analysis.
The initial number of patients in the intensive self-care training arm was 303. For this analysis, we made exclusions for submitting no diary data during the trial (n = 67) or for a missing response to the self-reported weighing adherence measure from the 12 month survey (n = 20 additional exclusions), leaving a sample of 216 patients.
Measures and data collection
A trained research assistant (RA) at each site administered baseline questionnaires and collected information about race/ethnicity, income, and insurance status. Socioeconomic status (SES) was measured with the MacArthur Scale of Subjective Social Status; this measure asks individuals to indicate on which ladder rung they feel that they stand relative to other people in the United States with regard to money, education, and jobs (range 0–9) [
8]. HF severity was assessed using a single item with a series of structured statements to categorize patients by New York Heart Association (NYHA) class. HF-related quality of life was assessed using the Improving Chronic Illness Care Evaluation (ICICE) HF Symptom Scale (HFSS); [
9] HFSS scores were transformed to a 100-point scale with 100 representing the least symptoms/best health. Literacy was measured with a Short Test of Functional health Literacy in Adults (s-TOFHLA) and categorized into adequate literacy (≥ 23 out of 36) or inadequate/marginal literacy (< 23 out of 36) [
10]. The RA abstracted medical records to collect additional demographic and clinical data.
Outcome assessment
The primary end-point for this study was HF-related hospitalization. The University of North Carolina Survey Research Unit conducted telephone surveys at 1, 6, and 12 months during which patients were asked about any hospitalizations or other events that occurred in the previous time period. Upon identification of a hospitalization, admission and discharge summaries were requested from the hospital; these records were reviewed by one of three adjudication committee members masked to intervention status to determine if the hospitalization was HF-related. Adjudication committee members used a study protocol and their clinical judgment to assess whether HF was present at admission and whether HF was an important contributing factor to the hospitalization. If the first assessor concluded that a hospitalization was definitely HF-related or definitely not HF-related, no further assessment was done. For all other hospitalizations, another assessor conducted a second assessment. If the first two assessors disagreed, a third assessor reviewed the hospitalization and the case was discussed by the full committee to resolve differences.
Weight monitoring adherence: self-reported and diary-recorded
Weight monitoring adherence was measured using two methods: self-reported frequency of weighing and diary-recorded weights. Self-reported weight monitoring adherence was collected at baseline and during telephone interviews using the following question: “How often do you weigh yourself?” Patients who reported weighing at least once a day (“every day” or “twice a day or more”) were considered optimally adherent; those who reported weighing less frequently (“several times a week”, “once every week or two”, or “less frequently than every 1 to 2 weeks”) were considered sub-optimally adherent. This threshold was chosen because weighing “every day” indicates a stricter adherence level that is closer to our ≥80% diary threshold than “several days a week”, which could represent a wide range of adherence. Our main predictor variable in the self-reported weight monitoring adherence analysis was collected following completion of the full intervention at the 12-month interview. Diary-recorded weight monitoring adherence was determined from weight diaries and dichotomized into ≥80% and <80% days of adherence to weight monitoring over a patient’s days in the trial to reflect optimal and sub-optimal adherence, respectively. The ≥80% threshold was chosen because this threshold is commonly used to define optimal medication adherence, [
11‐
13] and because we used this threshold to define weight monitoring adherence in a prior publication [
6]. We also performed sensitivity analyses to evaluate how different thresholds of weight monitoring adherence were associated with HF-related hospitalizations.
Statistical analysis
We compared demographic and clinical data by adherence groups for both self-reported and diary-recorded data for descriptive purposes with a chi-square test for dichotomous variables and Student’s t-test for continuous variables. A Fisher’s exact test was used to compare dichotomous variables with 5 or fewer individuals in 25% of categories. A Kolmogorov-Smirnov test was used to assess for normal distribution of continuous variables; for continuous variables found to have a non-normal distribution, a Wilcoxon-Mann–Whitney test was used to compare groups.
We compared the incidence rates of HF hospitalizations between (1) self-reported optimal versus sub-optimal adherence groups and (2) diary-recorded optimal versus sub-optimal adherence groups using negative binomial regression. In one negative binomial regression model we adjusted only for site; in the fully adjusted negative binomial regression model, we included demographic and clinical factors that were either statistically significantly different between groups in bivariate analyses (i.e., site, age, race/ethnicity, SES, HF QOL, previous MI/angina, self-reported weighing at baseline, and systolic dysfunction) or have been previously associated with HF-related hospitalizations (i.e., gender) [
14]. Standard errors were adjusted for clustering by site. Of note, we did not include total educator calls in the final model because educator calls were likely to have been part of the causal pathway in the association between weight monitoring adherence and HF-related hospitalizations.
We performed sensitivity analyses in which we used different adherence thresholds for diary-recorded weight monitoring adherence (i.e., ≥90%, ≥70%, and ≥60% thresholds). We considered a two-sided p value of <0.05 statistically significant. All data analyses were performed using Stata 12.0 (College Station, TX).
Discussion
In this study, we found that patients self-reporting at least daily weight monitoring adherence did not have reduced rates of HF hospitalization compared to those self-reporting less frequent weighing adherence at 12 months. In contrast, we found that patients with ≥80% diary-recorded weight monitoring adherence had a statistically significantly lower rate of HF hospitalization than those with <80% adherence over 12 months of follow-up. Our findings suggest that diary-recorded measures of adherence may accurately identify optimal self-care that is associated with a reduced risk of HF-related hospitalizations.
HF self-care behaviors are frequently assessed through global self-reported measures, including the Self-Care of HF Index (SCHFI), [
3] the revised Heart Failure Self-Care Behavioral Scale [
15,
16], the European HF Self-Care Behavioral Scale (EHFScB Scale), [
4] and the Revised HF Compliance scale, [
5,
17] all of which contain an item to assess weighing behavior. Better HF care/behavior scores on respective indices/scales have been associated with improved clinical outcomes [
17,
18]. In studies that have specifically evaluated the association between weight monitoring adherence and clinical outcomes, the association between adherence and clinical outcomes has been variable based on the adherence measure used [
17,
19,
20].
Daily weight monitoring is a mainstay of HF self-care, yet the most clinically meaningful measure to evaluate adherence to this behavior is not clear. Comparisons have been made between measures that are self-reported and measures obtained from repeated sampling of current behaviors or symptoms over a time period, termed “ecological momentary assessment” (EMA), in the work of Shiffman and colleagues [
21]. EMA measures have the potential to “minimize recall bias, maximize ecological validity, and allow study of microprocesses that influence behavior in real-world contexts” (pg 1) [
21]. EMA can be collected many ways, including diaries, telephone calls, and electronic records. The main objective of EMA is to ascertain multiple samples of symptoms or behaviors experienced at the time the sample is collected. Self-reported and EMA measures have been found to be discrepant in studies from various populations, including patients with alcoholism, [
22] tobacco use, [
23] urinary incontinence, [
24] and headaches [
25].
Discrepancies between self-reported and EMA measures of medication adherence [e.g., medication event monitoring systems (MEMS) caps (medication bottle caps that record times/dates that bottles are opened)], have also been noted in patients with HF [
19,
20]. Such discrepancies between adherence measures can be attributed to a number of characteristics, such as the frequency with which measures are collected, the duration of time over which measures estimate behavior, the types of behaviors being evaluated, and other factors [
21]. Overall, self-reported measures are at risk for systematic recall bias when compared to EMA measures [
21].
In our study, measures used to assess daily weight monitoring adherence fall into the general categories of self-reported recall and EMA from a daily diary. We found that a self-reported recall of optimal adherence at 12 months was associated with a somewhat higher risk of HF-related hospitalizations that was not statistically significant; the small size of the group self-reporting optimal adherence likely contributed to less precision in this outcome. Yet, we did find an association between diary-recorded weight monitoring adherence and HF-related hospitalizations at multiple thresholds of adherence, with an effect size that strengthened with increasing thresholds. Adherence thresholds ranging down to ≥60% of days were associated with decreased risk for HF-related hospitalization, suggesting benefit even at thresholds lower than our pre-specified cut-point of ≥80%.
One may speculate whether completion of weight diaries in this study is merely a reflection of program engagement and/or more advanced HF self-care skills/knowledge. To evaluate whether program engagement may have explained some of this association, we added the number of educator calls into our adjusted model and found that this did not lead to attenuation of the IRRs from our main analyses (results not shown). We theorize this is because the number of educator calls may have varied based on a range of factors including: a patient’s engagement in the program, lack of mastery of educational material that required more calls, or even patient-initiated calls due to concerns about their regimen or symptoms. Of note, the weight diaries in this study were used to teach a majority of patients (72% of intervention arm patients) how to self-adjust their diuretics based on weight. Although the observed association could have been partly related to this aspect of the intervention, the proportion of patients who were taught diuretic self-adjustment did not differ significantly by adherence in either self-reported or diary-recorded groups (Table
1).
Limitations
With regard to study limitations, our self-reported adherence question did not specify the duration of time for which patients were to report weighing behavior, which likely increased recall bias in responses. In addition, given that 85% of patients self-reported weighing at least daily at 12 months, patient responses to this question may not have accurately reflected behavior, potentially due to social desirability or other factors. It is important to note that the surveys were delivered by masked outcome assessors. The smaller sample size and very low rate of HF-related hospitalization in the group that self-reported sub-optimal adherence contributed to less precision in our results and lack of statistically significant findings.
In addition, our measure of diary-recorded weight monitoring averaged adherence over the entire follow-up period. As such, it is possible that adherence directly preceding HF hospitalizations differed from overall adherence; however, in a prior case–control study nested in this same study population, we found that diary-recorded weight monitoring adherence (≥80%) in the week preceding HF emergency department visits or hospitalizations was similarly protective [
6].
Our comparison between self-reported and diary-recorded adherence measures was not a direct comparison between randomized groups of individuals, but instead a comparison of how different measures of adherence were associated with clinical outcomes in the same group of individuals. We noted baseline differences between groups who were optimally adherent and sub-optimally adherent to both self-reported and diary-recorded measures; thus selection bias or unmeasured confounding may have affected our results. However, we attempted to mitigate such differences by adjusting for these variables in our analysis; in addition, we found comparable results to our main analysis when we performed a sensitivity analysis in which we included patients who never submitted a weight diary. The generalizability of our findings may be limited by our younger patients with less advanced HF than in other studies of HF self-care [
1,
26]. Strengths of this study include a diverse, well-characterized sample drawn from a multi-site trial and rigorous outcome assessment.
Competing interests
The authors declare that they have no competing interests.
Authors’ contributions
CDJ conceived of the study, participated in design of study and drafted the manuscript; GMH participated in the design of the study and performed the statistical analysis; DAD conceived of the study, participated in design of study, acquisition of data, and provided key revisions to manuscript; BE participated in the design of the study and participated in performing statistical analyses; JRW participated in the design of the study and provided key revisions to the manuscript; CWC participated in the design of the study and provided key revisions to the manuscript; DWB participated in the design of the study, acquisition of data, and provided key revisions to the manuscript; DS participated in the design of the study, acquisition of data, and provided key revisions to the manuscript; BR participated in acquisition of data, and provided key revisions to the manuscript; KBR participated in acquisition of data and provided key revisions to the manuscript; AMO participated in the acquisition of data and provided key revisions to the manuscript; VH participated in the design of the study and acquisition of data; KB participated in the design of the study and acquisition of data; MP conceived of the study, participated in design of study, acquisition of data, and provided key revisions to manuscript. All authors read and approved the final manuscript.