Background
Sugar-sweetened beverages (SSBs) are a broad category of beverages with added sugars that includes, but is not limited to, soft drinks, fruit juice, energy and sport drinks, and sweetened coffees and teas. They contribute 39% of all added sugars consumed in the United States [
1]. High SSB consumption is associated with serious health consequences for children, including weight gain, overweight, obesity, and dental caries [
2‐
4]. Among adults, additional health risks associated with SSB consumption include metabolic syndrome, type 2 diabetes [
5], cardiovascular disease [
6], and mortality [
7].
In light of its deleterious health effects, SSB consumption has been the focus of a diverse array of public health interventions that have been implemented at both the population/community- and individual–levels in an effort to curb population levels of consumption. Population-level interventions have included increasing taxes on SSBs [
8] or substituting other beverage options for SSBs in hospitals [
9] or schools [
10], while efforts to intervene at the individual level have primarily focused on those social and/or cognitive constructs believed to be related to SSB consumption, including knowledge of SSB health effects and attitudes and intentions about SSB consumption [
11‐
14].
While population-level interventions have generally been successful at reducing SSB consumption, individual-level interventions have reported mixed results, likely due to the variation in behavioral choices seen among individuals and across populations, as well as due to differences in how behavioral constructs are measured. Specifically, individual-level interventions have reported an association between increased SSB-related knowledge and decreased consumption [
15‐
17], while others have not [
11,
14,
18,
19]. Only one behavioral intervention reported changes in SSB intentions as well as consumption [
13]. Importantly, these studies did not use validated scales to measure changes in SSB behavioral constructs. Rather, they used non-validated survey questions related to SSB constructs [
15‐
17,
19] or validated questions focused on SSB-related outcomes such as oral health knowledge and behaviors [
11,
14]. The inconsistency of findings underscores the importance of developing valid measures of SSB-related behavioral constructs, used consistently across populations, as an important step in advancing intervention science aimed at reducing population consumption of SSBs.
Systematic reviews and other meta-analyses demonstrate the relationship between theoretical constructs and nutrition-related health behaviors and weight control [
20,
21]. There is a lack of standard, valid measures of SSB-related behaviors generally, but particularly among adults. Moreover, there is a lack of measures developed for low-income adult populations despite the fact that these populations bear the greatest burdens of chronic disease and likely need the greatest amount of behavioral support around health-related decision-making [
22]. The lack of valid measures may have contributed to the mixed results of individual-level interventions. Further, it has likely precluded a thorough understanding of the behavioral pathways associated with SSB consumption. The development of valid measures of behavioral constructs related to SSB consumption could both help clarify behavioral mechanisms that inform SSB consumption patterns and facilitate assessment of the efficacy of future individual-level interventions targeting SSB consumption.
This study aims to develop valid and reliable questionnaire items and/or scales for three SSB-related constructs informed by the Social Cognitive Theory (SCT). The SCT is a theory encompassing the interactions between environment, people, and their behavior [
23,
24]. For these reasons, SCT is frequently used as a theoretical underpinning for SSB-related interventions among both adults [
25] and adolescents [
12]. In this study, we focused on three constructs most applicable to individual-based interventions, specifically 1) SSB-related knowledge, 2) Self-efficacy to limit SSB intake, and 3) Intention to limit SSB intake. Together, these constructs inform health-related behavior. Knowledge can work in multiple ways, for instance increasing one’s behavioral capability to perform a behavior. Behavioral capability in turn is one factor related to increasing one’s self-efficacy, or ability to perform a behavior. Intention to engage in behavior influences self-regulatory processes such as goal setting and evaluating goal attainment progress.
This paper reports on the development and testing of measures to assess these three theory-related constructs associated with adult SSB consumption.
Methods
The research plan for this measure development study was reviewed and approved by the Boston University Medical Center Institutional Review Board. Data for the study was collected between July of 2016 and January of 2017. Participants were adult residents of public housing living in two housing developments in Boston, MA.
Questionnaire development
Questionnaire development was iterative and occurred in multiple phases to facilitate ongoing improvement of the instrument. The research literature was reviewed to identify items that pertained to the behavioral theory constructs of interest – knowledge, self-efficacy, and intention. The research team, which included expertise in nutrition, behavioral science, and epidemiology, reviewed each item to determine the appropriate fit within each construct and ensure that each question was well designed. Once existing items were compiled and reviewed, each construct was assessed to identify whether or not there were potential gaps in measurement. When gaps were identified, such as a lack of SSB-specific knowledge questions or re-framing for an adult population, measures were developed or modified to address them. The methods applied for each construct are described below.
Knowledge
Existing questionnaires [
12,
15,
26], the majority of which were developed for youth, were reviewed and adapted. New questions were written based upon generally accepted, publicly-available SSB-related knowledge [
27‐
29] and the expertise of the research team. At least one knowledge item corresponding to each self-efficacy and intention question of interest was included. This ensured that the overall questionnaire was asking about knowledge, self-efficacy, and intention related to the same concepts. The initial knowledge instrument had 9 total questions pertaining to adult SSB-related knowledge. Response options were multiple choice, and varied from True or False to more complex responses depending on the question. For all questions, there was only one correct option. A correct response was assigned a 1 and an incorrect or ‘don’t know’ response was assigned a 0.
Self-efficacy & intention
Existing questionnaires about SSBs, dental health behavior, and obesity were adapted for SSB-related self-efficacy and intention instruments [
12,
30‐
33]. Questions that had previously been pilot tested in the priority population were prioritized for inclusion [
30]. The final questionnaire included 12 items for self-efficacy and 4 for intention. Response options were scored 1 to 5 and ranged from “Not sure at all” to “Extremely sure” for some self-efficacy questions and “Strongly disagree” to “Strongly agree” for other self-efficacy questions, depending on question content. For intention items, the scale was again 1 to 5 and response options ranged from “Do not want to at all” to “Very much want to.” Thus, lower scores were associated with lower self-efficacy and/or intention with respect to SSB consumption.
The 15-question Beverage Intake Questionnaire (BEVQ-15) was administered in addition to questions pertaining to knowledge, self-efficacy, and intention. The BEVQ-15 is a validated measure of adult consumption of sugar-sweetened beverages and was used to assess total weekly calories from beverages and total calories from SSBs [
34‐
36]. However, to our knowledge, the BEVQ-15 has not been validated in populations with demographics similar to our study population i.e. low-income, urban adults. In the BEVQ-15, the predefined categories of SSBs are as follows: Sweetened Juice Drinks, Regular Soft Drinks, Sweet Tea, Coffee with cream and/or sugar, and Energy Drinks. Additional beverage categories that are listed in the BEVQ-15, but are also not classified as SSBs are: water, 100% fruit juice, whole milk, reduced fat milk, low-fat milk, coffee or tea without cream and/or sugar, beer, hard liquor, and wine. This instrument has been updated since the time our research was completed [
37].
After finalization of the initial questionnaire, it was translated into Spanish by study staff who are native Spanish speakers and back-translated by native Spanish speakers who were not involved in the translation process. Whenever possible, previously published Spanish translations of existing questions were used. The full questionnaire is available as a
supplementary file.
Pilot testing
The initial questionnaire was pilot tested with members of the priority population: residents of Public Housing Developments (PHDs) in the city of Boston, MA. Residents of PHDs are predominantly comprised of individuals from racial/ethnic minority groups living below the federal poverty line. Owing to contextual issues, including educational access, community resources, and discrimination, residents have been shown to suffer from disproportionately higher rates of chronic disease for which consumption of SSBs is a primary risk factor [
22]. For these reasons, pilot testing was aimed at ensuring comprehension of the questionnaire items, and completeness of constructs given cultural and environmental influences. Using a standardized protocol, two bi-lingual study staff administered the first version of the questionnaire to 12 participants, 6 in English and 6 in Spanish. Following the administration of the questionnaire, participants responded to a series of open-ended questions designed to assess the salience of the questionnaire items. In response to pilot testing, we refined, deleted, and merged questions based on feedback received. For example, we modified the language on item 11 of the self-efficacy instrument to state “when it’s on sale at the store” as opposed to the original language of, “when it’s cheap”.
Sample selection
Participants were recruited from two different PHDs in Boston, MA, one medium-sized (~ 250 households) and one large (~ 400 households) between July of 2016 and January of 2017. The research team obtained a complete listing of households (no resident information) for both PHDs from the Boston Housing Authority, which formed the sampling frame. Given our intent to engage in exploratory factor analysis, our target sample size was 150 [
38]. All households were approached at least once to assess eligibility and interest. Study staff who were bilingual in Spanish and English recruited participants via door-to-door knocking and posting flyers throughout the selected developments. Individuals were eligible if they spoke either English or Spanish, were at least 18 years old, and were residents of the selected PHD site. If an eligible individual agreed to participate, staff members attempted to conduct the interview immediately, or schedule for the near future. Recruitment efforts were conducted at various times of the day to maximize the possibility of contacting eligible individuals, including in the evenings and on weekends. In exchange for participation, residents received a $30 gift card to Target stores. Only one adult from each household was enrolled.
Data collection
Interviews were primarily conducted in the participant’s home or a common area in the PHD. Interviews were conducted by three, bilingual study staff members following a standardized protocol. The questionnaires were administered via a structured one-on-one interview conducted in the participant’s preferred language. On average, the interview took 38 min to complete. Participants did not see the survey items; however, item response options were printed out and made available to participants for viewing upon administering each item. Paper response sheets were used to record responses during the interview. Subsequently, responses were manually entered into an online database. Data from each interview were entered twice by two different study staff members for quality assurance. Discrepancies were reviewed by a third staff member.
In order to test the reliability of participant responses (test-retest), the final 60 participants were given the opportunity to participate in a repeat assessment to occur 13–15 days after the initial assessment with repeated compensation. Thirty participants completed a repeat assessment.
Statistical analyses
Analyses were conducted using SPSS Statistics (Version 25; Armonk, NY: IBM Corp, 6/17/2018) and IBM SPSS Amos (Version 24, Wexford, PA; Amos Development Corp,5/13/2019). Descriptive statistics to describe the sample and summary scores of questionnaire items were calculated. Construct validity, the extent to which the construct measures what it is thought to measure [
38,
39], was assessed by examining hypothesized relations between variables or dimensions for self-efficacy. Criterion validity, whether the construct is related to beverage consumption, was assessed for knowledge, self-efficacy and intention items. Internal consistency reliability and test-retest reliability were assessed for self-efficacy only.
Self-efficacy
The construct validity of the self-efficacy scale was evaluated using confirmatory factor analysis (CFA); which was hypothesized to result in a well-defined factor structure.
Prior to running the CFA, means, medians, modes, ranges, skew, and kurtosis were calculated to assess the normality of the 12 self-efficacy questions. Normally distributed data have a skew and kurtosis near 0 and values less than 2.0 are ideal for factor analysis purposes. The team discussed any questions that were not normally distributed to determine if the item should be removed prior to the data analysis. Items with a mean near the middle of the response range, a larger standard deviation, and skew and kurtosis less than one were considered ideal. Items with means, medians, modes that were close to the ends of the response range, skew or kurtosis above two and narrow standard deviations were considered for removal. Response options included as part of the self-efficacy questionnaire allowed for participants to report if they did not drink SSBs or regular soda (see SE2, SE3 in
supplementary file). Twenty-seven participants (18%) reported that they did not consume soda, while 11 participants (7%) reported that their consumption did not include other forms of SSBs. Maximum-likelihood estimation and full information maximum likelihood was used to handle missing data [
39].
For the CFA, factor loadings below 0.40 were considered for deletion, and model fit and modification indices were examined to optimize the fit. A model was considered to have good fit if confirmatory factor index (CFI) was greater than 0.95, and both root mean square error of approximation (RMSEA) and standardized root mean square residual (SRMR) were less than 0.05 [
40]. CFA were completed in IBM Amos (Version 24, Wexford, PA; Amos Development Corp).
Internal consistency (reliability) of the self-efficacy items was assessed with Cronbach’s alpha, a value >.70 was considered good and suggestive of the items measuring the same construct [
38]. Test-retest reliability for the self-efficacy scale score was evaluated using intraclass correlation coefficients (ICC).
Knowledge
The criterion validity of knowledge was hypothesized to be those who scored correctly on an item would have lower consumption of SSBs and higher intention to engage in healthful beverage consumption behavior. The percent of participants who responded correctly to each question was calculated. Questions that were deemed to be more “challenging” (< 50% correct responses) were then used to compare average BEVQ-15 scores across response categories to assess whether average consumption was significantly different based on SSB-related knowledge.
Intention
Criterion validity of intention was assessed by examining the relationship between intention and behavior, and intention and self-efficacy. A negative relationship was hypothesized for behavior and a positive one for self-efficacy.
Discussion
This study describes the development and initial validation of a questionnaire to assess 3 constructs related to adult SSB consumption: SSB-related knowledge (4 final items), self-efficacy (5 final items), and intention (4 final items). The results provide evidence for the validity of some of the items. The self-efficacy scale drew upon the literature to develop a novel scale for self-efficacy of sugar-sweetened beverage consumption in adults. The resulting 5-item scale met the criteria used to establish a good fitting model, suggesting good construct validity. Additionally, as predicted, the 5-item self-efficacy summary score was negatively correlated with calories consumed via beverages overall, and SSBs specifically, suggesting criterion validity of the scale, a subset of construct validity. The scale also had good internal consistency (alpha) and moderate test-retest reliability.
While there is extensive literature on self-efficacy [
12,
32,
33] the literature is less extensive for knowledge and intention questionnaires. In fact, for knowledge, we were unsuccessful in identifying existing questionnaires to inform this study. Four of the 8 items evaluated were discarded because they were not difficult enough (about 92–99% answered correctly) to provide an evaluation sensitive enough to show gains in knowledge across time. It is possible that these questions were answered correctly because of ongoing campaigns in urban areas in regard to SSB consumption. It is also possible that the use of the True/False format increased the chances of answering correctly. The four remaining items appeared to be more difficult, with 16 to 40% of the sample answering correctly. These items also included 3 true/false questions, but it is possible the content was not as well-known in this population. The knowledge item with the best profile (K2) used a multiple-choice format and 40% answered it correctly. This item was also significantly correlated with the self-efficacy summary score, and in the predicted direction, suggesting good criterion validity, whereas the other 3 items did not show statistically significant correlations. Future research could explore additional knowledge questions to improve the clarity of the wording, especially K8, and increase the breadth with which the construct can be measured. We recommend including all knowledge questions to enable a thorough assessment of the knowledge of different populations.
As mentioned previously, there is scant literature on intention questionnaires for SSB-related behaviors in adults. The criterion validity of the intention items was evaluated in this study by predicting that intention to drink fewer SSB-related beverages, more water, or tell others about what sugary drinks are would be negatively related to actual consumption. The intention to drink less soda (INT2) was significantly correlated with total caloric intake suggesting good criterion validity. It is possible that we did not find additional correlations between intention and consumption because of the “intention-behavior gap”, the idea that reported intentions do not always translate to behavior change [
43]. However, there is evidence of convergent validity for all 4 intention items because they were significantly correlated with self-efficacy scores in the expected direction. Taken together the intention items have good evidence for construct validity, although future studies should continue to explore their validity.
This study is the first to design and assess the validity of constructs related to consumption of SSBs in adults. Other studies focused on SSB-related behaviors have often used measures that were not validated, including questions related to SSB knowledge [
15,
26], intention [
44], and self-efficacy [
17]. These constructs are either directly specified or contribute to constructs within the SCT, which is a broad theory encompassing the interactions between environment, people, and their behavior [
23]. However, these constructs do not cover all aspects of SCT, which also include important factors such as outcome expectations and observational learning, which could be included in future questionnaire iterations.
Our study has several strengths. Measures were developed, pilot tested, adapted, and evaluated in both English and Spanish in a racially-diverse population of people living in public housing. Public housing residents are more likely than other populations to be from racial and ethnic minority groups and immigrants, and experience chronic diseases and poor overall health [
22]. As such, health-related research and interventions that incorporate public housing residents have a high potential to improve important health disparities. Study participants had a wide variety of SSB consumption patterns, with 27 people reporting that they consumed no soda and 11 people reporting no consumption of other SSBs types. There were also a fair number of respondents with high levels of SSB consumption. While the constructs measured by this scale are applicable to broad populations, a strength of this study is its testing in a diverse sample with varied SSB consumption patterns. That being said, future research on these measures would benefit from evaluating potential differences among individuals in racial/ethnic minority groups in SSB and related constructs.
This study should be interpreted in the context of some important limitations. This study was limited by the relatively small sample size of 150 PHD residents. The sample was also primarily women; thus, the validity of these measures may be different among men. The knowledge instrument was also limited by the high proportion of correct answers. Compared to other populations, our sample appeared to have greater knowledge of our assessed constructs [
45,
46]. When considering using this scale in other populations, researchers may want to include all of the knowledge questions. Specifically, item K8 had limitations as worded. The question was intended to assess knowledge about the impact of sugars contained in different beverages on dental health. However, as written, it could be read as ambiguous. This is because sugars added to SSBs are molecularly distinct from fructose found in fruit and lactose found in milk, despite the fact that they contribute similarly to dental carries and sugar-related health issues. We would recommend adjustments to this question for future uses of the scale, for example “The sugar that is found naturally in milk can cause cavities, just like sugar that is added to foods and drinks when they are being prepared.” Though this scale is designed to be broadly applicable to adult populations, this measure would benefit from being validated in other populations. Lastly, like any questionnaire study, the results may suffer from some amount of measurement error owing perhaps to one’s ability to recall information or perceptions of what responses may be socially desirable.
Conclusions
This study provides evidence for the validity of SSB-related knowledge, self-efficacy and intention questions for use in adults, which could provide important theory-based markers for program evaluations of SSB-related interventions. The existence of validated questionnaires is a necessary pre-requisite to understanding the mechanisms by which interventions are working (or not working), allowing program planners to make necessary adjustments for future interventions. These measures could be used in other settings that serve diverse and/or underserved populations similar to public housing developments, such as Special Supplemental Nutrition Program for Women, Infants, and Children (WIC) Centers, safety-net hospitals, and nutrition assistance/food distribution programs. Nevertheless, the validity of these questionnaires should be evaluated in these settings and other populations (e.g., men) to ensure they are generalizable.
Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit
http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (
http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.