Published on in Vol 3, No 4 (2015): Oct-Dec

The Most Popular Smartphone Apps for Weight Loss: A Quality Assessment

The Most Popular Smartphone Apps for Weight Loss: A Quality Assessment

The Most Popular Smartphone Apps for Weight Loss: A Quality Assessment

Original Paper

1School of Molecular Bioscience, Charles Perkins Centre, University of Sydney, Camperdown, Australia

2Nutritional Epidemiology Group, School of Food Science and Nutrition, University of Leeds, Leeds, United Kingdom

Corresponding Author:

Margaret Allman-Farinelli, PhD, FDAA

School of Molecular Bioscience

Charles Perkins Centre

University of Sydney

Johns Hopkins Dr

Camperdown, 2050

Australia

Phone: 61 2 9036 7045

Fax:61 2 8627 1605

Email: margaret.allman-farinelli@sydney.edu.au


Background: Advancements in mobile phone technology have led to the development of smartphones with the capability to run apps. The availability of a plethora of health- and fitness-related smartphone apps has the potential, both on a clinical and public health level, to facilitate healthy behavior change and weight management. However, current top-rated apps in this area have not been extensively evaluated in terms of scientific quality and behavioral theory evidence base.

Objective: The purpose of this study was to evaluate the quality of the most popular dietary weight-loss smartphone apps on the commercial market using comprehensive quality assessment criteria, and to quantify the behavior change techniques (BCTs) incorporated.

Methods: The top 200-rated Health & Fitness category apps from the free and paid sections of Google Play and iTunes App Store in Australia (n=800) were screened in August 2014. To be included in further analysis, an app had to focus on weight management, include a facility to record diet intake (self-monitoring), and be in English. One researcher downloaded and used the eligible apps thoroughly for 5 days and assessed the apps against quality assessment criteria which included the following domains: accountability, scientific coverage and content accuracy of information relevant to weight management, technology-enhanced features, usability, and incorporation of BCTs. For inter-rater reliability purposes, a second assessor provided ratings on 30% of the apps. The accuracy of app energy intake calculations was further investigated by comparison with results from a 3-day weighed food record (WFR).

Results: Across the eligible apps reviewed (n=28), only 1 app (4%) received full marks for accountability. Overall, apps included an average of 5.1 (SD 2.3) out of 14 technology-enhanced features, and received a mean score of 13.5 (SD 3.7) out of 20 for usability. The majority of apps provided estimated energy requirements (24/28, 86%) and used a food database to calculate energy intake (21/28, 75%). When compared against the WFR, the mean absolute energy difference of apps which featured energy intake calculations (23/28, 82%) was 127 kJ (95% CI -45 to 299). An average of 6.3 (SD 3.7) of 26 BCTs were included.

Conclusions: Overall, the most popular commercial apps for weight management are suboptimal in quality, given the inadequate scientific coverage and accuracy of weight-related information, and the relative absence of BCTs across the apps reviewed. With the limited regulatory oversight around the quality of these types of apps, this evaluation provides clinicians and consumers an informed view of the highest-quality apps in the current popular app pool appropriate for recommendation and uptake. Further research is necessary to assess the effectiveness of apps for weight management.

JMIR mHealth uHealth 2015;3(4):e104

doi:10.2196/mhealth.4334

Keywords



Obesity is an accelerating global health challenge. The Global Burden of Disease Study 2013 reports 37% of adults (2.1 billion) globally are overweight or obese, with a prevalence of more than 60% in Australia, the United Kingdom, and the United States [1]. Given the magnitude of the epidemic, treatment strategies and interventions with long-term effectiveness and a wide reach are required to address this major public health concern.

Among researchers, there is growing interest into the use of smartphones to deliver behavioral interventions for health because of their cost advantages, ubiquity, and portability [2,3]. Estimates of adult smartphone ownership are 64%, 54%, and 51% in Australia [4], the United Kingdom, and the United States, respectively [5]. A total of 68% of Australian [6], 86% of British [7], and 35% of American smartphone users [8] report downloading a smartphone app. Simultaneously, a plethora of health- and fitness-related apps are now available to individuals through the commercial market (eg, the Google Play store and iTunes App Store) [3,6] and their popularity is ever increasing [9].

Smartphone apps hold promise in supporting health behavior change and weight management [2,3,10-13]. To ensure that these apps are able to influence sustained positive health outcomes, quality assessment is necessary. A range of frameworks have been used to evaluate the quality of apps in a variety of medical and health promotion areas, such as cancer [14-16], diabetes [17,18], smoking [19-21], mental health [22-24], headaches [25], cardiology [26], alcohol [27,28], HIV [29], and pain management [30,31]. These evaluation frameworks include the analysis of content source and expertise, information quality, app technology and design, user engagement and ease of use, and behavioral theories.

Yet, despite the high prevalence of overweight and obesity, there are few evaluations of the quality of weight-management apps, such that even within a review and analysis of mobile health apps for the most prevalent conditions by the World Health Organization, there was no mention of evaluating apps addressing overweight and obesity [32]. To our knowledge, only two studies have evaluated the quality of weight-loss apps. One of the first studies to conduct a systematic analysis of smartphone and iPad weight-loss apps revealed that only eight of 54 apps were of good quality and less than a third had complete scientific accuracy of measurements and nutrition content linked to recommendations from evidence-based guidelines (eg, body mass index [BMI] and estimated energy requirements) [33]. Suboptimal information quality has also been found in Korean obesity-management smartphone apps [34].

When specifically considering the potential for commercial weight-loss apps to enable behavior change, the literature is similarly limited; however, there appears to be a shortage of evidence-based content [35,36] and behavioral theory-based strategies [13,37] being applied. Abraham and Michie’s [38] theory-linked taxonomy of behavior change techniques (BCTs) offers a method of assessing effective behavioral interventions by providing a systematic framework for categorizing the elements necessary for facilitating behavior change. This 26-item taxonomy has been used in a recent review, revealing that an average of 8.1 out of 26 BCTs were incorporated across 40 physical activity and dietary apps [39]. However, given that the majority were physical activity apps (n=30) and only six dietary apps were reviewed, a comprehensive analysis of the quality and evidence base of commercial dietary weight-loss apps, specifically, is warranted.

In addition to the scarcity of comparative studies assessing the quality and effectiveness of dietary weight-loss apps, the urgent and ongoing need for further evaluation of weight-loss apps is reinforced by the limited oversight and standardization around the quality of health and fitness apps by regulatory bodies, such as the US Food and Drug Administration (FDA) [40] and Australia’s Therapeutic Goods Administration [41]. Therefore, the aims of this study were to extend the body of research assessing the quality of such apps by, firstly, examining the accountability, scientific coverage, accuracy, technology-enhanced features, and usability of popular dietary weight-loss smartphone apps and, secondly, by quantifying BCT incorporation in these apps.


Sample Attainment

Dietary and weight-loss smartphone apps were located in the Health & Fitness category of the Google Play store and iTunes App Store in Australia on August 15, 2014. Using a method from previous studies which determined popularity [35-37], the first 200 ranked apps in the Top Selling and Top Apps or Top Paid Apps and Top Free Apps sections of the respective stores above were selected.

Each app underwent initial screening based on the descriptions and associated screenshot images provided by the stores. Inclusion in this evaluation required that the app meet the following criteria: (1) was intended for weight management, (2) addressed dietary behaviors, (3) involved the tracking of energy intake, nutrients, or foods, as self-monitoring has been found to have a consistent association with weight loss, both in intervention programs [42] as well as in smartphone-based strategies [2], (4) had stand-alone functionality (ie, not requiring subscription to another program to operate) [37], and (5) was in English. Apps which were miscategorized under the Health & Fitness category or that addressed other health behaviors were excluded. Specific diet subcategory (eg, paleo diet) apps were also excluded because of limited generalizability [37].

Apps which fulfilled the inclusion criteria were downloaded onto a Samsung S2 smartphone running Jelly Bean 4.1.2 software (for Google Play store Android apps) and onto an iPhone 5 running iOS 7.0.1 (for Apple apps). After one day of use of the app, another screening against the inclusion criteria was undertaken, and those failing to meet the criteria were excluded. Duplicate apps which were available on both the Android and iPhone platforms were selected for use only on the Android operating system.

Evaluation Criteria

As no widely accepted standards of quality evaluation for apps existed, a pro forma evaluation based on a modified version of the instrument developed by Gan and Allman-Farinelli [33] was collaboratively developed between the University of Sydney, Australia, and the University of Leeds, the United Kingdom. The tool contained the following basic descriptive information: name of app, developer, version, number of downloads, average ratings (ie, average number of stars that the app was rated), total number of ratings, number of users who voluntarily rated it, and price. The tool also included the following quality assessment features: accountability, scientific coverage and content accuracy, technology-enhanced features, usability, and incorporation of BCTs (see Table 1). Accountability measures, based on Silberg’s standards [43], evaluated an app’s authorship (ie, the author’s credentials and affiliations), attribution (ie, provision of information sources and references), disclosure (ie, sponsorship disclosure), and currency (ie, how up-to-date the content was kept).

Scientific coverage and content accuracy examined the range and accuracy of information related to weight management and general dietary advice provided by the apps. The practice guidelines for the treatment and management of overweight and obesity in adults released by the Dietitians Association of Australia (DAA) [44] and the National Health and Medical Research Council (NHMRC) [45] were consulted to determine the elements that would be relevant to a weight-management app based on a self-management approach. The features of healthy eating were derived from the NHMRC Australian Dietary Guidelines [46] and Nutrient Reference Values (NRVs) [46].

An additional element was included to further determine the accuracy of these dietary weight-loss apps in assessing energy intake. A weighed food record (WFR), which is considered to be the gold standard of dietary assessment [47], was kept by the first author (JC) for 3 days. The same 3-days’ worth of food intake was entered into all the apps, but using household measures or the default serving sizes provided by the app so as to mimic the food tracking process which would be conducted by a normal user. To determine the accuracy of the energy intake values provided by the apps, they were compared with the WFR results that were analyzed using the nutrient analysis software package FoodWorks, version 7 (Xyris Software) [48] with the Australian Food and Nutrient Database (AUSNUT) 2007 [49].

Apps were also appraised for their inclusion of a range of 14 technology-enhanced features compiled from common features observed in previous app evaluations, as these have been reported to reduce burden or enhance engagement in behavioral strategies [35,36]. The usability of apps was measured by the validated 10-item System Usability Scale (SUS), where items are ranked using a 5-point Likert scale, giving an overall usability score of 0-100 [50,51], and matched with a 7-point adjective rating scale: worst imaginable, awful, poor, ok, good, excellent, or best imaginable [52].

Abraham and Michie’s [38] 26-item taxonomy presented in the following three-phase categorization format was used: (1) motivational enhancing, (2) planning and preparation, and (3) goal striving and persistence [53]. This categorization format was used as a framework to quantify the incorporation of 26 BCTs into the apps, as this taxonomy provides a systematic method of identifying effective behavior change elements.

A total composite score out of 100 for their fulfilment of the different features of the quality assessment evaluation criteria was given to each app. The scoring system awarded the highest weight to scientific coverage and accuracy (32 points) and BCTs (26 points), followed by usability (SUS score out of 100 was scaled down proportionally to 20 points), technology-enhanced features (14 points), and accountability (8 points).

Table 1. Quality assessment evaluation criteria and scoring system.
Evaluation criteriaMaximum scorea
26 behavior change techniques (out of 26)

For each of the 26 behavior change techniquesb1
Accountability (out of 8)

Authors credited1

Author’s affiliation1

Author’s credentials2

Information sources/references given2

Sponsorship disclosed1

App modified in the last month1
Scientific coverage and accuracy (out of 32)

Anthropometric assessment


Body mass index (BMI)



Formula: BMI calculated and its use defined2



Interpretation of BMI: cutoff point for risk and treatment indicated when cutoff point exceeded; indicates healthy weight range4


Safety net on maximal weight loss which can be achieved2

Energy requirement calculator (calculates basal metabolic rate, energy requirement, or deficit based on individual\'s age, gender, physical activity level, and weight-loss goal)4

Calorie counter


Contains food database that helps calculate energy intake4


Energy intake calculations of apps coincide with 3-day WFRc10

Features of healthy eating


Calculates intake of macronutrients2


Recommends servings for five main food groups as per the AGHEd2


Recommends intake or limits other nutrients (ie, saturated fat, fiber, salt, and sugar) as per the AGHE and NRVse2
Technology-enhanced features (out of 14)

Weight/energy intake progress graphs or charts1

Recipes1

Pictures of food1

Barcode scanner1

Online social support/networking components (eg, Twitter and Facebook)1

Internet website links1

Food databases that can be modified (ie, add new foods and remember favorite foods)1

Educational material1

Reminders to log meals1

Calendar1

Flags for lapses in dietary goal adherence1

Physical activity tracking device (eg, accelerometer)/connection to activity apps1

Tracking of negative thoughts/stress1

Ability to export data/details about meals/daily summaries1
Usability (weighted score out of 20)

SUS itemsfN/Ag

aA total composite score out of a maximum of 100 is calculated from the summation of 5 individual quality criteria subscores.

bAs per Dusseldorp et al’s [53] three-phase categorization of behavior change techniques list.

cWFR: weighed food record.

dAGHE: Australian Guide to Healthy Eating.

eNRV: Nutrient Reference Value.

fSUS: System Usability Scale, as per Brooke’s [51] System Usability Scale list.

gN/A: not applicable. Each SUS item is rated on a 5-point Likert scale from 1 (strongly disagree) to 5 (strongly agree). Note that scores for individual SUS items are not meaningful on their own. The SUS score is calculated using a formula, with a maximum of 100, but in this evaluation tool the SUS score has been weighted.

Evaluation Procedure

The evaluation process was discussed among all the other authors to develop a systematic approach for conducting the assessment. All authors were present in the discussion of the assessment criteria, and for consultation on the scoring of individual apps. One expert assessor conducted all the app quality evaluations, with the second assessor reviewing 30% of the apps for inter-rater reliability purposes. Where discrepancies arose in assessors’ results, they were resolved by discussion and, when necessary, in consultation with a third assessor. Apps were used by the first author (JC) for a total of 5 days and scored against the quality assessment criteria. On the first day, the assessor familiarized herself with the menu and interface and thoroughly explored the different functions and key features of the app. Food logging was also completed by the primary assessor after each midmeal and main meal on the first, second, and third days. In order to maintain consistency across the 5 days, additional engagement with the app was based upon push notification prompts and reminders from the app in order to replicate the frequency of app engagement which is likely to be carried out by individuals in a naturalistic setting.

Data Analysis

The different components of the pro forma evaluation were analyzed using descriptive statistics. The frequency, mean, standard deviation, and relative rankings of apps were determined based on each assessment criteria and by overall score. Two-way mixed intraclass correlation coefficients (ICCs) were determined for inter-rater reliability. Absolute and percentage differences of the mean energy intake values of the 3 days were calculated for each app against the WFR. The overall mean of differences and 95% CIs of the apps from the WFR were calculated. Linear regression analysis was used to determine the relationship between the rankings of the apps as per the app stores (ie, popularity) versus the quality assessment criteria. P<.05 was considered significant. Statistical analyses were conducted using IBM SPSS Statistics for Windows, version 22.0 (IBM Corp) [54].


Sample Characteristics

From the sample of 800 top Health & Fitness category apps, 55 apps met the inclusion criteria following the initial screening and were downloaded to be included in the analysis. After the first day of use, 27 apps were excluded from further detailed evaluation because of duplication, lack of tracking functions, or not being stand-alone in functionality. A total of 28 apps were reviewed in detail, with 9 apps (32%) evaluated by both assessors. An excellent level of inter-rater reliability was observed (two-way mixed ICC .94, 95% CI .75-.99). These 28 apps were characterized into the following four categories: calorie counters (17/28, 61%), Weight Watchers point system-based apps (5/28, 18%), basic trackers which logged food or nutrients but contained no energy calculations (4/28, 14%), and image-based meal trackers which used a process of taking photos of meals in order to track intake rather than a focus on calorie counting (2/28, 7%) (see Figure 1).

A total of 23 apps out of 28 (82%) provided outputs which could be compared to the WFR and were included in the accuracy analysis of energy intake. The following 5 apps out of 28 (18%) were excluded from analysis as they did not calculate energy intake: Michelle Bridges 12 Week Body Transformation (12WBT); Food Journal by Katie Wright; FoodTrackerPro by Aspyre Solutions; Argus—Pedometer, Run, Cycle; and TwoGrand.

Figure 1. Flow diagram of the sampling procedure with the number of dietary weight-loss smartphone apps included or excluded.
View this figure

Quality of Apps

The scores for each of the evaluation components and the ranking of the apps based on their total quality score are summarized in Table 2. Noom Weight Loss Coach received the top ranking based on its overall score of 75. This was followed by Calorie Counter PRO by MyNetDiary and ControlMyWeight by CalorieKing (score of 65). The app receiving the lowest overall score was Food Journal by Katie Wright (score of 17). The mean overall score for the apps was 47.3 (SD 13.9).

Regression analyses determined that lower-numbered rankings in the app store (ie, greater popularity) were significantly associated with total quality assessment score (R2= .375; P=.001), scientific coverage and accuracy (R2=.377; P=.001), technology-enhanced features (R2=.192; P=.02), and incorporation of BCTs (R2=.166; P=.03), while showing no significant association with accountability and usability (see Figure 2).

Accountability

Only 1 app out of 28 (4%), Calorie Counter by SparkPeople, fulfilled all the accountability criteria. The mean score for accountability was 3.5 out of 8 (SD 2.3; see Table 2). Over half the apps were modified within the last month (17/28, 61%) and credited the authors (16/28, 57%). Around 40% of the apps disclosed sponsorship (12/28, 43%), information sources and references for the food database used by the apps (12/28, 43%), and authors' affiliations (11/28, 39%). Under a third of the apps (9/28, 32%) reported authors or app development team members with scientific or health professional credentials.

Scientific Coverage and Accuracy

The mean score for scientific coverage and accuracy was 18.8 out of 32 (SD 8.0), with ControlMyWeight by CalorieKing and Noom Weight Loss Coach both receiving the highest scores (28 out of 32) (see Table 2). The majority of apps provided estimated energy requirements (24/28, 86%) and contained a food database that helped to calculate energy intake (21/28, 75%) (see Figure 3). Less than a third of apps incorporated each of the anthropometric assessment features—calculation of BMI and defining its use (9/28, 32%), interpretation of BMI and healthy weight range (8/28, 29%), and safety net on maximal weight loss (8/28, 29%). The different features of healthy eating were incorporated to different extents, with 16 apps out of 28 (57%) calculating intake of macronutrients. However, only 11 apps out of 28 (39%) recommended guidelines for achieving healthy dietary patterns, such as limiting saturated fat, salt, and sugar, and maximizing fiber intake. Only 6 of the 28 apps (21%) recommended servings for the five main food groups. TwoGrand and Food Journal by Katie Wright did not include any of the elements for scientific coverage and accuracy.

Table 2. Relative ranking of popular dietary weight-loss smartphone apps. Ranking was determined according to their total score which was calculated from the sum of the scores for each component of the quality assessment criteria.
RankAppScore


Acc.aSCAbTEFcUs.dBCTeTSf
1gNoom Weight Loss Coach by Noom, Inc (2010, USA)5289191475
2Calorie Counter PRO by MyNetDiary, Inc (2010, USA)3276171265
2gControlMyWeight by CalorieKing Wellness Solutions (2012, Australia)628320865
4Food Diary and Calorie Tracker by MyNetDiary, Inc (2010, USA)327616.51163.5
5gEasy Diet Diary by Xyris Software (2011, Australia)727520463
6Calorie Counter by SparkPeople (2012, USA)8208151061
7gJillian Michaels Slim-Down: Weight Loss, Diet & Exercise Solution (2010, USA)622713957
8MyPlate Calorie Tracker LITE by Demand Media, Inc (2013, USA)621717556
9gCalorie Counter by MyFitnessPal, Inc (2009, USA)222812.51054.5
9Calorie Counter & Diet Tracker by Calorie Count (2010, USA)325713.5654.5
9gMy Diet Coach Pro by InspiredApps (A.L) Ltd (2012, USA)318612.51554.5
12Nutritionist—Dieting made easy by Outlier (2011, USA)522614754
13My Diet Diary Calorie Counter by MedHelp, Inc (2011, USA)422511.5850.5
14gCalorie Counter by FatSecret (2010, USA)222914.5249.5
15Cronometer by BigCrunch Consulting, Ltd (2011, USA)422414.5347.5
16Value Diary Plus by Fenlander Software Solutions, Ltd (2011, UK)023812447
17Diet Watchers Diary by Croc Software (2012, Israel)020315.5442.5
18Body Tracker—body fat tracker by Linear Software, LLC (2012, N/Ah)319410.5440.5
19gMap My (walk, run, ride, fitness) apps by MapMyFitness, Inc (2008, USA)62044.5539.5
19Map My + (walk, run, ride, fitness) apps by MapMyFitness, Inc (2008, USA)62044.5539.5
21Pts Plus Weight Diary by Frippware (2012, N/A)020411439
22Point Tracker Weight Watchers by PointTracker (N/A, UK)018313337
23Points Calculator & Weekly Weight Loss by Christian Robert Gossain (2011, N/A)120211236
24Argus—Pedometer, Run, Cycle by Azumio (2013, USA)46610.5834.5
25TwoGrand by TwoGrand, Inc (2013, USA)20515.5729.5
26gMichelle Bridges 12WBTi(2012, Australia)66111.5327.5
27FoodTrackerPro by Aspyre Solutions (2010, Australia)24413326
28Food Journal by Katie Wright (2012, USA)10015117
Mean (SD)3.5 (2.3)18.8 (8.0)5.1 (2.3)13.5 (3.7)6.3 (3.7)47.3 (13.9)

aAcc.: accountability (out of 8).

bSCA: scientific coverage and accuracy (out of 32).

cTEF: technology-enhanced features (out of 14).

dUs.: usability (out of 20).

eBCT: behavior change technique (out of 26).

fTS: total score (out of 100).

gEvaluated by two assessors for inter-rater reliability purposes.

hN/A: not applicable (as country or year was unavailable).

i12WBT: 12 Week Body Transformation.

Figure 2. Regression analyses of the association between the rankings in the commercial app store (ie, popularity) versus quality assessment measures: (a) overall quality assessment score, (b) accountability, (c) scientific coverage and accuracy, (d) technology-enhanced features, (e) usability, and (f) behavior change technique (BCT). Note: ranking is numerical, with the rank of most popular apps starting from 1 and the least popular app ranked at 200.
View this figure

Across the 23 apps which featured energy intake calculations, mean absolute energy difference when compared against the WFR was 127 kJ (95% CI -45 to 299) and mean percentage energy difference was 1.9% (95% CI -0.5 to 4.4; see Figure 4). Calorie Counter by FatSecret and Points Calculator & Weekly Weight Loss had the greatest discrepancy in reported energy intake values, with 1001 kJ (14%) greater and 700 kJ (10%) lower energy differences, respectively. In contrast, Map My (walk, run, ride, fitness) and Map My + (walk, run, ride, fitness) reported the smallest energy difference—13 kJ (0.2%) lower—when compared with the WFR.

Figure 3. Screenshot of sample smartphone app which provides estimates of energy requirements and searchable food databases (from Noom Weight Loss Coach by Noom, Inc).
View this figure
Figure 4. Accuracy of dietary apps compared to the weighed food record (WFR). Differences in mean energy intake values (kJ) over 3 days for dietary apps (n=23) were compared against the 3-day WFRs analyzed on FoodWorks. The overall mean difference of all the apps from the WFRs is denoted by the black diamond, and the 95% CI is indicated by the error bars.
View this figure

Technology-Enhanced Features

Out of the 14 technology-enhanced features considered, a mean of 5.1 features (SD 2.3) were identified across the apps. The apps with the greatest inclusion of technology-enhanced features were Calorie Counter by FatSecret and Noom Weight Loss Coach (score of 9 out of 14), while Food Journal by Katie Wright contained none of the features (see Table 2).

Weight or energy intake progress charts and modifiable food database were the most common technology-enhanced features present across the apps (22/28, 79%), followed by barcode scanners and online social support or networking, which were both included by 12 of the 28 apps (43%) (see Figure 5). A quarter of the apps (7/28, 25%) had the ability to export data, either for direct access by the individual or for a dietitian to access (eg, Easy Diet Diary), and included a built-in physical activity tracking device (eg, pedometer, accelerometer, or connection to other activity monitoring apps). Flags for lapses in dietary goal adherence was the least observed technology-enhanced feature, only appearing in 2 of the 28 apps (7%). Figure 6 illustrates examples of some of these features found in commercial apps.

Usability

The mean SUS score was 67.5 (SD 18.5) out of 100 (range 0-100), equating to an adjective rating of ok. The majority of apps (25/28, 89%) had a usability rating from ok to best imaginable. The 2 apps out of 28 (7%) with the greatest usability scores were ControlMyWeight by CalorieKing and Easy Diet Diary by Xyris (see Table 2). These apps had a greater adaptability within the food database, allowing favorite, recent foods to be memorized, and had a range of household and metric measures, which increased the ease of self-monitoring food and energy intake. They also included additional features which fostered an increased engagement with the app.

Incorporation of Behavior Change Techniques

An average of 6.3 (SD 3.7) of the 26 BCTs were included across the apps. The majority of the apps (26/28, 93%) integrated less than half of the BCTs. My Diet Coach Pro had the highest incorporation of BCTs (15 BCTs) followed by Noom Weight Loss Coach (14 BCTs), while Food Journal by Katie Wright had the lowest BCT inclusion (1 BCT) (see Table 2).

Figure 5. Incorporation of technology-enhanced features across apps. Number of total apps (n=28) incorporating each technology-enhanced feature.
View this figure
Figure 6. Screenshots of technology-enhanced features present in smartphone apps: (a) modifiable food database (from Calorie Counter by FatSecret), (b) weight progress charts (from Noom Weight Loss Coach by Noom, Inc), (c) built-in physical activity tracking device (eg, pedometer, accelerometer, or connection to other activity monitoring apps) (from Noom Weight Loss Coach by Noom, Inc), and (d) flags for lapses in dietary goal adherence (from MyFitnessPal by MyFitnessPal, Inc).
View this figure

Figure 7 highlights the proportion of apps that included each individual BCT, as per the three-phase categories. BCTs associated with goal striving and persistence were the most commonly incorporated, followed by planning and preparation, and lastly motivation enhancing. All apps incorporated self-monitoring of behavior, which predominantly appeared in the form of tracking of food or energy intake, and also through the monitoring of physical activity and exercise. Feedback on performance was also present in the majority of apps (24/28, 86%). Feedback predominantly appeared in the form of instant feedback, whereby energy intake was immediately updated when foods or exercises were logged. Longer-term trends of energy intake and weight progress were represented graphically by many apps. Only 2 apps out of 28 (7%)—Food Diary and Calorie Tracker, and Calorie Counter PRO—provided individualized and tailored feedback. Absent across all the apps were the following BCTs: agreeing on behavioral contract, identification of a role model, using follow-up prompts, self-talk, relapse prevention, and stress management (stress theories).

Figure 7. Incorporation of behavior change techniques (BCTs) across apps. Number of apps (n=28) incorporating each of the 26 individual BCTs according to the three-phase categories: motivation enhancing, planning and preparation, and goal striving and persistence.
View this figure

Principal Findings

This evaluation indicates that, overall, the most popular dietary weight-loss apps available on the commercial market are suboptimal in quality. Few apps scored well for measures of accountability and while, overall, many apps scored reasonably in the domain of scientific coverage and accuracy, there was limited scientific coverage of information relevant to weight management. Although the agreement between apps and a dietitian-coded weighed food record was fair—mean difference 127 kJ, 95% CI -45 to 299—the accuracy of energy intake calculations was variable across different apps. There was restricted coverage of technology-enhanced features, and the usability of apps ranged from the worst imaginable to the best imaginable. A limited incorporation of BCTs was found across the apps reviewed.

Evaluations based on assessing the actual app content and the inclusion of evidence-based information have been determined to be better predictors of appraising the quality of apps than content-independent review methodologies [55]. Furthermore, the self-management nature of these commercial dietary weight-loss apps emphasizes the necessity of delivering robust and accurate evidence-based information through these apps to the consumer. Considering the extent of BCT incorporation also provides an indication of the likely effectiveness of these apps to facilitate behavior change [56,57].

The accountability of apps is fundamental, both for the public and for their use as weight management tools in clinical practice or for the distribution of wide-reaching public health interventions to target obesity. Although many apps were updated regularly, less than half of the reviewed apps disclosed sponsorship, provided references and sources of information, and declared the authors' affiliations, which parallels the poor accountability found in other studies of obesity-management apps, both in Australia [33] and Korea [34]. It is also disconcerting that there was an absence of scientific and health professionals guiding the design and development of these weight-loss apps. This may offer one explanation for the predominance of calorie counting apps and limited scientific coverage of information that would support weight management, such as energy balance, and foods and beverages to meet the requirements and recommendations from dietary guidelines. Lay users and dietitians have expressed similar sentiments over the credibility, comprehensiveness, accuracy, and general quality of health and fitness apps, as well as the reputability and legitimacy of the app sources [3,58]. This indicates a need for collaborative input from researchers and qualified health professionals to guide the improvement and development of comprehensive theory-based dietary weight-loss apps with tailored and targeted nutrition advice.

Furthermore, there was variability in the accuracy of energy intake calculations, although the mean difference was small with the 95% CI indicating nonstatistically significant variation between the two methods. However, some weight-management apps display a large discrepancy in values when compared to the WFR. For example, the second most highly ranked app—Calorie Counter PRO by MyNetDiary, Inc—also had the second highest energy overestimation at 678 kJ. These results highlight the range of potential under- or overestimation by apps; however, the results are concordant with other studies which have found that dietary assessment carried out by mobile phones and nutrition apps have similar validity and reliability [59] and moderate-to-good correlations for measuring energy and nutrition intakes [60] when compared with conventional methods. In this evaluation, even when a trained dietitian entered the foods and serving sizes, there were difficulties experienced due to the lack of alternative serving sizes or household measures, and the inability to match the foods consumed as the majority of apps used a US food database. Another source of variability in accuracy may be the modifiability of food databases in some apps, which although offers the benefit of user customization of foods consumed, nevertheless presents shortcomings in the accuracy of nutrients when users enter them in themselves, and also can lead to losses to the quality of the food database from alterations by crowdsourcing. Since tracking of energy intake is an important feature of many apps, the need for accuracy is important to avoid misleading the consumer.

Evidence suggests that weight loss is supported by frequent contact with an intervention [37,61]. However, in health and fitness apps, retention has been found to rapidly decrease from 47% retention at 30 days to only 30% at 90 days [62], and with a quarter of downloaded health apps only used once, and three-quarters discontinued after the tenth use [63]. Similarly, self-monitoring and use of a weight-loss app is reported to decline over a 6-month period [10,64]. Thus, the usability (ie, the efficiency, acceptability, and appeal) of an app for its target audience is critical, particularly if the aim is to use apps repeatedly to facilitate long-term changes in behavioral outcomes and weight loss. For the dietary weight-loss apps reviewed, the mean SUS of 67.5 is equivalent to an adjective rating of ok. However, the weight-loss apps best rated for usability in this review, such as ControlMyWeight by CalorieKing and Easy Diet Diary by Xyris, were rated best imaginable (SUS 100), and out-rated other apps for recording physical activity exertion (SUS 75.4; good) [65] and for diabetes self-management (SUS 84; good) [66]. Many of the dietary weight-loss apps reviewed would still benefit from improvements in the ease of app use, as well as user engagement, particularly if they are to be the medium for delivering public health or preventative health interventions for chronic disease and obesity management.

Food logging and self-monitoring can be burdensome and time-consuming, and can result in noncompliance and underestimation as usual dietary intakes may be altered to avoid the inconvenience of recording [67]. Hence, technology-enhanced features, such as barcode scanners, can assist in reducing user burden and in maintaining motivation and compliance for ongoing use of the apps through online social networking with health professionals and others trying to lose weight [2,35,36]. In this evaluation, the restricted range of technology-enhanced features integrated within commercial apps may be another contributor to the decline in engagement with an app, especially as the primary role of these weight-loss apps is to promote self-monitoring and tracking.

In Internet-based interventions, incorporation of more BCTs were found to have a larger effect on behavior than interventions with fewer techniques [57]. Across the 28 apps reviewed, less than a quarter of the 26 BCTs were included. This gap between the theoretical framework, which has established the potential to enable behavior change and weight loss, and its subsequent inclusion in apps is consistent with the findings from other evaluations of weight loss [13,35-37] and physical activity and dietary [39] apps. The hallmarks associated with effective healthy eating and physical activity interventions have been determined to be self-monitoring accompanied by at least one of the following: feedback on performance, intention formation, specific goal setting, and a review of behavioral goals [56]. All the apps analyzed in this review included self-monitoring of behavior, as it was an inclusion criterion of this evaluation, and feedback on performance was also present in the majority of apps. However, only 2 apps—My Diet Coach Pro and Noom Weight Loss Coach—included the range of BCTs commonly associated with greater effectiveness.

These 2 apps also included gamification, which is defined as using elements of game design in nongame contexts [68], and involves the inclusion of motivational affordances, such as points, levels, clear goals, feedback, rewards, progress, and challenges [69]. Gamification has been found to yield positive effects among a review of empirical studies on gamification [69]. Furthermore, in physical activity and dietary health and fitness apps, behavioral theory and, more specifically, motivational components of behavior were significantly associated with gamification [70]. This suggests that gamification not only has an apparent overlap with BCT constructs, but that it also has the potential to increase the motivation of app users in order to sustain habits and engage individuals with the behavioral strategies within apps through creation of positive, intrinsically motivating, “gameful” experiences [69,71,72]. Therefore, the gamification of weight-management apps may be a possible avenue for enhancing the delivery of behavioral theories, particularly motivational components; more in-depth study of the relationship between gamification and health behavior change is necessary.

One of the key strengths of this study was the theory-driven approach to app evaluation which allowed for a thorough examination of multiple parameters around the quality of the apps, such as accountability, scientific coverage, accuracy, technology-enhanced features, and usability, as well as behavioral theory. Particularly, as there is no industry standard or regulation of weight-management apps, this evaluation will assist health professionals in understanding which apps from among the current popular app pool are of the highest quality and appropriate for recommendation to their clients, and will assist in protecting consumers from misinformation.

Limitations

It was not feasible in this study to evaluate all the weight-loss apps available to the public. Hence, it is possible that there are other apps that incorporate all the BCTs (but are not popular) or that some country-specific popular apps were missed. The accuracy of energy intake observed among all apps may have been influenced by the researcher being trained in nutrition (ie, a dietitian) and it is possible that the lay public would have more difficulty matching foods and interpreting the serving size to enter.

Although specific components of behavior change interventions may be understood to facilitate behavior change, they still require testing in trials. Emerging evidence suggests that caution should be exercised in the recommendation of apps in weight management. In randomized controlled trials evaluating commercial weight-loss smartphone apps such as MyFitnessPal [64] or Lose It! [73], although weight loss was observed in the intervention groups, the effects were not statistically significant when compared to the controls. In contrast, a researcher-developed weight-loss app, My Meal Mate (MMM), demonstrated significant weight reduction compared with controls in a 6-month period [10].

Conclusions

With the relative absence of BCTs incorporated, along with variability in the additional measures of quality of these apps, such as the scientific coverage and accuracy, the recommendation of dietary weight-loss apps in clinical practice and in public health should proceed with caution. Ongoing evaluation of these apps and implementation of a standardized framework for quality assessment is necessary to drive the design and development of higher-quality apps on the market. Further research around efficacy trials of apps to promote weight loss is also warranted.

Authors' Contributions

This project was carried out at the University of Sydney as a partial fulfilment of the Master of Nutrition and Dietetics Degree. JC, JEC, and MAF contributed to the conception and design of the study. JC conducted the research, analyzed the data, and drafted the first version of the manuscript. JEC and MAF contributed to writing and editing the manuscript. MAF had primary responsibility for the final content of the manuscript. All authors read and approved the final manuscript. Ms Monica Nour judged the single discrepancy in the inter-rater assessment.

Conflicts of Interest

JC declares no personal or financial conflicts of interest. JEC developed the My Meal Mate app on a grant from the National Prevention Research Initiative (grant number G0802108). It is available free of charge. MAF has developed food-based apps, but not for weight management.

  1. Ng M, Fleming T, Robinson M, Thomson B, Graetz N, Margono C, et al. Global, regional, and national prevalence of overweight and obesity in children and adults during 1980-2013: A systematic analysis for the Global Burden of Disease Study 2013. Lancet 2014 Aug 30;384(9945):766-781. [CrossRef] [Medline]
  2. Aguilar-Martínez A, Solé-Sedeño JM, Mancebo-Moreno G, Medina F, Carreras-Collado R, Saigí-Rubió F. Use of mobile phones as a tool for weight loss: A systematic review. J Telemed Telecare 2014 Sep;20(6):339-349. [CrossRef] [Medline]
  3. Dennison L, Morrison L, Conway G, Yardley L. Opportunities and challenges for smartphone applications in supporting health behavior change: Qualitative study. J Med Internet Res 2013;15(4):e86 [FREE Full text] [CrossRef] [Medline]
  4. Australian Communications and Media Authority (ACMA). Communications Report 2012-13. Melbourne, Australia: Commonwealth of Australia; 2013.   URL: http:/​/www.​acma.gov.au/​~/​media/​Research%20and%20Analysis/​Publication/​Comms%20Report%202012%2013/​PDF/​ACMA%20Communications%20report%20201213_WEB%20pdf.​pdf [accessed 2014-08-25] [WebCite Cache]
  5. eMarketer. US Smartphone Usage Nears UK Levels. 2014 Apr 2.   URL: http://www.emarketer.com/Article/US-Smartphone-Usage-Nears-UK-Levels/1010730 [accessed 2014-10-17] [WebCite Cache]
  6. Australian Communications and Media Authority (ACMA). 2013 Nov 20. Mobile apps: Putting the 'smart' in smartphones   URL: http:/​/www.​acma.gov.au/​theACMA/​engage-blogs/​engage-blogs/​Research-snapshots/​Mobile-apps-putting-the-smart-in-smartphones [accessed 2014-08-05] [WebCite Cache]
  7. Deloitte LLP. Mobile Consumer 2014: The UK Cut. Revolution and Evolution. 2014.   URL: http://www.deloitte.co.uk/mobileuk2014/assets/pdf/Deloitte_Mobile_Consumer_2014.pdf [accessed 2014-10-10] [WebCite Cache]
  8. Dreyer K. Over a Third of US Smartphone Owners Download at least One App per Month. 2014 Sep 02.   URL: http:/​/www.​comscore.com/​Insights/​Data-Mine/​Over-a-Third-of-US-Smartphone-Owners-Download-At-Least-One-App-Per-Month [accessed 2014-09-02] [WebCite Cache]
  9. Khalaf S. Flurry Insights. San Francisco, CA: Flurry Insights; 2014 Jun 19. Health and fitness apps finally take off, fueled by fitness fanatics   URL: http:/​/www.​flurry.com/​blog/​flurry-insights/​health-and-fitness-apps-finally-take-fueled-fitness-fanatics#.​VESXd2dxnIV [accessed 2015-11-12] [WebCite Cache]
  10. Carter MC, Burley VJ, Nykjaer C, Cade JE. Adherence to a smartphone application for weight loss compared to website and paper diary: Pilot randomized controlled trial. J Med Internet Res 2013;15(4):e32 [FREE Full text] [CrossRef] [Medline]
  11. Hebden L, Cook A, van der Ploeg HP, Allman-Farinelli M. Development of smartphone applications for nutrition and physical activity behavior change. JMIR Res Protoc 2012;1(2):e9 [FREE Full text] [CrossRef] [Medline]
  12. Stephens J, Allen J. Mobile phone interventions to increase physical activity and reduce weight: A systematic review. J Cardiovasc Nurs 2013;28(4):320-329 [FREE Full text] [CrossRef] [Medline]
  13. West JH, Hall PC, Hanson CL, Barnes MD, Giraud-Carrier C, Barrett J. There's an app for that: Content analysis of paid health and fitness apps. J Med Internet Res 2012;14(3):e72 [FREE Full text] [CrossRef] [Medline]
  14. Bender JL, Yue RY, To MJ, Deacken L, Jadad AR. A lot of action, but not in the right direction: Systematic review and content analysis of smartphone applications for the prevention, detection, and management of cancer. J Med Internet Res 2013;15(12):e287 [FREE Full text] [CrossRef] [Medline]
  15. Mobasheri MH, Johnston M, King D, Leff D, Thiruchelvam P, Darzi A. Smartphone breast applications - What's the evidence? Breast 2014 Oct;23(5):683-689. [CrossRef] [Medline]
  16. Vollmer DD, Fair K, Hong YA, Beaudoin CE, Pulczinski J, Ory MG. Apps seeking theories: Results of a study on the use of health behavior change theories in cancer survivorship mobile apps. JMIR Mhealth Uhealth 2015;3(1):e31 [FREE Full text] [CrossRef] [Medline]
  17. Arnhold M, Quade M, Kirch W. Mobile applications for diabetics: A systematic review and expert-based usability evaluation considering the special requirements of diabetes patients age 50 years or older. J Med Internet Res 2014;16(4):e104 [FREE Full text] [CrossRef] [Medline]
  18. Chomutare T, Fernandez-Luque L, Arsand E, Hartvigsen G. Features of mobile diabetes applications: Review of the literature and analysis of current applications compared against evidence-based guidelines. J Med Internet Res 2011;13(3):e65 [FREE Full text] [CrossRef] [Medline]
  19. Abroms LC, Lee WJ, Bontemps-Jones J, Ramani R, Mellerson J. A content analysis of popular smartphone apps for smoking cessation. Am J Prev Med 2013 Dec;45(6):732-736 [FREE Full text] [CrossRef] [Medline]
  20. Abroms LC, Padmanabhan N, Thaweethai L, Phillips T. iPhone apps for smoking cessation: A content analysis. Am J Prev Med 2011 Mar;40(3):279-285 [FREE Full text] [CrossRef] [Medline]
  21. Choi J, Noh G, Park D. Smoking cessation apps for smartphones: Content analysis with the self-determination theory. J Med Internet Res 2014;16(2):e44 [FREE Full text] [CrossRef] [Medline]
  22. Plaza I, Demarzo MM, Herrera-Mercadal P, García-Campayo J. Mindfulness-based mobile applications: Literature review and analysis of current features. JMIR Mhealth Uhealth 2013;1(2):e24 [FREE Full text] [CrossRef] [Medline]
  23. Shen N, Levitan M, Johnson A, Bender JL, Hamilton-Page M, Jadad AA, et al. Finding a depression app: A review and content analysis of the depression app marketplace. JMIR Mhealth Uhealth 2015;3(1):e16 [FREE Full text] [CrossRef] [Medline]
  24. Stoyanov SR, Hides L, Kavanagh DJ, Zelenko O, Tjondronegoro D, Mani M. Mobile app rating scale: A new tool for assessing the quality of health mobile apps. JMIR Mhealth Uhealth 2015;3(1):e27 [FREE Full text] [CrossRef] [Medline]
  25. Hundert AS, Huguet A, McGrath PJ, Stinson JN, Wheaton M. Commercially available mobile phone headache diary apps: A systematic review. JMIR Mhealth Uhealth 2014;2(3):e36 [FREE Full text] [CrossRef] [Medline]
  26. Martínez-Pérez B, de la Torre-Díez I, López-Coronado M, Herreros-González J. Mobile apps in cardiology: Review. JMIR Mhealth Uhealth 2013;1(2):e15 [FREE Full text] [CrossRef] [Medline]
  27. Crane D, Garnett C, Brown J, West R, Michie S. Behavior change techniques in popular alcohol reduction apps: Content analysis. J Med Internet Res 2015;17(5):e118 [FREE Full text] [CrossRef] [Medline]
  28. Weaver ER, Horyniak DR, Jenkinson R, Dietze P, Lim MS. "Let's get Wasted!" and other apps: Characteristics, acceptability, and use of alcohol-related smartphone applications. JMIR Mhealth Uhealth 2013;1(1):e9 [FREE Full text] [CrossRef] [Medline]
  29. Robustillo Cortés Mde L, Cantudo Cuenca MR, Morillo Verdugo R, Calvo Cidoncha E. High quantity but limited quality in healthcare applications intended for HIV-infected patients. Telemed J E Health 2014 Aug;20(8):729-735. [CrossRef] [Medline]
  30. Lalloo C, Jibb LA, Rivera J, Agarwal A, Stinson JN. "There's a Pain App for That": Review of patient-targeted smartphone applications for pain management. Clin J Pain 2015 Jun;31(6):557-563. [CrossRef] [Medline]
  31. Reynoldson C, Stones C, Allsop M, Gardner P, Bennett MI, Closs SJ, et al. Assessing the quality and usability of smartphone apps for pain self-management. Pain Med 2014 Jun;15(6):898-909. [CrossRef] [Medline]
  32. Martínez-Pérez B, de la Torre-Díez I, López-Coronado M. Mobile health applications for the most prevalent conditions by the World Health Organization: Review and analysis. J Med Internet Res 2013;15(6):e120 [FREE Full text] [CrossRef] [Medline]
  33. Gan KO, Allman-Farinelli M. A scientific audit of smartphone applications for the management of obesity. Aust N Z J Public Health 2011 Jun;35(3):293-294. [CrossRef] [Medline]
  34. Jeon E, Park H, Min YH, Kim H. Analysis of the information quality of korean obesity-management smartphone applications. Healthc Inform Res 2014 Jan;20(1):23-29 [FREE Full text] [CrossRef] [Medline]
  35. Breton ER, Fuemmeler BF, Abroms LC. Weight loss-There is an app for that! But does it adhere to evidence-informed practices? Transl Behav Med 2011 Dec;1(4):523-529 [FREE Full text] [CrossRef] [Medline]
  36. Pagoto S, Schneider K, Jojic M, DeBiasse M, Mann D. Evidence-based strategies in weight-loss mobile apps. Am J Prev Med 2013 Nov;45(5):576-582. [CrossRef] [Medline]
  37. Azar KM, Lesser LI, Laing BY, Stephens J, Aurora MS, Burke LE, et al. Mobile applications for weight management: Theory-based content analysis. Am J Prev Med 2013 Nov;45(5):583-589. [CrossRef] [Medline]
  38. Abraham C, Michie S. A taxonomy of behavior change techniques used in interventions. Health Psychol 2008 May;27(3):379-387. [CrossRef] [Medline]
  39. Direito A, Dale LP, Shields E, Dobson R, Whittaker R, Maddison R. Do physical activity and dietary smartphone applications incorporate evidence-based behaviour change techniques? BMC Public Health 2014;14:646 [FREE Full text] [CrossRef] [Medline]
  40. US Food and Drug Administration. Mobile Medical Applications: Guidance for Industry and Food and Drug Administration Staff. Rockville, MD; 2015 Feb 09.   URL: http://www.fda.gov/downloads/MedicalDevices/.../UCM263366.pdf [accessed 2015-03-31] [WebCite Cache]
  41. Australian Government, Department of Health. Therapeutic Goods Administration. Regulation of medical software and mobile medical 'apps'. 2013 Sep 13.   URL: https://www.tga.gov.au/regulation-medical-software-and-mobile-medical-apps [accessed 2015-05-12] [WebCite Cache]
  42. Burke LE, Wang J, Sevick MA. Self-monitoring in weight loss: A systematic review of the literature. J Am Diet Assoc 2011 Jan;111(1):92-102 [FREE Full text] [CrossRef] [Medline]
  43. Silberg WM, Lundberg GD, Musacchio RA. Assessing, controlling, and assuring the quality of medical information on the Internet: Caveant lector et viewor--Let the reader and viewer beware. JAMA 1997 Apr 16;277(15):1244-1245. [Medline]
  44. Dietitians Association of Australia. DAA Best Practice Guidelines for the Treatment of Overweight and Obesity in Adults. Canberra, Australia: Dietitians Association of Australia; 2012 Jan 25.   URL: http:/​/daa.​asn.au/​wp-content/​uploads/​2011/​03/​FINAL-DAA-obesity-guidelines-report-25th-January-2011-2.​pdf [accessed 2015-11-15] [WebCite Cache]
  45. National Health and Medical Research Council (NHMRC). Clinical Practice Guidelines for the Management of Overweight and Obesity in Adults, Adolescents and Children in Australia. Canberra, Australia: National Health and Medical Research Council (NHMRC); 2013.   URL: https:/​/https://www.​nhmrc.gov.au/​_files_nhmrc/​publications/​attachments/​n57_obesity_guidelines_140630.​pdf [accessed 2015-05-12] [WebCite Cache]
  46. National Health and Medical Research Council (NHMRC). Canberra, Australia: National Health and Medical Research Council (NHMRC); 2006. Nutrient reference values for Australia and New Zealand   URL: https://www.nrv.gov.au/ [accessed 2015-05-13] [WebCite Cache]
  47. Gibson RS. Validity in dietary assessment methods. In: Principles of Nutritional Assessment. 2nd edition. New York, NY: Oxford University Press; 2005:149-196.
  48. FoodWorks. High Gate Hill, Australia: Xyris Software   URL: https://www.xyris.com.au/ [accessed 2014-08-25] [WebCite Cache]
  49. Food Standards Australia New Zealand. Canberra, Australia: Food Standards Australia New Zealand; 2008. AUSNUT 2007   URL: http://www.foodstandards.gov.au/science/monitoringnutrients/ausnut/Pages/ausnut2007.aspx [accessed 2015-11-15] [WebCite Cache]
  50. Bangor A, Kortum PT, Miller JT. An empirical evaluation of the System Usability Scale. Int J Hum Comput Interact 2008 Jul 30;24(6):574-594. [CrossRef]
  51. Brooke J. SUS: A "quick and dirty" usability scale. In: Jordan PW, Thomas B, Weerdmeester BA, McClelland IL, editors. Usability Evaluation in Industry. London, UK: Taylor & Francis; 1996:189-194.
  52. Bangor A, Kortum P, Miller J. Determining what individual SUS scores mean: Adding an adjective rating scale. J Usability Stud 2009 May;4(3):114-123 [FREE Full text]
  53. Dusseldorp E, van Genugten L, van Buuren S, Verheijden MW, van Empelen P. Combinations of techniques that effectively change health behavior: Evidence from Meta-CART analysis. Health Psychol 2014 Dec;33(12):1530-1540. [CrossRef] [Medline]
  54. IBM. Chicago, IL: IBM Corporation; 2013. SPSS software   URL: https://www-01.ibm.com/software/analytics/spss/ [accessed 2014-08-12] [WebCite Cache]
  55. BinDhim NF, Hawkey A, Trevena L. A systematic review of quality assessment methods for smartphone health apps. Telemed J E Health 2015 Feb;21(2):97-104. [CrossRef] [Medline]
  56. Michie S, Abraham C, Whittington C, McAteer J, Gupta S. Effective techniques in healthy eating and physical activity interventions: A meta-regression. Health Psychol 2009 Nov;28(6):690-701. [CrossRef] [Medline]
  57. Webb TL, Joseph J, Yardley L, Michie S. Using the Internet to promote health behavior change: A systematic review and meta-analysis of the impact of theoretical basis, use of behavior change techniques, and mode of delivery on efficacy. J Med Internet Res 2010;12(1):e4 [FREE Full text] [CrossRef] [Medline]
  58. Lieffers JR, Vance VA, Hanning RM. Use of mobile device applications in Canadian dietetic practice. Can J Diet Pract Res 2014;75(1):41-47. [Medline]
  59. Sharp DB, Allman-Farinelli M. Feasibility and validity of mobile phones to assess dietary intake. Nutrition 2014;30(11-12):1257-1266. [CrossRef] [Medline]
  60. Lieffers JR, Hanning RM. Dietary assessment and self-monitoring with nutrition applications for mobile devices. Can J Diet Pract Res 2012;73(3):e253-e260. [Medline]
  61. Thomas SL, Hyde J, Karunaratne A, Kausman R, Komesaroff PA. "They all work...when you stick to them": A qualitative investigation of dieting, weight loss, and physical exercise, in obese individuals. Nutr J 2008;7:34 [FREE Full text] [CrossRef] [Medline]
  62. Farago P. Flurry Insights. San Francisco, CA: Flurry Insights; 2012 Oct 22. App engagement: The matrix reloaded   URL: http://flurrymobile.tumblr.com/post/113379517625/app-engagement-the-matrix-reloaded [accessed 2014-10-12] [WebCite Cache]
  63. McLean VA. PRWeb. 2011 Apr 25. Motivating patients to use smartphone health apps   URL: http://www.prweb.com/releases/2011/04/prweb5268884.htm [accessed 2014-09-25] [WebCite Cache]
  64. Laing BY, Mangione CM, Tseng C, Leng M, Vaisberg E, Mahida M, et al. Effectiveness of a smartphone application for weight loss compared with usual care in overweight primary care patients: A randomized, controlled trial. Ann Intern Med 2014 Nov 18;161(10 Suppl):S5-S12. [CrossRef] [Medline]
  65. Heinonen R, Luoto R, Lindfors P, Nygård C. Usability and feasibility of mobile phone diaries in an experimental physical exercise study. Telemed J E Health 2012 Mar;18(2):115-119. [CrossRef] [Medline]
  66. Arsand E, Tatara N, Østengen G, Hartvigsen G. Mobile phone-based self-management tools for type 2 diabetes: The few touch application. J Diabetes Sci Technol 2010 Mar;4(2):328-336 [FREE Full text] [Medline]
  67. Rebro SM, Patterson RE, Kristal AR, Cheney CL. The effect of keeping food records on eating patterns. J Am Diet Assoc 1998 Oct;98(10):1163-1165. [CrossRef] [Medline]
  68. Deterding S, Dixon D, Khaled R, Nacke L. From game design elements to gamefulness: Defining gamification. In: Proceedings of the 15th International Academic MindTrek Conference: Envisioning Future Media Environments. New York, NY: ACM; 2011 Presented at: 15th International Academic MindTrek Conference: Envisioning Future Media Environments; September 28-30, 2011; Tampere, Finland p. 9-15. [CrossRef]
  69. Hamari J, Koivisto J, Sarsa H. Does gamification work?-- A literature review of empirical studies on gamification. In: Proceedings of the 47th Hawaii International Conference on System Sciences. New York, NY: IEEE; 2014 Presented at: 47th Hawaii International Conference on System Sciences (HICSS); January 6-9, 2014; Waikoloa, HI p. 3025-3034. [CrossRef]
  70. Lister C, West JH, Cannon B, Sax T, Brodegard D. Just a fad? Gamification in health and fitness apps. JMIR Serious Games 2014;2(2):e9 [FREE Full text] [CrossRef] [Medline]
  71. Huotari K, Hamari J. Defining gamification: A service marketing perspective. In: Proceedings of the 16th International Academic MindTrek Conference: Media of the Future. New York, NY: ACM; 2012 Presented at: 16th International Academic MindTrek Conference: Media of the Future; October 3-5, 2012; Tampere, Finland p. 17-22. [CrossRef]
  72. King D, Greaves F, Exeter C, Darzi A. 'Gamification': Influencing health behaviours with games. J R Soc Med 2013 Mar;106(3):76-78. [CrossRef] [Medline]
  73. Allen JK, Stephens J, Dennison Himmelfarb CR, Stewart KJ, Hauck S. Randomized controlled pilot study testing use of smartphone technology for obesity treatment. J Obes 2013;2013:151597 [FREE Full text] [CrossRef] [Medline]


12WBT: 12 Week Body Transformation
Acc.: accountability
AGHE: Australian Guide to Healthy Eating
AUSNUT: Australian Food and Nutrient Database
BCT: behavior change technique
BMI: body mass index
DAA: Dietitians Association of Australia
FDA: Food and Drug Administration
ICC: intraclass correlation coefficient
N/A: not applicable
NHMRC: National Health and Medical Research Council
NRV: Nutrient Reference Value
SCA: scientific coverage and accuracy
SUS: System Usability Scale
TEF: technology-enhanced features
TS: total score
Us.: usability
WFR: weighed food record


Edited by G Eysenbach; submitted 16.02.15; peer-reviewed by A Subar, F Saigí-Rubió, H Lee; comments to author 05.05.15; revised version received 26.05.15; accepted 07.10.15; published 16.12.15

Copyright

©Juliana Chen, Janet E Cade, Margaret Allman-Farinelli. Originally published in JMIR Mhealth and Uhealth (http://mhealth.jmir.org), 16.12.2015.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR mhealth and uhealth, is properly cited. The complete bibliographic information, a link to the original publication on http://mhealth.jmir.org/, as well as this copyright and license information must be included.