Abstract

Background. Measuring success of obesity interventions is critical. Several methods measure weight loss outcomes but there is no consensus on best practices. This systematic review evaluates relevant outcomes (weight loss, BMI, % body fat, and fat mass) to determine which might be the best indicator(s) of success. Methods. Eligible articles described adult weight loss interventions that included diet and physical activity and a measure of weight or BMI change and body composition change. Results. 28 full-text articles met inclusion criteria. Subjects, settings, intervention lengths, and intensities varied. All studies measured body weight (−2.9 to −17.3 kg), 9 studies measured BMI (−1.1 to −5.1 kg/m2), 20 studies measured % body fat (−0.7 to −10.2%), and 22 studies measured fat mass (−0.9 to −14.9 kg). All studies found agreement between weight or BMI and body fat mass or body fat % decreases, though there were discrepancies in degree of significance between measures. Conclusions. Nearly all weight or BMI and body composition measures agreed. Since body fat is the most metabolically harmful tissue type, it may be a more meaningful measure of health change. Future studies should consider primarily measuring % body fat, rather than or in addition to weight or BMI.

1. Introduction

The obesity treatment literature includes many sophisticated analyses, methods, and conclusions, yet the problem persists [13]. Given all of the information now known, to move forward in intervention development and evaluation, more accurate measures of success are needed to monitor changes. The field of obesity treatment often has redundancy of interventions and measures but heterogeneity of outcome measures, making it difficult to combine results and move toward the ultimate goal of achieving healthy weights [35]. Most weight loss studies measure weight and/or BMI to assess intervention-related changes, given their ease of measurement and interpretation [4, 5]. Though well correlated with body composition, weight and BMI only inform total loss or change, which could include lean body mass in addition to fat loss [6, 7]. BMI may also inaccurately reflect intervention-related change, in that it does not account for bone and muscle density, frame size, and fat distribution [8, 9].

Loss of fat is the major outcome of interest for a variety of health reasons. Body fat can have varying degrees of benefit and harm, depending on location, amount, and time of fat disposition [1012]. While babies and young children depend on body fat to promote brain and tissue growth, as children age, the percent of fat that is beneficial decreases [13]. Among older adults, body fat is also metabolically harmful, with an exception that it may offer some protection against bone loss and fractures [14]. However, for adults, excess body fat is widely acknowledged to be associated with such diseases as type 2 diabetes, stroke, hypertension, cardiovascular disease, and arthritis [15, 16]. In particular, abdominal fat has been associated with increased morbidity and mortality among adults [11, 12]. Body fat is best captured by measures other than weight and BMI, such as bioelectrical impedance (BIA), dual-energy X-ray absorptiometry (DEXA), underwater weighing, air displacement, and skinfold thickness [17]. Measuring body fat as part of weight loss interventions is a common but not universal practice and it is usually viewed as a secondary outcome, with weight or BMI being primary [5, 18].

Compounding the measurement issues described above, adult weight loss intervention studies primarily target dietary interventions, rather than (or more than) physical activity (PA) interventions [5]. Although diet can lead to reduced body fat, it can also lead to overall weight loss that can include reduced fat-free mass (bone and muscle) [19]. Overall weight loss does not distinguish between types of tissue mass lost. Much research shows that PA is a key driver of fat loss and maintenance or increase of fat-free mass [19, 20]. Ideally, interventions should include components of both diet and PA, to reduce body fat and maintain or increase fat-free mass [18, 20]. Therefore, studies that include PA as a component of interventions (in addition to diet) should theoretically include a measure other than weight or BMI to potentially best capture changes.

The objectives of this review were to address the following questions:

(1) What are the best or most consistent measures of success in adult weight loss interventions that include diet and PA: weight or BMI, or body composition? (2) Are weight loss or BMI changes or body composition changes adequate measures of intervention success? (3) Do the studies that include a body composition measure in addition to weight or BMI reach the same conclusions? A systematic review was conducted to examine and evaluate all of the existing findings on these topics. This review does not include a meta-analysis because intervention studies contain many heterogeneous components (duration, intensity, length, and setting of interventions), so that compiling results may lead to incomplete or inconclusive findings.

2. Methods

2.1. Search Strategy

The Cochrane library was searched for existing reviews on this topic and information from related systematic reviews. As there were no available or registered review papers on these specific questions, the following search methods were employed in July and August 2012. This search was primarily conducted using online scientific literature databases. PubMed (1953–present) and PsychInfo (1806–present) were used to do an exhaustive search combining all terms. Additional search resources were used to acquire remaining papers meeting review criteria: the online database at Google Scholar (1992–present) and searching through references from eligible papers found (ancestry search). The overarching goal of the search was to identify studies of adult weight loss interventions that included diet and PA and a measure of weight or BMI and body composition. The following title and abstract keyword search terms were used in all databases, with limitations to humans, English language, randomized controlled trials (RCTs) or clinical trials, and adults over age 18: “weight loss” AND “overweight” OR “obese” OR “obesity” AND “diet” OR “dietary” OR “calorie restriction” AND “exercise” OR “physical activity” OR “fitness” AND “BMI” OR “body mass index” AND “fat loss” OR “body composition” OR “skinfold” OR “skinfold thickness” or “tricep skinfold” OR “DEXA” OR “DXA” OR “underwater weigh*” OR “bioelectrical impedance” OR “BIA.”

2.2. Study Selection

Eligibility criteria for inclusion into this review were as follows. Study types were limited to randomized controlled trials published in English. There was no lower limit on year of publication. The types of participants intended for this review were adults ages 18–65 who were overweight or obese (BMI ≥ 25.0). Studies of adults with comorbid health conditions (i.e., prediabetes and prehypertension) were included because many interventions target such populations. All interventions were eligible if they targeted weight loss and included a diet and aerobic PA component. No restrictions were placed on duration, intensity, or setting of intervention (i.e., inpatient and outpatient). The eligible outcome measures were at least one measure of overall weight change (taken both before and after intervention), pounds or kilograms of weight or BMI reduction, and at least one body fat measure (taken both before and after intervention): skinfold thickness, DEXA, underwater weighing, BIA, or air displacement. While waist or hip circumference is sometimes considered to be a body composition measure, it can be too gross to reliably identify changes in short-term studies, so it was excluded from this search.

Exclusion criteria were studies not published in English, inclusion of children or older adults, interventions that included only diet or only PA, interventions in which the only PA was strength training, studies that included only one outcome measure (weight or BMI or body composition), nonintervention studies or designs other than RCTs (reviews, position papers, and cross-sectional or noncontrolled studies), studies that included dietary supplements or drugs to assist in weight loss, secondary or redundant data analyses (in that case, only the primary results were included in this review), and the case when the full-text article was unavailable from interlibrary loan, online sources, or correspondence with the author.

The study selection process, all completed by the author, began with general keyword (title and abstract) searches in the databases and reference lists of appropriate papers. Of those titles that appeared relevant, a more thorough abstract review was conducted. Of abstracts that appeared relevant, a full-text review was conducted, when available, and all eligible full-text articles were included in this paper. Throughout the study selection process, duplicates were removed. If one trial published multiple papers, only the primary outcome paper or the most recent (whichever was most relevant) was included.

2.3. Data Extraction and Assessment of Studies

The author extracted and compiled the detailed data items and study characteristics from all articles. The data extraction tables included, as available, study type, sample size including gender breakdown, baseline ages, SES or race, comorbidities, intervention setting and length, body composition measure, baseline weight and/or BMI (and standard deviations (SD) or range), baseline body composition (and SD or range), follow-up weight and/or BMI (and SD), and follow-up body composition (and SD or range). For the principle summary measures, the variables were extracted from the studies when the data were published, but when the average weight and/or BMI change, average body composition change, and summary of agreement were not explicitly listed, they were calculated from the available data (e.g., calculating the average weight change from the baseline to follow-up weight).

3. Results

3.1. Study Selection

The flowchart describing study screening, exclusion, eligibility, and selection is shown in Figure 1. Two hundred and thirty-five studies were identified through the various search sources. Of the nonduplicate studies, 145 were excluded for the reasons listed in the flowchart; the main reasons were that the intervention did not include both diet and PA, that the study did not include or measure body composition, and that the intervention did not involve a calorie restricted diet (e.g., manipulating macronutrient composition in isocaloric weight maintenance diets). Of the 56 excluded full-text articles, the main exclusion reasons were that the studies did not report body composition data, included older adults, and used drugs or supplements to aid weight loss. Ultimately, 28 studies met all inclusion criteria and were included in this review.

3.2. Study Characteristics

The study characteristics are presented in Table 1. There was much heterogeneity across studies, with respect to other characteristics. Sample sizes ranged from 5 to 111, and a majority of studies (18 studies = 64%) used only women participants. The studies included and focused on a range of adult ages, with baseline ages ranging from 28 to 54.7. No studies reported participants’ socioeconomic status (SES). Of the few studies that reported racial composition of samples, most participants were white. The country of origin could perhaps be used to infer racial composition of samples when otherwise not indicated (e.g., primarily white participants in Belgium, The Netherlands, and Australia). Most studies were conducted in the United States, with fewer from Europe and Australia. Three main body composition measures were used (categories were not mutually exclusive, as some studies used multiple measures): DEXA was used in 13 studies, BIA was used in eight, and underwater weighing was used in six. Two studies used skinfold thickness (bi- or triceps), one used air displacement, and one used doubly labeled water with appropriate body composition calculations. Fifteen studies reported attrition rates, with values ranging from 2.5 to 48.8% loss.

The studies also demonstrated heterogeneity in factors such as intervention emphases, diet types, and length (Table 1). Most studies took place at outpatient facilities (university or hospital clinical research centers), two studies took place in inpatient clinics, and three studies did not give details on intervention setting. The interventions ranged from six weeks to two years in length, with half (13 studies) in the 12- to 16-week range, and five studies lasted 24 weeks. There were varied emphases and strategies for the different components of the interventions. For the diet component of the interventions, strategies included visits with a dietician, calorie restriction (ranges: 420–1800 cal/day), specific macronutrient proportions (e.g., % calories from fat and carbohydrates), liquid diets with and without solid food supplementation, food provided by programs, and nutrition education. For the calorie restriction, the most common target value was 1200 calories/day or a range including 1200, but the liquid and inpatient diets were much lower (e.g., 420 calories/day), and when men were included in studies, the calorie ranges were higher (1500–1800 calories/day). Several studies did not report a specific calorie target but rather gave each participant an individualized goal based on their resting metabolic rate and subtracting 250–1000 calories from that as the daily goal. For the PA components of the interventions, the strategies included varied amounts of activity per day and week, structured and supervised aerobic activity (commonly walking and indoor cycling), circuit classes, skills-based and noncompetitive activity classes, individualized heart rate training goals, and emphases on lifestyle activity. Most of the studies included weekly or biweekly individual or group meetings with a nutritionist, exercise counselor, and/or psychologist for support, education, and behavior modification strategies.

3.3. Outcome Measures

The outcome measures of baseline and follow-up BMI, body fat, and fat mass, plus the average changes, summary of agreement, and attrition are presented in Table 2. The follow-up outcomes are reported for the intervention group and for the longest follow-up period reported in the paper.

Weight and BMI Outcomes. Averages are presented as overall values, unadjusted for length or intensity of intervention and unweighted for sample size. All 28 studies reported weight as an outcome, and all reported losses with wide ranging values (−2.9 to −17.3 kg). The average weight loss at the longest reported follow-up time point was −8.2 kg. While most studies measured baseline BMI, only nine reported follow-up BMI values as an outcome. The range of BMI losses was −1.1 to −5.1 kg/m2, with an average loss of −3.1 kg/m2.

Body Composition Outcomes. Twenty studies measured % body fat, all finding losses (−0.7 to −10.2%), with an average decrease of −5.1%. Twenty-two of the studies measured fat mass, all finding losses. The range of fat mass lost was −0.9 to −14.9 kg, and the average decrease was −6.6 kg.

3.4. Agreement between Weight and Body Composition Measures

All of the studies found a decrease in weight, and those that measured BMI showed decreases that were in agreement with the weight losses. That is, there was no discrepancy between the interpretations of weight and BMI changes, though weight loss showed greater changes than BMI. All of the studies found a decrease in the body composition measure(s) used. Most of the weight lost was accounted for by fat loss. In control groups that included diet only interventions, the percentage of fat lost was significantly greater in the diet + PA groups, while the diet + PA groups preserved or increased their fat-free mass more so than control (diet only) groups. Overall, all of the studies had agreement between the weight or BMI and body composition measure(s). Two studies were discrepant between the significance of the measures: one had a borderline significant reduction in fat mass, with a significant weight decrease, and the other had a more significant reduction in fat mass and % body fat than weight. The details and significance of the agreement across outcomes are presented in Table 2.

Overall agreement did not describe the variability among weight loss measures completely. Across studies, the losses of fat mass and % body fat were proportionally greater than losses of BMI or weight and, in one instance, fat mass or % body fat losses were more significantly different before and after intervention than the overall weight or BMI losses. While there is some redundancy across weight loss measures, body composition was a consistent measure of success in these studies, with all of the studies that reported it finding decreases after intervention in parallel or more so than weight or BMI decreases.

4. Discussion

This review focused on evaluating measures of success in diet and PA weight loss interventions for adults. There was heterogeneity across studies in terms of designs, settings, participants, and types of outcome measures. Despite the differences, several themes emerged. All of the studies demonstrated agreement across measures (weight or BMI and % body fat or fat mass). However, nuances were present as well. Specifically and as expected, fat accounted for most of weight lost. While not a primary focus of this review, several studies reported that fat-free mass was preserved or increased following the interventions that included PA. The conclusions from measures of weight or BMI and body fat % or fat mass were largely in agreement and body fat is more metabolically informative than overall weight. Thus, it can be proposed that measuring body fat should be considered a primary outcome of weight loss studies. In aggregate, the data presented here support the conclusion that measuring % body fat or fat mass before and after weight loss interventions that include diet and PA may be the most efficient and informative measure of success or change.

Body fat measures are highly accurate, though each type has pros and cons. Underwater weighing is the gold-standard, but it can be unpleasant and inconvenient and often not feasible for obese participants [17]. It is rarely used in more recent studies, given the technological advances. DEXA, which was commonly used in the studies reviewed here, is highly accurate but expensive [17, 21, 22]. Cost is the most common barrier against using DEXA. However, given the increased precision of measurement, the cost of DEXA scans may be justifiable for research groups, with long-term use. BIA is also commonly used to measure fat, but its accuracy is more questionable and likely depends on different equations used to estimate body composition and the quality of the equipment [17, 23]. Skinfold thickness is an inexpensive and useful method for large surveillance studies, but its accuracy and reliability are variable, depending on rater training and precision of caliper location [17, 23]. Body fat also is the most metabolically harmful tissue type, so it makes sense to promote its measurement over others [11, 12, 15, 16]. Further, just as weight and BMI do not provide nuanced measures of health, body fat mass is a similarly gross measure. Body fat % may be a more indicative measure of health, as it allows more specificity by accounting for other tissue types’ contributions to weight and body composition.

As BMI and weight are ubiquitous in weight loss studies [5], it is not likely that a paradigm shift will occur quickly, in which measurement shifts to focus on % body fat. Further, most people do not know their body fat percentage or have a context for its interpretation the way people do for weight and, increasingly, BMI. However, healthy body fat % ranges do exist for different ages and genders [13, 24], and these values could become more commonly evaluated and discussed. The evidence presented herein suggests that % body fat should become more of a primary measure of health and weight loss success, as it provides a succinct and meaningful indication of a person’s body composition, and likely disease risk, than weight, BMI, and fat mass.

This review had several limitations. First, only studies available in English were included. While this may introduce bias, most of the countries that bear the largest burden of adult obesity are economically developed and English-speaking. So it is unlikely that many contradictory or critical studies have been published in other languages. As with all reviews, this one encompassed studies with considerable heterogeneity of study/intervention and outcome components. While, at this stage of research, this problem is mostly inevitable, future studies may become more homogenous in measurement and reporting of outcomes if they follow the CONSORT and EQUATOR Network guidelines [25]. Another limitation is that most studies did not describe their attrition rates. Of those that did, many had high loss, over the 20% considered acceptable for weight loss studies [26]. Attrition is an important consideration for generalizing the results of this and other studies, so more consistent reporting is necessary, along with improved strategies for retaining participants in weight loss studies.

The risk of bias across studies merited attention. There is a concern that authors and journal editors typically prefer to show weight/fat loss, and so there is a risk of positive publication bias in this field [26]. Indeed, while we know that when properly carried out, diet and PA studies do promote fat loss, many interventions suffer from attrition, loss of participant motivation, and weight/fat regain over time; most studies presented here do not include long-term follow-up data. It is likely that many studies with negative findings do not make it into the published literature. Unfortunately, there is no way to tell how many of those studies existed (particularly before the NIH clinical trials registry: http://clinicaltrials.gov/), but everyone in the weight loss research field should consider results with this caveat in mind [26]. Risk of bias in individual studies also merited attention. While, ideally, this would have been assessed, most studies did not provide enough information to make consistent or relevant judgments of bias (i.e., blinding is not possible in weight loss trials and attrition and funding sources were not always reported). Four out of the 28 studies (8.5%) reported funding conflicts of interest, indicating a low risk of bias. The risk of bias in the present review is also minimal, as the author had no sources of financial support in its creation.

In conclusion, % body fat in addition to or along with weight, BMI, and fat mass appears to be a useful, consistent, and meaningful measure of success in adults weight loss studies. It is recommended that researchers include it as a primary outcome measure in future studies.

Conflict of Interests

The author has no potential conflict of interests to declare.

Acknowledgments

Drs. Linda Gallo, Kerri Boutelle, Karen Calfas, and James Sallis, all from the SDSU/UCSD Joint Doctoral Program in Clinical Psychology, are gratefully acknowledged, for their reviews of this paper and input into its development and structure.