Abstract

Introduction. Most dietary questionnaires are not created for use in a clinical setting for an adult health exam. We created the Healthy Eating Vital Sign (HEVS) to assess eating behaviors associated with excess weight. This study investigated the validity and reliability of the HEVS. Methods. Using a cross-sectional study design, participants responded to the HEVS and the Block Food Frequency Questionnaire (BFFQ). We analyzed the data descriptively, and, with Pearson’s correlation and Cronbach coefficient alpha. Results. We found moderate correlation ( r h o > 0 . 3 ) between multiple items of the HEVS and BFFQ. The Cronbach's alpha was 0.49. Conclusion. Our results support the criterion validity and internal reliability of the HEVS as compared to the BFFQ. The HEVS can help launch a dialogue between patients and providers to monitor and potentially manage dietary behaviors associated with many chronic health conditions, including obesity.

1. Introduction

The United States (US) did not meet the Healthy People 2010 objective to decrease the prevalence of adult obesity to 15% [1]. According to the Centers for Disease Control and Prevention (CDC), 27% of US adults are obese [2]. Flegal et al. report more dismal statistics; 68% of adults are overweight ( B M I ≥ 2 5 ) and 34% are obese ( B M I ≥ 3 0 ) [3].

Multiple factors influence energy balance, or energy intake versus energy expenditure. However, primary care providers have the opportunity to engage with people and potentially affect behaviors that can tilt the energy balance [4]. A provider’s attention to weight has great influence on patients [5, 6]. Therefore, effectively and efficiently managing and preventing overweight and obesity in the primary care setting is warranted [7].

Traditionally, food frequency questionnaires are used to assess habitual dietary behavior. The Block Food Frequency Questionnaire (BFFQ) is a valid and reliable instrument used as a standard tool for nutrition assessment [8, 9]. The BFFQ contains more than 100 questions, takes approximately 45 minutes to complete, and focuses on nutrient intake rather than eating behaviors. Because of its length and the complexities involved in dietary analysis, the BFFQ is too cumbersome for routine clinical screening of patients’ nutritional habits. Recognizing this problem, Glasgow et al. recommended Starting the Conversation-(STC) Diet and the Summary of Diabetes Self-Care Activities (SDSCA) as practical measures for clinical use [10]. The STC-Diet is a 7-item instrument to assess dietary behaviors, created for the New Leaf (Well-Integrated Screening and Evaluation for Women in Massachusetts, Arizona and North Carolina) (WISEWOMAN) intervention program [11]. To our knowledge, this scale has not been studied for validity and reliability. The SDSCA is an 11-item survey that assesses many health indicators for diabetic patients. It includes two questions of specific foods eaten in the last 7 days: fruits and vegetables, and high fat foods [12]. These questionnaires, however, were not created for use in a clinical setting for a routine adult health exam.

Our previous review indicated five specific eating behaviors associated with excessive weight status: (1) frequent fast food/restaurant consumption, (2) consumption of large portion sizes, (3) high consumption of sugar-added beverages, (4) low fruit and vegetable consumption, and (5) infrequent breakfast consumption [13]. We created the Healthy Eating Vital Sign (HEVS) to clinically address these specific eating behaviors as risk factors for obesity, which, to our knowledge, no other tool addresses in a clinical setting. The HEVS questions recent, one-day or one-week, recall of eating behaviors, and typical behavior over a day or a week. For example, one of the recent recall questions of the HEVS is “How many times did you drink juice or punch yesterday?” One of the HEVS typical recall questions is “How many times do you typically eat vegetables in one day?” (see the Appendix).

Previous evaluation supported the content validity of the HEVS. We found that sugar-added beverage consumption ( 𝛽 = 0 . 6 1 , 𝑃 = 0 . 0 0 6 ) and consuming full portion sizes served at restaurant/fast food establishments (OR = 1.34, 𝑃 = 0 . 0 0 5 ) were positively associated with BMI and obesity, while eating at restaurant/fast food establishments (OR = 1.24, 𝑃 = 0 . 0 0 5 ) was positively associated with being overweight. Consumption of more than 3 fruits and/or vegetables a day tended to have a negative association with BMI ( 𝛽 = − 0 . 0 9 , 𝑃 = 0 . 6 6 ); however, this behavior is associated with weight stability [14]. After examining its content validity, the HEVS was revised for the present study, eliminating the questions regarding breakfast and consumption of large portion sizes. We deemed our question of breakfast consumption too vague for adequate correlation with weight. Because large portion size has been closely associated with restaurant and fast food consumption, we excluded the question of large portion size [15].

Utilizing a cross-sectional study design, the purpose of this investigation was to determine the criterion validity and internal reliability of the HEVS. Our ultimate goal is to develop a screening tool for use in primary care clinics that would help providers identify these potentially modifiable behaviors among patients.

2. Methods

The Institutional Research Review board of The University of Utah approved this research with human subjects (IRB no. 00038314).

2.1. Clinic Selection

To further explore the HEVS, we joined investigators of the Utah Women’s Health Information Network (UWIN). UWIN reflects partnerships among the University of Utah, the Utah Department of Health, the Association for Utah Community Health, and Utah Navajo Health Services, Inc. One UWIN project aimed to validate relatively new assessments of physical activity and nutrition that can be used in primary care clinics. The HEVS was added to this project.

2.2. Participant Selection

Participants were recruited from 8 primary care clinics. The UWIN grant partnership facilitated data collection among four, federally qualified community health centers (Community Health Centers (CHCs), Inc.). The remaining 4 clinics were participants of the Utah Health Research Network (UHRN), which includes 10 clinics within the University of Utah Health Care Community Clinics system. These four clinics were recommended by the study coinvestigators and selected based on their similarity to the participating CHC Inc. sites.

We recruited clinic staff (i.e., medical assistants, medical records, and billing specialists and nurses) of the targeted CHC, Inc. and UHRN sites. We invited women and m e n ≥ 1 8 years to participate. Potential participants with uncontrolled chronic disease, significant musculoskeletal disease that would limit physical activity, or women who were pregnant were excluded.

2.3. Procedures

We communicated with clinic administration to schedule times for recruitment and data collection. Research personnel visited each clinic on two occasions. On Day 1, we reviewed the study, determined participant eligibility, obtained consent, explained the BFFQ, and conducted basic demographic and health history assessments. The health history was self-reported, including height and weight. Depending upon participant self-identification of typical dietary habits, some received the version of the BFFQ that is based upon the Hispanic-American Diet, while others were given the BFFQ based upon the typical American diet [16]. Although the BFFQ uses different food lists to accommodate Hispanic and typical American nutritional habits, they provide the same dietary analysis. The participants took the BFFQ home with them for completion.

Day 2 of data collection occurred one week after the first, whereupon participants returned their completed BFFQ and completed the HEVS. Research personnel checked the BFFQ for missing data and then administered the HEVS questionnaire verbally and circled participants’ answers. HEVS required about 1 minute to administer for most participants.

2.4. Analysis

We calculated the BMI utilizing the formula B M I = w e i g h t / ( h e i g h t 2 ) ∗ 7 0 3 . We used SAS/STAT Software for analysis. We defined moderate correlation as rho = 0.3–0.6, and significance at 𝑃 ≤ 0 . 0 5 . We also calculated the cronbach coefficient Alpha to indicate the internal reliability of HEVS. We defined alpha > 0.4 as acceptable [17].

3. Results

Participants ( 𝑁 = 6 0 , 38.3 ± 9.6 yrs.) were mostly female ( 𝑛 = 5 6 ). Fifty-four percent reported to be White/Caucasian, and 25% were Latino/a. All participants were employees of the CHC, Inc. or UHRN Clinics. Thirty-two percent had a normal BMI (19 < BMI < 25), 25% were overweight (30 < BMI > 25), and 43% were obese (BMI > 30). Table 1 describes other participant demographics. All participants completed the HEVS and the BFFQ. Table 2 provides a numerical summary of the HEVS and BFFQ responses.

Table 1 
Summary of participant demographics.
Table 2 
Descriptive summary of responses to HEVS and BFFQ, 𝑁 = 6 0 .

Pearson’s correlation analysis revealed moderate association between multiple items of the HEVS and the BFFQ (see Table 3). Most significant associations were between the number of times participants ate at restaurant or fast food establishments and BFFQ responses to fat grams (recently and typical, 𝑟 = 0 . 3 , 𝑃 < 0 . 0 5 ), and total trans-fat grams (recently, 𝑟 = 0 . 5 , 𝑃 < 0 . 0 0 1 ; typical, 𝑟 = 0 . 4 , 𝑃 < 0 . 0 1 ), and daily servings of bread, rice, pasta, and cereal (recently, 𝑟 = 0 . 4 , 𝑃 < 0 . 0 1 ; typical, 𝑟 = 0 . 3 , 𝑃 < 0 . 0 5 ).

Table 3 
Discriminant and criterion Pearson correlation coefficients between Healthy Eating Vital Sign and Block Food Frequency Questionnaire, 𝑁 = 6 0 .

The HEVS recall of typical consumption of non-diet soda was most significantly associated with BFFQ responses to total kilocalories of energy ( 𝑟 = 0 . 4 , 𝑃 < 0 . 0 1 ), total grams of sugar ( 𝑟 = 0 . 4 , 𝑃 < 0 . 0 1 ), and percentage of kilocalories from sweet and desserts ( 𝑟 = 0 . 3 , 𝑃 < 0 . 0 5 ). Recent and typical HEVS recall responses from the number of times participant drank juice or punch were moderately associated with BFFQ responses to total kilocalories of energy (recently and typical, 𝑟 = 0 . 3 , 𝑃 < 0 . 0 5 ), and total grams of sugar (recently and typical, 𝑟 = 0 . 4 , 𝑃 < 0 . 0 1 ).

Recent and typical HEVS recall responses from the number of times participants ate vegetables were moderately associated with BFFQ responses to overall dietary fiber grams (recently and typical, 𝑟 = 0 . 3 , 𝑃 < 0 . 0 5 ), dietary fiber grams from fruits and vegetables (recently and typical, 𝑟 = 0 . 4 , 𝑃 < 0 . 0 1 ), daily servings of vegetables (recently and typical, 𝑟 = 0 . 3 , 𝑃 < 0 . 0 5 ), and daily frequency of fruits and fruit juices ( 𝑟 = 0 . 4 , 𝑃 < 0 . 0 . 1 and 0.3, 𝑃 < 0 . 0 5 ). The typical responses from the HEVS question of vegetable consumption were negatively correlated with the total trans-fat grams ( 𝑟 = 0 . 3 , 𝑃 < 0 . 0 5 ).

Recent and typical HEVS responses from the number of times participants ate fruits were moderately associated with BFFQ responses to overall dietary fiber grams (recently and typical, 𝑟 = 0 . 3 , 𝑃 < 0 . 0 5 ), and daily frequency of fruits and fruit juices (recently and typical, 𝑟 = 0 . 4 , 𝑃 < 0 . 0 1 ).

The standardized Cronbach alpha for internal consistency was 0.49 (see Table 4).

Table 4 
Internal consistency of HEVS questions.

4. Discussion

This investigation demonstrates evidence for criterion validity and internal reliability of the HEVS. Our results support the criterion validity of the HEVS as compared to the BFFQ. Most of the significant correlations would be classified as moderate in strength. Further, most of the results demonstrate correlations among like nutritional variables; for example, the HEVS fruit and vegetable consumption questions were correlated primarily with BFFQ fruit and vegetable variables. The associations between HEVS responses to the consumption of non-diet soda with BFFQ responses to fat intake variables, cholesterol, and daily servings of whole grains, breads, cereals, rice, and pastas show that this particular question is related to multiple dietary behaviors and not just the consumption of beverages with added sugar. The HEVS questions, however, can help launch a dialogue between patients and providers to explore these interactions, which are often unique and individualized.

Though the Cronbach’s alpha did not reach the common cutoff of 0.7, the alpha we obtained, which was >0.40, indicated acceptable consistency through the tested item [17]. Future factor analysis, which would require a larger sample size, would help to combine items into a few factors in order to obtain higher consistency.

Previous evaluation supported the content validity of this instrument, associating responses of the HEVS to weight [14]. Our sample for this study was too small to determine such associations.

The HEVS assesses the frequency of eating patterns by asking respondents the number of times per day and week particular foods are ingested. This differs from most food frequency questionnaires, which ask respondents to quantify servings of food. Often, the concept of serving size is difficult for people (patients and providers alike) to quantify. Communicating the frequency of a dietary behavior is less complex. Traynor et al. found no significant difference between responses of fruit and vegetable consumption quantified by servings or frequency ( 𝑃 = 0 . 9 4 ) [18]. The investigators created the HEVS in agreement with the findings of this investigation.

This study had a small sample size, limiting its power. However, we would anticipate stronger correlation between the HEVS and FFQ given a larger study population. Furthermore, causation could not be established with this survey study. Other limitations of this study include the following. We collected data for this study during spring and summer months; therefore, we could not account for seasonal variations. The data were skewed according to gender (female = 56 and male = 4); therefore, we could not categorize our analysis by gender. The gender and ethnic/racial diversity of our sample was limited and did not match that of the general US population. Furthermore, the administration method made this study subject to recall bias, and the setting might introduce other subject biases, as we used a self-administered questionnaire collected in a clinic environment.

This study utilized the responses from staff working in primary care medical clinics. They all had at least a high school education (or educational equivalent) and 1-2 years of vocational training. We did not collect specific data on level of education, and we have inadequate male representation. We assumed responses from our population would closely match those of the general adult population of Utah. However, this assumption is not scientifically based and limits the generalizability of this study. Future endeavors could assess a patient population to allow further inferences.

Our ultimate goal is to create an effective screening tool to identify key eating behaviors that may assist primary care providers with managing excessive weight. We envision a concise 3–5 item tool, feasible for use during a 15-minute clinic visit. With the emergence of electronic medical records, the questionnaire can be programmed in with nursing notes or the vital signs. The nurse or medical assistant can ask and record the responses while rooming a patient, or the provider can do the same as they encounter the patient. Alternatively, the questionnaire can be administered in paper form, and patients can respond as they wait for the provider in the reception area or exam room.

We consider this to be a successful investigation for the criterion validity of the HEVS. Medical management of weight in clinical settings is centered upon (1) assessment and (2) counseling based upon that assessment. With the HEVS, providers can assess eating behaviors and identify patients who may need counseling to prevent or manage overweight and/or obesity. Our next endeavor will be to create a counseling instrument that complements the HEVS, then pilot the use of these instruments in clinical settings.

Appendix

For more details See Table 5.

Table 5 
The Healthy Eating Vital Signs (HEVS).

Conflict of Interests

The authors declare that there is no conflict of interests.

Acknowledgments

Thanks are due to Elizabeth A. Joy, MD, MPH for facilitating the Utah Health Research Network collaborations necessary for this endeavor. This paper is funded in part by DHHS Office on Women's Health (Asist2010: ASTWH070006-01-00) and University of Utah Undergraduate Research Opportunities Program. The authors wish to thank the participating clinics of the Community Health Centers Inc. and of the University of Utah Primary Care Research Network.