Abstract

Dietary indices evaluate diet quality, usually based on current dietary guidelines. Indices can therefore contribute to our understanding of early-life obesity-risk dietary behaviours. Yet indices are commonly applied to dietary data collected by onerous methods (e.g., recalls or records). Short dietary assessment instruments are an attractive alternative to collect data from which to derive an index score. A systematic review of studies published before April 2013 was conducted to identify short (≤50 items) tools that measure whole-of-diet intake of young children (birth-five years) and are applicable to dietary indices, in particular screening obesogenic dietary behaviours. The search identified 3686 papers of which 16, reporting on 15 tools ( , infants and toddlers birth-24 months; , preschoolers 2–5 years), met the inclusion criteria. Most tools were food frequency questionnaires ( ), with one innovative dietary questionnaire identified. Seven were tested for validity or reliability, and one was tested for both. Six tools ( , infants and toddlers; , preschoolers) are applicable for use with current dietary indices, five of which screen obesogenic dietary behaviours. Given the limited number of brief, valid and reliable dietary assessment tools for young children to which an index can be applied, future short tool development is warranted, particularly for screening obesogenic dietary behaviours.

1. Introduction

Individuals do not consume single nutrients, foods, or food groups, but rather combinations of foods [1]. Therefore in nutrition research it is appealing to capture the mix of foods and/or nutrients likely to influence health [2]. Dietary indices, for example evaluate diet quality by assessing dietary intake against predetermined criteria, usually reflecting current dietary guidelines [3].

Childhood overweight and obesity is a global health problem with 40 million children under the age of five classified as overweight [4]. Given the consequences of obesity and the persistence of obesity from childhood into adulthood [5], it is of major importance to address overweight early in life. As recommendations for overweight prevention and treatment are consistent with food-based dietary guidelines [6, 7], dietary indices offer a way of understanding the contribution of early life food intake to obesity risk.

Evaluation of diet against food-based dietary guidelines using an index [8] still requires accurate assessment of dietary intake at the food or food group level. In children under five, indices have commonly been applied to dietary data collected by 24-hour recalls, diet diaries, or weighed food records [9]. Yet, these methods are associated with high respondent burden and are cost- and time-intensive in terms of administration and analysis [10]. The use of these dietary assessment methods is a challenge in large epidemiological studies. Additionally, while energy and nutrient intakes can easily be derived from these detailed methods, it is often difficult to extract food intake data in a way that allows meaningful comparison with food-based dietary guidelines [8].

Short, simple dietary assessment instruments are an attractive alternative to collect data from which to derive a diet quality score, as they are associated with reduced participant burden, data handling and processing, and costs. They are consequently suitable for survey or epidemiological research [11]. Further, as they supply information quickly [11], they are useful in clinical settings for the rapid assessment of individuals’ food intake against food-based dietary guidelines. In view of the high worldwide childhood obesity rates, simple tools that assess early life obesogenic dietary habits are crucial. Given their advantages, short tools that enable evaluation of young children’s dietary intake against food-based dietary guidelines using a dietary index are required.

Thus, this review aimed to (1) examine short tools, including their reliability and validity, that measure diet of children birth-five years, (2) identify the short tools that could be used in dietary index research, including screening of obesogenic dietary behaviours.

2. Methods

2.1. Search and Selection Strategy

A six-stage systematic search was conducted to identify existing short tools that measure whole diet in young children. The search strategy and article selection are summarised in Figure 1. In stage one, MEDLINE via PubMed, Web of Science, and SCOPUS were searched for relevant articles published prior to June 2011. The search terms were developed and combined under the following headings: (1) child (birth-5 years), for example infant, toddler, preschooler, and child; (2) diet, for example food, nutrition, dietary intake, dietary pattern, eating pattern, food intake; (3) assessment tool, for example tool, dietary assessment, evaluate, questionnaire, checklist, validity, and reproducibility. Search term lists were comprehensive with small adaptations made for individual databases searched (see Supplementary information). Stage two involved elimination of irrelevant articles in Endnote using specific term searches through “title” and “keywords” (all terms presented in the Supplementary Information in Supplementary Material available online at http://dx.doi.org/10.1155/2013/709626). Subsequently, the title and abstract of the remaining 3303 articles were screened against the review inclusion and exclusion criteria, outlined below (stage three). If it was unclear whether an article should be included from the title and abstract, the full article was retrieved and screened (stage four). In stage five, reference lists of all included articles and relevant reviews were searched for additional studies. Lastly, searches were rerun in April 2013 to identify articles published after June 2011 (stage six). All resulting articles were screened according to stages two to five. Overall, all articles were assessed for eligibility independently by the primary author but in consultation with all coauthors.

2.2. Inclusion and Exclusion Criteria

The included studies were determined using the following criteria. (1)Types of outcome measures: studies with whole-of diet intake data were included. Those assessing individual foods, food groups, nutrients or behaviours, and/or household, family, or group consumption were excluded. (2)Types of dietary assessment methods: studies assessing dietary intake using a short dietary assessment tool were included. For example food frequency questionnaires, checklists, and other dietary questionnaires classified as 50 food intake questions or less. This criterion was set by the authors in an attempt to capture tools that were five pages or less and/or could be completed within 30 minutes. Articles were excluded if dietary assessment tools such as 24-hour recalls, diet histories or food records were used to measure food intake, as they are considered standardised methods that are limited by complex researcher-based administration [12]. If the number of questionnaire items was not reported, or if the tool had been captured in a previously identified paper, articles were excluded. (3)Types of participants: studies assessing dietary intake of healthy children aged birth to five years, reported by a parent or primary caregiver without assistance from the child, were included. Studies not applicable to the general population (e.g., preterm infants or children with disabilities, health conditions, or behavioural/learning difficulties) were excluded. (4)Other: studies were limited to the English language, humans and those with an abstract. Review studies, reports, conference papers, and similar documents were excluded.

2.3. Data Extraction and Analysis

Data, including sample characteristics, questionnaire details, and reliability and validity were extracted into standardized tables by the principal author and checked for completion and accuracy by all coauthors. Data synthesis comprised grouping studies by age group and comparing in terms of dietary assessment characteristics; reliability (i.e., tool reproducibility or repeatability using a test-retest procedure [13]); validity (i.e., the ability to accurately measure food consumption data that represents the true intake of the individual [14], determined by comparison with an already validated method); and usefulness for current dietary index applications and screening obesogenic dietary behaviours. Applicability of tools to dietary indices was determined by comparing tool characteristics with characteristics of available indices for children aged up to five years, based on those identified in a recent review [9]. Tools were defined as applicable to dietary indices if all index components could be assessed both easily and accurately. Indices covering the five “core” food groups (i.e., foods recommended to be consumed every day including fruits; vegetables; cereals (e.g., bread, rice, and pasta, noodles); meat and alternatives (e.g., fish, eggs, and nuts); dairy), are highlighted. Indices suitable for screening obesogenic dietary behaviours were defined by the assessment of foods not included in the “core” food groups, described as “noncore” (energy-dense, low nutrient) foods and recommended to be consumed in minimal amounts [6, 15].

3. Results

3.1. General Description of Included Studies

Sixteen studies met the review inclusion criteria (Figure 1). The most common reason for exclusion was the type of outcome data ( ), followed by study assessment methodology ( ) and study participants ( ). The final 16 papers reported on 15 tools developed to assess dietary intake in early childhood (birth-5 years); seven evaluate infant and toddler dietary intake [1622] eight evaluate preschoolers dietary intake [2331] (Table 1). Studies included a range of population groups from predominately European [16, 17, 1921, 2428] and other western countries [18, 23, 2931] and were largely published from 2006 onwards [16, 18, 19, 2331], with no retrieved papers published prior to 2000. The number of participants varied from 44 [25] to 27 763 [17], with three studies presenting data from large, prospective birth cohorts UK Southampton Women’s Study (SWS) [19], UK Avon Longitudinal Study of Parents and Children (ALSPAC) [16], and the Norwegian Mother and Child Cohort Study (MoBa) [17].

3.2. Dietary Assessment Methods and Testing

Most ( of 15) tools used a food frequency questionnaire (FFQs) format [1628, 30, 31], with one innovative tool, the NutriSTEP nutrition screening tool for preschoolers, identified [29]. The majority of tools were self-administered [1618, 20, 21, 2329, 31] and nonquantitative [1618, 2225, 29, 31]. The average tool length was 33 items (range 6–47), with 5 tools comprising less than 25 items [18, 20, 21, 23, 29]. Reference periods for recalling foods varied from the past week [18, 19, 22] to past year [27, 28]. Fourteen of the 16 studies reviewed reported food or food group intake as a tool outcome measure [1618, 2027, 2931], whilst two reported energy and nutrient intakes only [19, 28]. Overall, testing was undertaken on approximately half of identified tools ( , described in 8 papers) (Table 2). A range of tests to assess reliability and validity were reported. Test definitions and review assessment criteria are presented in the Supplementary Table. Validity (Table 3) and/or reliability (Table 4) were most commonly tested using correlations, although agreement statistics were also used.

3.2.1. Infants and Toddlers (Birth-24 Months)

All seven [1622] tools assessing infant and toddler dietary intakes were FFQs, ranging in length from 15 [20] to 43 [16] items. Three tools were evaluated for validity [1921] (Table 4) whilst none were evaluated for reliability.

Validity testing revealed that the FFQs overestimated energy and nutrient intakes compared with the selected reference standard (all weighed dietary records, WDR) [1921]. Correlations for energy and nutrients were low to moderate and slightly higher when energy adjusted [20, 21]. Bland Altman plots for nutrient intakes showed mostly positive mean differences [19], systematic increases in difference with increasing intake for most nutrients [20, 21] and large limits of agreement [20, 21]. Little gross misclassification (3% [21], 5% [20]), defined as classification of intake by the tool in the opposite quartile or tertile of intake, was reported with over one-third of subjects (38% [21], 36% [20]) classified into the same category of nutrient intake. At the food level, FFQ’s generally revealed higher median intakes for several food items (11/17 [21] and 7/15 foods [20]) than the WDR [20, 21]. Correlations for most foods were low or moderate with low ( [20]) and moderate ( [21]) overall median correlations. Importantly, no studies used agreement statistics at the food level.

3.2.2. Preschool Children (2–5 Years)

Of the eight tools evaluating pre-schoolers’ dietary intakes, described in nine papers [2331], seven were FFQ’s [2328, 30, 31] but length varied widely (six [29] to 47 [27, 28, 31] items). Overall, three tools were assessed for reliability only [24, 25, 29] and one for reliability and validity of food [27] and nutrient [28] intake (Tables 3 and 4).

To assess test-retest reliability [24, 25, 2729] the period between administrations varied, ranging from two to four weeks [29] to an average of four months (range 0–364 days) [24]. No tool was assessed for reliability of energy intake and only one for nutrients [28]. The latter revealed that for average daily calcium intakes readministrations were not significantly different ( ), were highly correlated ( ) with moderate agreement ( ) and that nearly all subjects were classified into the same or adjacent quartile of intake (93%) [28]. The reproducibility of food intake was assessed for four tools [24, 25, 27, 29] and showed no statistically significant differences for most foods (38/43 [24], 13/13 foods [27]). Mean spearman’s correlations were moderate ( [24], [25], and [27]) with good intraclass correlation coefficients (ICC’s) reported for many food items ( [25]; [27]) and moderate overall mean ICC’s ( [25, 27]). Two studies showed moderate overall agreement for food items ( [24], [29]).

Only one tool was assessed for validity, reported in two studies [27, 28]. This tool significantly underestimated calcium intake measured by an estimated dietary record (EDR), yet methods were moderately correlated ( , adjusted ) [28]. Sensitivity and specificity of calcium intake was 62% and 77%, respectively, [28] and nearly half (42%) of subjects were correctly classified [28]. Agreement statistics showed fair agreement ( ) and large differences for higher average nutrient intakes (Bland-Altman plot) [28]. For food intake, mean differences were predominately less than 30% (12/13 foods) [27], whilst the median correlation was low ( [27]) and agreement mostly poor (4/13 foods) or fair (4/13 foods) [27]. Gross misclassification was less than 10% for all food groups whilst classification into the same or adjacent category ranged from 67% (meat products) to 88% (fruit juice) [27].

3.3. Dietary Index Applications

Dietary indices developed to characterise the diet quality of infants, toddlers or preschool-aged children are summarised in Table 5 [26, 3148]. Overall, data from six tools ( , infants and toddlers [20, 21]; , pre-schooler [26, 27, 30, 31]) can be applied to five measures of diet quality reviewed [26, 31, 39, 42, 47], all developed for use in pre-schoolers (Table 5). Two have been tested for validity only [20, 21] and one for both validity and reliability [27]. Of these six short tools, two [26, 31], both for use in pre-schoolers, have previously been used in dietary index applications. The Healthy Nutrition Score for Kids and Youth (HuSKY) has been applied to the 54-item (45 food-item) semi-quantitative FFQ assessing intakes of three to six-year-old German children [26], whilst the 47-item non-quantitative FFQ has been used to assess dietary diversity in American children under five [31].

No other short tools were identified that provide dietary data to which a dietary index could be applied, often because the level of detail provided by the tool was too minimal for application of an index. This is particularly evident for those indices comprising food-group subcategories (e.g., “vitamin A-rich vegetables”) [33, 36, 38, 43, 44, 48]. Additionally, application of several tools to current indices would require detailed analysis to determine nutrient (e.g., total fat, cholesterol, and iron) intakes [32, 34, 40, 41, 43, 44, 46]. Lastly, portion size quantification is required for the majority of dietary indices reviewed [26, 32, 34, 36, 3844, 4648] and thus only quantitative or semiquantitative tools provide data to which these indices could be applied.

3.4. Screening Obesogenic Behaviours

Of the 15 tools reviewed, 13 assess the intake of “noncore” foods and/or beverages ( , infant and toddlers [1621]; pre-schoolers [2330]). Three of these were specifically designed to screen obesity related behaviours [24, 25, 29] whilst five were identified (above) as being useful for application of a dietary index. Of the 19 indices reviewed [9], three ( , infants and toddlers [34]; , pre-schoolers [26, 39]) included food items associated with poor diet quality, such as intake of high fat or sugary foods and/or beverages. Two of these indices can be used with the short tools identified in this review [26, 39].

4. Discussion

This review identified 16 papers reporting on 15 short dietary assessment tools that measure whole diet of children under five years ( , infants and toddlers; , pre-schoolers). Tool reliability and validity and applicability to dietary indices and for screening obesogenic dietary behaviours are highlighted. All but one tool was a FFQ, and approximately half ( ) of all tools were tested for either reliability or validity, and one tested for both. Six tools provide dietary intake data to which an index can be applied, five of which screen obesogenic dietary behaviours. Overall, testing of tool properties was limited and few tools are applicable to current dietary indices that screen obesogenic dietary behaviours of children from birth to five years of age.

Of the 15 tools identified in this review, only seven were tested for validity and/or reliability at the food or food group level. In general, there was a lack of reliability testing to accompany validity testing with only one of four tools assessed for validity also assessed for reliability. As validity requires reliability [49], the remaining three tools cannot be identified as valid. Moreover, there was a high reliance on correlations which assess association only and thus should not be used alone but alongside agreement measures such as kappa statistic and Bland-Altman analysis [50, 51]. Further, although the reference period covered by the validation standard should correspond to that of the questionnaire [52], 3- or 7-day food records were commonly used in the reviewed studies to assess the validity of FFQs covering two weeks [20, 21] or 12 months intake [27, 28]. For reliability studies, if readministration periods are too close, subjects may remember their previous responses, or if too far apart, lower reliability may reflect true variation in diet [52], particularly in young children at an age when dietary habits are rapidly changing [53]. This is evident as an average re-administration period of 4 months yielded weaker agreement [24] than studies with shorter re-administration periods. Despite these limitations in tool testing, and in considering the realistic estimates of measurement error between two dietary assessment methods [54] in conjunction with unstable dietary habits of young children, the reliability and validity results presented here can be considered reasonable. Thus, several short dietary assessment tools can be judged as useful for characterising the diet of children under 5.

Given the increasing interest in assessing diet quality using an index, resulting from an increased understanding of the complexity in which individuals consume foods [55], determining those short tools that are useful for dietary index applications is of interest. For the current indices available for children under five years of age, summarised in this review, diet quality is assessed based on intake of particular foods or food groups, nutrients, or a combination of both. Although most of the tools reviewed estimate whole-of-diet food intake making them potentially useful for food or food-group based index applications, few ( of 15) can be directly applied to current indices of diet quality [20, 21, 26, 27, 30, 31]. Further, these tools are limited by a lack of testing, with only one tested for reliability and validity [27, 28]. Thus the accuracy of the other five tools in assessing dietary intake, and diet quality when applied to an index, is questionable. Therefore, testing of tool properties is recommended prior to dietary index applications.

Several factors explain why other short tools reviewed are not useful for dietary index applications. First, as mentioned, many indices assess diet quality based on nutrient intakes or a combination of nutrient and food intakes. Applying an index of this type to a questionnaire-type tool requires linkage with appropriate food composition data to derive nutrient intakes. Alternatively, questionnaire-type tools are most applicable to food-based indices. Further, several indices assess food-group subcategories, such as “vitamin A-rich vegetables” or “dark green vegetables,” which are not measured by the short tools reviewed. Also limiting applicability is that portion size quantification is required to apply dietary data to several indices. Although these factors limit the applicability of short tools to current indices, several tools that capture food groups of interest are ideal for development of a suitable index. For example the 47-item FFQ by Huybrechts et al. [27] is suitable as it assesses “core” and “noncore” food intake and was the one tool tested for both reliability and validity of food intake. Development of a dietary index based on food intake assessed using this short tool would be appropriate. Alternatively, future research to develop suitable short dietary assessment tools that measure whole diet to which a current index can be applied is ideal.

Moreover, in view of the high rates of overweight and obesity among children under five worldwide [4], indices are potentially a useful tool to evaluate early life dietary behaviours that contribute to obesity risk. Yet few current indices for children less than five years assess obesogenic dietary behaviours, with many evaluating “core” food and/or nutrient intakes only. Thus, future indices based on “core” and “noncore” food intake are warranted. Additionally, considering that few short tools assess “noncore” intakes and are useful for application of a dietary intake there is a need for future development of short tools that are useful for both dietary index applications and screening obesogenic dietary behaviours in children under five, particularly in those less than two years of age.

Overall, this systematic review highlights the lack of high quality short dietary intake assessment tools for young children, particularly less than two years, to which a dietary index can be applied. Further, as the majority of those tools available for dietary index applications were developed and tested in European populations, restricting their generalisability outside the European context, there is a need for short dietary assessment tools developed for use in other populations of young children to which an index can be applied. Lastly, it is important to note that several rapid dietary assessment tools have been designed for use in young children, yet are not presented in this review as they focus on limited aspects of food intake, for example fruit and vegetables [56], beverages [57], and obesity-related food and beverages only [58], not total diet. Future rapid dietary assessment tools should be designed to comprehensively measure young children’s whole-of-diet intake, including obesogenic dietary behaviours, and should be tested for reliability and validity of food intake.

5. Conclusion

A key finding of this review is that although several short dietary assessment tools were identified as useful for characterising whole diet of children birth-5 years, there is an overall lack of brief, valid and reliable dietary assessment tools available for use in this age group. This highlights a need for greater testing of existing short tools. A second key finding is that few short dietary assessment tools, particularly those developed for under 2’s, are suitable for dietary index applications and for screening obesogenic dietary behaviours of young children. Due to the benefits of assessing diet quality using indices and of capturing dietary intake using less demanding, time-consuming and expensive dietary assessment methodologies, this review identifies opportunities for short tool development for use in children under five that are adequately reliable and valid for use, applicable to dietary indices, and that assess obesogenic dietary behaviours.

Conflicts of Interests

The authors declare no conflict of interests.

Acknowledgments

Rebecca K. Golley is supported by a National Heart Foundation Fellowship, and Lucinda K. Bell is supported by an Australian Postgraduate Award (APA).

Supplementary Materials

Supplementary 1 material provides details of the six-stage search process undertaken for the literature review. Details of inclusion and exclusion criteria applied to retrieved articles are detailed in the table. Supplementary 2 defines statistical tests used to assess reliability and validity of reviewed studies and highlights the review assessment criteria.

  1. Supplementary Material