Hostname: page-component-7c8c6479df-r7xzm Total loading time: 0 Render date: 2024-03-27T19:43:02.118Z Has data issue: false hasContentIssue false

Diet–obesity associations in children: approaches to counteract attenuation caused by misreporting

Published online by Cambridge University Press:  09 October 2012

Claudia Börnhorst
Affiliation:
BIPS – Institute for Epidemiology and Prevention Research, Achterstrasse 30, 28359 Bremen, Germany
Inge Huybrechts
Affiliation:
Department of Public Health, Ghent University, Ghent, Belgium International Agency for Research on Cancer (IARC), Dietary Exposure Assessment Group (DEX), Lyon, France
Antje Hebestreit
Affiliation:
BIPS – Institute for Epidemiology and Prevention Research, Achterstrasse 30, 28359 Bremen, Germany
Barbara Vanaelst
Affiliation:
Department of Public Health, Ghent University, Ghent, Belgium Research Foundation–Flanders (FWO), Brussels, Belgium
Dénes Molnár
Affiliation:
Medical Faculty, Department of Pediatrics, University of Pécs, Pécs, Hungary
Silvia Bel-Serrat
Affiliation:
GENUD (Growth, Exercise, Nutrition and Development) Research Group, University of Zaragoza, Zaragoza, Spain
Theodora Mouratidou
Affiliation:
GENUD (Growth, Exercise, Nutrition and Development) Research Group, University of Zaragoza, Zaragoza, Spain
Luis A Moreno
Affiliation:
GENUD (Growth, Exercise, Nutrition and Development) Research Group, University of Zaragoza, Zaragoza, Spain
Valeria Pala
Affiliation:
Fondazione IRCSS, Istituto Nazionale dei Tumori, Department of Preventive and Predictive Medicine, Nutritional Epidemiology Unit, Milan, Italy
Marge Eha
Affiliation:
Department of Surveillance and Evaluation, National Institute for Health Development, Tallinn, Estonia
Yiannis A Kourides
Affiliation:
Research and Education Foundation of Child Health, Paphos, Cyprus
Alfonso Siani
Affiliation:
Institute of Food Sciences, CNR, Avellino, Italy
Gabriele Eiben
Affiliation:
Department of Public Health and Community Medicine, University of Gothenburg, Gothenburg, Sweden
Iris Pigeot*
Affiliation:
BIPS – Institute for Epidemiology and Prevention Research, Achterstrasse 30, 28359 Bremen, Germany
*
*Corresponding author: Email pigeot@bips.uni-bremen.de
Rights & Permissions [Opens in a new window]

Abstract

Objective

Measurement errors in dietary data lead to attenuated estimates of associations between dietary exposures and health outcomes. The present study aimed to compare and evaluate different approaches of handling implausible reports by exemplary analysis of the association between dietary intakes (total energy, soft drinks, fruits/vegetables) and overweight/obesity in children.

Design

Cross-sectional multicentre study.

Setting

Kindergartens/schools from eight European countries participating in the IDEFICS Study.

Subjects

Children (n 5357) aged 2–9 years who provided one 24 h dietary recall and complete covariate information.

Results

The 24 h recalls were classified into three reporting groups according to adapted Goldberg cut-offs: under-report, plausible report or over-report. In the basic logistic multilevel model (adjusted for age and sex, including study centre as random effect), the dietary exposures showed no significant association with overweight/obesity (energy intake: OR=0·996 (95 % CI 0·983, 1·010); soft drinks: OR = 0·999 (95 % CI 0·986, 1·013)) and revealed even a positive association for fruits/vegetables (OR = 1·009 (95 % CI 1·001, 1·018)). When adding the reporting group (dummy variables) and a propensity score for misreporting as adjustment terms, associations became significant for energy intake as well as soft drinks (energy: OR = 1·074 (95 % CI 1·053, 1·096); soft drinks: OR = 1·015 (95 % CI 1·000, 1·031)) and the association between fruits/vegetables and overweight/obesity pointed to the reverse direction compared with the basic model (OR = 0·993 (95 % CI 0·984, 1·002)).

Conclusions

Associations between dietary exposures and health outcomes are strongly affected or even masked by measurement errors. In the present analysis consideration of the reporting group and inclusion of a propensity score for misreporting turned out to be useful tools to counteract attenuation of effect estimates.

Type
Hot topic – Childhood Obesity
Copyright
Copyright © The Authors 2012

Measurement errors in dietary variables pose a challenge for epidemiologists when investigating associations between dietary intakes and health outcomes(Reference Freedman, Schatzkin and Midthune1). Problems in particular emerge from misreporting, which comprises under-reporting and over-reporting. Several studies have revealed that misreporting is characteristic to specific individuals and results in differential errors(Reference Lioret, Touvier and Balin2Reference Black and Cole4). Differential errors are related to the outcome of interest and induce bias such that associations between dietary factors and health outcomes may be attenuated, exaggerated or hidden(Reference Shai, Rosner and Shahar5), whereas non-differential (random) errors tend to attenuate associations. Various procedures have been proposed to screen out implausible dietary recalls(Reference Goldberg, Black and Jebb6, Reference McCrory, Hajduk and Roberts7) but the question how to handle recalls identified as implausible is still open.

Researchers commonly refer to validation studies that confirm the accuracy/reliability of their assessment instruments but do not consider misreporting in the later analyses, although there are different procedures that could be applied(Reference Nielsen and Adair8, Reference Huang, Roberts and Howarth9): (i) exclusion of inaccurate recalls; (ii) adjustment for the reporting group (under-report, plausible report, over-report); (iii) stratified analysis by reporting group; and (iv) propensity score adjustment.

Despite several studies having found that exclusion of under-reports strengthened diet–obesity relationships(Reference Livingston and Black3, Reference Mendez, Wynter and Wilks10, Reference Howarth, Huang and Roberts11), data exclusions may introduce a source of unknown bias and has not been recommended(Reference Gibson12). Adjusting for the reporting group seems an appropriate alternative to data exclusions and was shown to yield consistent results compared with those obtained from plausible reports in stratified analyses(Reference Mendez, Wynter and Wilks10). Although not applied in this context yet, the propensity score is a common tool to reduce bias by equating groups based on selected covariables. A propensity score reflects the conditional probability of assignment to a particular group given a vector of observed covariables(Reference Rosenbaum and Rubin13). Construction of a propensity score based on variables previously found to be related to misreporting could be another option to account for implausible recalls.

Studies in adults investigating the handling of implausible recalls are rare(Reference Nielsen and Adair8, Reference Huang, Roberts and Howarth9, Reference Mendez, Popkin and Buckland14). To the authors’ knowledge, no study to date has addressed this issue in children. As dietary recalls in young children often rely on proxy reports(Reference Livingstone and Robson15), it is likely that misreporting is triggered by different factors compared with adults (e.g. unintentional under-reporting due to lack of parental control). The present study aimed to evaluate the four different approaches to account for misreporting in the statistical analysis mentioned above and finally to give recommendations on how to handle the problem of inaccurate reports in future studies on dietary behaviour in children.

Materials and methods

Study population

IDEFICS (Identification and prevention of Dietary- and lifestyle-induced health EFfects In Children and infantS) is a multicentre, setting-based study aiming to prevent and investigate the causes of diet- and lifestyle-related diseases like overweight and obesity in European children aged 2–9 years. The baseline survey was conducted from September 2007 to June 2008; more than 31 500 children were contacted, out of whom finally 16 220 participated and fulfilled the inclusion criteria of the IDEFICS Study. Children were recruited through kindergartens/schools. In addition to self-completion questionnaires, interviews with parents concerning lifestyle habits and dietary intakes as well as anthropometric measurements and examinations of the children were conducted in examination centres, which were the settings in most countries. All measurements were taken by trained study personnel using standardised procedures in all eight study centres (Belgium, Cyprus, Estonia, Germany, Hungary, Italy, Spain and Sweden). Details on the design and objectives of the study are given elsewhere(Reference Ahrens, Bammann and de Henauw16, Reference Ahrens, Bammann and Siani17).

Ethics approval

Applicable institutional and governmental regulations regarding the ethical use of human volunteers were followed during this research. Approval of the appropriate ethics committees was obtained by each of the eight participating centres carrying out the fieldwork (Belgium: Ethics Committee, University Hospital, Ghent; Cyprus: Cyprus National Bioethics Committee; Estonia: Tallinn Medical Research Ethics Committee; Germany: Ethics Committee, Universtiy of Bremen; Hungary: Egészségügyi Tudományos Tanács, Pécs; Italy: Comitato Etico, Avellino; Spain: Comité Ético de Investigación, Clínica de Aragón (CEICA); Sweden: Regional Ethics Review Board, University of Gothenburg).

Parents provided written informed consent for all examinations. Each child was informed orally about the modules by field workers and asked for his/her consent immediately before examination(Reference Ahrens, Bammann and Siani17). Study children did not undergo any procedure before both they and their parents gave consent for examinations, collection of samples, subsequent analysis and storage of personal data and collected samples. Participants and their parents could consent to single components of the study while abstaining from others.

Anthropometry

Height (centimetres) of the children was measured to the nearest 0·1 cm with a calibrated statiometer (Seca 225; Seca, Birmingham, UK); body weight (kilograms) was measured in light underwear on a calibrated scale accurate to 0·1 kg (Tanita BC 420 SMA; Tanita Europe GmbH, Sindelfingen, Germany). BMI was calculated as weight divided by height squared and the children were categorised according to the International Obesity Taskforce criteria(Reference Cole, Bellizzi and Flegal18, Reference Cole, Flegal and Nicholls19). According to these criteria, centile curves corresponding to a BMI of 25 kg/m2 and 30 kg/m2 at age 18 years are chosen as extrapolation into childhood of the well-accepted adult cut-offs to define overweight/obesity, respectively. Thin and normal-weight children, as well as overweight and obese children, were combined into one category each to construct a binary outcome measure to be included in the logistic model.

Dietary data

Dietary data were assessed using the computerised 24 h dietary recall (24-HDR) SACINA (Self-Administered Children and Infants Nutrition Assessment), which is based on the previously designed and validated HELENA-DIAT(Reference Vereecken, Covents and Sichert-Hellert20) instrument that was originally developed for Flemish adolescents(Reference Vereecken, Covents and Matthys21). SACINA is structured according to six meal occasions (breakfast, morning snack, lunch, afternoon snack, dinner, evening snack) related to a range of chronological daily activities. For each food item the participant selects the consumed quantity by means of pictures with increasing portion sizes (based on predefined standard amounts) that are displayed on the screen to facilitate estimation of portion sizes. The intake of the food item is calculated then as the product of the reported quantity and the standard amount (e.g. 4 spoons of sauce at 15 g = 60 g). Proxies, mainly the parents, completed the 24-HDR under supervision of field personnel which lasted 20–30 min. In case the child had lunch at school on weekdays, school meals were additionally assessed by means of direct observation. Trained observers, teachers or caregivers entered portion sizes of all consumed foods and drinks on predefined assessment sheets. The uniquely coded food items were linked to country-specific food composition tables. Missing quantities for single food items as well as obviously implausible data entries were imputed by country-, food group- and age-specific median intakes (0·01 % of the entries) to avoid excessive recall exclusions. Incomplete interviews were excluded, e.g. if the proxy did not know about at least one main meal or in the case of missing school meal information (n 2518). Furthermore, intakes of energy >16 736 kJ/d (>4000 kcal/d) which seemed to be a result of computer or data-entry errors rather than of misreporting (e.g. several repeated entries for the same food item) were excluded (n 10). Although up to six repeated 24-HDR were carried out in a smaller sample, only the first recall day was included in the current analysis (including weekdays and weekend days) to obtain an equal number of 24-HDR for each child. The assessment procedure was slightly different in the Hungarian study centre, where dietary recalls were not performed via the standardised SACINA software but via paper-and-pencil 24-HDR registrations that were entered in the SACINA software afterwards. As this increased data heterogeneity and further seemed to affect the misreporting behaviour, data from Hungary were not considered in the present analyses. A study sample based on equal procedures and standardised assessment instruments was needed for this exploratory methodological study.

Energy intake (EI; kJ/d), fruit/vegetable intake and soft drink intake (as a percentage of total daily EI; %EI) were used as exposure measures in the different models as these were repeatedly proposed to be associated with overweight/obesity(Reference Zurriaga, Perez-Panades and Quiles Izquierdo22Reference Alinia, Hels and Tetens24).

Statistical methods

Classification of 24 h dietary recalls

The BMR was estimated from the equations published by Schofield(Reference Schofield25) and recommended by the FAO/WHO/United Nations University (1985) taking into account age, sex, body height and weight. To determine whether reported EI was consistent with energy requirements, the ratio of proxy-reported EI to predicted BMR was used to classify the 24-HDR into under-reports (UdR), plausible reports (PR) and over-reports (OvR) according to Goldberg et al.(Reference Goldberg, Black and Jebb6). Since the original Goldberg cut-offs were developed for adults and do not consider differences in EI due to age and sex, cut-off values were re-calculated for application in children as suggested previously(Reference Lioret, Touvier and Balin2, Reference Sichert-Hellert, Kersting and Schoch26) using the formula:

$${\rm{Cut {\hbox-} off}}\: = {\rm PAL}\:\:\times \:\exp \left[ { \pm {\rm{1}}{\rm{.96}}\:\times \:\frac{{(S\:/\:100)}}{{\sqrt n }}} \right],\eqno\rm$$

where

$$S\: = \:\sqrt {\frac{\rm CV{_{{wEI}}^{2} }}{d}\: + {\rm CV}\:_{{\rm wBMR}}^{2} \: + {\rm CV}\:_{{\rm PA}}^{2} }. }\eqno\rm$$

The within-subject CV for EI (CVwEI), the within-subject CV for BMR (CVwBMR) and the CV for physical activity (CVPA) were replaced by age- and sex-specific values as given in Nelson et al.(Reference Nelson, Black and Morris27) and Black et al.(Reference Black28). Goldberg's overall physical activity level (PAL) of 1·55 was substituted by age- and sex-dependent levels of light physical activity (2–5 years: 1·45; 6–10 years: males 1·55, females 1·50) according to Torun et al.(Reference Torun, Davies and Livingstone29). The number of days (d) was set to 1 (one 24-HDR per child) to account for the large day-to-day variation in diet. Cut-off limits need to be wider if only one or few recall days are available as these may not reflect usual intakes but exceptional days. The resulting age- and sex-specific cut-off values to define UdR, PR and OvR are given in Table 1, which were then used to classify the recalls accordingly.

Table 1 Lower and upper cut-off limits to classify 1 d 24-HDR as UdR or OvR based on EI:BMR

24-HDR, 24 h dietary recall; UdR, under-report; OvR, over-report; EI, energy intake.

PR (plausible report) has EI:BMR within the cut-offs.

Calculation of the propensity score

In a previous study based on the IDEFICS data(Reference Börnhorst, Huybrechts and Ahrens30), backward elimination in the course of multilevel logistic regression analysis was applied to identify factors significantly related to misreporting in proxy reports for young children. The covariables that turned out to be significantly associated with misreporting were used in the construction of the propensity score: age and sex of the child(Reference Cole, Freeman and Preece31, Reference Cole, Freeman and Preece32), net household income (dummy: high v. medium/low), number of persons below 18 years of age in the household and day of the interview (dummy: weekday v. Saturday/Sunday). The following information on parental concerns and perception of their child's weight status obtained from a self-administered proxy questionnaire was included: ‘How concerned are you about your child… (i) becoming overweight?’; (ii) becoming underweight?’ (response categories were ‘unconcerned’, ‘a little concerned’, ‘concerned’ and ‘very concerned’); ‘Do you think your child is… (i) ‘much too underweight?’; (ii) ‘slightly too underweight?’; (iii) ‘proper weight?’; (iv) ‘slightly too overweight’; (v) ‘much too overweight?’ (response categories were ‘yes’ and ‘no’). Further intakes from the following food items commonly perceived to be healthy/unhealthy were considered as predictors for misreporting: chocolate products, other sugary products (e.g. cakes, biscuits, ice cream), soft drinks, fruits/vegetables, milk (all as %EI) and water (g/d). Although BMI is a repeatedly shown predictor of misreporting, it was not included in the construction of the propensity score as the weight status is the outcome variable in the present analysis.

The conditional probability (propensity score) of being classified as UdR given the mentioned covariables was calculated applying a logistic multilevel regression model including all covariates mentioned above as fixed effects and the study centre as random effect:

$$\,{\rm Propensity\ score}\, = \,{\rm estimated\ }P({\rm UdR}\,|\:{\rm covariates}).\eqno\rm$$

Fruit/vegetable intake was not included as a covariable in the propensity score calculation when investigating diet–obesity models using fruit/vegetable intake as exposure variable. Analogously, soft drink intake was not considered in the construction of the propensity score when investigating models using soft drink intake as exposure.

Model building

Associations between overweight/obesity and dietary intakes were exemplarily analysed to investigate different procedures of handling implausible dietary recalls. Logistic multilevel regression analyses were conducted using a dummy indicating overweight/obesity as outcome and the three dietary variables as exposure measures: EI in kJ/d (models labelled with ‘a’), %EI from fruits/vegetables (labelled with ‘b’) and %EI from soft drinks (labelled with ‘c’).

The first model (basic model) included only adjustment terms for age and sex and a random effect for the study centre to account for the clustered study design (Model 1a–c). The basic model was also run adding all variables used in the calculation of the propensity score as potential confounders (Model 2a–c). Model 3 was identical to the basic model but here recalls classified as UdR and OvR were excluded. Further, the basic model was run adjusting additionally for the reporting group (Model 4a–c), for the propensity score (Model 5a–c) or for both (Model 6a–c). In addition, the basic model was analysed stratified by reporting group (Model 7a–c) as well as stratified by reporting group and at the same time adjusted for the propensity score (Model 8a–c).

The current analysis includes only children with 24-HDR and complete covariate information (n 5962). All analyses were performed using the statistical software package SAS version 9·1.

Results

Descriptive analyses of the study population and all covariables used for the construction of the propensity score are presented in Table 2 (categorical variables) and Table 3 (continuous variables). Regarding the total study group, 6·7 % (n 402) of the proxy reports were classified as UdR and 4·0 % (n 241) as OvR. Both UdR and OvR were slightly higher in girls compared with boys and higher in the low/medium compared with the high income group. Percentages of UdR were higher in overweight/obese children, in the older age group (6 to <10 years), on weekend days and if proxies were concerned about their child becoming overweight or perceived their child to be slightly/much too overweight. OvR, on the other hand, was higher in thin/normal-weight children, on weekend days or if proxies were concerned about their child becoming underweight. %EI from fruits/vegetables was highest in UdR whereas %EI from chocolate and other sugary products were highest in OvR. Soft drink consumption was slightly lower in the OvR group compared with the UdR and PR groups.

Table 2 Descriptive analyses of categorical covariables stratified by reporting group (total numbers and row percentages): children aged 2–9 years, IDEFICS Study

UdR, under-report; PR, plausible report; OvR, over-report.

*Weight categories according to International Obesity Taskforce criteria(Reference Cole, Bellizzi and Flegal18, Reference Cole, Flegal and Nicholls19).

Table 3 Descriptive analyses of continuous covariables stratified by reporting group (means and standard deviations): children aged 2–9 years, IDEFICS Study

UdR, under-report; PR, plausible report; OvR, over-report; EI, energy intake; %EI, percentage of energy intake.

Tables 4 and 5 show the odds ratios and 95 % confidence intervals obtained from the different models for the association between overweight/obesity and the three dietary exposures. Effects of continuous variables are assessed as 1-unit offsets from the mean; e.g. the OR for the association between overweight/obesity and %EI from fruits/vegetables indicates the increase in risk when increasing %EI from fruits/vegetables by 1 % compared with the mean of the total study population.

In the basic model (Table 4, Models 1a–c), odds ratios were not significant for EI and soft drink intake and indicated even a significant positive association between overweight/obesity and fruit/vegetable intake (OR = 1·009, 95 % CI 1·001, 1·018). Adjustment for covariables (Models 2a–c) revealed similar results, but the association between fruits/vegetables and overweight/obesity was rendered insignificant here (OR = 1·009 (95 % CI 0·998, 1·020)). When excluding UdR and OvR (Models 3a–c), a significantly positive association between EI and overweight/obesity was observed (OR = 1·057, 95 % CI 1·038, 1·076). Adjustment for the reporting group (Models 4a–c) also revealed a significantly positive association between EI and overweight/obesity that was even slightly more pronounced compared with the model excluding misreports. When adjusting for the propensity score, all associations were strengthened (Models 5a–c) with the association between overweight/obesity and fruit/vegetable intake being reversed compared with the basic model. Significant associations were found between overweight/obesity and EI as well as soft drink intake. Finally, adjustment for the reporting group and propensity score at the same time strengthened the association between overweight/obesity and EI whereas the other associations remained nearly unchanged (Models 6a–c) compared with the model adjusting only for the propensity score.

Table 4 OR and 95 % CI for the associations between overweight/obesity and EI (Model 1a to 6a), %EI from fruits/vegetables (Model 1b to 6b) and %EI from soft drinks (Model 1c to 6c) in different models: children aged 2–9 years, IDEFICS Study

EI, energy intake; %EI, percentage of energy intake; PR, plausible report; UdR, under-report; OvR, over-report.

Effects of continuous variables are assessed as 1-unit offsets from the mean. Due to the small scale of the propensity score, 0.01-unit offsets from mean were chosen here.

*Basic model: logistic multilevel regression model; OR for the association between overweight/obesity and food intake adjusted for age and sex and including the study centre as random effect (n 5962).

†Basic model additionally adjusted for net household income (dummy: high v. medium/low), number of persons below 18 years of age in the household, day of the interview (dummy: weekday v. Saturday/Sunday), information on parental concerns and perception regarding their child's weight status and reported intakes from food groups associated with misreporting.

‡Basic model, but excluding UdR and OvR (n 5319).

§Basic model adjusted for the reporting group (UdR, PR, OvR).

∥Basic model adjusted for a propensity score for misreporting.

¶Basic model adjusted for the reporting group and for the propensity score for misreporting.

When stratifying the basic model by the reporting group (Table 5, Model 7a–c), only EI was significantly related to overweight/obesity in all three strata. Additional adjustment for the propensity score (Model 8a–c) strengthened associations between all three dietary exposures and overweight/obesity. Here a significant reverse association between fruit/vegetable intake and overweight/obesity was observed in OvR and a positive association was found between soft drinks and overweight/obesity in UdR. The relationship between overweight/obesity and EI was much stronger in the UdR and OvR groups compared with PR.

Table 5 OR and 95 % CI for the association between overweight/obesity and EI (Model 7a, 8a), %EI from fruits/vegetables (Model 7b, 8b) and %EI from soft drinks (Model 7c, 8c) in different models stratified by reporting group (UdR, PR, OvR): children aged 2–9 years, IDEFICS Study

EI, energy intake; %EI, percentage of energy intake; UdR, under-report; PR, plausible report; OvR, over-report.

Effects of continuous variables are assessed as 1-unit offsets from the mean. Due to the small scale of the propensity score, 0·01-unit offsets from mean were chosen here.

*Basic model: logistic multi-level regression model stratified by reporting group (UdR, PR, OvR); OR for the association between overweight/obesity and dietary intakes adjusted for age and sex and including the study centre as random effect.

†Basic model adding the propensity score as adjustment term.

Discussion

To the authors’ knowledge, the present study is the first one in children applying and comparing several statistical approaches to counteract attenuation of risk estimates caused by misreporting of dietary information. Negligence of misreporting in the statistical model revealed insignificant or even (unexpected) reversed diet–obesity associations. Consistent with previous findings on differential misreporting by weight status(Reference Heitmann, Lissner and Osler33), the UdR group had higher mean BMI Z-scores but reported lower (implausible) EI compared with PR. The opposite was true for the OvR group. Such reporting bias may obscure positive relationships between diet and weight status. Researchers should be aware that results may differ strongly depending on the statistical model selected and that the choice of an adequate model needs to be taken thoroughly. Consideration of misreporting in any way yielded results more consistent with hypotheses relating food intake to overweight/obesity(Reference Tohill, Seymour and Serdula34, Reference Rolls, Drewnowski and Ledikwe35). However, the true effects remained unknown due to the lack of validation data. A recent study reported that not excluding implausible reports resulted in weak, non-significant or even misleading associations between BMI and diet(Reference Huang, Roberts and Howarth9), whereas Nielsen and Adair stated that examining all data but stratifying by level of intake may be more informative for population nutrient intake than exclusion of misreports(Reference Nielsen and Adair8). Savage et al. found a significant association between BMI and reported EI in the PR of pre-adolescent girls, but neither in the total study group nor when analysing only misreports (combining UdR and OvR into one group)(Reference Savage, Mitchell and Smiciklas-Wright36). This agrees with our results for the total study group (basic model). Nevertheless, our stratified analysis revealed statistically significant associations between overweight/obesity and EI in all three reporting groups, being even stronger in UdR and OvR compared with PR. This may be explained by either: (i) differences in the mean intake levels to which the effects are put into relation (mean EI: 3197 kJ/d (764 kcal/d) in UdR, 6632 kJ/d (1585 kcal/d) in PR, 11 590 kJ/d (2770 kcal/d) in OvR); or (ii) differences between the reporting groups in terms of participants’ characteristics (e.g. prevalence of overweight/obesity: 38·0 % in UdR, 19·9 % in PR, 13·2 % in OvR). Our results argue against combining UdR and OvR into one group in stratified analyses as determinants of misreporting and participants' characteristics are likely to differ(Reference Börnhorst, Huybrechts and Ahrens30). Moreover, the differences between the groups of UdR, PR and OvR suggest that data exclusions may actually introduce a selection bias, so that exclusion of misreports is not recommended. However, the reduced sample sizes resulting from both data exclusions and stratification go along with limited statistical power especially in the (smaller) groups of UdR and OvR. Adjustment for the reporting group does not affect the statistical power to such a degree and shifted associations between overweight/obesity and all three dietary exposures to the expected directions (Models 4a–c). These results agree with those from a study by Mendez et al.(Reference Mendez, Wynter and Wilks10) where associations between different food groups and overweight/obesity became stronger after inclusion of dummy variables identifying under- and over-reports. In that study, dummy adjustment revealed results similar to those obtained when limiting the analysis sample to plausible reports, as observed in our study. However, this approach has the disadvantage of misclassifications of single recalls being quite likely, which may again bias the results(Reference Greenland and Robins37).

After adjustment for the propensity score, which combined various indicators for misreporting into one summary measure, associations between overweight/obesity and soft drink as well as fruit/vegetable intakes increased markedly. To correct for selective reporting of single food items, also dietary variables commonly associated with misreporting were included when constructing the propensity score. This approach strived for an effect similar to regression calibration(Reference Spiegelman, McDermott and Rosner38) although both procedures differ. The idea of calibration in general is the replacement of exposures measured with error by ‘adjusted’ values using additional information obtained from biomarker measurements or from a second dietary assessment instrument. Common calibration approaches assume (non-differential) linear measurement error with constant variance or linear random within-person error in the case of replicate measurements (e.g. repeated 24-HDR)(Reference Spiegelman, McDermott and Rosner38Reference Kaaks, Riboli and van Staveren40) – assumptions that are often violated due to differential misreporting(Reference Black and Cole4, Reference Livingstone, Robson and Black41). Moreover, error structures were found to be correlated when assessing dietary information via different assessment methods (e.g. FFQ and 24-HDR)(Reference Kipnis, Subar and Midthune42). Although the use of two complementary dietary assessment methods is recommended e.g. when investigating usual intakes(Reference Carroll, Midthune and Subar43, Reference de Boer, Slimani and van't Veer44), the benefit of a second assessment instrument to correct for misreporting is questionable(Reference Westerterp and Goris45). Further studies are needed to explore and compare the calibration and propensity score approach. However, it can be suspected that statistical adjustment of relative risks based on biomarker data with independent error structures (e.g. doubly labelled water for EI) incorporating characteristics of misreporters should be preferred if such data exist(Reference Freedman, Schatzkin and Midthune1, Reference Freedman, Midthune and Carroll39, Reference Freedman, Tasevska and Kipnis46). In the absence of validation data, the propensity score seems to be a useful, cost-effective alternative to account for misreporting.

In our models, intakes from soft drinks and fruits/vegetables were examined in relation to total daily intake of energy (expressed as %EI) instead of including absolute amounts (g/d). Use of absolute amounts would result in lower effects in high energy consumers compared with low energy consumers(Reference Livingston and Black3, Reference Willett and Stampfer47). To overcome this problem, different energy adjustment models have been proposed next to the one applied here(Reference Kipnis, Freedman and Brown48). But again energy adjustment cannot eliminate differential biases(Reference Livingston and Black3) and is therefore not sufficient to correct for subject-specific and selective misreporting of certain foods/macronutrients(Reference Westerterp and Goris45, Reference Lafay, Mennen and Basdevant49). The advantage of additional incorporation of the propensity score over simple energy-adjustment methods is that the propensity score is a comprehensive approach to account for several covariables related to misreporting instead of considering only the level of EI. Under-reporting is difficult to distinguish from undereating (defined as eating less than required to maintain body weight, accompanied by weight loss) but both are treated equally in energy-adjustment models, while it can be hypothesised that subject characteristics and therefore propensity scores differ between undereaters and under-reporters. Nevertheless, in the case of non-differential errors energy-adjustment methods were shown to be a good approach to counteract underestimation of relative risks and reduction of statistical power(Reference Freedman, Schatzkin and Midthune1).

Several sensitivity analyses were carried out (e.g. including only children with two repeated 24-HDR (n 904), excluding OvR (n 241), excluding UdR (n 402), excluding 24-HDR with at least one imputed value (n 69), excluding thin (n 556) or obese children (n 430)). When including only children with two repeated 24-HDR, model estimates became unstable due to the reduction in sample size. In all other cases, results remained nearly unchanged compared with the results given here. Details can be obtained from the author on request.

The present analysis is based on data in children relying on proxy reports. Here misreporting may result not only from intentional misreporting, e.g. caused by social desirability or parental concerns about their child's weight status, but also from unintentional misreporting due to lack of parental control (out-of-home meals). Our discussion mainly refers to studies in adolescents/adults as related studies are lacking in children. Although determinants for misreporting may differ between children and adolescent/adult populations, previous studies and the present one reveal similar results concerning the statistical approaches of data exclusions, stratification or adjustment for the reporting group. Nevertheless, results of the newly applied propensity score approach should not simply be transferred. When applying the propensity score approach in future studies, variables for the construction of the score should be selected depending on the study population under investigation, which may require a pre-study to identify the relevant determinants of misreporting. The analysis of the usefulness of the propensity score adjustment in adolescent/adult populations is a task for future research.

Limitations and strengths

Only one recall day per child was used in the present analysis which does not reflect usual intakes due to the day-to-day variation that characterises dietary data in general(Reference Nielsen, Montgomery and Kelly50). Day-to-day variation results in random (non-differential) errors that may have weakened associations between dietary factors and overweight/obesity. In addition, extreme intakes may not necessarily reflect misreporting but rather specific diets (e.g. energy restricted) or exceptional days (e.g. the child was ill or extremely physically active). Reverse causation cannot be precluded as obesity may even cause low intakes due to dieting or change in eating behaviour. Causal inference is limited owing to the cross-sectional study design.

Sensitivity of the cut-off technique to correctly classify UdR and OvR is limited as it aims only to identify misreports resulting in physiologically implausibly low/high EI(Reference Goldberg, Black and Jebb6). By application of the cut-off technique distinction between varying degrees of misreporting is not feasible; e.g. under-reporting from a high intake level may not be detected as the reported intake may still be such high that EI:BMR does not fall below the cut-off. Furthermore, not considering individual physical activity levels of the children when classifying the 24-HDR is a limitation. Physically inactive children may have a very low daily energy expenditure making even low reported intakes plausible, whereas physically active children have an increased likelihood to be misclassified as OvR. Child-specific reference PAL were used in the calculation of the cut-offs to compensate for the lack of sufficient individual information on physical activity.

The study was a first exploratory approach to investigate the usefulness of propensity scores in the context of dietary misreporting in children. The authors are aware that there are several different ways to construct a propensity score by inclusion of additional/different variables, e.g. physical activity, number of daily meals, etc. The rather exploratory character of the paper should be underlined here. However, the application of the new propensity score approach, along with the large sample size, the variety of covariables and the standardised assessment procedures suggest that the present study provides important knowledge on methods to handle misreporting in future research, while also highlighting gaps in knowledge as starting points for further analyses.

Conclusions

Associations between dietary exposures and health outcomes are strongly affected or even masked or reversed by measurement errors. Instead of data exclusions that may result in unknown bias, misreporting should rather be addressed in the model building process including adjustment terms for misreporting. Dummy adjustment for the reporting group revealed associations more consistent with expectations, which was most pronounced considering the association between EI and overweight/obesity. However, more sophisticated adjustments seem to be necessary to counteract the effect of selective misreporting of other food groups. In this respect, the propensity score adjustment turned out to be a useful tool to correct for subject-specific misreporting as it combines various variables associated with misreporting into one scalar and should be further investigated in future studies.

Acknowledgements

Sources of funding: This work was done as part of the IDEFICS Study (www.idefics.eu) and is published on behalf of its European Consortium. Financial support was provided by the European Community within the Sixth RTD Framework Programme Contract No. 016181 (FOOD). S.B.-S. was funded by a grant from the Aragón's Regional Government (Diputación General de Aragón, DGA). B.V. was funded by the Research Foundation–Flanders (FWO). Conflict of interest: All the authors declare that there are no conflicts of interest. Authors’ contributions: All authors contributed to conception and design, acquisition of data, analysis or interpretation of data. Each author has seen and approved the contents of the submitted manuscript. Final approval of the version published was given by all authors.

References

1.Freedman, LS, Schatzkin, A, Midthune, Det al. (2011) Dealing with dietary measurement error in nutritional cohort studies. J Natl Cancer Inst 103, 10861092.CrossRefGoogle ScholarPubMed
2.Lioret, S, Touvier, M, Balin, Met al. (2011) Characteristics of energy under-reporting in children and adolescents. Br J Nutr 105, 16711680.CrossRefGoogle ScholarPubMed
3.Livingston, MB & Black, AE (2003) Markers of the validity of reported energy intake. J Nutr 133, Suppl. 3, 895S920S.CrossRefGoogle Scholar
4.Black, AE & Cole, TJ (2001) Biased over- or under-reporting is characteristic of individuals whether over time or by different assessment methods. J Am Diet Assoc 101, 7080.CrossRefGoogle ScholarPubMed
5.Shai, I, Rosner, BA, Shahar, DRet al. (2005) Dietary evaluation and attenuation of relative risk: multiple comparisons between blood and urinary biomarkers, food frequency, and 24-hour recall questionnaires: the DEARR study. J Nutr 135, 573579.CrossRefGoogle ScholarPubMed
6.Goldberg, GR, Black, AE, Jebb, SAet al. (1991) Critical evaluation of energy intake data using fundamental principles of energy physiology: 1. Derivation of cut-off limits to identify under-recording. Eur J Clin Nutr 45, 569581.Google ScholarPubMed
7.McCrory, MA, Hajduk, CL & Roberts, SB (2002) Procedures for screening out inaccurate reports of dietary energy intake. Public Health Nutr 5, 873882.CrossRefGoogle ScholarPubMed
8.Nielsen, SJ & Adair, L (2007) An alternative to dietary data exclusions. J Am Diet Assoc 107, 792799.CrossRefGoogle ScholarPubMed
9.Huang, TT, Roberts, SB, Howarth, NCet al. (2005) Effect of screening out implausible energy intake reports on relationships between diet and BMI. Obes Res 13, 12051217.CrossRefGoogle ScholarPubMed
10.Mendez, MA, Wynter, S, Wilks, Ret al. (2004) Under- and overreporting of energy is related to obesity, lifestyle factors and food group intakes in Jamaican adults. Public Health Nutr 7, 919.CrossRefGoogle ScholarPubMed
11.Howarth, NC, Huang, TT, Roberts, SBet al. (2005) Dietary fiber and fat are associated with excess weight in young and middle-aged US adults. J Am Diet Assoc 105, 13651372.CrossRefGoogle Scholar
12.Gibson, RS (2005) Principles of Nutritional Assessment, 2nd ed. New York: Oxford University Press.CrossRefGoogle Scholar
13.Rosenbaum, PR & Rubin, DB (1983) The central role of the propensity score in observational studies for causal effects. Biometrika 70, 4155.CrossRefGoogle Scholar
14.Mendez, MA, Popkin, BM, Buckland, Get al. (2011) Alternative methods of accounting for underreporting and overreporting when measuring dietary intake–obesity relations. Am J Epidemiol 173, 448458.CrossRefGoogle ScholarPubMed
15.Livingstone, MB & Robson, PJ (2000) Measurement of dietary intake in children. Proc Nutr Soc 59, 279293.CrossRefGoogle ScholarPubMed
16.Ahrens, W, Bammann, K, de Henauw, Set al. (2006) Understanding and preventing childhood obesity and related disorders – IDEFICS: a European multilevel epidemiological approach. Nutr Metab Cardiovasc Dis 16, 302308.CrossRefGoogle ScholarPubMed
17.Ahrens, W, Bammann, K, Siani, Aet al. (2011) The IDEFICS cohort: design, characteristics and participation in the baseline survey. Int J Obes (Lond) 35, Suppl 1, S3S15.CrossRefGoogle ScholarPubMed
18.Cole, TJ, Bellizzi, MC, Flegal, KMet al. (2000) Establishing a standard definition for child overweight and obesity worldwide: international survey. BMJ 320, 12401243.CrossRefGoogle ScholarPubMed
19.Cole, TJ, Flegal, KM, Nicholls, Det al. (2007) Body mass index cut offs to define thinness in children and adolescents: international survey. BMJ 335, 194.CrossRefGoogle ScholarPubMed
20.Vereecken, CA, Covents, M, Sichert-Hellert, Wet al. (2008) Development and evaluation of a self-administered computerized 24-h dietary recall method for adolescents in Europe. Int J Obes (Lond) 32, Suppl. 5, S26S34.CrossRefGoogle ScholarPubMed
21.Vereecken, CA, Covents, M, Matthys, Cet al. (2005) Young adolescents’ nutrition assessment on computer (YANA-C). Eur J Clin Nutr 59, 658667.CrossRefGoogle ScholarPubMed
22.Zurriaga, O, Perez-Panades, J, Quiles Izquierdo, Jet al. (2011) Factors associated with childhood obesity in Spain. The OBICE study: a case–control study based on sentinel networks. Public Health Nutr 14, 11051113.CrossRefGoogle ScholarPubMed
23.O'Connor, TM, Yang, SJ & Nicklas, TA (2006) Beverage intake among preschool children and its effect on weight status. Pediatrics 118, e1010e1018.CrossRefGoogle ScholarPubMed
24.Alinia, S, Hels, O & Tetens, I (2009) The potential association between fruit intake and body weight – a review. Obes Rev 10, 639647.CrossRefGoogle ScholarPubMed
25.Schofield, WN (1985) Predicting basal metabolic rate, new standards and review of previous work. Hum Nutr Clin Nutr 39, Suppl. 1, 541.Google ScholarPubMed
26.Sichert-Hellert, W, Kersting, M & Schoch, G (1998) Underreporting of energy intake in 1 to 18 year old German children and adolescents. Z Ernahrungswiss 37, 242251.CrossRefGoogle ScholarPubMed
27.Nelson, M, Black, AE, Morris, JAet al. (1989) Between- and within-subject variation in nutrient intake from infancy to old age: estimating the number of days required to rank dietary intakes with desired precision. Am J Clin Nutr 50, 155167.CrossRefGoogle ScholarPubMed
28.Black, AE (2000) Critical evaluation of energy intake using the Goldberg cut-off for energy intake:basal metabolic rate. A practical guide to its calculation, use and limitations. Int J Obes Relat Metab Disord 24, 11191130.CrossRefGoogle ScholarPubMed
29.Torun, B, Davies, PS, Livingstone, MBet al. (1996) Energy requirements and dietary energy recommendations for children and adolescents 1 to 18 years old. Eur J Clin Nutr 50, Suppl.1, S37S80.Google ScholarPubMed
30.Börnhorst, C, Huybrechts, I, Ahrens, Wet al. (2012) Prevalence and determinants of misreporting among European children in proxy-reported 24-hour dietary recalls. Br J Nutr (Epublication ahead of print version).Google Scholar
31.Cole, TJ, Freeman, JV & Preece, MA (1998) British 1990 growth reference centiles for weight, height, body mass index and head circumference fitted by maximum penalized likelihood. Stat Med 17, 407429.3.0.CO;2-L>CrossRefGoogle ScholarPubMed
32.Cole, TJ, Freeman, JV & Preece, MA (1995) Body mass index reference curves for the UK, 1990. Arch Dis Child 73, 2529.CrossRefGoogle ScholarPubMed
33.Heitmann, BL, Lissner, L & Osler, M (2000) Do we eat less fat, or just report so? Int J Obes Relat Metab Disord 24, 435442.CrossRefGoogle ScholarPubMed
34.Tohill, BC, Seymour, J, Serdula, Met al. (2004) What epidemiologic studies tell us about the relationship between fruit and vegetable consumption and body weight. Nutr Rev 62, 365374.CrossRefGoogle ScholarPubMed
35.Rolls, BJ, Drewnowski, A & Ledikwe, JH (2005) Changing the energy density of the diet as a strategy for weight management. J Am Diet Assoc 105, 5 Suppl. 1, S98S103.CrossRefGoogle ScholarPubMed
36.Savage, JS, Mitchell, DC, Smiciklas-Wright, Het al. (2008) Plausible reports of energy intake may predict body mass index in pre-adolescent girls. J Am Diet Assoc 108, 131135.CrossRefGoogle ScholarPubMed
37.Greenland, S & Robins, JM (1985) Confounding and misclassification. Am J Epidemiol 122, 495506.CrossRefGoogle ScholarPubMed
38.Spiegelman, D, McDermott, A & Rosner, B (1997) Regression calibration method for correcting measurement-error bias in nutritional epidemiology. Am J Clin Nutr 65, 4 Suppl., 1179S1186S.CrossRefGoogle ScholarPubMed
39.Freedman, LS, Midthune, D, Carroll, RJet al. (2011) Using regression calibration equations that combine self-reported intake and biomarker measures to obtain unbiased estimates and more powerful tests of dietary associations. Am J Epidemiol 174, 12381245.CrossRefGoogle ScholarPubMed
40.Kaaks, R, Riboli, E & van Staveren, W (1995) Calibration of dietary intake measurements in prospective cohort studies. Am J Epidemiol 142, 548556.CrossRefGoogle ScholarPubMed
41.Livingstone, MB, Robson, PJ, Black, AEet al. (2003) An evaluation of the sensitivity and specificity of energy expenditure measured by heart rate and the Goldberg cut-off for energy intake: basal metabolic rate for identifying mis-reporting of energy intake by adults and children: a retrospective analysis. Eur J Clin Nutr 57, 455463.CrossRefGoogle ScholarPubMed
42.Kipnis, V, Subar, AF, Midthune, Det al. (2003) Structure of dietary measurement error: results of the OPEN biomarker study. Am J Epidemiol 158, 1421.CrossRefGoogle ScholarPubMed
43.Carroll, RJ, Midthune, D, Subar, AFet al. (2012) Taking advantage of the strengths of 2 different dietary assessment instruments to improve intake estimates for nutritional epidemiology. Am J Epidemiol 175, 340347.CrossRefGoogle ScholarPubMed
44.de Boer, EJ, Slimani, N, van't Veer, Pet al. (2011) The European Food Consumption Validation Project: conclusions and recommendations. Eur J Clin Nutr 65, Suppl.1, S102S107.CrossRefGoogle ScholarPubMed
45.Westerterp, KR & Goris, AH (2002) Validity of the assessment of dietary intake: problems of misreporting. Curr Opin Clin Nutr Metab Care 5, 489493.CrossRefGoogle ScholarPubMed
46.Freedman, LS, Tasevska, N, Kipnis, Vet al. (2010) Gains in statistical power from using a dietary biomarker in combination with self-reported intake to strengthen the analysis of a diet–disease association: an example from CAREDS. Am J Epidemiol 172, 836842.CrossRefGoogle ScholarPubMed
47.Willett, W & Stampfer, MJ (1986) Total energy intake: implications for epidemiologic analyses. Am J Epidemiol 124, 1727.CrossRefGoogle ScholarPubMed
48.Kipnis, V, Freedman, LS, Brown, CCet al. (1997) Effect of measurement error on energy-adjustment models in nutritional epidemiology. Am J Epidemiol 146, 842855.CrossRefGoogle ScholarPubMed
49.Lafay, L, Mennen, L, Basdevant, Aet al. (2000) Does energy intake underreporting involve all kinds of food or only specific food items? Results from the Fleurbaix Laventie Ville Sante (FLVS) study. Int J Obes Relat Metab Disord 24, 15001506.CrossRefGoogle ScholarPubMed
50.Nielsen, SB, Montgomery, C, Kelly, LAet al. (2008) Energy intake variability in free-living young children. Arch Dis Child 93, 971973.CrossRefGoogle ScholarPubMed
Figure 0

Table 1 Lower and upper cut-off limits to classify 1 d 24-HDR as UdR or OvR based on EI:BMR

Figure 1

Table 2 Descriptive analyses of categorical covariables stratified by reporting group (total numbers and row percentages): children aged 2–9 years, IDEFICS Study

Figure 2

Table 3 Descriptive analyses of continuous covariables stratified by reporting group (means and standard deviations): children aged 2–9 years, IDEFICS Study

Figure 3

Table 4 OR and 95 % CI for the associations between overweight/obesity and EI (Model 1a to 6a), %EI from fruits/vegetables (Model 1b to 6b) and %EI from soft drinks (Model 1c to 6c) in different models: children aged 2–9 years, IDEFICS Study

Figure 4

Table 5 OR and 95 % CI for the association between overweight/obesity and EI (Model 7a, 8a), %EI from fruits/vegetables (Model 7b, 8b) and %EI from soft drinks (Model 7c, 8c) in different models stratified by reporting group (UdR, PR, OvR): children aged 2–9 years, IDEFICS Study