Reliability of 24-Hour Dietary Recalls as a Measure of Diet in African-American Youth

      Abstract

      Background

      Although it is a common practice to estimate dietary intake using three random 24-hour dietary recalls, some studies have suggested up to nine may be necessary to reliably estimate usual intake in youth. Given the resulting increase in resources and participant burden, more research is needed to determine whether this method is reliable, particularly in African-American youth at increased risk for obesity and other chronic diseases.

      Objective

      This study estimated the reliability with which 24-hour dietary recalls measure energy, fat, fruit, and vegetable intake in African-American youth and examined how reliability changes as a function of the number of recalls.

      Design

      This study used cross-sectional data collection across three studies.

      Participants/setting

      Participants were African-American youth (n=456, mean±standard deviation age 13.28±1.86 years, 64% were girls, mean±standard deviation body mass index [calculated as kg/m2] 31.45±7.94) who completed random 24-hour dietary recalls (67% completed three) conducted by research assistants using the Automated Self-Administered 24-Hour recall system (n=258) or registered dietitian nutritionists using the Nutrition Data System for Research (n=198).

      Main outcome measures/statistical analyses

      Estimates provided by multilevel models were used to calculate the proportion of variance accounted for between individuals and the reliability of means within individuals as a function of the number of recalls.

      Results

      Reliability estimates for assessing dietary outcomes using one to three recalls ranged from 11% to 62%. To achieve 80% reliability, the following number of recalls would need to be conducted: 8 for energy intake, 13 for fat intake, 21 to 32 for fruit intake, and 21 to 25 for vegetable intake.

      Conclusions

      The common practice of assessing dietary intake with three recalls does so with low reliability in African-American youth. Until more objective methods for reliably estimating usual intake are developed, researchers who choose to use 24-hour dietary recalls are encouraged to include estimates of the measure’s reliability in a priori power calculations for improved decision making regarding the number of observations and/or sample size.

      Keywords

      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'

      Subscribe:

      Subscribe to Journal of the Academy of Nutrition and Dietetics
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect

      References

        • Estruch R.
        • Ros E.
        • Salas-Salvadó J.
        • et al.
        Primary prevention of cardiovascular disease with a Mediterranean diet.
        N Engl J Med. 2013; 368: 1279-1290
        • Ebbeling C.B.
        • Feldman H.A.
        • Chomitz V.R.
        • et al.
        A randomized trial of sugar-sweetened beverages and adolescent body weight.
        N Engl J Med. 2012; 367: 1407-1416
        • Patrick K.
        • Calfas K.
        • Norman G.
        • et al.
        Randomized controlled trial of a primary care and home-based intervention for physical activity and nutrition behaviors: PACE+ for adolescents.
        Arch Pediatr Adolesc Med. 2006; 160: 128-136
        • Baranowski T.
        • Baranowski J.
        • Thompson D.
        • et al.
        Video game play, child diet, and physical activity behavior change: A randomized clinical trial.
        Am J Prev Med. 2011; 40: 33-38
        • Lytle L.
        • Murray D.
        • Perry C.
        • et al.
        School-based approaches to affect adolescents' diets: Results from the TEENS study.
        Health Educ Behav. 2004; 31: 270
        • Baranowski T.
        • Baranowski J.
        • Cullen K.
        • et al.
        5 a Day Achievement Badge for African-American boy scouts: Pilot outcome results.
        Prev Med. 2002; 34: 353-363
        • Archer E.
        • Hand G.A.
        • Blair S.N.
        Validity of US nutritional surveillance: National Health and Nutrition Examination Survey caloric energy intake data, 1971-2010.
        PLoS One. 2013; 8: e76632
        • Mitka M.
        Do flawed data on caloric intake from NHANES present problems for researchers and policy makers?.
        JAMA. 2013; 310: 2137-2138
        • Hébert J.R.
        • Hurley T.G.
        • Steck S.E.
        • et al.
        Considering the value of dietary assessment data in informing nutrition-related health policy.
        Adv Nutr. 2014; 5: 447-455
        • Dhurandhar N.
        • Schoeller D.
        • Brown A.
        • et al.
        Energy balance measurement: When something is not better than nothing.
        Int J Obes (Lond). 2015; 39: 1109-1113
        • Archer E.
        • Pavela G.
        • Lavie C.J.
        The inadmissibility of What We Eat In America and NHANES dietary data in nutrition and obesity research and the scientific formulation of national dietary guidelines.
        Mayo Clin Proc. 2015; 90: 911-926
        • Davy B.M.
        • Estabrooks P.A.
        The validity of self-reported dietary intake data: Focus on the “What We Eat In America” component of the National Health and Nutrition Examination Survey research initiative.
        Mayo Clin Proc. 2015; 90: 845-847
        • Hébert J.R.
        • Hurley T.G.
        • Steck S.E.
        • et al.
        Reply to E Archer and SN Blair.
        Adv Nutr. 2015; 6: 230-233
        • Archer E.
        • Blair S.N.
        Response to LS Freedman et al.
        Adv Nutr. 2015; : 489-490
        • Freedman L.S.
        • Carroll R.J.
        • Neuhouser M.L.
        • et al.
        Reply to E Archer and SN Blair.
        Adv Nutr. 2015; 6: 389
        • Nelson M.
        • Black A.E.
        • Morris J.A.
        • Cole T.J.
        Between-and within-subject variation in nutrient intake from infancy to old age: Estimating the number of days required to rank dietary intakes with desired precision.
        Am J Clin Nutr. 1989; 50: 155-167
        • Ollberding N.J.
        • Couch S.C.
        • Woo J.G.
        • Kalkwarf H.J.
        Within-and between-individual variation in nutrient intake in children and adolescents.
        J Acad Nutr Diet. 2014; 114: 1749-1758
        • Dodd K.W.
        • Guenther P.M.
        • Freedman L.S.
        • et al.
        Statistical methods for estimating usual intake of nutrients and foods: A review of the theory.
        J Am Diet Assoc. 2006; 106: 1640-1650
        • Tooze J.A.
        • Kipnis V.
        • Buckman D.W.
        • et al.
        A mixed-effects model approach for estimating the distribution of usual intake of nutrients: The NCI method.
        Stat Med. 2010; 29: 2857-2868
        • Lawman H.G.
        • Wilson D.K.
        Associations of social and environmental supports with sedentary behavior, light and moderate-to-vigorous physical activity in obese underserved adolescents.
        Int J Behav Nutr Phys Act. 2014; 11: 92
        • St George S.M.
        • Wilson D.K.
        • Schneider E.M.
        • Alia K.A.
        Project SHINE: Effects of parent−adolescent communication on sedentary behavior in African American adolescents.
        J Pediatr Psychol. 2013; 38: 997-1009
        • Wilson D.K.
        • Kitzman-Ulrich H.
        • Resnicow K.
        • et al.
        An overview of the Families Improving Together (FIT) for weight loss randomized controlled trial in African American families.
        Contemp Clin Trials. 2015; 42: 145-157
        • Kuczmarski R.
        • Ogden C.
        • Guo S.
        • et al.
        2000 CDC Growth Charts for the United States: Methods and development.
        Vital Health Stat 11. 2002; : 1
        • Subar A.F.
        • Kirkpatrick S.I.
        • Mittl B.
        • et al.
        The Automated Self-Administered 24-hour dietary recall (ASA24): A resource for researchers, clinicians, and educators from the National Cancer Institute.
        J Acad Nutr Diet. 2012; 112: 1134-1137
        • Subar A.F.
        • Crafts J.
        • Zimmerman T.P.
        • et al.
        Assessment of the accuracy of portion size reports using computer-based food photographs aids in the development of an automated self-administered 24-hour recall.
        J Am Diet Assoc. 2010; 110: 55-64
        • Subar A.F.
        • Thompson F.E.
        • Potischman N.
        • et al.
        Formative research of a quick list for an automated self-administered 24-hour dietary recall.
        J Am Diet Assoc. 2007; 107: 1002-1007
        • Zimmerman T.P.
        • Hull S.G.
        • McNutt S.
        • et al.
        Challenges in converting an interviewer-administered food probe database to self-administration in the National Cancer Institute automated self-administered 24-hour recall (ASA24).
        J Food Compos Anal. 2009; 22: S48-S51
        • Thompson F.
        • Dixit-Joshi S.
        • Potischman N.
        • et al.
        Feasibility and performance of NCI's Automated Self-Administered 24-Hour recall (ASA24).
        Am J Epidemiol. 2013; 177: S1-S181
        • Kirkpatrick S.I.
        • Subar A.F.
        • Douglass D.
        • et al.
        Performance of the Automated Self-Administered 24-hour Recall relative to a measure of true intakes and to an interviewer-administered 24-h recall.
        Am J Clin Nutr. 2014; 100: 233-240
      1. Nutrition Data System for Research [computer program]. Version 2008. Minneapolis: Nutrition Coordinating Center, University of Minnesota; June 2008.

        • Feskanich D.
        • Sielaff B.H.
        • Chong K.
        • Buzzard I.M.
        Computerized collection and analysis of dietary intake information.
        Comput Methods Prog Biomed. 1989; 30: 47-57
        • Posner B.M.
        • Smigelski C.
        • Duggal A.
        • Morgan J.
        • Cobb J.
        • Cupples L.
        Validation of two-dimensional models for estimation of portion size in nutrition research.
        J Am Diet Assoc. 1992; 92: 738-741
      2. R [computer program]. Version 3.2.2. Wien, Austria: The R Foundation for Statistical Computing; August 2015.

        • Raudenbush S.W.
        • Bryk A.S.
        Hierarchical Linear Models: Applications and Data Analysis Methods.
        2nd ed. Sage Publications, Inc, Thousand Oaks, CA2002
        • DeVellis R.F.
        Scale Development: Theory and Applications.
        2nd ed. Sage Publications, Inc, Thousand Oaks, CA2003
        • Kanyongo G.Y.
        • Brook G.P.
        • Kyei-Blankson L.
        • Gocmen G.
        Reliability and statistical power: How measurement fallibility affects power and required sample sizes for several parametric and nonparametric statistics.
        J Mod Appl Stat Methods. 2007; 6: 9
        • Pereira R.A.
        • Araujo M.C.
        • Lopes TdS.
        • Yokoo E.M.
        How many 24-hour recalls or food records are required to estimate usual energy and nutrient intake?.
        Cad Saúde Pública. 2010; 26: 2101-2111
        • Arab L.
        • Wesseling-Perry K.
        • Jardack P.
        • Henry J.
        • Winter A.
        Eight self-administered 24-hour dietary recalls using the Internet are feasible in African Americans and whites: The energetics study.
        J Am Diet Assoc. 2010; 110: 857-864
        • Martin C.K.
        • Nicklas T.
        • Gunturk B.
        • Correa J.B.
        • Allen H.
        • Champagne C.
        Measuring food intake with digital photography.
        J Human Nutr Diet. 2014; 27: 72-81
        • Dong Y.
        • Scisco J.
        • Wilson M.
        • Muth E.
        • Hoover A.
        Detecting periods of eating during free-living by tracking wrist motion.
        IEEE J Biomed Health Inform. 2014; 18: 1253-1260
        • Kipnis V.
        • Midthune D.
        • Buckman D.W.
        • et al.
        Modeling data with excess zeros and measurement error: Application to evaluating relationships between episodically consumed foods and health outcomes.
        Biometrics. 2009; 65: 1003-1010
        • Vance V.A.
        • Woodruff S.J.
        • McCargar L.J.
        • Husted J.
        • Hanning R.M.
        Self-reported dietary energy intake of normal weight, overweight and obese adolescents.
        Public Health Nutr. 2009; 12: 222-227
        • Baxter S.D.
        • Hitchcock D.B.
        • Guinn C.H.
        • et al.
        A validation study concerning the effects of interview content, retention interval, and grade on children's recall accuracy for dietary intake and/or physical activity.
        J Acad Nutr Diet. 2014; 114: 1902-1914
        • Baxter S.D.
        • Hitchcock D.B.
        • Guinn C.H.
        • et al.
        A pilot study of the effects of interview content, retention interval, and grade on accuracy of dietary information from children.
        J Nutr Educ Beh. 2013; 45: 368-373

      Biography

      S. M. St. George is a postdoctoral fellow, Department of Public Health Sciences, University of Miami, Miller School of Medicine, Miami, FL.

      Biography

      M. L. Van Horn is a professor, Department of Individual, Family, and Community Education, College of Education, University of New Mexico, Albuquerque.

      Biography

      H. G. Lawman is director of research and evaluation, Division of Chronic Disease Prevention, Philadelphia Department of Health, Philadelphia, PA.

      Biography

      D. K. Wilson is a professor, Department of Psychology, University of South Carolina, Columbia.