Advertisement

Quality control for interviews to obtain dietary recalls from children for research studies

      Abstract

      Quality control is an important aspect of a study because the quality of data collected provides a foundation for the conclusions drawn from the study. For studies that include interviews, establishing quality control for interviews is critical in ascertaining whether interviews are conducted according to protocol. Despite the importance of quality control for interviews, few studies adequately document the quality control procedures used during data collection. This article reviews quality control for interviews and describes methods and results of quality control for interviews from two of our studies regarding the accuracy of children’s dietary recalls; the focus is on quality control regarding interviewer performance during the interview, and examples are provided from studies with children. For our two studies, every interview was audio recorded and transcribed. The audio recording and typed transcript from one interview conducted by each research dietitian either weekly or daily were randomly selected and reviewed by another research dietitian, who completed a standardized quality control for interviews checklist.Major strengths of the methods of quality control for interviews in our two studies include: (a) interviews obtained for data collection were randomly selected for quality control for interviews, and (b) quality control for interviews was assessed on a regular basis throughout data collection. The methods of quality control for interviews described may help researchers design appropriate methods of quality control for interviews for future studies.
      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'

      Subscribe:

      Subscribe to Journal of the Academy of Nutrition and Dietetics
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect

      References

        • Whitney C.W.
        • Lind B.K.
        • Wahl P.W.
        Quality assurance and quality control in longitudinal studies.
        Epidemiol Rev. 1998; 20: 71-80
        • Edwards S.
        • Slattery M.L.
        • Mori M.
        • Berry T.D.
        • Caan B.J.
        • Palmer P.
        • Potter J.D.
        Objective system for interviewer performance evaluation for use in epidemiological studies.
        Am J Epidemiol. 1994; 140: 1020-1028
        • Frank G.C.
        • Hollatz A.T.
        • Webber L.S.
        • Berenson G.S.
        Effect of interviewer recording practices on nutrient intake—Bogalusa Heart Study.
        J Am Diet Assoc. 1984; 84: 1432-1439
      1. Tippett K.S. Cypel Y.S. Design and Operation The Continuing Survey of Food Intakes by Individuals and the Diet and Health Knowledge Survey, 1994–96. US Department of Agriculture, 1998 (Agricultural Research Service. No. 96-1)
        • US Department of Health and Human Services
        Plan and Operation of the Third National Health and Nutrition Examination Survey, 1988–94. National Center for Health Statistics, Vital and Health Statistics, Hyattsville, MD1994 (DHHS Publication No. (PHS) 94-1308)
      2. Food Surveys Research Group. Frequently Asked Questions—HHS-USDA Dietary Survey Integration. http://www.barc.usda.gov/bhnrc/foodsurvey/integrationfaq.html. Accessed June 24, 2002.

        • Frank G.C.
        • Berenson G.S.
        • Webber L.S.
        Dietary studies and the relationship of diet to cardiovascular disease risk factor variables in 10-year old children—The Bogalusa Heart Study.
        Am J Clin Nutr. 1978; 31: 328-340
        • Obarzanek E.
        • Kimm S.Y.S.
        • Barton B.A.
        • Van Horn L.
        • Kwiterovich Jr., P.O.
        • Simons-Morton D.G.
        • Hunsberger S.A.
        • Lasser N.L.
        • Robson A.M.
        • Franklin Jr., F.A.
        • Lauer R.M.
        • Stevens V.J.
        • Friedman L.A.
        • Dorgan J.F.
        • Greenlick M.R.
        Long-term safety and efficacy of a cholesterol-lowering diet in children with elevated low-density lipoprotein cholesterol.
        Pediatrics. 2001; 107: 256-264
        • Stone E.J.
        • Osganian S.K.
        • McKinlay S.M.
        • Wu M.C.
        • Webber L.S.
        • Luepker R.V.
        • Perry C.L.
        • Parcel G.S.
        • Elder J.P.
        Operational design and quality control in the CATCH multicenter trial.
        Prev Med. 1996; 25: 384-399
        • McPherson R.S.
        • Hoelscher D.M.
        • Alexander M.
        • Scanlon K.S.
        • Serdula M.K.
        Dietary assessment methods among school-aged children.
        Prev Med. 2000; 31: S11-S33
        • Baxter S.D.
        • Thompson W.O.
        • Litaker M.S.
        • Frye F.H.A.
        • Guinn C.H.
        Low accuracy and low consistency of fourth-graders’ school breakfast and school lunch recalls.
        J Am Diet Assoc. 2002; 102: 386-395
        • Baxter S.D.
        • Thompson W.O.
        • Davis H.C.
        • Johnson M.H.
        Impact of gender, ethnicity, meal component, and time interval between eating and reporting on accuracy of fourth-graders’ self-reports of school lunch.
        J Am Diet Assoc. 1997; 97: 1293-1298
        • Baxter S.D.
        • Thompson W.O.
        • Davis H.C.
        Prompting methods affect the accuracy of children’s school lunch recalls.
        J Am Diet Assoc. 2000; 100: 911-918
        • Baxter S.D.
        • Thompson W.O.
        • Smith A.F.
        • Litaker M.S.
        • Yin Z.
        • Frye F.H.A.
        • Guinn C.H.
        • Baglio M.L.
        • Shaffer N.M.
        Reverse versus forward order reporting and the accuracy of fourth-graders’ recalls of school breakfast and school lunch.
        Prev Med. 2003; 36: 601-614
        • Baxter S.D.
        • Thompson W.O.
        • Litaker M.S.
        • Guinn C.H.
        • Frye F.H.A.
        • Baglio M.L.
        • Shaffer N.M.
        Accuracy of fourth-graders’ dietary recalls of school breakfast and school lunch validated with observations.
        J Nutr Educ Behav. 2003; 35: 124-134
        • Bransby E.R.
        • Daubney C.G.
        • King J.
        Comparison of results obtained by different methods of individual dietary survey.
        Br J Nutr. 1948; 2: 89-110
        • Carter R.L.
        • Sharbaugh C.O.
        • Stapell C.A.
        Reliability and validity of the 24-hour recall.
        J Am Diet Assoc. 1981; 79: 542-547
        • Crawford P.B.
        • Obarzanek E.
        • Morrison J.
        • Sabry Z.I.
        Comparative advantage of 3-day food records over 24-hour recall and 5-day food frequency validated by observation of 9- and 10-year-old girls.
        J Am Diet Assoc. 1994; 94: 626-630
        • Domel S.B.
        • Thompson W.O.
        • Baranowski T.
        • Smith A.F.
        How children remember what they have eaten.
        J Am Diet Assoc. 1994; 94: 1267-1272
        • Emmons L.
        • Hayes M.
        Accuracy of 24-hr recalls of young children.
        J Am Diet Assoc. 1973; 62: 409-415
        • Greger J.L.
        • Etnyre G.M.
        Validity of 24-hour dietary recalls by adolescent females.
        Am J Public Health. 1978; 68: 70-72
        • Lytle L.A.
        • Murray D.M.
        • Perry C.L.
        • Eldridge A.L.
        Validating fourth-grade students’ self-report of dietary intake.
        J Am Diet Assoc. 1998; 98: 570-572
        • Lytle L.A.
        • Nichaman M.Z.
        • Obarzanek E.
        • Glovsky E.
        • Montgomery D.
        • Nicklas T.
        • Zive M.
        • Feldman H.
        Validation of 24-hour recalls assisted by food records in third-grade children.
        J Am Diet Assoc. 1993; 93: 1431-1436
        • Reynolds L.A.
        • Johnson S.B.
        • Silverstein J.
        Assessing daily diabetes management by 24-hour recall interview.
        J Pediatr Psychol. 1990; 15: 493-509
        • Mack K.A.
        • Blair J.
        • Presser S.
        Measuring and improving data quality in children’s reports of dietary intake.
        in: Warnecke R.B. Health Survey Research Methods Conference Proceedings. 1996: 51-55 (Hyattsville, MD: DHHS Publication no. (PHS) 96-1013)
        • Meredith A.
        • Matthews A.
        • Zickefoose M.
        • Weagley E.
        • Wayave M.
        • Brown E.G.
        How well do school children recall what they have eaten?.
        J Am Diet Assoc. 1951; 27: 749-751
        • Samuelson G.
        An epidemiological study of child health and nutrition in a northern Swedish county. II. Methodological study of the recall technique.
        Nutr Metab. 1970; 12: 321-340
        • Stunkard A.J.
        • Waxman M.
        Accuracy of self-reports of food intake.
        J Am Diet Assoc. 1981; 79: 547-551
        • Todd K.S.
        • Kretsch M.J.
        Accuracy of the self-reported dietary recall of new immigrant and refugee children.
        Nutr Res. 1986; 6: 1031-1043
        • Baranowski T.
        • Islam N.
        • Baranowski J.
        • Cullen K.W.
        • Myres D.
        • Marsh T.
        • de Moor C.
        The Food Intake Recording Software System is valid among fourth-grade children.
        J Am Diet Assoc. 2002; 102: 380-385
        • Contento I.R.
        • Randell J.S.
        • Basch C.E.
        Review and analysis of evaluation measures used in nutrition intervention research.
        J Nutr Educ Behav. 2002; 34: 2-25
        • Baranowski T.
        • Henske J.
        • Simons-Morton B.
        • Palmer J.
        • Tiernan K.
        • Hooks P.C.
        • Dunn J.K.
        Dietary change for cardiovascular disease prevention among Black-American families.
        Health Educ Res. 1990; 5: 433-443
        • Bush P.J.
        • Zuckerman A.E.
        • Taggart V.S.
        • Theiss P.K.
        • Peleg E.O.
        • Smith S.A.
        Cardiovascular risk factor prevention in black school children.
        Health Educ Q. 1989; 16: 215-227
        • Gortmaker S.L.
        • Cheung L.W.Y.
        • Peterson K.E.
        • Chomitz G.
        • Cradle J.H.
        • Dart H.
        • Fox M.K.
        • Bullock R.B.
        • Sobol A.M.
        • Colditz G.
        • Field A.E.
        • Laird N.
        Impact of a school-based interdisciplinary intervention on diet and physical activity among urban primary school children.
        Arch Pediatr Adolesc Med. 1999; 153: 975-983
        • Lindholm B.W.
        • Touliatos J.
        • Wenberg M.F.
        Predicting changes in nutrition knowledge and dietary quality in ten- to thirteen-year-olds following a nutrition education program.
        Adolescence. 1984; 19: 367-375
        • Luepker R.V.
        • Perry C.L.
        • Murray D.M.
        • Mullis R.
        Hypertension prevention through nutrition education in youth.
        Health Psychol. 1988; 7: 233-245
        • McDonald W.F.
        • Brun J.K.
        • Esserman J.
        In-home interviews measure positive effects of a school nutrition program.
        J Nutr Educ. 1981; 13: 140-144
        • Nader P.R.
        • Stone E.J.
        • Lytle L.A.
        • Perry C.L.
        • Osganian S.K.
        • Kelder S.
        • Webber L.S.
        • Elder J.P.
        • Montgomery D.
        • Feldman H.A.
        • Wu M.
        • Johnson C.
        • Parcel G.S.
        • Luepker R.V.
        Three-year maintenance of improved diet and physical activity.
        Arch Pediatr Adolesc Med. 1999; 153: 695-704
        • Nader P.R.
        • Sallis J.F.
        • Patterson T.L.
        • Abramson I.S.
        • Rupp J.W.
        • Senn K.L.
        • Atkins C.J.
        • Roppe B.E.
        • Morris J.A.
        • Wallace J.P.
        • Vega W.A.
        A family approach to cardiovascular risk reduction.
        Health Educ Q. 1989; 16: 229-244
        • Luepker R.V.
        • Perry C.L.
        • McKinlay S.M.
        • Nader P.R.
        • Parcel G.S.
        • Stone E.J.
        • Webber L.S.
        • Elder J.P.
        • Feldman H.A.
        • Johnson C.C.
        • Kelder S.H.
        • Wu M.
        Outcomes of a field trial to improve children’s dietary patterns and physical activity.
        JAMA. 1996; 275: 768-776
        • Perry C.L.
        • Bishop D.B.
        • Taylor G.
        • Murray D.M.
        • Mays R.W.
        • Dudovitz B.S.
        • Smyth M.
        • Story M.
        Changing fruit and vegetable consumption among children.
        Am J Public Health. 1998; 88: 603-609
        • Perry C.L.
        • Luepker R.V.
        • Murray D.M.
        • Kurth C.
        • Mullis R.
        • Crockett S.
        • Jacobs Jr., D.R.
        Parent involvement with children’s health promotion.
        Am J Public Health. 1988; 78: 1156-1160
        • Perry C.L.
        • Luepker R.V.
        • Murray D.M.
        • Hearn M.D.
        • Halper A.
        • Dudovitz B.
        • Maile M.C.
        • Smyth M.
        Parent involvement with children’s health promotion.
        Health Educ Q. 1989; 16: 171-180
        • Perry C.L.
        • Lytle L.A.
        • Feldman H.
        • Nicklas T.
        • Stone E.
        • Zive M.
        • Garceau A.
        • Kelder S.H.
        Effects of the Child and Adolescent Trial for Cardiovascular Health (CATCH) on fruit and vegetable intake.
        J Nutr Educ. 1998; 30: 354-360
        • Reynolds K.D.
        • Franklin F.A.
        • Binkley D.
        • Raczynski J.M.
        • Harrington K.F.
        • Kirk K.A.
        • Person S.
        Increasing the fruit and vegetable consumption of fourth-graders.
        Prev Med. 2000; 30: 309-319
        • Schinke S.P.
        • Singer B.
        • Cole K.
        • Contento I.R.
        Reducing cancer risk among Native American adolescents.
        Prev Med. 1996; 25: 146-155
        • Walter H.J.
        Primary prevention of chronic disease among children.
        Health Educ Q. 1989; 16: 201-214
        • Fowler Jr., F.J.
        Reducing interviewer-related error through interviewer training, supervision, and other means.
        in: Biemer P.P. Groves R.M. Lyberg L.E. Mathiowetz N.A. Sudman S. Measurement Errors in Surveys. John Wiley & Sons, New York1991: 259-278
        • Billiet J.
        • Loosveldt G.
        Improvement of the quality of responses to factual survey questions by interviewer training.
        Public Opin Q. 1988; 52: 190-211
        • Fowler Jr., F.J.
        • Mangione T.W.
        Standardized Survey Interviewing.
        Applied Social Research Methods Series.Vol. 18. Sage Publications, Newbury Park, CA1990
        • Dennis B.
        • Stamler J.
        • Buzzard M.
        • Conway R.
        • Elliott P.
        • Moag-Stahlberg A.
        • Okayama A.
        • Okuda N.
        • Robertson C.
        • Robinson F.
        • Schakel S.
        • Stevens M.
        • Van Heel N.
        • Zhao L.
        • Zhou B.
        INTERMAP.
        J Hum Hypertens. 2003; 17: 609-622
        • Simons-Morton B.G.
        • Parcel G.S.
        • Baranowski T.
        • Forthofer R.
        • O’Hara N.M.
        Promoting physical activity and a healthful diet among children.
        Am J Public Health. 1991; 81: 986-991

      Biography

      S. D. Baxter is a research professor and C. H. Guinn a research dietitian, University of South Carolina, Ar-nold School of Public Health, Department of Epidemiol-ogy and Biostatistics, Center for Research in Nutrition and Health Disparities, Columbia. W. O. Thompson is director and professor emeritus, Office of Biostatistics and Bioinformatics, Medical College of Georgia, Augusta. At the time of the study, N. M. Shaffer, S. Baxter, M. L. Baglio, C. H. Guinn, and F. H. A. Frye were at the Medical College of Georgia, Department Pediatrics, Georgia Prevention Institute, Augusta.