Advertisement

Pointers and Pitfalls in Interpreting Nutrition and Dietetics Research: The Importance of Statistical and Clinical Significance

Published:October 30, 2021DOI:https://doi.org/10.1016/j.jand.2021.10.022

      Abstract

      This monograph focuses on understanding statistical and clinical significance and is one in a research and statistics series published by the statistical team of the Journal of the Academy of Nutrition and Dietetics. The content covers the research questions, definition of clinical significance, hypothesis testing, P values, effect sizes, sample sizes, CIs, power analyses, minimal clinically important differences, and validity. This monograph concludes with a summary of the importance of clinical and statistical results for credentialed nutrition and dietetics practitioners to consider when assessing statistical and clinical significance. The assessment will help readers make subjective clinical judgments in the application of research findings based on their experience.

      Keywords

      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'

      Subscribe:

      Subscribe to Journal of the Academy of Nutrition and Dietetics
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect

      References

        • van Rijn M.H.
        • Bech A.
        • Bouyer J.
        • van den Brand J.A.
        Statistical significance versus clinical relevance.
        Nephrol Dial Transpl. 2017; 32: ii6-ii12
        • Ranganathan P.
        • Pramesh C.S.
        • Buyse M.
        Common pitfalls in statistical analysis: Clinical versus statistical significance.
        Perspect Clin Res. 2015; 6: 169-170
        • Jakobsen J.C.
        • Gluud C.
        • Winkel P.
        • Lange T.
        • Wetterslev J.
        The thresholds for statistical and clinical significance—A five-step procedure for evaluation of intervention effects in randomised clinical trials.
        BMC Med Res Methodol. 2014; 14: 34
        • Gleason P.
        • Naglack M.C.
        • Koprowski C.
        Fundamentals of statistical applications.
        in: van Horn L. Beto J. Research: Successful Approaches in Nutrition and Dietetics. Academy of Nutrition and Dietetics, 2019: 480-511
      1. van Horn L. Beto J. Research: Successful Approaches in Nutrition and Dietetics. 4th ed. Academy of Nutrition and Dietetics, 2019
        • Boushey C.
        • Harris K.
        • Bruemmer B.
        • Archer S.L.
        • Van Horn L.
        Publishing nutrition research: A review of study design, statistical analysis, and other key elements of manuscript preparation, Part 1.
        J Am Diet Assoc. 2006; 106: 89-96
        • Boushey C.J.
        • Harris J.
        • Bruemmer B.
        • Archer S.L.
        Publishing nutrition research: A review of sampling, sample size, statistical analysis, and other key elements of manuscript preparation, part 2.
        J Am Diet Assoc. 2008; 108: 678-688
        • Harris J.E.
        • Boushey C.
        • Bruemmer B.
        • Archer S.L.
        Publishing nutrition research: A review of nonparametric methods, part 3.
        J Am Diet Assoc. 2008; 108: 1488-1496
        • Sheean P.M.
        • Bruemmer B.
        • Gleason P.
        • Harris J.
        • Boushey C.
        • Van Horn L.
        Publishing nutrition research: A review of multivariate techniques—Part 1.
        J Am Diet Assoc. 2011; 111: 103-110
        • Harris J.E.
        • Sheean P.M.
        • Gleason P.M.
        • Bruemmer B.
        • Boushey C.
        Publishing nutrition research: A review of multivariate techniques—Part 2: Analysis of variance.
        J Acad Nutr Diet. 2012; 112: 90-98
        • Gleason P.M.
        • Boushey C.J.
        • Harris J.E.
        • Zoellner J.
        Publishing nutrition research: A review of multivariate techniques—Part 3: Data reduction methods.
        J Acad Nutr Diet. 2015; 115: 1072-1082
        • Zoellner J.
        • Harris J.E.
        Mixed-methods research in nutrition and dietetics.
        J Acad Nutr Diet. 2017; 117: 683-697
        • Harris J.E.
        • Gleason P.M.
        • Sheean P.M.
        • Boushey C.
        • Beto J.A.
        • Bruemmer B.
        An introduction to qualitative research for food and nutrition professionals.
        J Am Diet Assoc. 2009; 109: 80-90
        • Zoellner J.
        • Van Horn L.
        • Gleason P.M.
        • Boushey C.J.
        What is translational research? Concepts and applications in nutrition and dietetics.
        J Acad Nutr Diet. 2015; 115: 1057-1071
        • Gleason P.M.
        • Harris J.E.
        The Bayesian approach to decision making and analysis in nutrition research and practice.
        J Acad Nutr Diet. 2019; 119: 1993-2003
        • Bruemmer B.
        • Harris J.
        • Gleason P.
        • et al.
        Publishing nutrition research: A review of epidemiologic methods.
        J Am Diet Assoc. 2009; 109: 1728-1737
        • Gleason P.M.
        • Harris J.
        • Sheean P.M.
        • Boushey C.J.
        • Bruemmer B.
        Publishing nutrition research: Validity, reliability, and diagnostic test assessment in nutrition-related research.
        J Am Diet Assoc. 2010; 110: 409-419
        • Harris J.E.
        • Raynor H.A.
        Crossover designs in nutrition and dietetics research.
        J Acad Nutr Diet. 2017; 117: 1023-1030
        • Page P.
        Beyond statistical significance: Clinical interpretation of rehabilitation research literature.
        Int J Sports Phys Ther. 2014; 9: 726-736
        • Solla F.
        • Tran A.
        • Bertoncelli D.
        • Musoff C.
        • Bertoncelli C.M.
        Why a p-value is not enough.
        Clin Spine Surg. 2018; 31: 385-388
        • Nakagawa S.
        • Cuthill I.C.
        Effect size, confidence interval and statistical significance: A practical guide for biologists.
        Biol Rev Camb Philos. 2007; 82: 591-605
        • Salkind N.
        Statistics for People Who Think they Hate Statistics.
        7th ed. Sage Publications, Inc, 2019
        • Thompson B.
        Effect sizes, confidence intervals, and confidence intervals for effect sizes.
        Psychol Schools. 2007; 44: 423-432
        • Noordzij M.
        • Tripepi G.
        • Dekker F.W.
        • Zoccali C.
        • Tanck M.W.
        • Jager K.J.
        Sample size calculations: Basic principles and common pitfalls.
        Nephrol Dial Transpl. 2010; 25: 1388-1393
        • Drummond K.E.
        • Murphy-Reyes A.
        Nutrition Research: Concepts & Applications.
        Student edition. Jones & Bartlett Learning, 2017
        • LeFort S.M.
        The statistical versus clinical significance debate.
        J Nurs Scholarsh. 1993; 25: 57-62
        • Greenland S.
        • Senn S.J.
        • Rothman K.J.
        • et al.
        Statistical tests, p values, confidence intervals, and power: A guide to misinterpretations.
        Eur J Epidemiol. 2016; 31: 337-350
        • Jenkins D.J.
        • Jones P.J.
        • Frohlich J.
        • et al.
        The effect of a dietary portfolio compared to a DASH-type diet on blood pressure.
        Nutr Metab Cardiovasc. 2015; 25: 1132-1139
        • Sullivan G.M.
        • Feinn R.
        Using effect size-or why the p value is not enough.
        J Grad Med Educ. 2012; 4: 279-282
        • Lee D.K.
        Alternatives to p value: Confidence interval and effect size.
        Korean J Anesthesiol. 2016; 69: 555-562
        • Cohen J.
        Statistical Power Analysis for the Behavioral Sciences.
        2nd ed. Lawrence Erlbaum Associates, 1998
      2. Boston University School of Public Health. Confidence Intervals.
        • Szumilas M.
        Explaining odds ratios.
        J Can Acad Child Adolesc Psychiatry. 2010; 19: 227-229
        • Tan S.
        • Tan S.
        The correct interpretation of confidence intervals.
        Proc Singapore Healthc. 2010; 19: 276-278
      3. Sample size calculator. Raosoft.
        (Accessed May 29, 2021)
        • Muennig P.
        Cost-Effectiveness Analysis in Health: A Practical Approach.
        2nd ed. Jossey-Bass/Wiley, 2008
        • Zhang P.
        • Atkinson K.M.
        • Bray G.A.
        • et al.
        Within-trial cost-effectiveness of a structured lifestyle intervention in adults with overweight/obesity and type 2 diabetes: Results from the Action for Health in Diabetes (Look AHEAD) study.
        Diabetes Care. 2021; 44: 67-74
        • Jensen M.D.
        • Ryan D.H.
        • Apovian C.M.
        • et al.
        2013 AHA/ACC/TOS guideline for the management of overweight and obesity in adults: A report of the American College of Cardiology/American Heart Association Task Force on Practice Guidelines and The Obesity Society.
        Circulation. 2014; 129: S102-S138
        • Warkentin L.M.
        • Majumdar S.R.
        • Johnson J.A.
        • et al.
        Weight loss required by the severely obese to achieve clinically important differences in health-related quality of life: Two-year prospective cohort study.
        BMC Med. 2014; 12: 175
        • Ettehad D.
        • Emdin C.A.
        • Kiran A.
        • et al.
        Blood pressure lowering for prevention of cardiovascular disease and death: A systematic review and meta-analysis.
        Lancet. 2016; 387: 957-967

      Biography

      J. E. Harris is a professor of nutrition, West Chester University of PA, Sturzebecker Health Science Center, West Chester, PA.

      Biography

      J. Zoellner is a professor, Department of Public Health Sciences, University of Virginia, School of Medicine, Charlottesville, VA.