Abstract
Background
Programmatic assessment has been proposed as the way forward for competency-based
assessment, yet there is a dearth of literature describing the implementation and
evaluation of programmatic assessment approaches.
Objective
To evaluate the implementation of a programmatic assessment and explore its ability
to support students and assessors.
Design
A qualitative evaluation of programmatic assessment was employed.
Participants/setting
Interviews with graduates (n = 8) and preceptors (n = 12) together with focus groups
with faculty assessors (n = 9) from the one Australian university explored experiences
of the programmatic approach, role of assessment in learning, and defensibility of
assessment decisions in determining competence.
Analysis performed
Data were analyzed into key themes using framework analysis.
Results
The programmatic assessment increased confidence in defensibility of assessment decisions,
reduced emotional burden of assessment, increased value of assessment, and identified
and remediated at-risk students earlier when philosophical and practice shifts in
approaches to assessment were embraced.
Conclusions
Programmatic assessment supports a holistic approach to competency development and
assessment and has multiple benefits for learners and assessors.
Keywords
To read this article in full you will need to make a payment
Purchase one-time access:
Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online accessOne-time access price info
- For academic or personal research use, select 'Academic and Personal'
- For corporate R&D use, select 'Corporate R&D Professionals'
Subscribe:
Subscribe to Journal of the Academy of Nutrition and DieteticsAlready a print subscriber? Claim online access
Already an online subscriber? Sign in
Register: Create an account
Institutional Access: Sign in to ScienceDirect
References
- Criteria for good assessment: consensus statement and recommendations from the Ottawa 2010 Conference.Med Teach. 2011; 33: 206-214
- Is there a Plan B?: Clinical educators supporting underperforming students in practice settings.Teaching Higher Educ. 2013; 18: 531-544
- Work-based assessment: qualitative perspectives of novice nutrition and dietetics educators.J Hum Nutr Diet. 2013; 27: 513-521
- Programmatic assessment of competence in dietetics: a new frontier.J Acad Nutr Diet. 2017; 117: 175-179
- Benefits, barriers, and motivators to training dietetic interns in clinical settings: a comparison between preceptors and nonpreceptors.J Acad Nutr Diet. 2018; 118: 471-480
- A new framework for designing programmes of assessment.Adv Health Sci Educ Theory Pract. 2010; 15: 379-393
- Programmatic assessment: from assessment of learning to assessment for learning.Med Teach. 2011; 33: 478-485
- A model for programmatic assessment fit for purpose.Med Teach. 2012; 34: 205-214
- Designing programmes of assessment: a participatory approach.Med Teach. 2017; 39: 1182-1188
- The impact of programmatic assessment on student learning: theory versus practice.Med Educ. 2015; 49: 487-498
- Joining the dots: conditional pass and programmatic assessment enhances recognition of problems with professionalism and factors hampering student progress.BMC Med Educ. 2011; 11: 29
- Stakes in the eye of the beholder: an international study of learners’ perceptions within programmatic assessment.Med Educ. 2018; 52: 654-663
- Assessment practices for dietetics trainees: a systematic review.J Acad Nutr Diet. 2019; 119: 272-292.e223
- Description, justification and clarification: a framework for classifying the purposes of research in medical education.Med Educ. 2008; 42: 128-133
- Re-visioning academic medicine through a constructionist lens.Acad Med. 2020; 95: 846-850
- Sampling in interview-based qualitative research: a theoretical and practical guide.Qual Res Psychol. 2014; 11: 25-41
- Sample size in qualitative interview studies: guided by information power.Qual Health Res. 2016; 26: 1753-1760
- The space between: on being an insider-outsider in qualitative research.Int J Qual Methods. 2009; 8: 54-63
- Qualitative data analysis for applied policy research.Analyzing Qualitative Data. Routledge, Philadelphia, PA2002: 187-208
- NVivo [computer program]. Version 11. QSR International, Melbourne, Australia2019
- A practical approach to programmatic assessment design.Adv Health Sci Educ Theory Pract. 2017; 22: 1169-1182
- The Prato Statement on cost and value in professional and interprofessional education.J Interprof Care. 2017; 31: 1-4
- Considerations that will determine if competency-based assessment is a sustainable innovation.Adv Health Sci Educ Theory Pract. 2019; 24: 413-421
- On the issue of costs in programmatic assessment.Perspect Med Educ. 2016; 5: 303-307
- Stakeholder perspectives on workplace-based performance assessment: towards a better understanding of assessor behaviour.Adv Health Sci Educ Theory Pract. 2017; 22: 1213-1243
- Challenges in preparing the dietetics workforce of the future: an exploration of dietetics educators’ experiences.Nutr Diet. 2019; 76: 382-391
- Qualitative and quantitative feedback in the context of competency-based education.Med Teach. 2017; 39: 1245-1249
- How ‘testing’ has become ‘programmatic assessment for learning’.Health Professions Educ. 2019; 5: 177-184
- Tackling wicked problems: how theories of agency can provide new insights.Med Educ. 2017; 51: 353-365
- Theoretical considerations on programmatic assessment.Med Teach. 2020; 42: 213-220
- Patient involvement in education of nutrition and dietetics students: a systematic review.Nutrients. 2019; 11: 2798
Biography
J. Dart is a senior lecturer, Department of Nutrition, Dietetics, and Food, Monash University Faculty of Medicine, Nursing, and Health Sciences, Clayton, Victoria, Australia.
Biography
C. Twohig is a research assistant, Department of Nutrition, Dietetics, and Food, Monash University Faculty of Medicine, Nursing, and Health Sciences, Clayton, Victoria, Australia.
Biography
A. Anderson is a senior lecturer, Department of Nutrition, Dietetics, and Food, Monash University Faculty of Medicine, Nursing, and Health Sciences, Clayton, Victoria, Australia.
Biography
A. Bryce is a nutrition programs manager and senior lecturer, Department of Nutrition, Dietetics, and Food, Monash University Faculty of Medicine, Nursing, and Health Sciences, Clayton, Victoria, Australia.
Biography
J. Collins is a senior lecturer, Department of Nutrition, Dietetics, and Food, Monash University Faculty of Medicine, Nursing, and Health Sciences, Clayton, Victoria, Australia.
Biography
Gibson is an associate professor, Department of Nutrition, Dietetics, and Food, Monash University Faculty of Medicine, Nursing, and Health Sciences, Clayton, Victoria, Australia.
Biography
S. Kleve is a senior lecturer, Department of Nutrition, Dietetics, and Food, Monash University Faculty of Medicine, Nursing, and Health Sciences, Clayton, Victoria, Australia.
Biography
J. Porter is an associate professor, Department of Nutrition, Dietetics, and Food, Monash University Faculty of Medicine, Nursing, and Health Sciences, Clayton, Victoria, Australia.
Biography
E. Volders is a senior lecturer, Department of Nutrition, Dietetics, and Food, Monash University Faculty of Medicine, Nursing, and Health Sciences, Clayton, Victoria, Australia.
Biography
C. Palermo is an associate professor and the director, Department of Nutrition, Dietetics, and Food, Monash University Faculty of Medicine, Nursing, and Health Sciences, Clayton, Victoria, Australia.
Article info
Publication history
Published online: February 18, 2021
Accepted:
January 17,
2021
Received:
July 29,
2020
Footnotes
STATEMENT OF POTENTIAL CONFLICT OF INTEREST No potential conflict of interest was reported by the authors.
FUNDING/SUPPORT There is no funding to disclose.
Identification
Copyright
© 2021 by the Academy of Nutrition and Dietetics.
