Exploration of medical students’ approach to progress test preparation
DOI:
https://doi.org/10.11157/fohpe.v25i3.724Keywords:
medical students, study behaviour, progress tests, remediation, feedbackAbstract
Introduction: Medical students are expected to develop competencies in applying clinical knowledge. Progress testing is an assessment for learning and is intended to assist in knowledge acquisition and to promote ongoing recall. This study explored student preparation for progress tests (PTs), relationships between approach and performance, and patterns that could assist with targeting learning support.
Methods: A cross-sectional survey exploring study approach and learning context, comprising multi-choice and open-ended responses, was administered to students during their clinical years (n = 297). Quantitative data was analysed using descriptive statistics and comparative analysis, and qualitative data was categorised.
Results: One hundred twenty-nine students responded (43.4%), with most demonstrating a stable PT performance over time. Twenty-two students had dynamic changes in their aggregate grades. Poor early PT performance was associated with developing an improvement strategy (χ2 6.954, p = 0.008). Students never falling below satisfactory were less likely to have a strategy (χ2 10.084, p = 0.001). All poorly performing students were using practice question banks, but this was not true for students who scored satisfactorily. The need for pastoral care was associated with poorer performance (χ2 4.701, p = 0.030).
Conclusions: Student approaches to PT preparation are diverse, however there are correlations between preparation factors and performance outcomes. Students with poor early performance demonstrated improved results over time that may be attributed to targeted support and preparation strategies. Widespread use of practice questions may not be sufficient to impact results without additional strategies. External impacts to performance were common, and barriers to accessing pastoral care were evident. The feedback dashboard was underutilised, suggesting a need to improve feedback literacy and ensure this is fit for purpose.
References
Cecilio-Fernandes, D., Kerdijk, W., Jaarsma, A. D. C., & Tio, R. A. (2016). Development of cognitive processing and judgments of knowledge in medical students: Analysis of progress test results. Medical Teacher, 38(11), 1125–1129. https://doi.org/10.3109/0142159x.2016.1170781
Chen, Y., Henning, M., Yielder, J., Jones, R., Wearn, A., & Weller, J. (2015). Progress testing in the medical curriculum: Students’ approaches to learning and perceived stress. BMC Medical Education, 15, Article 147. https://doi.org/10.1186/s12909-015-0426-y
Clemency, B., Martin-Gill, C., Rall, N., May, P., Lubin, J., Cooley, C., Van Dillen, C., Silvestri, S., Portela, R., Cooney, D., Knutsen, C., & March, J. (2017). Association between EMS question bank completion and passing rates on the EMS certification examination. Prehospital Emergency Care, 21(4), 498–502. https://doi.org/10.1080/10903127.2017.1294225
Dion, V., St-Onge, C., Bartman, I., Touchie, C., & Pugh, D. (2022). Written-based progress testing: A scoping review. Academic Medicine, 97(5), 747–757. https://doi.org/10.1097/acm.0000000000004507
Dyrbye, L. N., Thomas, M. R., & Shanafelt, T. D. (2005). Medical student distress: Causes, consequences, and proposed solutions. Mayo Clinic Proceedings, 80(12), 1613–1622. https://doi.org/10.4065/80.12.1613
Englander, R., Cameron, T., Ballard, A. J., Dodge, J., Bull, J., & Aschenbrener, C. A. (2013). Toward a common taxonomy of competency domains for the health professions and competencies for physicians. Academic Medicine, 88(8), 1088–1094. https://doi.org/10.1097/acm.0b013e31829a3b2b
Epstein, R. M. (2007). Assessment in medical education. New England Journal of Medicine, 356(4), 387–396. https://doi.org/10.1056/nejmra054784
Franz, A., Oberst, S., Peters, H., Berger, R., & Behrend, R. (2022). How do medical students learn conceptual knowledge? High-, moderate- and low-utility learning techniques and perceived learning difficulties. BMC Medical Education, 22, Article 250. https://doi.org/10.1186/s12909-022-03283-0
Görlich, D., & Friederichs, H. (2021). Using longitudinal progress test data to determine the effect size of learning in undergraduate medical education: A retrospective, single-center, mixed model analysis of progress testing results. Medical Education Online, 26(1). https://doi.org/10.1080/10872981.2021.1972505
Hill, M. R., Goicochea, S., & Merlo, L. J. (2018). In their own words: Stressors facing medical students in the millennial generation. Medical Education Online, 23(1), Article 1530558. https://doi.org/10.1080/10872981.2018.1530558
Holmboe, E. S., Sherbino, J., Englander, R., Snell, L., & Frank, J. R. (2017). A call to action: The controversy of and rationale for competency-based medical education. Medical Teacher, 39(6), 574–581. https://doi.org/10.1080/0142159x.2017.1315067
Liles, J., Vuk, J., & Tariq, S. (2018). Study habits of medical students: An analysis of which study habits most contribute to success in the preclinical years. MedEdPublish, 7, 61. https://doi.org/10.15694/mep.2018.0000061.1
Lillis, S., Yielder, J., Mogol, V., O'Connor, B., Bacal, K., Booth, R., & Bagg, W. (2014). Progress testing for medical students at the University of Auckland: Results from the first year of assessments. Journal of Medical Education and Curricular Development, 1. https://doi.org/10.4137/jmecd.s20094
Lizzio, A., Wilson, K., & Simons, R. (2002). University students' perceptions of the learning environment and academic outcomes: Implications for theory and practice. Studies in Higher Education, 27(1), 27–52. https://doi.org/10.1080/03075070120099359
Moir, F., Yielder, J., Dixon, H., & Hawken, S. (2018). SAFE-DRS: Health and wellbeing in the curriculum in the Auckland Medical Programme. International Journal of Innovation, Creativity and Change, 4(3), 49–64.
Moir, F., Yielder, J., Sanson, J., & Chen, Y. (2018). Depression in medical students: Current insights. Advances in Medical Education and Practice, 9, 323–333. https://doi.org/10.2147/amep.s137384
Molloy, E., Ajjawi, R., Bearman, M., Noble, C., Rudland, J., & Ryan, A. (2020). Challenging feedback myths: Values, learner involvement and promoting effects beyond the immediate task. Medical Education, 54(1), 33–39. https://doi.org/10.1111/medu.13802
Preston, R., Gratani, M., Owens, K., Roche, P., Zimanyi, M., & Malau-Aduli, B. (2020). Exploring the impact of assessment on medical students’ learning. Assessment & Evaluation in Higher Education, 45(1), 109–124. https://doi.org/10.1080/02602938.2019.1614145
Puthran, R., Zhang, M. W., Tam, W. W., & Ho, R. C. (2016). Prevalence of depression amongst medical students: A meta-analysis. Medical Education, 50(4), 456–468. https://doi.org/10.1111/medu.12962
Ryan, A., McColl, G. J., O'Brien, R., Chiavaroli, N., Judd, T., Finch, S., & Swanson, D. (2017). Tensions in post-examination feedback: Information for learning versus potential for harm. Medical Education, 51(9), 963–973. https://doi.org/10.1111/medu.13366
Steiner-Hofbauer, V., & Holzinger, A. (2020). How to cope with the challenges of medical education? Stress, depression, and coping in undergraduate medical students. Academic Psychiatry, 44(4), 380–387. https://doi.org/10.1007/s40596-020-01193-1
Van der Vleuten, C., Freeman, A., & Collares, C. F. (2018). Progress test utopia. Perspectives on Medical Education, 7(2), 136–138. https://doi.org/10.1007/s40037-018-0413-1
Wade, L., Harrison, C., Hollands, J., Mattick, K., Ricketts, C., & Wass, V. (2011). Student perceptions of the progress test in two settings and the implications for test deployment. Advances in Health Sciences Education, 17(4), 573–583. https://doi.org/10.1007/s10459-011-9334-z
Wynter, L., Burgess, A., Kalman, E., Heron, J. E., & Bleasel, J. (2019). Medical students: What educational resources are they using? BMC Medical Education, 19, Article 36. https://doi.org/10.1186/s12909-019-1462-9
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2024 Focus on Health Professional Education: A Multi-Professional Journal
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
On acceptance for publication in FoHPE the copyright of the manuscript is signed over to ANZAHPE, the publisher of FoHPE.
