Effectiveness of online learning interventions on student engagement and academic performance amongst first-year students in allied health disciplines: A systematic review of the literature

Saravana Kumar; Gabrielle Todd

doi:10.11157/fohpe.v23i3.430

Authors

Saravana Kumar UniSA Allied Health and Human Performance, University of South Australia http://orcid.org/0000-0002-4003-4411
Gabrielle Todd UniSA Clinical and Health Sciences, University of South Australia http://orcid.org/0000-0002-2465-6026

DOI:

https://doi.org/10.11157/fohpe.v23i3.430

Keywords:

Education, Distance, Students, Health Occupations, Allied Health Occupations, Health Personnel, Systematic Review, Academic Performance, Educational Measurement

Abstract

Introduction: Online learning has increased in popularity due to its perceived ability to improve access for students. With advancements in technology, traditional barriers such as location, time and space can be readily overcome. However, despite its popularity, there continues to be ongoing debate regarding its effectiveness.

Methods: We searched commercially produced (six databases) and grey literature sources, limiting our search to humans and English language publications. Two reviewers independently screened the search results. Included studies were assessed for methodological quality assessment using the McMaster Critical Appraisal Tool for quantitative studies. Summarised data from the included studies were descriptively synthesised.

Results: We identified a modest body of evidence (19 studies) that indicates that online learning interventions may have a positive impact on student engagement and academic performance for first-year allied health students. This finding should be considered with caution due to methodological concerns about the low-level evidence base arising from lack of adequate and representative sampling, lack of clarity and descriptions regarding the interventions utilised and lack of psychometrically sound outcome measures, just to name a few.

Conclusions: There continues to remain key knowledge gaps in this field, such as who benefits the most, or the least, and the nature of any benefits and limitations, for which ongoing research is required.

Author Biographies

Saravana Kumar, UniSA Allied Health and Human Performance, University of South Australia

Associate Professor

Gabrielle Todd, UniSA Clinical and Health Sciences, University of South Australia

Associate Professor of Neuroscience

References

Bates, A. W. (2015). Teaching in a digital age. Tony Bates Associates.

Bearman, M., Smith, C. D., Carbone, A., Slade, S., Baik, C., Hughes-Warrington, M., & Neumann, D. L. (2012). Systematic review methodology in higher education. Higher Education Research & Development, 31(5), 625–640. https://doi.org/10.1080/07294360.2012.702735

Benino, D., Girardi, A., & Czarniak, P. (2011). Incorporating online teaching in an introductory pharmaceutical practice course: A study of student perceptions within an Australian university. Pharmacy Practice, 9(4), 252–258. https://doi.org/10.4321/s1886-36552011000400011

Cappi, V., Artioli, G., Ninfa, E., Ferrari, S., Guarnieri, M. C., Martucci, G., & Sarli, L. (2019). The use of blended learning to improve health professionals’ communication skills: A literature review [Supplemental material]. Acta Biomedica, 90(4), 17–24. https://doi.org/10.23750/abm.v90i4-S.8330

Cordier, R., McAuliffe, T., Wilson, N. J., Totino, R., Dender, A., Smith, C., & Stephens, M. (2016). The appropriateness and feasibility of an online e-Portfolio for assessment of undergraduate allied health students. Australian Occupational Therapy Journal, 63(3), 154–163. https://doi.org/10.1111/1440-1630.12226

Curtis, G. J., Gouldthorp, B., Thomas, E. F., O'Brien, G. M., & Correia, H. M. (2013). Online academic-integrity mastery training may improve students' awareness of, and attitudes toward, plagiarism. Psychology Learning & Teaching, 12(3), 282–289. https://doi.org/10.2304/plat.2013.12.3.282

Coyne, E., Rands, H., Frommolt, V., Kain, V., Plugge, M., & Mitchell, M. (2018). Investigation of blended learning video resources to teach health students clinical skills: An integrative review. Nurse Education Today, 63, 101–107. https://doi.org/10.1016/j.nedt.2018.01.021

Delaval, M., Michinov, N., Le Bohec, O., & Le Hénaff, B. (2017). How can students' academic performance in statistics be improved? Testing the influence of social and temporal-self comparison feedback in a web-based training environment. Interactive Learning Environments, 25(1), 35–47. https://doi.org/10.1080/10494820.2015.1090456

Feng, J. Y., Chang, Y. T., Chang, H. Y., Erdley, W. S., Lin, C. H., & Chang, Y. J. (2013). Systematic review of effectiveness of situated e-learning on medical and nursing education. Worldviews on Evidence-Based Nursing, 10(3), 174–183. https://doi.org/10.1111/wvn.12005

Fernandez-Lao, C., Cantarero-Villanueva, I., Galiano-Castillo, N., Caro-Moran, E., Diaz-Rodriguez, L., & Arroyo-Morales, M. (2016). The effectiveness of a mobile application for the development of palpation and ultrasound imaging skills to supplement the traditional learning of physiotherapy students. BMC Medical Education, 16(1), Article 274. https://doi.org/10.1186/s12909-016-0775-1

Gagnon, K. (2015). Using twitter in health professional education: A case study. Journal of Allied Health, 44(1), 25–33.

Hammarlund, C. S., Nilsson, M. H., & Gummesson, C. (2015). External and internal factors influencing self-directed online learning of physiotherapy undergraduate students in Sweden: A qualitative study. Journal of Educational Evaluation for Health Professions, 12, Article 33. https://doi.org/10.3352/jeehp.2015.12.33

James, R. (2016). Tertiary student attitudes to invigilated, online summative examinations. International Journal of Educational Technology in Higher Education, 13, Article 19. https://doi.org/10.1186/s41239-016-0015-0

Jones, H. (2008, November 20–December 3). Pestering staff into online learning: An integrated plan for implementation [Paper presentation]. ascilite Melbourne 2008: Hello! Where are you in the landscape of educational technology? https://www.ascilite.org/conferences/melbourne08/

Kalata, L. R., & Abate, M. A. (2013). A mentor-based portfolio program to evaluate pharmacy students' self-assessment skills. American Journal of Pharmaceutical Education, 77(4), Article 81. https://doi.org/10.5688/ajpe77481

Law, M., Pollock, N., Letts, L., Bosch, J., & Westmorland, M. (1998). Critical review form: Quantitative studies. https://www.unisa.edu.au/siteassets/episerver-6-files/global/health/sansom/documents/icahe/cats/mcmasters_quantitative-review.pdf

Letts, L., Wilkins, S., Law, M., Stewart, D., Bosch, J., & Westmorland, M. (2007). Guidelines for critical review form: Qualitative studies (Version 2.0). https://www.canchild.ca/system/tenon/assets/attachments/000/000/360/original/qualguide.pdf

Leung, J., Ferrari, A., Baxter, A., Schoultz, M., Beattie, M., & Harris, M. (2017). Systematic reviews: Inducting research students into scholarly conversations? Higher Education Research & Development, 36(1), 217–220. https://doi.org/10.1080/07294360.2016.1190527

Lewis, D. J. A., & Sewell, R. D. E. (2007). Providing formative feedback from a summative computer-aided assessment. American Journal of Pharmaceutical Education, 71(2), Article 33.

Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gotzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009). The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evalauate health care interventions: Explanation and elaboration. PLOS Medicine, 62(10), E1–E34. https://doi.org/10.1016/j.jclinepi.2009.06.006

Lin, S. J., & Crawford, S. Y. (2007). An online debate series for first-year pharmacy students. American Journal of Pharmaceutical Education, 71(1), Article 12.

Mayer, R. E. (2010). Rote versus meaningful learning. Theory Into Practice, 41(4), 226–232. https://doi.org/10.1207/s15430421tip4104_4

McClean, S., McCartan, K. G., Meskin, S., Gorges, B., & Hagan, W. P. (2016). Reflections on "YouTestTube.com": An online video-sharing platform to engage students with chemistry laboratory classes. Journal of Chemical Education, 93(11), 1863–1870. https://doi.org/10.1021/acs.jchemed.6b00045

Moni, R. W., Moni, K. B., Poronnik, P., & Lluka, L. J. (2007). Biohorizons: An econference to assess human biology in large, first-year classes. Biochemistry and Molecular Biology Education, 35(4), 255–263. https://doi.org/10.1002/bmb.71

Munn, J., & Small, J. (2017). What is the best way to develop information literacy and academic skills of first year health science students? A systematic review. Evidence Based Library and Information Practice, 12(3), 56–94. https://doi.org/10.18438/B8QS9M

Nallaya, S., Delaney, B. L., Savelsberg, H., & Lancione, C. (2018). Developing a self-regulated curricula of scaffolded academic and information literacies in a digital learning environment. Journal of Academic Language and Learning, 12(1), A179–A192. https://journal.aall.org.au/index.php/jall/article/view/517

Ni, A. Y. (2013). Comparing the effectiveness of classroom and online learning: Teaching research methods. Journal of Public Affairs Education, 19(2), 199–215. https://doi.org/10.1080/15236803.2013.12001730

North, S., Beck, B., Liveris, M., Vega, A., Boyington, N., Stockwell, L., St. George, T. E., & Hopp, J. (2018). Students' knowledge and self-perceptions regarding integrative medicine and health following training in first-year graduate PA, PT, and OT programs. Journal of Allied Health, 47(3), e91–e95.

Nutan, M. T. H., & Demps, E. L. (2014). Online assessments in pharmaceutical calculations for enhancing feedback and practice opportunities. Currents in Pharmacy Teaching and Learning, 6(6), 807–814. https://doi.org/10.1016/j.cptl.2014.07.010

Pei, L., & Wu, H. (2019). Does online learning work better than offline learning in undergraduate medical education? A systematic review and meta-analysis. Medical Education Online, 24(1), Article 1666538. https://doi.org/10.1080/10872981.2019.1666538

Picciano, A. (2015). Planning for online education: A systems model. Online Learning, 19(5), 142–158. https://doi.org/10.24059/olj.v19i5.548

Regmi, K., & Jones, L. (2020). A systematic review of the factors—enablers and barriers—affecting e-learning in health sciences education. BMC Medical Education, 20, Article 19. https://doi.org/10.1186/s12909-020-02007-6

Rowe, M., Osadnik, C. R., Pritchard, S., & Maloney, S. (2019). These may not be the courses you are seeking: A systematic review of open online courses in health professions education. BMC Medical Education, 19(1), Article 356. https://doi.org/10.1186/s12909-019-1774-9

Sando, K. R., & Feng, X. Y. (2018). Use of an online spaced-education game to study top 200 drugs in a skills laboratory course. American Journal of Pharmaceutical Education, 82(7), 808–817. https://doi.org/10.5688/ajpe6324

Shukor, N. A., Tasir, Z., & Van der Meijden, H. (2015). An examination of online learning effectiveness using data mining. Procedia: Social and Behavioral Sciences, 172, 555–562. https://doi.org/10.1016/j.sbspro.2015.01.402

Soh, B. P., Reed, W. M., Poulos, A., & Brennan, P. C. (2013). E-tutorial improves students' ability to detect lesions. Radiologic Technology, 85(1), 17–26.

Stamper, B. D., Buhler, A. V., Harrelson, J. P., Roberts, S. C., Malhotra, A., Elbarbry, F. A., Rao, D., Karimi, R., Turner, R. B., Marlow, C., & Devaud, L. L. (2017). Forecasting academic success through implementation of an online prerequisite review tutorials program for first year pharmacy students. Currents in Pharmacy Teaching and Learning, 9(2), 261–271. https://doi.org/10.1016/j.cptl.2016.11.012

Suleman, F. (2016). Assessing the effect of an online HIV/AIDS course on 1st-year pharmacy students' knowledge. African Journal of Health Professions Education, 8(1), 108–112. https://doi.org/10.7196/AJHPE.2016.v8i1.750

Unge, J., Lundh, P., Gummesson, C., & Amner, G. (2018). Learning spaces for health sciences: What is the role of e-learning in physiotherapy and occupational therapy education. Physical Therapy Reviews, 23(1), 50–60. https://doi.org/10.1080/10833196.2018.1447423

Vaughan, K. T. L. (2009). Development of targeted online modules for recurring reference questions. Medical Reference Services Quarterly, 28(3), 211–220. https://doi.org/10.1080/02763860903069870