“Do you reckon I should sit?” Is it possible to predict success in the ACEM fellowship examination?
DOI:
https://doi.org/10.11157/fohpe.v18i3.104Keywords:
emergency medicine, medical education, specialty boards, assessmentAbstract
Introduction: The ACEM (Australasian College for Emergency Medicine) fellowship examination is a high-stakes assessment occurring at the end of postgraduate training in emergency medicine. The objectives of this study were to identify factors that allow prediction of success or failure in the ACEM fellowship examination, information that may be useful to those involved in examination preparation.
Methods: From 2009–2012, six consecutive cohorts of Victorian ACEM trainees sat a practice written examination and completed surveys regarding examination preparation. Subsequent ACEM fellowship examination outcome was obtained by contacting trainees and using ACEM annual reports. Univariate analysis was undertaken to determine which factors would most reliably predict examination success. Each sitting of the practice examination was viewed separately.
Results: From the 150 examination candidates, we received responses on 111 occasions from a total of 80 trainees (several candidates sat the exam more than once). Pass/fail data was available for 72 datasets. The strongest positive predictors for examination success included the number of examination sections passed in the practice examination (OR 3.34, 95% CI 1.61–6.90), reading outside of the major international emergency medicine textbooks (OR 2.53, 95% CI 1.21–5.28) and a belief that attending a course was helpful for examination preparation (OR 1.70, 95% CI 1.06–2.73). Years since graduating from medical school (OR 0.79, 95% CI 0.69–0.91) was negatively associated with examination success.
Conclusions: In this cohort of Victorian trainees, performance in a practice examination had one of the strongest associations with performance in the real ACEM fellowship examination. Practice examinations are a useful method to provide benchmarking and advice to candidates prior to the formal examination.
References
Australasian College for Emergency Medicine (ACEM). (2004–2013). Reports from the 33rd to 51st ACEM fellowship examinations. Melbourne, Australia: Author.
Australasian College for Emergency Medicine (ACEM). (2017). Educational resources. Retrieved May 2014, from www.acem.org.au
Australian Resuscitation Council. (2016). ARC clinical guidelines. Retrieved May 2014, from www.resus.com.au/guidelines/
Brill-Edwards, P., Evans, G., Hamilton, P., Hramiak, I., Megran, D., Schmuck, M. L., . . . Norman, G. (2001). Predicting performance on the Royal College of Physicians and Surgeons of Canada internal medicine written examination. CMAJ, 165(10), 1305–1307.
Cameron, P., & O’Reilly, G. (2004). Is the ACEM training programme adequate? Emergency Medicine Australasia, 16(4), 271–273.
Cooper, J. G., Rutherford, E., & Hamer, W. (2013). Survey of trainee attitudes to preparation for and participation in the FCEM examination. Emergency Medicine Journal, 30(1), 58–62. doi:10.1136/emermed-2011-200975
Corneille, M. G., Willis, R., Stewart, R. M., & Dent, D. L. (2011). Performance on brief practice examination identifies residents at risk for poor ABSITE and ABS qualifying examination performance. Journal of Surgical Education, 68(3), 246–249. doi:10.1016/j.jsurg.2010.12.009
Craig, S., Braitberg, G., Nicolas, C., White, G., & Egerton-Warburton, D. (2010). Assessment and feedback in emergency medicine training: Views of Australasian emergency trainees. Emergency Medicine Australas, 22(6), 537–547. doi:10.1111/j.1742-6723.2010.01353.x
Frederick, R. C., Hafner, J. W., Schaefer, T. J., & Aldag, J. C. (2011). Outcome measures for emergency medicine residency graduates: Do measures of academic and clinical performance during residency training correlate with American Board of Emergency Medicine test performance? Academic Emergency Medicine, 18(Suppl. 2), S59–S64. doi:10.1111/j.1553-2712.2011.01116.x
Malangoni, M. A., Jones, A. T., Rubright, J., Biester, T. W., Buyske, J., & Lewis, F. R., Jr. (2012). Delay in taking the American Board of Surgery qualifying examination affects examination performance. Surgery, 152(4), 738–743; discussion 743–746. doi:10.1016/j.surg.2012.07.001
McClintock, J. C., & Gravlee, G. P. (2010). Predicting success on the certification examinations of the American Board of Anesthesiology. Anesthesiology, 112(1), 212–219. doi:10.1097/ALN.0b013e3181c62e2f
National Health and Medical Research Council (NHMRC). (2007). National statement on ethical conduct in human research. Canberra, Australia: National Health and Medical Research Council, Australian Research Council, Australian Vice-Chancellors’ Committee.
Oyebode, F., & Furlong, E. (2007). MRCPsych examinations: Cumulative results 1997–2002. Psychiatric Bulletin, 31(2), 61–64. doi:10.1192/pb.bp.105.009035
Perrin, K., Prasad, S., & Robinson, G. (2005). Survey of the Royal Australasian College of Physicians examination candidates: Preparation and impact on lifestyle. Internal Medicine Journal, 35(11), 680–682. doi:10.1111/j.1445-5994.2005.00936.x
Pinheiro-Torres, C., Tang, P., & Dacre, J. (2013). Performance at MRCP(UK): When should trainees sit examinations? Clinical Medicine, 13(2), 166–169. doi:10.7861/clinmedicine.13-2-166
Rogers, I. R., Leach, D., & Brookes, J. G. (2004). Why don’t trainees pass the emergency medicine fellowship examination? Emergency Medicine Australas, 16(4), 336–342. doi:10.1111/j.1742-6723.2004.00621.x
Salter, R., & Smith, S. (1998). How to pass the MRCP (UK) examination—ask a successful candidate! Postgraduate Medical Journal, 74(867), 33–35.
Shellito, J. L., Osland, J. S., Helmer, S. D., & Chang, F. C. (2010). American Board of Surgery examinations: Can we identify surgery residency applicants and residents who will pass the examinations on the first attempt? American Journal of Surgery, 199(2), 216–222.
doi:10.1016/j.amjsurg.2009.03.006
Tyrer, S. P., Leung, W.-C., Smalls, J., & Katona, C. (2002). The relationship between medical school of training, age, gender and success in the MRCPsych examinations. Psychiatric Bulletin, 26(7), 257–263. doi:10.1192/pb.26.7.257
Wilkes, G., Peirce, B., Foot, C., & Ting, J. (2009). Examination emergency medicine: A guide to the ACEM fellowship examination. Chatswood, NSW, Australia: Elsevier.
Downloads
Published
How to Cite
Issue
Section
License
On acceptance for publication in FoHPE the copyright of the manuscript is signed over to ANZAHPE, the publisher of FoHPE.
