Australian medical regulations and strengthened continuing professional development (CPD): A policy implementation gap analysis with the specialist medical colleges

Carol Pizzuti; Cristiana Palmieri; Tim Shaw

doi:10.11157/fohpe.v25i3.763

Authors

Carol Pizzuti The University of Sydney, Australia
Cristiana Palmieri The Royal Australasian College of Physicians, The University of Sydney, Australia
Tim Shaw The University of Sydney, Australia

DOI:

https://doi.org/10.11157/fohpe.v25i3.763

Keywords:

continuing professional development, CPD, data analytics, policy implementation, qualitative research, Australia

Abstract

Introduction: Starting from 2023, Australian medical practitioners must meet new mandatory continuing professional development (CPD) requirements for registration renewal. In particular, each year they must complete 12.5 hours of educational activities and 25 hours of CPD activities related to reviewing performance and measuring outcomes, with a minimum of 5 hours each for reviewing performance and measuring outcomes activities, and they are encouraged to use patient health data and large eHealth datasets for better insights. Despite concerns regarding data accessibility and outcome measurement, specialist medical colleges are implementing these requirements. This study aims to explore factors influencing colleges’ efforts and provide recommendations for future research and action to enable data-driven CPD practices.

Methods: A policy implementation gap analysis employing semi-structured interviews as a standalone method was conducted with participating colleges. Four colleges agreed to participate, with a total of 18 participants recruited from either the colleges’ staff who are responsible for interpreting and implementing CPD regulatory policies or the colleges’ CPD committees. Interviews were analysed using inductive and deductive thematic analysis. Data collection, data analysis and final results were reported using the COREQ checklist.

Results: Three themes were identified from the interview analysis: (1) colleges' organisational structure and their roles and responsibilities within the Australasian CPD ecosystem, (2) challenges and enablers for policy implementation and (3) organisational needs and future actions at college level and necessary pre-conditions at ecosystemic level for strengthened CPD.

Conclusions: Internal and external organisational factors are hindering colleges’ efforts to implement policy. More research, a reassessment of colleges’ roles, responsibilities and structure, and collaboration among colleges and data holders are necessary to enable full policy implementation and strengthened CPD practices.

References

Abdullah, K. H., & Sofyan, D. (2022). Middle managers and dilemmas in the organisation. Asian Journal of Research in Business and Management, 4(2), 35–49. https://myjms.mohe.gov.my/index.php/ajrbm/article/view/18067

Ajjawi, R., & Regehr, G. (2018). When I say … feedback. Medical Education, 53(7), 652–654. https://doi.org/10.1111/medu.13746

Allen, L. M., Palermo, C., Armstrong, E., & Hay, M. (2019). Categorising the broad impacts of continuing professional development: A scoping review. Medical Education, 53(11), 1087–1099. https://doi.org/10.1111/medu.13922

Archer, J. C. (2010). State of the science in health professional education: Effective feedback. Medical Education, 44(1), 101–108. https://doi.org/10.1111/j.1365-2923.2009.03546.x

Archer, J., Pitt, R., Nunn, S., & Regan De Bere, S. (2015). The evidence and options for medical revalidation in the Australian context. Medical Board of Australia (MBA). https://www.dcnz.org.nz/assets/Medical-Board-2015-Evidence-and-options-for-medical-revalidation.pdf

Australian Medical Council (AMC). (n.d.). Specialist medical colleges. Retrieved July 18, 2023, from https://www.amc.org.au/accredited-organisations/assessment-and-accreditation-of-specialist-medical-programs/specialist-medical-colleges/

Australian Medical Council (AMC). (2015). Standards for assessment and accreditation of specialist medical education programs and professional development programs 2015. https://www.medicalboard.gov.au/documents/default.aspx?record=WD15%2F18556&dbid=AP&chksum=8Ef84XkkjAytAh9NamXwDg%3D%3D

Australian Medical Council, & Medical Board of Australia. (2022). Criteria for AMC accreditation of CPD homes. https://www.amc.org.au/wp-content/uploads/2022/08/Criteria-for-AMC-Accreditation-of-CPD-Homes-August-2022.pdf

Badham, R., & Santiago, B. (2023). Ironies of organizational change: Introduction to change management and organizational theory. Edward Elgar Publishing. https://doi.org/10.4337/9781786437723

Birkland, T. A. (2016). An introduction to the policy process: Theories, concepts, and models of public policy making (4th ed.). Taylor & Francis Group. https://doi.org/10.4324/9781315717371

Bowie, P., Bradley, N. A., & Rushmer, R. (2012). Clinical audit and quality improvement: Time for a rethink? Journal of Evaluation in Clinical Practice, 18(1), 42–48. https://doi.org/10.1111/j.1365-2753.2010.01523.x

Breen, K. J. (1999). Self-regulation of the medical profession in Australia: An update. The Australian Health Consumer, 2, 25–26.

Breen, K. J. (2014). Revalidation: What is the problem and what are the possible solutions? Medical Journal of Australia, 200(3), 153–156. https://doi.org/10.5694/mja13.11261

Brown, C., Belfield, C., & Field, S. (2002). Cost effectiveness of continuing professional development in health care: A critical review of the evidence. British Medical Journal, 324(7338), 652–655. https://doi.org/10.1136/bmj.324.7338.652

Bucalon, B., Shaw, T., Brown, K., & Kay, J. (2022). State-of-the-art dashboards on clinical indicator data to support reflection on practice: Scoping review. JMIR Medical Informatics, 10(2), Article e32695. https://doi.org/10.2196/32695

Bucalon, B., Whitelock-Wainwright, E., Williams, C., Conley, J., Veysey, M., Kay, J., & Shaw, T. (2023). Thought leader perspectives on the benefits, barriers, and enablers for routinely collected electronic health data to support professional development: Qualitative study. Journal of Medical Internet Research, 25, Article e40685. https://doi.org/10.2196/40685

Campbell, C., & Sisler, J. (2019). Supporting learning and continuous practice improvement for physicians in Canada: A new way forward. Summary report of the future of medical education in Canada (FMEC CPD) Project. https://www.cpdcoalition.ca/wp-content/uploads/2021/01/FMEC-CPD_Synthesized_EN_WEB.pdf

Cook, D. A., Blachman, M. J., Price, D. W., West, C. P., Thomas, B. L. B., Berger, R. A., & Wittich, C. M. (2018). Educational technologies for physician continuous professional development: A national survey. Academic Medicine, 93(1), 104–112. https://doi.org/10.1097/ACM.0000000000001817

Cook, D. A., Stephenson, C. R., Wilkinson, J. M., Maloney, S., Baasch Thomas, B. L., Prokop, L. J., & Foo, J. (2022). Costs and economic impacts of physician continuous professional development: A systematic scoping review. Academic Medicine, 97(1), 152–161. https://doi.org/10.1097/ACM.0000000000004370

Davis, D. A., & McMahon, G. T. (2018). Translating evidence into practice: Lessons for CPD. Medical Teacher, 40(9), 892–895. https://doi.org/10.1080/0142159X.2018.1481285

de la Croix, A., & Veen, M. (2018). The reflective zombie: Problematizing the conceptual framework of reflection in medical education. Perspectives on Medical Education, 7(6), 394–400. https://doi.org/10.1007/s40037-018-0479-9

Ellaway, R. H., Pusic, M. V., Galbraith, R. M., & Cameron, T. (2014). Developing the role of big data and analytics in health professional education. Medical Teacher, 36(3), 216–222. https://doi.org/10.3109/0142159X.2014.874553

Fereday, J., & Muir-Cochrane, E. (2006). Demonstrating rigor using thematic analysis: A hybrid approach of inductive and deductive coding and theme development. International Journal of Qualitative Methods, 5(1), 80–92. https://doi.org/10.1177/160940690600500107

Ferguson, J., Wakeling, J., & Bowie, P. (2014). Factors influencing the effectiveness of multisource feedback in improving the professional practice of medical doctors: A systematic review. BMC Medical Education, 14, Article 17. https://doi.org/10.1186/1472-6920-14-76

Geffen, L. (2014). A brief history of medical education and training in Australia. The Medical Journal of Australia, 201(Suppl. 1), 19–22. https://doi.org/10.5694/mja14.00118

General Medical Council (GMC). (2012). Continuing professional development: Guidance for all doctors. https://www.gmc-uk.org/-/media/documents/cpd-guidance-for-all-doctors-0316_pdf-56438625.pdf

Germov, J. (2018). Challenges to medical dominance. In J. Germov (Ed.), Second opinion: An introduction to health sociology (6th ed., pp. 478–503). Oxford University Press.

Golden, S. H., Hager, D., Gould, L. J., Mathioudakis, N., & Pronovost, P. J. (2017). A gap analysis needs assessment tool to drive a care delivery and research agenda for integration of care and sharing of best practices across a health system. Joint Commission Journal on Quality and Patient Safety, 43(1), 18–28. https://doi.org/10.1016/j.jcjq.2016.10.004

Hakim, C. (2000). Research design: Successful designs for social and economic research (2nd ed.). Routledge. https://doi.org/10.4324/9780203354971

Handfield-Jones, R. S., Mann, K. V., Challis, M. E., Hobma, S. O., Klass, D. J., McManus, I. C., Paget, N. S., Parboosingh, I. J., Wade, W. B., & Wilkinson, T. J. (2002). Linking assessment to learning: A new route to quality assurance in medical practice. Medical Education, 36(10), 949–958. https://doi.org/10.1046/j.1365-2923.2002.01315.x

Hanlon, H. R., Prihodova, L., Hoey, H., Russell, T., Donegan, D., & O’Shaughnessy, A. (2021). Attitudes, perceived benefits, and experiences of engagement with professional competence schemes for doctors in Ireland: Findings from a national survey. Journal of Continuing Education in the Health Professions, 41(3), 176–184. https://doi.org/10.1097/CEH.0000000000000338

Hosseini, S., Allen, L., Khalid, F., Li, D., Stellrecht, E., Howard, M., & Chan, T. M. (2023). Evaluation of continuing professional development for physicians. Time for change: A scoping review. Perspectives on Medical Education, 12(1), 198–207. https://doi.org/10.5334/pme.838

Janssen, A., Kay, J., Talic, S., Pusic, M., Birnbaum, R. J., Cavalcanti, R., Gasevic, D., & Shaw, T. (2023). Electronic health records that support health professional reflective practice: A missed opportunity in digital health. Journal of Healthcare Informatics Research. https://doi.org/10.1007/s41666-022-00123-0

Khan, A., Huque, R., Shah, S. K., Kaur, J., Baral, S., Gupta, P. C., Cherukupalli, R., Sheikh, A., Selvaraj, S., Nargis, N., Cameron, I., & Siddiqi, K. (2014). Smokeless tobacco control policies in South Asia: A gap analysis and recommendations. Nicotine and Tobacco Research, 16(6), 890–894. https://doi.org/10.1093/ntr/ntu020

Kim, S., & Ji, Y. (2018). Gap analysis. In R. L. Heath & W. Johansen (Eds.), The international encyclopedia of strategic communication (pp. 1–6). JohnWiley & Sons. https://doi.org/10.1002/9781119010722.iesc0079

Kitto, S. (2021). The importance of proactive and strategic technology-enhanced continuing professional development. Journal of Continuing Education in the Health Professions, 41(1), 3–4. https://doi.org/10.1097/CEH.0000000000000343

Mackee, N. (2014). Revalidation: Do we need it? InSight Plus. https://insightplus.mja.com.au/2014/5/revalidation-do-we-need-it/

Malatesta International. (2019). Evaluation of the regular practice review programme: Final evaluation report. https://www.mcnz.org.nz/assets/Publications/Reports/a185d7b752/Evaluation-of-RPR-final-report-August-2019.pdf

Mazmanian, P. E., Cervero, R. M., & Durning, S. J. (2021). Reimagining physician development and lifelong learning: An ecological framework. Journal of Continuing Education in the Health Professions, 41(4), 291–298. https://doi.org/10.1097/CEH.0000000000000406

McAteer, J., Di Ruggiero, E., Fraser, A., & Frank, J. W. (2019). Bridging the academic and practice/policy gap in public health: Perspectives from Scotland and Canada. Journal of Public Health (Oxford, England), 41(3), 632–637. https://doi.org/10.1093/pubmed/fdy127

McIntosh, M. J., & Morse, J. M. (2015). Situating and constructing diversity in semi-structured interviews. Global Qualitative Nursing Research, 2. https://doi.org/10.1177/2333393615597674

Medical Board of Australia (MBA). (2010). Registration standard: Continuing professional development 2010. https://www.ahpra.gov.au/documents/default.aspx?record=WD18%2f25066&dbid=AP&chksum=9qt5SQGuxMQBuUp1zkdvcw%3d%3d&_gl=1*pv2k4d*_ga*MzgwMzQ1NjU3LjE3MTIwMzE5NTY.*_ga_F1G6LRCHZB*MTcyNDM1Mzc4NC45LjEuMTcyNDM1NDExMC4wLjAuMA

Medical Board of Australia (MBA). (2016a). Medical board consults on revalidation in Australia. https://www.medicalboard.gov.au/news/2016-08-16-revalidation.aspx

Medical Board of Australia (MBA). (2016b). Medical practitioners’ ongoing fitness and competence to practise: A report of social research into community and doctors’ views about trust, confidence and fitness to practise in the medical profession. https://apo.org.au/sites/default/files/resource-files/2016-11/apo-nid70905.pdf

Medical Board of Australia (MBA). (2016c). Registration standard: Continuing professional development. https://www.medicalboard.gov.au/documents/default.aspx?record=WD10%2F101&dbid=AP&chksum=Nx18OyXfwajDAfAm%2FQQNNQ%3D%3D

Medical Board of Australia (MBA). (2017a). Building a professional performance framework. 2017. https://www.medicalboard.gov.au/Professional-Performance-Framework.aspx

Medical Board of Australia (MBA). (2017b). Expert advisory group on revalidation: Final report. 2017. https://www.medicalboard.gov.au/documents/default.aspx?record=WD17%2F24295&dbid=AP&chksum=Txmn8C7v%2BC53Wjsz3sXn2w%3D%3D

Medical Board of Australia (MBA). (2017c). Pillars of the professional performance framework. https://www.medicalboard.gov.au/documents/default.aspx?record=WD17%2F24291&dbid=AP&chksum=zSfKFl17NXByCA6aNmq9sA%3D%3D

Medical Board of Australia (MBA). (2019). Public consultation: Draft revised registration standard: Continuing professional development. https://www.medicalboard.gov.au/News/Past-Consultations/Consultations-February-2020.aspx

Medical Board of Australia (MBA). (2021). Registration standard: Continuing professional development. https://www.ahpra.gov.au/documents/default.aspx?record=WD21%2F31046&dbid=AP&chksum=TqPI98CYQYllvPkGwiAz%2Fw%3D%3D

Medical Council of New Zealand. (2019). Strengthened recertification requirements for vocationally registered doctors. https://www.mcnz.org.nz/assets/Publications/Booklets/f7d4bc7fff/Strengthened-recertification-requirements-for-vocationally-registered-doctors-November-2019.pdf

Overeem, K., Faber, M. J., Arah, O. A., Elwyn, G., Lombarts, K. M. J. M. H., Wollersheim, H. C., & Grol, R. P. T. M. (2007). Doctor performance assessment in daily practise: Does it help doctors or not? A systematic review. Medical Education, 41(11), 1039–1049. https://doi.org/10.1111/j.1365-2923.2007.02897.x

Pantaleon, L. (2019). Why measuring outcomes is important in health care. Journal of Veterinary Internal Medicine, 33(2), 356–362. https://doi.org/10.1111/jvim.15458

Pizzuti, C., Palmieri, C., & Shaw, T. (n.d.). The role of medical regulations and medical regulators in fostering the use of eHealth data for strengthened continuing professional development (CPD): A document analysis with key informants’ interviews [Manuscript submitted for publication].

Pizzuti, C., Palmieri, C., & Shaw, T. (2023). Using eHealth data to inform CPD for medical practitioners: A scoping review with a consultation exercise with international experts. Journal of Continuing Education in the Health Professions, 43(4), S47–S58. https://doi.org/10.1097/CEH.0000000000000534

Pusic, M. V., Birnbaum, R. J., Thoma, B., Hamstra, S. J., Cavalcanti, R. B., Warm, E. J., Janssen, A., & Shaw, T. (2023). Frameworks for integrating learning analytics with the electronic health record. Journal of Continuing Education in the Health Professions, 43(1), 52–59. https://doi.org/10.1097/CEH.0000000000000444

Ritchie, J., & Spencer, L. (2002). Qualitative data analysis for applied policy research. In A. Humerman & M. Miles (Eds.), The qualitative researcher’s companion (pp. 305–329). SAGE Publications. https://doi.org/10.4135/9781412986274

Roberts, L. J. (2015). Revalidation: Implications for Australian anaesthetists. Anaesthesia and Intensive Care, 43(5), 652–661. https://doi.org/10.1177/0310057x1504300516

The Royal Australian College of General Practitioners (RACGP). (n.d.). Continuing professional development standards. https://www.racgp.org.au/getattachment/dd0a87c7-338f-424c-a24f-e542d493ee2a/Continuing-professional-development-CPD-Standards.aspx

The Royal Australian and New Zealand College of Psychiatrists (RANZCP). (n.d.). 2023 CPD program guide & requirements. https://www.ranzcp.org/cpd-program-membership/cpd-program/program-guide-requirements

The Royal Australasian College of Physician (RACP). (2024). 2023 MyCPD framework. Retrieved October 3, 2023, from https://www.racp.edu.au/fellows/continuing-professional-development/2024-mycpd-framework

The Royal Australasian College of Surgeons (RACS). (n.d.). Continuing professional development guide. Retrieved October 3, 2023, from https://www.surgeons.org/-/media/CPD/racs-cpd-guide-2022.pdf?rev=3b2e66754c2d409a9e60973471ec21ae&hash=4E55D89006EEB8ED6D5AFB225D9CF747

Scott, K. M., Baur, L., & Barrett, J. (2017). Evidence-based principles for using technology-enhanced learning in the continuing professional development of health professionals. Journal of Continuing Education in the Health Professions, 37(1), 61–66. https://doi.org/10.1097/CEH.0000000000000146

Seigel, J., Whalen, L., Burgess, E., Joyner, B. L., Purdy, A., Saunders, R., Munn, L. T., Yip, T., & Willis, T. S. (2014). Successful implementation of standardized multidisciplinary bedside rounds, including daily goals, in a pediatric ICU. Joint Commission Journal on Quality and Patient Safety, 40(2), 83–90. https://doi.org/10.1016/s1553-7250(14)40010-2

Shaw, T., Janssen, A., Crampton, R., O’Leary, F., Hoyle, P., Jones, A., Shetty, A., Gunja, N., Ritchie, A. G., Spallek, H., Solman, A., Kay, J., Makeham, M. A. B., & Harnett, P. (2019). Attitudes of health professionals to using routinely collected clinical data for performance feedback and personalised professional development. Medical Journal of Australia, 210(S6), S17–S21. https://doi.org/10.5694/mja2.50022

Silvestro, R. (2005). Applying gap analysis in the health service to inform the service improvement agenda. International Journal of Quality & Reliability Management, 22(3), 215–233. https://doi.org/10.1108/02656710510582462

Sockalingam, S., Tavares, W., Charow, R., Youssef, A., Campbell, C., Davis, D., Giuliani, M., Okrainec, A., Papadakos, J., Silver, I., & Wiljer, D. (2019). Examining associations between physician data utilization for practice improvement and lifelong learning. Journal of Continuing Education in the Health Professions, 39(4), 236–242. https://doi.org/10.1097/CEH.0000000000000268

Springer, J., Haas, P., & Porowski, A. (2017). Applied policy research: Concepts and cases (2nd ed.). Routledge. https://doi.org/10.4324/9780203873496

Srinivasan, U., Ramachandran, D., Quilty, C., Rao, S., Nolan, M., & Jonas, D. (2018). Flying blind: Australian researchers and digital health, Volume 2: Health data series. https://nla.gov.au/nla.obj-890484453/view

Stevens, S., Read, J., Baines, R., Chatterjee, A., & Archer, J. (2018). Validation of multisource feedback in assessing medical performance: A systematic review. Journal of Continuing Education in the Health Professions, 38(4), 262–268. https://doi.org/10.1097/CEH.0000000000000219

Swain, J. (2018). A hybrid approach to thematic analysis in qualitative research: Using a practical example. https://doi.org/10.4135/9781526435477

Tavares, W., Sockalingam, S., Valanci, S., Giuliani, M., Campbell, C., Silver, I., Charow, R., Jeyakumar, T., & Wiljer, D. (2023). Performance data advocacy for continuing professional development in health professions. Academic Medicine, 99(2), 153–158. https://doi.org/10.1097/ACM.0000000000005490

Thoma, B., Warm, E., Hamstra, S. J., Cavalcanti, R., Pusic, M., Shaw, T., Verma, A., Frank, J. R., & Hauer, K. E. (2020). Next steps in the implementation of learning analytics in medical education: Consensus from an international cohort of medical educators. Journal of Graduate Medical Education, 12(3), 303–311. https://doi.org/10.4300/JGME-D-19-00493.1

Tong, A., Sainsbury, P., & Craig, J. (2007). Consolidated criteria for reporting qualitative research (COREQ): A 32-item checklist for interviews and focus groups. International Journal for Quality in Health Care, 19(6), 349–357. https://doi.org/10.1093/intqhc/mzm042

Trebble, T. M., Carder, C., Maureen, P., Walmsley, E., Jones, R., Hockey, P., & Clarke, N. (2015). Determining doctors’ views on performance measurement and management of their clinical practice. Future Hospital Journal, 2(3), 171–172. https://doi.org/10.7861/futurehosp.2-3-171

Tsang, J. Y., Peek, N., Buchan, I., Van Der Veer, S. N., & Brown, B. (2022). Systematic review and narrative synthesis of computerized audit and feedback systems in healthcare. Journal of the American Medical Informatics Association, 29(6), 1106–1119. https://doi.org/10.1093/jamia/ocac031

Vreugdenburg, T. D., Forel, D., Marlow, N., Maddern, G. J., Quinn, J., Lander, R., & Tobin, S. (2018). Morbidity and mortality meetings: Gold, silver or bronze? ANZ Journal of Surgery, 88(10), 966–974. https://doi.org/10.1111/ans.14380

Wang, X., Birch, S., Zhu, W., Ma, H., Embrett, M., & Meng, Q. (2016). Coordination of care in the Chinese health care systems: A gap analysis of service delivery from a provider perspective. BMC Health Services Research, 16, Article 571. https://doi.org/10.1186/s12913-016-1813-8

Wiese, A., Galvin, E., Korotchikova, I., & Bennett, D. (2022). Doctors’ attitudes to maintenance of professional competence: A scoping review. Medical Education, 56(4), 374–386. https://doi.org/10.1111/medu.14678

Wiljer, D., Tavares, W., Charow, R., Williams, S., Campbell, C., Davis, D., Jeyakumar, T., Mylopoulos, M., Okrainec, A., Silver, I., & Sockalingam, S. (2022). A qualitative study to understand the cultural factors that influence clinical data use for continuing professional development. Journal of Continuing Education in the Health Professions, 43(1), 34–41. https://doi.org/10.1097/ceh.0000000000000423

Wiljer, D., Williams, S., Charow, R., Campbell, C., Davis, D., Younus, S., Mylopoulos, M., Okrainec, A., Silver, I., Tavares, W., & Sockalingam, S. (2022). Exploring systemic influences on data-informed learning: Document review of policies, procedures, and legislation from Canada and the United States. Journal of Continuing Education in the Health Professions, 42(3), 219–223. https://doi.org/10.1097/CEH.0000000000000424

Yam, C. H. K., Griffiths, S. M., Liu, S., Wong, E. L. Y., Chung, V. C. H., & Yeoh, E. K. (2016). Medical regulation: Ten key trends emerging from an international review. Journal of Medical Regulation, 102(1), 16–27. https://doi.org/10.30770/2572-1852-102.1.16