Evaluation of a Canadian Post-Licensure Educational Program for Registered Nurses in Primary Care: A Mixed-Methods Study Protocol
Main Article Content
Abstract
Objectives: 1) To assess the impacts of the educational program on RNs’ learning outcomes, professional practices, and interprofessional collaboration. 2) To evaluate implementation by identifying factors that support or hinder the successful deployment in primary care settings in Canadian provinces.
Methods: A mixed-methods evaluation guided by the RE-AIM Framework, Eco-Normalization Theory, and the New World Kirkpatrick Model will be conducted. Three populations will be involved: RNs in primary care, facilitators supporting learners, and administrators or managers engaged in implementation. Quantitative data will be collected via online demographic and pre-and post-training questionnaires. Qualitative data will be obtained through open-ended questions, semi-structured interviews and the research team’s logbook. Data integration will examine interactions between the program, RNs and primary care settings.
Discussion and Research Spin-offs: This national-scale educational program is the first in Canada designed specifically for RNs practising in primary care. A rigorous evaluation of its implementation across diverse organizational models will improve understanding of its mechanisms and impacts. Findings will contribute critical insights to strengthen the RNs’ role in primary care and support a sustainable transformation of their practice.
Article Details
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors hold the copyright on their papers without restrictions and retain it without restrictions after publication of the papers on the journal’s website.
References
Allen, M. (Ed.). (2017). The SAGE encyclopedia of communication research methods. SAGE Publications.
Barrett, C., Mathews, M., Poitras, M. E., Norful, A. A., Martin-Misener, R., Tranmer, J., Ryan, D., & Lukewich, J. (2021). Job titles and education requirements of registered nurses in primary care: An international document analysis. International journal of nursing studies advances, 3, 100044. https://doi.org/10.1016/j.ijnsa.2021.100044
Ben Charif, A., Zomahoun, H. T. V., LeBlanc, A., Langlois, L., Wolfenden, L., Yoong, S. L., Williams, C. M., Lépine, R., & Légaré, F. (2017). Effective strategies for scaling up evidence-based practices in primary care: a systematic review. Implementation science : IS, 12, 139. https://doi.org/10.1186/s13012-017-0672-y
Breton, M., Marshall, E. G., Deslauriers, V., Smithman, M. A., Moritz, L. R., Buote, R., Morrison, B., Christian, E. K., McKay, M., Stringer, K., Godard-Sebillotte, C., Sourial, N., Laberge, M., MacKenzie, A., Isenor, J. E., Duhoux, A., Ashcroft, R., Mathews, M., Cossette, B., Hudon, C., … Green, M. E. (2022). COVID-19 - an opportunity to improve access to primary care through organizational innovations? A qualitative multiple case study in Quebec and Nova Scotia (Canada). BMC health services research, 22(1), 759. https://doi.org/10.1186/s12913-022-08140-w
Brzozowski, S. L., King, B., & Steege, L. M. (2023). Nurses’ perception of identity, practice and support needed in primary care: A descriptive qualitative study. Journal of advanced nursing, 79(9), 3337–3350. https://doi.org/10.1111/jan.15640
Calder, S., Tomczyk, B., Cussen, M. E., Hansen, G. J., Hansen, T. J., Jensen, J., Mossin, P., Andersen, B., Rasmussen, C. O., & Schliemann, P. (2022). A Framework for Standardizing Emergency Nursing Education and Training Across a Regional Health Care System: Programming, Planning, and Development via International Collaboration. Journal of emergency nursing, 48(1), 104–116. https://doi.org/10.1016/j.jen.2021.08.006
Calma, K. R. B., Halcomb, E., & Stephens, M. (2019). The impact of curriculum on nursing students’ attitudes, perceptions and preparedness to work in primary health care: An integrative review. Nurse education in practice, 39, 1–10. https://doi.org/10.1016/j.nepr.2019.07.006
Canadian Family Practice Nurses Association. (2019, December). National Competencies for Registered Nurses in Primary Care. https/www.cfpna.ca/
Canadian Institute for Health Information. (2021). How Canada Compares: Results From the Commonwealth Fund’s 2020 International Health Policy Survey of the General Population in 11 Countries — Methodology Notes. https://www.cihi.ca/sites/default/files/document/how-canada-compares-cmwf-survey-2020-meth-note-en.pdf
Canadian Nurses Association. (2022). Nursing statistics. https://www.cna-aiic.ca/en/nursing/regulated-nursing-in-canada/nursing-statistics
Carrier, A., Beaudoin, M., Éthier, A., & Bédard, D. (2025). Agir en tant qu’agent de changement : effets longitudinaux d’une formation sur mesure visant à développer les compétences des professionnelles des services sociaux et de santé. Canadian Medical Education Journal / Revue canadienne de l’éducation médicale, 16(4), 28–33. https://doi.org/10.36834/cmej.80292
Cohen, J. (1988). Statistical Power Analysis for the Behavioral Sciences (2nd ed.). Lawrence Erlbaum Associates.
College of Family Physicians of Canada. (2019). A new vision for Canada: Family Practice-The Patient’s Medical Home. https://patientsmedicalhome.ca/files/uploads/PMH_VISION2019_ENG_WEB_2.pdf
Creswell, J. W., & Plano Clark, V. L. (2018). Designing and Conducting Mixed Methods Research (3rd ed.). Sage Plublications.
Drummond, D., Sinclair, D., & Gratton, J. (2022, November 2). Troubles in Canada’s Health Workforce: The why, the Where, and the Way Out of Shortages. The C.D. Howe Institute. https://www.cdhowe.org/sites/default/files/2022-11/Commentary%20630.pdf
Ebrahimi, H., Mohammadi Hosseini, F., Amirnia, M., Mehraee, A., Jamali, V., & Hejazi, S. A. (2012). Factors influencing nurses’ participation in continuing education programs in Tabriz University of Medical Sciences. Iranian Journal of Medical Education, 12(7), 518–526.
Fetters, M. D. (2020). The Mixed Methods Research Workbook: Activities for Designing, Implementing, and Publishing Projects. SAGE Publications.
Flaubert, J. L., Le Menestrel, S., Williams, D. R., Wakefield, M. K., National Academies of Sciences, E., & Medicine. (2021). Supporting the Health and Professional Well-Being of Nurses. In The Future of Nursing 2020-2030: Charting a Path to Achieve Health Equity. National Academies Press.
Flood, C. M., Thomas, B., & McGibbon, E. (2023). Canada’s primary care crisis: Federal government response. Healthcare Management Forum, 36(5), 327–332. https://doi.org/10.1177/08404704231183863
Fortin, M., Contant, E., Savard, C., Hudon, C., Poitras, M. E., & Almirall, J. (2011). Canadian guidelines for clinical practice: an analysis of their quality and relevance to the care of adults with comorbidity. BMC family practice, 12, 74. https://doi.org/10.1186/1471-2296-12-74
Freund, T., Everett, C., Griffiths, P., Hudon, C., Naccarella, L., & Laurant, M. (2015). Skill mix, roles and remuneration in the primary care workforce: who are the healthcare professionals in the primary care teams across the world?. International journal of nursing studies, 52(3), 727–743. https://doi.org/10.1016/j.ijnurstu.2014.11.014
Girden E. R. (1991). ANOVA Repeated Measures (Vol. 84). SAGE Publications.
Glasgow, R. E., & Estabrooks, P. E. (2018). Pragmatic Applications of RE-AIM for Health Care Initiatives in Community and Clinical Settings. Preventing chronic disease, 15, E02. https://doi.org/10.5888/pcd15.170271
Glasgow, R. E., Klesges, L. M., Dzewaltowski, D. A., Estabrooks, P. A., & Vogt, T. M. (2006). Evaluating the impact of health promotion programs: using the RE-AIM framework to form summary measures for decision making involving complex issues. Health Education Research, 21(5), 688–694. https://doi.org/10.1093/her/cyl081
Glasgow, R. E., McKay, H. G., Piette, J. D., & Reynolds, K. D. (2001). The RE-AIM framework for evaluating interventions: what can it tell us about approaches to chronic illness management?. Patient education and counseling, 44(2), 119–127. https://doi.org/10.1016/s0738-3991(00)00186-5
Graham, I. D., Logan, J., Harrison, M. B., Straus, S. E., Tetroe, J., Caswell, W., & Robinson, N. (2006). Lost in knowledge translation: time for a map?. The Journal of continuing education in the health professions, 26(1), 13–24. https://doi.org/10.1002/chp.47
Guest, G., Namey, E. E., & Mitchell, M. L. (2013). Collecting Qualitative Data: A Field Manual for Applied Research. SAGE Publications.
Halcomb, E., Bird, S., Mcinnes, S., Ashley, C., & Huckel, K. (2021). Exploring job satisfaction and turnover intentions among general practice nurses in an Australian Primary Health Network. Journal of nursing management, 29(5), 943–952. https://doi.org/10.1111/jonm.13230
Halcomb, E., Stephens, M., Bryce, J., Foley, E., & Ashley, C. (2016). Nursing competency standards in primary health care: an integrative review. Journal of clinical nursing, 25(9-10), 1193–1205. https://doi.org/10.1111/jocn.13224
Hamza, D. M., & Regehr, G. (2021). Eco-Normalization: Evaluating the Longevity of an Innovation in Context. Academic medicine : journal of the Association of American Medical Colleges, 96(11S), S48–S53. https://doi.org/10.1097/ACM.0000000000004318
Harlan, M. D., Rosenzweig, M. Q., & Hoffmann, R. L. (2021). Preferred Teaching/Learning Strategies for Graduate Nursing Students in Web-Enhanced Courses. Dimensions of critical care nursing : DCCN, 40(3), 149–155. https://doi.org/10.1097/DCC.0000000000000469
Huybrecht, S., Loeckx, W., Quaeyhaegens, Y., De Tobel, D., & Mistiaen, W. (2011). Mentoring in nursing education: Perceived characteristics of mentors and the consequences of mentorship. Nurse education today, 31(3), 274–278. https://doi.org/10.1016/j.nedt.2010.10.022
Kirkpatrick J., D., & Kirkpatrick W., K. (2016). Kirkpatrick’s Four Levels of Training Evaluation (1st ed.). Association for Talent Development.
La Duke, P. (2017). How to Evaluate Training: Using the Kirkpatrick Model. Professional safety, 62(8), 20–21.
Loan, L. A., Parnell, T. A., Stichler, J. F., Boyle, D. K., Allen, P., VanFosson, C. A., & Barton, A. J. (2018). Call for action: Nurses must play a critical role to enhance health literacy. Nursing Outlook, 66(1), 97–100. https://doi.org/10.1016/j.outlook.2017.11.003
Lukewich, J., Allard, M., Ashley, L., Aubrey-Bassler, K., Bryant-Lukosius, D., Klassen, T., Magee, T., Martin-Misener, R., Mathews, M., Poitras, M. E., Roussel, J., Ryan, D., Schofield, R., Tranmer, J., Valaitis, R., & Wong, S. T. (2020). National Competencies for Registered Nurses in Primary Care: A Delphi Study. Western journal of nursing research, 42(12), 1078–1087. https://doi.org/10.1177/0193945920935590
Lukewich, J., Martin-Misener, R., Norful, A. A., Poitras, M. E., Bryant-Lukosius, D., Asghari, S., Marshall, E. G., Mathews, M., Swab, M., Ryan, D., & Tranmer, J. (2022). Effectiveness of registered nurses on patient outcomes in primary care: a systematic review. BMC health services research, 22(1), 740. https://doi.org/10.1186/s12913-022-07866-x
Lukewich, J., Mathews, M., Poitras, M. E., Tranmer, J., Martin-Misener, R., Bryant-Lukosius, D., Aubrey-Bassler, K., Klassen, T., Curnew, D., Bulman, D., Leamon, T., & Ryan, D. (2023). Primary care nursing competencies in Canadian undergraduate nursing programs: A national cross-sectional survey. Nurse education in practice, 71, 103738. https://doi.org/10.1016/j.nepr.2023.103738
Lukewich, J., Poitras, M.-E., & Mathews, M. (2021). Unseen, unheard, undervalued: advancing research on registered nurses in primary care. Practice Nursing, 32(4), 158–162. https://doi.org/10.12968/pnur.2021.32.4.158
Lukewich, J., Poitras, M.-E., Vaughan, C., Ryan, D., Guérin, M., Bulman, D., Klassen, T., Devey-Burry, R., McGraw, M., Curnew, D., & Epp, S. (2024). Canadian Post-licensure Education for Primary Care Nurses Addressing the Patient’s Medical Home Model and Canadian Competencies for Registered Nurses in Primary Care: An Environmental Scan. Quality Advancement in Nursing Education - Avancées en formation infirmière, 10(2), Article 8. https://doi.org/10.17483/2368-6669.1429
Lukewich, J., Taylor, S., Poitras, M. E., & Martin-Misener, R. (2018). Advancing Family Practice Nursing in Canada: An Environmental Scan of International Literature and National Efforts towards Competency Development. Nursing leadership (Toronto, Ont.), 31(2), 66–78. https://doi.org/10.12927/cjnl.2018.25602
MacLean, L., Hassmiller, S., Shaffer, F., Rohrbaugh, K., Collier, T., & Fairman, J. (2014). Scale, causes, and implications of the primary care nursing shortage. Annual review of public health, 35, 443–457. https://doi.org/10.1146/annurev-publhealth-032013-182508
Miles, M. B., Huberman, M. A., & Saldana, J. (2014). Qualitative Data Analysis: A Method Sourcebook (3rd ed.). SAGE Publications.
Mirza, N., Manankil-Rankin, L., Prentice, D., Hagerman, L.-A., & Draenos, C. (2019). Practice readiness of new nursing graduates: A concept analysis. Nurse education in practice, 37, 68–74. https://doi.org/10.1016/j.nepr.2019.04.009
Morin, A., Couturier, Y., Poirier, M. D., T. Vaillancourt, V., Massé, S., D. Tardif, A., & Poitras, M. E. (2023). The impact of patients as trainers on registered nurses’ patient engagement in primary care clinics: a qualitative study. BMC Primary Care, 24(1), 265. https://doi.org/10.1186/s12875-023-02210-6
Norful, A., Martsolf, G., de Jacq, K., & Poghosyan, L. (2017). Utilization of registered nurses in primary care teams: A systematic review. International Journal of Nursing Studies, 74, 15–23. https://doi.org/10.1016/j.ijnurstu.2017.05.013
Oelke, N. D., Besner, J., & Carter, R. (2014). The evolving role of nurses in primary care medical settings. International journal of nursing practice, 20(6), 629–635. https://doi.org/10.1111/ijn.12219
Pardeux. (2024). Pardeux [Online platform]. https://pardeux.ca
Patton, M. Q. (2010). Developmental Evaluation: Applying Complexity Concepts to Enhance Innovation and Use. Guilford Press.
Pluye, P. (2012). Les méthodes mixtes. In C. Dagenais & V. Ridde (Eds.), Approches et pratiques en évaluation de programmes (pp. 125–143). Presses de l’Université de Montréal. https://doi.org/10.4000/books.pum.5981
Pluye, P., & Grad, R. M. (2006). Cognitive impact assessment of electronic knowledge resources: a mixed methods evaluation study of a handheld prototype. AMIA ... Annual Symposium proceedings. AMIA Symposium, 2006, 634–638.
Poitras, M. E., Bélanger, E., Vaillancourt, V. T., Kienlin, S., Körner, M., Godbout, I., Bernard-Hamel, J., O’Connor, S., Blanchette, P., Khadhraoui, L., Sawadogo, J., Massougbodji, J., Zomahoun, H. T. V., Gallani, M. C., Stacey, D., & Légaré, F. (2021). Interventions to Improve Trainers’ Learning and Behaviors for Educating Health Care Professionals Using Train-the-Trainer Method: A Systematic Review and Meta-analysis. The Journal of continuing education in the health professions, 41(3), 202–209. https://doi.org/10.1097/CEH.0000000000000375
Poitras, M.-E., Chouinard, M.-C., Gallagher, F., & Fortin, M. (2018). Nursing Activities for Patients With Chronic Disease in Primary Care Settings: A Practice Analysis. Nursing research, 67(1), 35–42. https://doi.org/10.1097/NNR.0000000000000253
Poitras, M. E., Couturier, Y., Doucet, E., T Vaillancourt, V., Gauthier, G., Poirier, M. D., Massé, S., Hudon, C., Delli-Colli, N., Gagnon, D., Careau, E., Duhoux, A., Gaboury, I., Berbiche, D., Ben Charif, A., Ashcroft, R., Lukewich, J., Ramond-Roquin, A., Beaupré, P., & Morin, A. (2024). Enhanced train-the-trainer program for registered nurses and social workers to apply the founding principles of primary care in their practice: a pre-post study. BMC primary care, 25(1), 322. https://doi.org/10.1186/s12875-024-02574-3
Poitras, M.-E., Couturier, Y., Doucet, E., T. Vaillancourt, V., Poirier, M.-D., Gauthier, G., Hudon, C., Delli-Colli, N., Gagnon, D., Careau, E., Duhoux, A., Gaboury, I., Charif, A. B., Ashcroft, R., Lukewich, J., Ramond-Roquin, A., & Massé, S. (2022). Co-design, implementation, and evaluation of an expanded train-the-trainer strategy to support the sustainability of evidence-based practice guides for registered nurses and social workers in primary care clinics: a developmental evaluation protocol. BMC Primary Care, 23(1), article number 84. https://doi.org/10.1186/s12875-022-01684-0
Poitras, M. E., Lukewich, J., Klassen, T., Guérin, M., Ryan, D., Langlois, A. S., Braithwaite, S., Morin, A., Curnew, D., Vaughan, C., McGraw, M., Devey-Burry, R., Poirier, M. D., Leamon, T., Epp, S., & Bulman, D. (2024). Co-development of a national, bilingual, post-licensure accredited educational program for registered nurses in primary care: A knowledge-to-action exemplar. Healthcare management forum, 37(1_suppl), 43S–48S. https://doi.org/10.1177/08404704241259929
REDCap consortium. (2026). REDCap, version 16.1.3 [Computer software]. https://projectredcap.org
Sasseville, M., Supper, W., Gartner, J. B., Layani, G., Amil, S., Sheffield, P., Gagnon, M. P., Hudon, C., Lambert, S., Attisso, E., Bureau Lagarde, V., Breton, M., Poitras, M. E., Pluye, P., Roux-Levy, P. H., Plaisimond, J., Bergeron, F., Ashcroft, R., Wong, S., Groulx, A., … LeBlanc, A. (2023). Clinical Integration of Digital Patient-Reported Outcome Measures in Primary Health Care for Chronic Disease Management: Protocol for a Systematic Review. JMIR research protocols, 12, e48155. https://doi.org/10.2196/48155
Shahhosseini, Z., & Hamzehgardeshi, Z. (2014). The facilitators and barriers to nurses’ participation in continuing education programs: a mixed method explanatory sequential study. Global journal of health science, 7(3), 184–193. https://doi.org/10.5539/gjhs.v7n3p184
Siju, J., Orekoya, G., Vernet, E., & Anagboso, U. (2023). Developing a Standardized Method for Clinical Staff Training, Education, and Competency. Journal for Nurses in Professional Development, 39(1), 27–32. https://doi.org/10.1097/nnd.0000000000000821
Stanhope, V., Ross, A., Choy-Brown, M., & Jessell, L. (2019). A Mixed Methods Study of Organizational Readiness for Change and Leadership During a Training Initiative Within Community Mental Health Clinics. Administration and Policy in Mental Health and Mental Health Services Research, 46(5), 678–687. https://doi.org/10.1007/s10488-019-00946-x
UXPERTISE INC. (2026). uxpertise LMS [Online platform]. https://uxpertise.ca/uxpertise-lms/