Evidence of learning in workplace-based assessments in a Family Medicine Training Programme

Abstract

Background: Learning portfolios (LPs) provide evidence of workplace-based assessments (WPBAs) in clinical settings. The educational impact of LPs has been explored in high-income countries, but the use of portfolios and the types of assessments used for and of learning have not been adequately researched in sub-Saharan Africa. This study investigated the evidence of learning in registrars’ LPs and the influence of the training district and year of training on assessments. Methods: A cross-sectional study evaluated 18 Family Medicine registrars’ portfolios from study years 1–3 across five decentralised training sites affiliated with the University of the Witwatersrand. Descriptive statistics were calculated for the portfolio and quarterly assessment (QA) scores and self-reported clinical skills competence levels. The competence levels obtained from the portfolios and university records served as proxy measures for registrars’ knowledge and skills. Results: The total LP median scores ranged from 59.9 to 81.0, and QAs median scores from 61.4 to 67.3 across training years. The total LP median scores ranged from 62.1 to 83.5 and 62.0 to 67.5, respectively in QAs across training districts. Registrars’ competence levels across skill sets did not meet the required standards. Higher skills competence levels were reported in the women’s health, child health, emergency care, clinical administration and teaching and learning domains. Conclusion: The training district and training year influence workplace-based assessment (WPBA) effectiveness. Ongoing faculty development and registrar support are essential for WPBA. Contribution: This study contributes to the ongoing discussion of how to utilise WPBA in resource-constrained sub-Saharan settings. © 2024. The Authors.

Keywords

Author Keywords

work-based learning Family Medicine assessment for learning assessment of learning family physician formative assessments learning portfolio workplace-based assessments

Index Keywords

Teaching learning training adult clinical competence cross-sectional study female human male procedures Cross-Sectional Studies Humans Article workplace education general practice scoring system Competence Educational Measurement self report high income country South Africa Orthopedics emergency care clinical effectiveness Family Practice family medicine child health palliative therapy health care quality primary health care anesthetic agent forensic science health care facility women's health workplace based assessment

Author Affiliations

Department of Family Medicine and Primary Care, University of the Witwatersrand Faculty of Health Sciences, Johannesburg, Gauteng, South Africa, Gauteng Department of Health, Ekurhuleni District Health Services, Germiston, South Africa

Centre for Health Science Education, University of the Witwatersrand Faculty of Health Sciences, Johannesburg, Gauteng, South Africa

Division of Family Medicine and Primary Care, Stellenbosch University, Faculty of Medicine and Health Sciences, Cape Town, Western Cape, South Africa, Provincial Government of Western Cape Department of Health, South Africa, Department of Family Medicine, Faculty of Health Sciences, University of Cape Town, Cape Town, Western Cape, South Africa

Funding & Acknowledgements

University of the Witwatersrand, Johannesburg

Funding text 1: This research work is supported by the Faculty Research Committee Individual Research Grants 2021, University of the Witwatersrand.; Funding text 2: This work is based on the research supported in part by the National Research Foundation of South Africa for the grant, Unique Grant No 122003.

National Research Foundation, NRF

Grant: 122003

Funding text 1: This research work is supported by the Faculty Research Committee Individual Research Grants 2021, University of the Witwatersrand.; Funding text 2: This work is based on the research supported in part by the National Research Foundation of South Africa for the grant, Unique Grant No 122003.

National Research Foundation, NRF

Funding text 1: This research work is supported by the Faculty Research Committee Individual Research Grants 2021, University of the Witwatersrand.; Funding text 2: This work is based on the research supported in part by the National Research Foundation of South Africa for the grant, Unique Grant No 122003.

References 10 References

1 Transforming and Scaling Up Health Professionals Education and Training World Health Organisation Guidelines 2013 Homepage on the Internet

2 Defining and Measuring the Social Accountability of Medical Schools, (1995)

3 Kenwright, Diane N., Quality in medical education, Understanding Medical Education: Evidence, Theory, and Practice, pp. 101-110, (2018)

4 David, M. Friedman Ben, AMEE medical education guide no. 24: Portfolios as a method of student assessment, Medical Teacher, 23, 6, pp. 535-551, (2001)

5 Van Der Vleuten, Cees P.M., Programmatic assessment: the process, rationale and evidence for modern evaluation approaches in medical education, Medical Journal of Australia, 209, 9, pp. 386-388, (2018)

6 Morris, Clare S., Work-based learning, Understanding Medical Education: Evidence, Theory, and Practice, pp. 163-177, (2018)

7 Wood, Diana F., Formative assessment: Assessment for learning, Understanding Medical Education: Evidence, Theory, and Practice, pp. 361-373, (2018)

8 Klenowski, Val, Assessment for Learning revisited: An Asia-Pacific perspective, Assessment in Education: Principles, Policy and Practice, 16, 3, pp. 263-268, (2009)

9 Mahan Kulasegaram, Kulamakan Mahan, Beyond "formative": Assessments to enrich student learning, Advances in Physiology Education, 42, 1, pp. 5-14, (2018)

10 Essential Handbook for GP Training and Education, (2013)

Evidence of learning in workplace-based assessments in a Family Medicine Training Programme

How to Cite