Procedure-based assessment implementation in colorectal surgery: a scoping review

Abstract

Background: Competency-based training (CBT) programs use procedure-based assessments (PBAs) to evaluate trainees' abilities to perform specific procedures in clinical settings, similar to Entrustable Professional Activities (EPAs). PBAs help determine trainees' readiness for advanced training levels. However, there is limited evidence on implementing colorectal-specific PBAs in surgical training schemes. This review aims to identify observed and perceived challenges to implementing PBAs in workplace settings. Methods: A scoping review following the Joanna Briggs Institute Protocol for Scoping Reviews (JBI-ScR) was conducted. Eligible studies provided evidence on the implementation, feasibility, and challenges of PBAs in colorectal surgery, including various study designs from retrospective to prospective. Results: Of the 80 screened studies, 75 were excluded based on exclusion criteria. Most of the included studies were conducted in national training institutions in the United Kingdom, assessing 778 colorectal procedures with specific PBAs. The main facilitators of implementing PBAs were structured assessments, focused assessors' training, and electronic forms usage. Conclusion: This review offers insight into the practicality and feasibility of implementing PBAs in colorectal surgery. Identified challenges include the need for adequate assessor training and the time-consuming nature of the assessment. These findings could improve PBA implementation in colorectal surgery and enhance surgical education quality. However, the limited number of studies and existing literature heterogeneity call for more research to identify other gaps. © 2023 The Authors. ANZ Journal of Surgery published by John Wiley & Sons Australia, Ltd on behalf of Royal Australasian College of Surgeons.

Keywords

Author Keywords

implementation colorectal surgery feasibility competency-based education procedure-based assessment

Index Keywords

clinical competence human Humans workplace education prospective study Prospective Studies retrospective study Retrospective Studies colorectal surgery colorectal tumor Colorectal Neoplasms

Author Affiliations

Faculty of Medicine and Health, Sydney, NSW, Australia, Royal Prince Alfred Hospital, Sydney, NSW, Australia

Faculty of Medicine and Health, Sydney, NSW, Australia, Department of Colorectal Surgery, Northern Hospital, Melbourne, VIC, Australia

Faculty of Medicine and Health, Sydney, NSW, Australia, University of Kansas School of Medicine - Wichita, Wichita, KS, United States

Funding & Acknowledgements

University of Sydney, USYD

Open access publishing facilitated by The University of Sydney as part of the Wiley – The University of Sydney agreement via the Council of Australian University Librarians. Open access publishing facilitated by The University of Sydney, as part of the Wiley - The University of Sydney agreement via the Council of Australian University Librarians.

References 11 References

1 Franzese, Christine B., The Evolution of Surgical Training: Perspectives on Educational Models from the Past to the Future, Otolaryngologic Clinics of North America, 40, 6, pp. 1227-1235, (2007)

2 Robinson, James O., The Barber-Surgeons of London, Archives of Surgery, 119, 10, pp. 1171-1175, (1984)

3 Bhatti, Nasir I., Viewpoint: Competency in surgical residency training: Defining and raising the bar, Academic Medicine, 82, 6, pp. 569-573, (2007)

4 ten Cate, Olle Th J., Competency-based medical education and its competency frameworks, Technical and Vocational Education and Training, 23, pp. 903-929, (2017)

5 Mayne, Alistair Ivan William, The Usefulness of Procedure-Based Assessments in Postgraduate Surgical Training Within the Intercollegiate Surgical Curriculum Programme

6 A Scoping Review, Journal of Surgical Education, 77, 5, pp. 1227-1235, (2020)

7 Foster, Jake D., Objective assessment of technique in laparoscopic colorectal surgery: What are the existing tools?, Techniques in Coloproctology, 19, 1, pp. 1-4, (2015)

8 Moorthy, Krishna M., Objective assessment of technical skills in surgery, British Medical Journal, 327, 7422, pp. 1032-1037, (2003)

9 Peters, Micah D.J., Best practice guidance and reporting items for the development of scoping review protocols, JBI Evidence Synthesis, 20, 4, pp. 953-968, (2022)

10 Munn, Zachary, The development of software to support multiple systematic review types: The Joanna Briggs Institute System for the Unified Management, Assessment and Review of Information (JBI SUMARI), International Journal of Evidence-Based Healthcare, 17, 1, pp. 36-43, (2019)

11 Moher, David, Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement, BMJ (Online), 339, 7716, pp. 332-336, (2009)

Procedure-based assessment implementation in colorectal surgery: a scoping review

How to Cite