J R De Siqueira1, M J Gough1. 1. Yorkshire School of Surgery, Health Education Yorkshire and the Humber, Leeds, UK.
Abstract
BACKGROUND: Working time restrictions and public expectation have stimulated competence-based assessment in surgery. Nevertheless, certification of completion of training, and board accreditation across the developed world, still rely on experiential models based on indicative numbers as markers of operative competence. This study assessed the correlation between trainer assessment of competence and completion of indicative numbers. METHODS: Analysis of UK Intercollegiate Surgical Curriculum Programme portfolios of general surgical trainees in a single Local Education and Training Board allowed comparison of Procedure Based Assessment (PBA) scores (level of competence) for cholecystectomy, segmental colectomy and Hartmann's procedure with operative numbers. RESULTS: Among 121 trainees, there was a positive correlation between operative numbers and 1058 PBA scores for cholecystectomy (rs = 0·532, P < 0·001), segmental colectomy (rs = 0·552, P < 0·001) and Hartmann's procedure (rs = 0·663, P < 0·001). Of those who completed the indicative numbers defined for each procedure to achieve certification of completion of training, only eight of 30 performing cholecystectomy, eight of 52 undertaking segmental colectomy and seven of 36 performing Hartmann's procedure had achieved three PBAs at the level considered to represent independent operating (level 4). More than half of all assessments (259 of 428, 60·5 per cent; 85 of 132 cholecystectomy, 140 of 217 colectomy and 34 of 79 Hartmann's) performed after trainees had completed their indicative numbers were scored below level 4. CONCLUSION: A minimum number of index procedures did not reflect competence in a significant proportion of trainees. A more reliable tool is required for certification.
BACKGROUND: Working time restrictions and public expectation have stimulated competence-based assessment in surgery. Nevertheless, certification of completion of training, and board accreditation across the developed world, still rely on experiential models based on indicative numbers as markers of operative competence. This study assessed the correlation between trainer assessment of competence and completion of indicative numbers. METHODS: Analysis of UK Intercollegiate Surgical Curriculum Programme portfolios of general surgical trainees in a single Local Education and Training Board allowed comparison of Procedure Based Assessment (PBA) scores (level of competence) for cholecystectomy, segmental colectomy and Hartmann's procedure with operative numbers. RESULTS: Among 121 trainees, there was a positive correlation between operative numbers and 1058 PBA scores for cholecystectomy (rs = 0·532, P < 0·001), segmental colectomy (rs = 0·552, P < 0·001) and Hartmann's procedure (rs = 0·663, P < 0·001). Of those who completed the indicative numbers defined for each procedure to achieve certification of completion of training, only eight of 30 performing cholecystectomy, eight of 52 undertaking segmental colectomy and seven of 36 performing Hartmann's procedure had achieved three PBAs at the level considered to represent independent operating (level 4). More than half of all assessments (259 of 428, 60·5 per cent; 85 of 132 cholecystectomy, 140 of 217 colectomy and 34 of 79 Hartmann's) performed after trainees had completed their indicative numbers were scored below level 4. CONCLUSION: A minimum number of index procedures did not reflect competence in a significant proportion of trainees. A more reliable tool is required for certification.
Authors: C E Jones; R Smyth; S C Keys; O Ron; M P Stanton; L Kitteringham; R A Wheeler; N J Hall Journal: Ann R Coll Surg Engl Date: 2020-05-21 Impact factor: 1.891
Authors: Marcel A Kamp; Bastian Malzkorn; Christiane von Sass; Francesco DiMeco; Constantinos G Hadjipanayis; Christian Senft; Marion Rapp; Irina Gepfner-Tuma; Konstantinos Fountas; Sandro M Krieg; Martin Neukirchen; Ioan Ștefan Florian; Oliver Schnell; Hendrik-Jan Mijderwijk; Alessandro Perin; Peter Baumgarten; Jasper H van Lieshout; Niklas Thon; Miriam Renovanz; Ulf Kahlert; Jochem K H Spoor; Daniel Hänggi; Aaron Lawson McLean; Matthias Mäurer; Silvio Sarrubbo; Christian F Freyschlag; Nils O Schmidt; Francesco Vergani; Christine Jungk; Marco Stein; Marie-Therese Forster; Jeffrey S Weinberg; John Sinclair; Evgenii Belykh; Lorenzo Bello; Emmanuel Mandonnet; Aliasgar Moiyadi; Michael Sabel Journal: J Neurooncol Date: 2021-04-21 Impact factor: 4.130
Authors: F Köckerling; A J Sheen; F Berrevoet; G Campanelli; D Cuccurullo; R Fortelny; H Friis-Andersen; J F Gillion; J Gorjanc; D Kopelman; M Lopez-Cano; S Morales-Conde; J Österberg; W Reinpold; R K J Simmermacher; M Smietanski; D Weyhe; M P Simons Journal: Hernia Date: 2019-11-21 Impact factor: 4.739