OBJECTIVE: Reduced training time combined with no rigorous assessment for technical skills makes it difficult for trainees to monitor their competence. We have developed an objective bench-top assessment of technical skills at a level commensurate with a junior registrar in cardiac surgery. METHODS: Forty cardiothoracic surgeons were recruited for the study, consisting of 12 junior trainees (year 1-3), 15 senior trainees (year 4-6) and 13 consultants. The assessment consisted of four key tasks on standardised bench-top models: aortic root cannulation, vein-graft to aorta anastomosis, vein-graft to Left Anterior Descending (LAD) anastomosis and femoral triangle dissection. An expert surgeon was present at each station to provide passive assistance and rate performance on a validated global rating scale giving rise to a total possible score of 40. Three expert surgeons repeated the ratings retrospectively, using blinded video recordings. Data analysis employed non-parametric tests. RESULTS: Both live and video scores differentiated significantly between performances of all groups of surgeons for all four stations (P < 0.01) (median live and video score for LAD; Junior 19,17; Senior 29,22; Consultant 36,28). Correlations between live and blinded rating were high (r = 0.67-0.84; P < 0.001) as was inter-rater reliability between the three expert video raters (alpha = 0.81). CONCLUSIONS: The use of bench-top tasks to differentiate between cardiac surgeons of differing technical abilities has been validated for the first time. Furthermore, it is unnecessary to perform post-hoc video rating to obtain objective data. These measures can provide formative feedback for surgeons-in-training and lead to the development of a competency-based technical skills curriculum.
OBJECTIVE: Reduced training time combined with no rigorous assessment for technical skills makes it difficult for trainees to monitor their competence. We have developed an objective bench-top assessment of technical skills at a level commensurate with a junior registrar in cardiac surgery. METHODS: Forty cardiothoracic surgeons were recruited for the study, consisting of 12 junior trainees (year 1-3), 15 senior trainees (year 4-6) and 13 consultants. The assessment consisted of four key tasks on standardised bench-top models: aortic root cannulation, vein-graft to aorta anastomosis, vein-graft to Left Anterior Descending (LAD) anastomosis and femoral triangle dissection. An expert surgeon was present at each station to provide passive assistance and rate performance on a validated global rating scale giving rise to a total possible score of 40. Three expert surgeons repeated the ratings retrospectively, using blinded video recordings. Data analysis employed non-parametric tests. RESULTS: Both live and video scores differentiated significantly between performances of all groups of surgeons for all four stations (P < 0.01) (median live and video score for LAD; Junior 19,17; Senior 29,22; Consultant 36,28). Correlations between live and blinded rating were high (r = 0.67-0.84; P < 0.001) as was inter-rater reliability between the three expert video raters (alpha = 0.81). CONCLUSIONS: The use of bench-top tasks to differentiate between cardiac surgeons of differing technical abilities has been validated for the first time. Furthermore, it is unnecessary to perform post-hoc video rating to obtain objective data. These measures can provide formative feedback for surgeons-in-training and lead to the development of a competency-based technical skills curriculum.
Authors: Marliza O'Dwyer; Cristina A Fleming; Shane Ahern; Sean Barrett; Nicola B Raftery; Tara Ní Dhonnchú; Kishore Doddakula Journal: BJS Open Date: 2022-01-06