BACKGROUND: Attending assessment is a critical part of endoscopic education for gastroenterology fellows. The aim of this study was to develop and validate a concise, web-based assessment tool to evaluate real-time fellow performance in upper endoscopy. METHODS: We developed the Skill Assessment in Fellow Endoscopy Training (SAFE-T) upper endoscopy tool to capture both summative and formative feedback in a concise, five-part questionnaire. The tool mirrors the previously validated SAFE-T colonoscopy tool and is administered electronically via a web-based application. We evaluated the tool in a prospective study of 15 gastroenterology fellows (5 fellows each from Years 1-3 of training) over the 2018-2019 academic year. An independent reviewer evaluated a subset of these procedures and completed both the SAFE-T and Assessment of Competency in Endoscopy (ACE) upper endoscopy forms for reliability testing. RESULTS: Twenty faculty completed 413 SAFE-T evaluations of the 15 fellows in the study. The mean SAFE-T overall score differentiated each sequential fellow year of training, with first-year cases having lower performance than second-year cases (3.31 vs 4.25, P < 0.001) and second-year cases having lower performance than third-year cases (4.25 vs 4.56, P < 0.001). The mean SAFE-T overall score decreased with increasing case-complexity score, with straightforward compared with average cases (3.98 vs 3.39, P < 0.001) and average compared with challenging cases (3.39 vs 2.84, P = 0.042). In dual-observed procedures, the SAFE-T tool showed excellent inter-rater reliability with a Kappa agreement statistic of 0.815 (P = 0.001). The SAFE-T overall score also highly correlated with the ACE upper endoscopy overall hands-on score (r = 0.76, P = 0.011). CONCLUSIONS: We developed and validated the SAFE-T upper endoscopy tool-a concise and web-based means of assessing real-time gastroenterology fellow performance in upper endoscopy.
BACKGROUND: Attending assessment is a critical part of endoscopic education for gastroenterology fellows. The aim of this study was to develop and validate a concise, web-based assessment tool to evaluate real-time fellow performance in upper endoscopy. METHODS: We developed the Skill Assessment in Fellow Endoscopy Training (SAFE-T) upper endoscopy tool to capture both summative and formative feedback in a concise, five-part questionnaire. The tool mirrors the previously validated SAFE-T colonoscopy tool and is administered electronically via a web-based application. We evaluated the tool in a prospective study of 15 gastroenterology fellows (5 fellows each from Years 1-3 of training) over the 2018-2019 academic year. An independent reviewer evaluated a subset of these procedures and completed both the SAFE-T and Assessment of Competency in Endoscopy (ACE) upper endoscopy forms for reliability testing. RESULTS: Twenty faculty completed 413 SAFE-T evaluations of the 15 fellows in the study. The mean SAFE-T overall score differentiated each sequential fellow year of training, with first-year cases having lower performance than second-year cases (3.31 vs 4.25, P < 0.001) and second-year cases having lower performance than third-year cases (4.25 vs 4.56, P < 0.001). The mean SAFE-T overall score decreased with increasing case-complexity score, with straightforward compared with average cases (3.98 vs 3.39, P < 0.001) and average compared with challenging cases (3.39 vs 2.84, P = 0.042). In dual-observed procedures, the SAFE-T tool showed excellent inter-rater reliability with a Kappa agreement statistic of 0.815 (P = 0.001). The SAFE-T overall score also highly correlated with the ACE upper endoscopy overall hands-on score (r = 0.76, P = 0.011). CONCLUSIONS: We developed and validated the SAFE-T upper endoscopy tool-a concise and web-based means of assessing real-time gastroenterology fellow performance in upper endoscopy.
Authors: Melina C Vassiliou; Pepa A Kaneva; Benjamin K Poulose; Brian J Dunkin; Jeffrey M Marks; Riadh Sadik; Gideon Sroka; Mehran Anvari; Klaus Thaler; Gina L Adrales; Jeffrey W Hazey; Jenifer R Lightdale; Vic Velanovich; Lee L Swanstrom; John D Mellinger; Gerald M Fried Journal: Surg Endosc Date: 2010-01-29 Impact factor: 4.584
Authors: Robert E Sedlack; Walter J Coyle; Keith L Obstein; Mohammad A Al-Haddad; Gennadiy Bakis; Jennifer A Christie; Raquel E Davila; Barry DeGregorio; Christoper J DiMaio; Brintha K Enestvedt; Jennifer Jorgensen; Daniel K Mullady; Liz Rajan Journal: Gastrointest Endosc Date: 2013-11-14 Impact factor: 9.427
Authors: S G Patel; R Keswani; G Elta; S Saini; P Menard-Katcher; J Del Valle; L Hosford; A Myers; D Ahnen; P Schoenfeld; S Wani Journal: Am J Gastroenterol Date: 2015-03-24 Impact factor: 10.864
Authors: Keith Siau; James Crossley; Paul Dunckley; Gavin Johnson; Mark Feeney; Neil D Hawkes; Ian L P Beales Journal: Surg Endosc Date: 2019-03-25 Impact factor: 4.584