BACKGROUND: The purpose of the present study was to compare the use of a human and a computer-based technical skills assessment tool in live and simulated gastrointestinal endoscopies performed by consultants and trainees. METHODS: Validated human-based Likert scales were used individually for generic and specific technical skills for two procedures. Two observers assessed each procedure independently and blindly. Computer-based assessment tools were also used, assessing aspects of the mucosa as well as various procedural times. The two tools were then compared. RESULTS: A total of 210 live and simulated endoscopies (107 esophagogastroduodenoscopy [OGD], 103 sigmoidoscopy) were performed by 18 consultants and 37 trainees. Mean inter-rater reliability using Cronbach alpha was good for the human-based tool (range: p = 0.62-0.75). Construct validity was good for the human-based tool (analysis of variance [ANOVA] range: p = 0.000-0.002) but not for the computer-based tool (ANOVA range: p = 0.263-0.701). CONCLUSIONS: This human-based technical skills assessment tool of gastrointestinal endoscopies seems to have face, content, concurrent, and construct validities compared to computer-based assessment parameters. The tool has the possibility of being used in training, self-appraisal, and revalidation.
BACKGROUND: The purpose of the present study was to compare the use of a human and a computer-based technical skills assessment tool in live and simulated gastrointestinal endoscopies performed by consultants and trainees. METHODS: Validated human-based Likert scales were used individually for generic and specific technical skills for two procedures. Two observers assessed each procedure independently and blindly. Computer-based assessment tools were also used, assessing aspects of the mucosa as well as various procedural times. The two tools were then compared. RESULTS: A total of 210 live and simulated endoscopies (107 esophagogastroduodenoscopy [OGD], 103 sigmoidoscopy) were performed by 18 consultants and 37 trainees. Mean inter-rater reliability using Cronbach alpha was good for the human-based tool (range: p = 0.62-0.75). Construct validity was good for the human-based tool (analysis of variance [ANOVA] range: p = 0.000-0.002) but not for the computer-based tool (ANOVA range: p = 0.263-0.701). CONCLUSIONS: This human-based technical skills assessment tool of gastrointestinal endoscopies seems to have face, content, concurrent, and construct validities compared to computer-based assessment parameters. The tool has the possibility of being used in training, self-appraisal, and revalidation.
Authors: Rajesh Aggarwal; Teodor P Grantcharov; Jens R Eriksen; Dorthe Blirup; Viggo B Kristiansen; Peter Funch-Jensen; Ara Darzi Journal: Ann Surg Date: 2006-08 Impact factor: 12.969
Authors: Arjun D Koch; Sonja N Buzink; Jeroen Heemskerk; Sanne M B I Botden; Roeland Veenendaal; Jack J Jakimowicz; Erik J Schoon Journal: Surg Endosc Date: 2007-05-22 Impact factor: 4.584
Authors: Sachin Wani; Matthew Hall; Rajesh N Keswani; Harry R Aslanian; Brenna Casey; Rebecca Burbridge; Amitabh Chak; Ann M Chen; Gregory Cote; Steven A Edmundowicz; Ashley L Faulx; Thomas G Hollander; Linda S Lee; Daniel Mullady; Faris Murad; V Raman Muthusamy; Patrick R Pfau; James M Scheiman; Jeffrey Tokar; Mihir S Wagh; Rabindra Watson; Dayna Early Journal: Clin Gastroenterol Hepatol Date: 2014-11-14 Impact factor: 11.382
Authors: Moon Jae Chung; Se Woo Park; Seong-Hun Kim; Chang Min Cho; Jun-Ho Choi; Eun Kwang Choi; Tae Hoon Lee; Eunae Cho; Jun Kyu Lee; Tae Jun Song; Jae Min Lee; Jun Hyuk Son; Jin Suk Park; Chi Hyuk Oh; Dong-Ah Park; Jeong-Sik Byeon; Soo Teik Lee; Ho Gak Kim; Hoon Jai Chun; Ho Soon Choi; Chan Guk Park; Joo Young Cho Journal: Clin Endosc Date: 2021-03-24
Authors: Moon Jae Chung; Se Woo Park; Seong-Hun Kim; Chang Min Cho; Jun-Ho Choi; Eun Kwang Choi; Tae Hoon Lee; Eunae Cho; Jun Kyu Lee; Tae Jun Song; Jae Min Lee; Jun Hyuk Son; Jin Suk Park; Chi Hyuk Oh; Dong-Ah Park; Jeong-Sik Byeon; Soo Teik Lee; Ho Gak Kim; Hoon Jai Chun; Ho Soon Choi; Chan Guk Park; Joo Young Cho Journal: Gut Liver Date: 2021-05-15 Impact factor: 4.519