Andrew Hill1,2, Mark S Horswill3, Annaliese M Plooy4, Marcus O Watson5,3,6, Lachlan N Rowlands6, Guy M Wallis4, Stephan Riek4, Robin Burgess-Limerick4, David G Hewett5,6. 1. Clinical Skills Development Service, Metro North Hospital and Health Service, Brisbane, Australia. Andrew.Hill@health.qld.gov.au. 2. School of Psychology, The University of Queensland, Brisbane, Australia. Andrew.Hill@health.qld.gov.au. 3. School of Psychology, The University of Queensland, Brisbane, Australia. 4. School of Human Movement Studies, The University of Queensland, Brisbane, Australia. 5. Clinical Skills Development Service, Metro North Hospital and Health Service, Brisbane, Australia. 6. School of Medicine, The University of Queensland, Brisbane, Australia.
Abstract
BACKGROUND: The quality of colonoscopy is known to vary. The extent to which colonoscopists can recognize the presence of subtle colorectal lesions by visually distinguishing them from the surrounding mucosa (i.e., polyp recognition skill) may be one of several attributes that influence polyp detection rates. The aim of the present study was to develop and validate the first objective test of polyp recognition skill. METHODS: Validation study. Twenty-eight experienced colonoscopists and eighty novices took a preliminary 280-item computer-based polyp recognition test. Items were genuine endoscopic images which participants assessed for the presence of "likely polyps." Half included clinically identified polyps. Participants clicked on a suspected lesion or a button marked "no likely polyp", and the main outcome measures were accuracy and response latency. The best items were selected for the final 50-item test. RESULTS: In the preliminary test, experienced colonoscopists correctly identified more polyps than novices (P < .0001) and better discriminated between clinically identified polyps and non-polyp features (as measured by d', P < .0001). For polyp items, the experienced group also responded faster (P < .01). Effect sizes were large for accuracy (Cohen's d = 3.22) and d' (Cohen's d = 3.22). The 50 final test items produced comparable results for accuracy, d', and response latency. For both versions of the test, score scale reliability was high for both polyp and non-polyp items (α = .82 to .97). CONCLUSIONS: The observed experienced-novice differences support the construct validity of the performance measures derived from the tests, indicating that polyp recognition skill can be quantified objectively. The final test may potentially be used to assess trainees, but test sensitivity may be insufficient to make fine-grained distinctions between different skill levels among experienced colonoscopists. More sensitive future tests may provide a valuable supplement to clinical detection rates, allowing objective comparisons between skilled colonoscopists.
BACKGROUND: The quality of colonoscopy is known to vary. The extent to which colonoscopists can recognize the presence of subtle colorectal lesions by visually distinguishing them from the surrounding mucosa (i.e., polyp recognition skill) may be one of several attributes that influence polyp detection rates. The aim of the present study was to develop and validate the first objective test of polyp recognition skill. METHODS: Validation study. Twenty-eight experienced colonoscopists and eighty novices took a preliminary 280-item computer-based polyp recognition test. Items were genuine endoscopic images which participants assessed for the presence of "likely polyps." Half included clinically identified polyps. Participants clicked on a suspected lesion or a button marked "no likely polyp", and the main outcome measures were accuracy and response latency. The best items were selected for the final 50-item test. RESULTS: In the preliminary test, experienced colonoscopists correctly identified more polyps than novices (P < .0001) and better discriminated between clinically identified polyps and non-polyp features (as measured by d', P < .0001). For polyp items, the experienced group also responded faster (P < .01). Effect sizes were large for accuracy (Cohen's d = 3.22) and d' (Cohen's d = 3.22). The 50 final test items produced comparable results for accuracy, d', and response latency. For both versions of the test, score scale reliability was high for both polyp and non-polyp items (α = .82 to .97). CONCLUSIONS: The observed experienced-novice differences support the construct validity of the performance measures derived from the tests, indicating that polyp recognition skill can be quantified objectively. The final test may potentially be used to assess trainees, but test sensitivity may be insufficient to make fine-grained distinctions between different skill levels among experienced colonoscopists. More sensitive future tests may provide a valuable supplement to clinical detection rates, allowing objective comparisons between skilled colonoscopists.
Entities:
Keywords:
Colonoscopy; Polyp detection; Polyp recognition; Skill assessment; Training
Authors: Charles J Kahi; David G Hewett; Dustin Lee Norton; George J Eckert; Douglas K Rex Journal: Clin Gastroenterol Hepatol Date: 2010-10-01 Impact factor: 11.382
Authors: Christine M Zupanc; Guy M Wallis; Andrew Hill; Robin Burgess-Limerick; Stephan Riek; Annaliese M Plooy; Mark S Horswill; Marcus O Watson; Hans de Visser; David Conlan; David G Hewett Journal: BMC Med Educ Date: 2017-07-12 Impact factor: 2.463
Authors: Andreas S Vilmann; Christian Lachenmeier; Morten Bo S Svendsen; Bo Soendergaard; Yoon S Park; Lars Bo Svendsen; Lars Konge Journal: Endosc Int Open Date: 2022-01-14