Omer Burak Argun1, Kristin Chrouser2, Sanket Chauhan3, Manoj Monga4, Bodo Knudsen5, Geoffrey N Box5, David I Lee6, Matthew T Gettman7, Lauren H Poniatowski8, Qi Wang9, Troy E Reihsen8, Robert M Sweet10. 1. Department of Urology, University of Minnesota, Minneapolis, Minnesota; Department of Urology, Acibadem University, Istanbul, Turkey. 2. Department of Urology, University of Minnesota, Minneapolis, Minnesota; Minneapolis Veterans Affairs Medical Center, Minneapolis, Minnesota. 3. Seeger Simulation Training and Research Center, Baylor University Medical Center, Dallas, Texas. 4. Department of Urology, Cleveland Clinic, Cleveland, Ohio. 5. Department of Urology, Ohio State University, Columbus, Ohio. 6. Department of Surgery, University of Pennsylvania, Philadelphia, Pennsylvania. 7. Department of Urology, Mayo Medical School and Mayo Clinic, Rochester, Minnesota. 8. Department of Urology, University of Minnesota, Minneapolis, Minnesota. 9. Clinical and Translational Science Institute, University of Minnesota, Minneapolis, Minnesota. 10. Department of Urology, University of Minnesota, Minneapolis, Minnesota. Electronic address: rsweet@umn.edu.
Abstract
PURPOSE: We evaluated the internal and construct validity of an assessment tool for cystoscopic and ureteroscopic cognitive and psychomotor skills at a multi-institutional level. MATERIALS AND METHODS: Subjects included a total of 30 urology residents at Ohio State University, Columbus, Ohio; Penn Presbyterian Medical Center, Philadelphia, Pennsylvania; and Mayo Clinic, Rochester, Minnesota. A single external blinded reviewer evaluated cognitive and psychomotor skills associated with cystoscopic and ureteroscopic surgery using high fidelity bench models. Exercises included navigation, basketing and relocation; holmium laser lithotripsy; and cystoscope assembly. Each resident received a total cognitive score, checklist score and global psychomotor skills score. Construct validity was assessed by calculating correlations between training year and performance scores (both cognitive and psychomotor). Internal validity was confirmed by calculating correlations between test components. RESULTS: The median total cognitive score was 91 (IQR 86.25, 97). For psychomotor performance residents had a median total checklist score of 7 (IQR 5, 8) and a median global psychomotor skills score of 21 (IQR 18, 24.5). Construct validity was supported by the positive and statistically significant correlations between training year and total cognitive score (r = 0.66, 95% CI 0.39-0.82, p = 0.01), checklist scores (r = 0.66, 95% CI 0.35-0.84, p = 0.32) and global psychomotor skills score (r = 0.76, 95% CI 0.55-0.88, p = 0.002). The internal validity of OSATS was supported since total cognitive and checklist scores correlated with the global psychomotor skills score. CONCLUSIONS: In this multi-institutional study we successfully demonstrated the construct and internal validity of an objective assessment of cystoscopic and ureteroscopic cognitive and technical skills, including laser lithotripsy.
PURPOSE: We evaluated the internal and construct validity of an assessment tool for cystoscopic and ureteroscopic cognitive and psychomotor skills at a multi-institutional level. MATERIALS AND METHODS: Subjects included a total of 30 urology residents at Ohio State University, Columbus, Ohio; Penn Presbyterian Medical Center, Philadelphia, Pennsylvania; and Mayo Clinic, Rochester, Minnesota. A single external blinded reviewer evaluated cognitive and psychomotor skills associated with cystoscopic and ureteroscopic surgery using high fidelity bench models. Exercises included navigation, basketing and relocation; holmium laser lithotripsy; and cystoscope assembly. Each resident received a total cognitive score, checklist score and global psychomotor skills score. Construct validity was assessed by calculating correlations between training year and performance scores (both cognitive and psychomotor). Internal validity was confirmed by calculating correlations between test components. RESULTS: The median total cognitive score was 91 (IQR 86.25, 97). For psychomotor performance residents had a median total checklist score of 7 (IQR 5, 8) and a median global psychomotor skills score of 21 (IQR 18, 24.5). Construct validity was supported by the positive and statistically significant correlations between training year and total cognitive score (r = 0.66, 95% CI 0.39-0.82, p = 0.01), checklist scores (r = 0.66, 95% CI 0.35-0.84, p = 0.32) and global psychomotor skills score (r = 0.76, 95% CI 0.55-0.88, p = 0.002). The internal validity of OSATS was supported since total cognitive and checklist scores correlated with the global psychomotor skills score. CONCLUSIONS: In this multi-institutional study we successfully demonstrated the construct and internal validity of an objective assessment of cystoscopic and ureteroscopic cognitive and technical skills, including laser lithotripsy.
Authors: Barrett S Boody; Brett D Rosenthal; Tyler J Jenkins; Alpesh A Patel; Jason W Savage; Wellington K Hsu Journal: Global Spine J Date: 2017-06-23
Authors: Michal M Nowakowski; Paulina Trybek; Mateusz Rubinkiewicz; Tomasz Cegielny; Michał Romaniszyn; Michał Pędziwiatr; Łukasz Machura Journal: Wideochir Inne Tech Maloinwazyjne Date: 2018-03-10 Impact factor: 1.195
Authors: Barrett S Boody; Sohaib Z Hashmi; Brett D Rosenthal; Joseph P Maslak; Michael H McCarthy; Alpesh A Patel; Jason W Savage; Wellington K Hsu Journal: Global Spine J Date: 2017-12-10