Sarah E Mowry1, Erika Woodson2, Samuel Gubbels3, Matt Carfrae4, Marlan R Hansen5. 1. Department of Otolaryngology, University Hospitals, Cleveland Medical Center, Cleveland, Ohio, U.S.A. 2. Department of Otolaryngology, Cleveland Clinic Foundation, Cleveland, Ohio, U.S.A. 3. Department of Otolaryngology, University of Colorado, Denver, Colorado, U.S.A. 4. Iowa Ear Center, Clive, Iowa, U.S.A. 5. Department of Otolaryngology, University of Iowa, Iowa City, Iowa, U.S.A.
Abstract
EDUCATIONAL OBJECTIVE: Objective metrics in skilled-based educational courses allow trainees and instructors to assess performance and monitor progress. The objective is to validate a concise, easy-to-use instrument for assessment of resident skill during a timed cadaveric temporal-bone (CTB) dissection. STUDY DESIGN: Retrospective analysis. METHODS: An instrument was developed to assess resident performance on a yearly timed microdissection of CTB. Five neurotologists participated in the assessment. Each reviewer's score was compared to the score given by the senior neurotologist each year for every resident. Spearman's correlation analysis was then used to assess the reproducibility of the instrument in assessing resident performance. The ability of the instrument to distinguish among experienced and novice trainees and to demonstrate improvement with experience were also assessed. RESULTS: The instrument was created and used for 6 years. Thirty residents were assessed. Correlation of scores between the senior neurotologist and the other neurotologist together was very high (r = 0.883, P < 0.001). Three specific tasks distinguished novice from senior dissectors: posterior canal, opening the membranous labyrinth, and disruption of the ossicular chain. CONCLUSION: A new instrument for assessment of resident skill on CTB dissection is presented. The instrument is easy to use, and scores derived from it are consistent across reviewers. The new instrument distinguishes experienced trainees from novice trainees, is sensitive to individual experience, and has proved useful in providing trainees with objective performance measures. LEVEL OF EVIDENCE: NA. Laryngoscope, 128:451-455, 2018.
EDUCATIONAL OBJECTIVE: Objective metrics in skilled-based educational courses allow trainees and instructors to assess performance and monitor progress. The objective is to validate a concise, easy-to-use instrument for assessment of resident skill during a timed cadaveric temporal-bone (CTB) dissection. STUDY DESIGN: Retrospective analysis. METHODS: An instrument was developed to assess resident performance on a yearly timed microdissection of CTB. Five neurotologists participated in the assessment. Each reviewer's score was compared to the score given by the senior neurotologist each year for every resident. Spearman's correlation analysis was then used to assess the reproducibility of the instrument in assessing resident performance. The ability of the instrument to distinguish among experienced and novice trainees and to demonstrate improvement with experience were also assessed. RESULTS: The instrument was created and used for 6 years. Thirty residents were assessed. Correlation of scores between the senior neurotologist and the other neurotologist together was very high (r = 0.883, P < 0.001). Three specific tasks distinguished novice from senior dissectors: posterior canal, opening the membranous labyrinth, and disruption of the ossicular chain. CONCLUSION: A new instrument for assessment of resident skill on CTB dissection is presented. The instrument is easy to use, and scores derived from it are consistent across reviewers. The new instrument distinguishes experienced trainees from novice trainees, is sensitive to individual experience, and has proved useful in providing trainees with objective performance measures. LEVEL OF EVIDENCE: NA. Laryngoscope, 128:451-455, 2018.
Authors: Joshua A Lee; Michaela F Close; Yuan F Liu; M Andrew Rowley; Mitchell J Isaac; Mark S Costello; Shaun A Nguyen; Ted A Meyer Journal: JAMA Otolaryngol Head Neck Surg Date: 2020-10-01 Impact factor: 6.223