Andrew Pittner1, Michael Nolan1, Aisha Traish1, Asim Farooq1, Robert Feder1, Geoff Hill1, Surendar Dwarakanathan1, William McGaghie1, Charles Bouchard2. 1. From the Department of Ophthalmology (Pittner, Nolan, Bouchard), Loyola University Medical Center, the Department of Ophthalmology & Visual Sciences (Traish, Farooq), University of Illinois at Chicago, the Department of Ophthalmology (Feder), Northwestern University, the Division of Ophthalmology (Hill, Dwarakanathan), John H. Stroger Jr. Hospital of Cook County, and the Department of Medical Education (McGaghie), Northwestern University Feinberg School of Medicine, Chicago, Illinois, USA. 2. From the Department of Ophthalmology (Pittner, Nolan, Bouchard), Loyola University Medical Center, the Department of Ophthalmology & Visual Sciences (Traish, Farooq), University of Illinois at Chicago, the Department of Ophthalmology (Feder), Northwestern University, the Division of Ophthalmology (Hill, Dwarakanathan), John H. Stroger Jr. Hospital of Cook County, and the Department of Medical Education (McGaghie), Northwestern University Feinberg School of Medicine, Chicago, Illinois, USA. Electronic address: cboucha@lumc.edu.
Abstract
PURPOSE: To assess interrater reliability in grading cataract surgery performance of ophthalmology residents and attending physicians before and after rater skill training. SETTING: Metropolitan Chicago, Illinois, USA. DESIGN: Prospective interventional test design. METHODS: Video versions of a previously validated scoring key for rating cataract surgery were created for participant training. All participants received 2 frame-of-reference training sessions lasting 2 hours each. Participants graded 4 videorecorded cataract surgeries before training (pretest) and 4 more after training (posttest). Intraclass correlation coefficients (ICCs), which measured the degree of rater agreement, were calculated before and after training. Participants completed a subjective confidence questionnaire at the beginning and at the end of the study. RESULTS: The study participants included 9 postgraduate year (PGY)-3 residents, 8 PGY-4 residents, and 5 ophthalmology attending physicians from 4 medical centers in metropolitan Chicago. The rater training sessions had the greatest increase in ICCs among PGY-3 residents. The ICC improvement between the PGY-4 residents and attending physicians was uneven. After training, all residents felt more confident about their ability to rate and to perform cataract surgery. CONCLUSIONS: Learning to effectively grade performance of cataract surgery by reviewing video clips has the potential to be an important part of ophthalmology residency education. The benefit of such a protocol was greatest in the early stages of residency education and might provide a guideline for quality assessment that accelerates surgical skill development. FINANCIAL DISCLOSURE: None of the authors has a financial or proprietary interest in any material or method mentioned.
PURPOSE: To assess interrater reliability in grading cataract surgery performance of ophthalmology residents and attending physicians before and after rater skill training. SETTING: Metropolitan Chicago, Illinois, USA. DESIGN: Prospective interventional test design. METHODS: Video versions of a previously validated scoring key for rating cataract surgery were created for participant training. All participants received 2 frame-of-reference training sessions lasting 2 hours each. Participants graded 4 videorecorded cataract surgeries before training (pretest) and 4 more after training (posttest). Intraclass correlation coefficients (ICCs), which measured the degree of rater agreement, were calculated before and after training. Participants completed a subjective confidence questionnaire at the beginning and at the end of the study. RESULTS: The study participants included 9 postgraduate year (PGY)-3 residents, 8 PGY-4 residents, and 5 ophthalmology attending physicians from 4 medical centers in metropolitan Chicago. The rater training sessions had the greatest increase in ICCs among PGY-3 residents. The ICC improvement between the PGY-4 residents and attending physicians was uneven. After training, all residents felt more confident about their ability to rate and to perform cataract surgery. CONCLUSIONS: Learning to effectively grade performance of cataract surgery by reviewing video clips has the potential to be an important part of ophthalmology residency education. The benefit of such a protocol was greatest in the early stages of residency education and might provide a guideline for quality assessment that accelerates surgical skill development. FINANCIAL DISCLOSURE: None of the authors has a financial or proprietary interest in any material or method mentioned.
Authors: Michele Coppola; Alessandro Marchese; Alessandro Rabiolo; Maria Vittoria Cicinelli; Karl Anders Knutsson Journal: Int Ophthalmol Date: 2018-11-21 Impact factor: 2.031
Authors: Anuprita Gandhi Bhatt; Kuldeep S Dole; Madan Deshpande; Khurshed Bharucha; V K S Kalyani Journal: Indian J Ophthalmol Date: 2021-12 Impact factor: 1.848