Michael S Cohen1,2, Razan A Basonbul1,2,3, Samuel R Barber1, Elliott D Kozin1,2, Alejandro C Rivas4, Daniel J Lee1,2. 1. Department of Otolaryngology, Massachusetts Eye and Ear Infirmary, Boston, Massachusetts. 2. Department of Otology and Laryngology, Harvard Medical School, Boston, Massachusetts, U.S.A. 3. Department of Otolaryngology-Head and Neck Surgery, Faculty of Medicine in Rabigh, King Abdulaziz University, Jeddah, Saudi Arabia. 4. Department of Otolaryngology-Head and Neck Surgery, Vanderbilt University Medical Center, Nashville, Tennessee, U.S.A.
Abstract
OBJECTIVES/HYPOTHESIS: To design and validate a classification system for endoscopic ear surgery. STUDY DESIGN: Validation study. METHODS: A classification system was devised that quantifies use of the endoscope during middle ear surgery. Otologic operative reports were reviewed by attending surgeons and trainees. A power analysis was performed to determine number of cases needed to review. The following categories were used: class 0 is defined by using the microscope only; class 1 describes the use of endoscope for inspection without dissection; and class 2 describes mixed use of the endoscope and the microscope. It is further subdivided into 2a and 2b, where the endoscope is used for less than 50% of dissection and more than 50% of dissection, respectively. Class 3 describes the use of the endoscope for the entire surgery. Fifty cases were reviewed by three attending otologic surgeons, one resident, and one medical student. RESULTS: Weighted Cohen's Kappa for inter-rater agreement between the two institutional surgeons was 0.79 (95% bias corrected [BC] confidence interval [CI]: 0.58-0.93). Agreement between the external surgeon and the two institutional surgeons was 0.77 (95% BC CI: 0.58-0.89) and 0.76 (95% BC CI: 0.57-0.88). Weighted Kappa between institutional surgeons and a resident was 0.73 (95% BC CI: 0.53-0.88) and 0.62 (95% BC CI: 0.38-0.80), and between institutional surgeons and a medical student was 0.75 (95% BC CI: 0.56-0.89) and 0.70 (95% BC CI: 0.49-0.85). CONCLUSIONS: There was substantial inter-rater agreement. This classification system can be used as a simple and reliable tool to describe the extent to which an endoscope was used during ear surgery. LEVEL OF EVIDENCE: NA. Laryngoscope, 128:967-970, 2018.
OBJECTIVES/HYPOTHESIS: To design and validate a classification system for endoscopic ear surgery. STUDY DESIGN: Validation study. METHODS: A classification system was devised that quantifies use of the endoscope during middle ear surgery. Otologic operative reports were reviewed by attending surgeons and trainees. A power analysis was performed to determine number of cases needed to review. The following categories were used: class 0 is defined by using the microscope only; class 1 describes the use of endoscope for inspection without dissection; and class 2 describes mixed use of the endoscope and the microscope. It is further subdivided into 2a and 2b, where the endoscope is used for less than 50% of dissection and more than 50% of dissection, respectively. Class 3 describes the use of the endoscope for the entire surgery. Fifty cases were reviewed by three attending otologic surgeons, one resident, and one medical student. RESULTS: Weighted Cohen's Kappa for inter-rater agreement between the two institutional surgeons was 0.79 (95% bias corrected [BC] confidence interval [CI]: 0.58-0.93). Agreement between the external surgeon and the two institutional surgeons was 0.77 (95% BC CI: 0.58-0.89) and 0.76 (95% BC CI: 0.57-0.88). Weighted Kappa between institutional surgeons and a resident was 0.73 (95% BC CI: 0.53-0.88) and 0.62 (95% BC CI: 0.38-0.80), and between institutional surgeons and a medical student was 0.75 (95% BC CI: 0.56-0.89) and 0.70 (95% BC CI: 0.49-0.85). CONCLUSIONS: There was substantial inter-rater agreement. This classification system can be used as a simple and reliable tool to describe the extent to which an endoscope was used during ear surgery. LEVEL OF EVIDENCE: NA. Laryngoscope, 128:967-970, 2018.