Jennifer Rose-Nussbaumer1, Thomas M Lietman2, Caroline H Shiboski3, Stephen C Shiboski4, Vatinee Y Bunya5, Esen K Akpek6, Muthiah Srinivasan7, Jeena Mascarenhas7, Giacomina Massaro-Giordano5, Nancy A McNamara8, John P Whitcher2, Bruce D Gaynor9. 1. Francis I. Proctor Foundation, University of California San Francisco, San Francisco, California; Department of Ophthalmology, University of California San Francisco, San Francisco, California; Department of Optometry, University of California, Berkeley, Berkeley, California. 2. Francis I. Proctor Foundation, University of California San Francisco, San Francisco, California; Department of Ophthalmology, University of California San Francisco, San Francisco, California; Department of Epidemiology and Biostatistics, University of California San Francisco, San Francisco, California. 3. Department of Dentistry, University of California San Francisco, San Francisco, California. 4. Department of Epidemiology and Biostatistics, University of California San Francisco, San Francisco, California. 5. Department of Ophthalmology, University of Pennsylvania, Philadelphia, Pennsylvania. 6. Department of Ophthalmology, Johns Hopkins University, Baltimore, Maryland. 7. Aravind Eye Care System at Madurai, Madurai, India. 8. Francis I. Proctor Foundation, University of California San Francisco, San Francisco, California; Department of Optometry, University of California, Berkeley, Berkeley, California. 9. Francis I. Proctor Foundation, University of California San Francisco, San Francisco, California; Department of Ophthalmology, University of California San Francisco, San Francisco, California. Electronic address: Bruce.Gaynor@ucsf.edu.
Abstract
PURPOSE: To determine the intra-observer and inter-observer reliability of a novel ocular staining score among trained ophthalmologists. DESIGN: Reliability analysis within a prospective, observational, multicenter cohort study. METHODS: Those enrolled in the National Institutes of Health-funded Sjögren's International Collaborative Clinical Alliance (SICCA) who presented for follow-up at the University of California San Francisco, Aravind Eye Hospital, Johns Hopkins University, and the University of Pennsylvania were included. Study participants were graded using the ocular staining score by at least 2 masked SICCA-trained ophthalmologists. The primary outcome for this study was the intraclass correlation coefficient (ICC) for the total ocular staining score. ICCs were also calculated for tear break-up time (TBUT) and conjunctival and corneal staining. RESULTS: Total ocular staining score had an ICC of 0.91 for the right eye (95% confidence interval [CI] 0.85-0.96) and 0.90 for the left eye (95% CI 0.83-0.97). Corneal staining (right eye 0.86, 95% CI 0.76-0.93, left eye 0.90, 95% CI 0.81-0.95) and conjunctival staining (right eye 0.87, 95% CI 0.80-0.93, left eye 0.85, 95% CI 0.75-0.93) demonstrated excellent agreement. The ICC for TBUT was slightly lower (right eye 0.77, 95% CI 0.64-0.89; left eye 0.81, 95% CI 0.68-0.90). CONCLUSIONS: Previous studies have shown that the ocular staining score is correlated with other diagnostic components of Sjögren syndrome. In this study, we demonstrate high reliability in grading among trained ophthalmologists, completing the validation of this test.
PURPOSE: To determine the intra-observer and inter-observer reliability of a novel ocular staining score among trained ophthalmologists. DESIGN: Reliability analysis within a prospective, observational, multicenter cohort study. METHODS: Those enrolled in the National Institutes of Health-funded Sjögren's International Collaborative Clinical Alliance (SICCA) who presented for follow-up at the University of California San Francisco, Aravind Eye Hospital, Johns Hopkins University, and the University of Pennsylvania were included. Study participants were graded using the ocular staining score by at least 2 masked SICCA-trained ophthalmologists. The primary outcome for this study was the intraclass correlation coefficient (ICC) for the total ocular staining score. ICCs were also calculated for tear break-up time (TBUT) and conjunctival and corneal staining. RESULTS: Total ocular staining score had an ICC of 0.91 for the right eye (95% confidence interval [CI] 0.85-0.96) and 0.90 for the left eye (95% CI 0.83-0.97). Corneal staining (right eye 0.86, 95% CI 0.76-0.93, left eye 0.90, 95% CI 0.81-0.95) and conjunctival staining (right eye 0.87, 95% CI 0.80-0.93, left eye 0.85, 95% CI 0.75-0.93) demonstrated excellent agreement. The ICC for TBUT was slightly lower (right eye 0.77, 95% CI 0.64-0.89; left eye 0.81, 95% CI 0.68-0.90). CONCLUSIONS: Previous studies have shown that the ocular staining score is correlated with other diagnostic components of Sjögren syndrome. In this study, we demonstrate high reliability in grading among trained ophthalmologists, completing the validation of this test.
Authors: S C Shiboski; C H Shiboski; L A Criswell; A N Baer; S Challacombe; H Lanfranchi; M Schiødt; H Umehara; F Vivino; Y Zhao; Y Dong; D Greenspan; A M Heidenreich; P Helin; B Kirkham; K Kitagawa; G Larkin; M Li; T Lietman; J Lindegaard; N McNamara; K Sack; P Shirlaw; S Sugai; C Vollenweider; J Whitcher; A Wu; S Zhang; W Zhang; J S Greenspan; T E Daniels Journal: Arthritis Care Res (Hoboken) Date: 2012-04 Impact factor: 4.794
Authors: S R Pillemer; E L Matteson; L T Jacobsson; P B Martens; L J Melton; W M O'Fallon; P C Fox Journal: Mayo Clin Proc Date: 2001-06 Impact factor: 7.616
Authors: Abdou Amza; Boubacar Kadri; Baido Nassirou; Nicole E Stoller; Sun N Yu; Zhaoxia Zhou; Stephanie Chin; Sheila K West; Robin L Bailey; David C W Mabey; Jeremy D Keenan; Travis C Porco; Thomas M Lietman; Bruce D Gaynor Journal: PLoS Negl Trop Dis Date: 2012-04-24
Authors: Anthony W Solomon; Richard J C Bowman; David Yorston; Patrick A Massae; Salesia Safari; Brian Savage; Neal D E Alexander; Allen Foster; David C W Mabey Journal: Am J Trop Med Hyg Date: 2006-03 Impact factor: 2.345
Authors: Vatinee Y Bunya; Satasuk Joy Bhosai; Ana Maria Heidenreich; Kazuko Kitagawa; Genevieve B Larkin; Thomas M Lietman; Bruce D Gaynor; Esen K Akpek; Mina Massaro-Giordano; M Srinivasan; Travis C Porco; John P Whitcher; Stephen C Shiboski; Lindsey A Criswell; Caroline H Shiboski Journal: Am J Ophthalmol Date: 2016-09-16 Impact factor: 5.258
Authors: Vatinee Y Bunya; Min Chen; Yuanjie Zheng; Mina Massaro-Giordano; James Gee; Ebenezer Daniel; Ryan O'Sullivan; Eli Smith; Richard A Stone; Maureen G Maguire Journal: JAMA Ophthalmol Date: 2017-10-01 Impact factor: 7.389
Authors: Astrid Rasmussen; Donald U Stone; C Erick Kaufman; Kimberly S Hefner; Nicole R Fram; Rhea L Siatkowski; Andrew J W Huang; James Chodosh; Pablo T Rasmussen; Dustin A Fife; Nathan Pezant; Kiely Grundahl; Lida Radfar; David M Lewis; Michael H Weisman; Swamy Venuturupalli; Daniel J Wallace; Nelson L Rhodus; Michael T Brennan; Courtney G Montgomery; Christopher J Lessard; R Hal Scofield; Kathy L Sivils Journal: ACR Open Rheumatol Date: 2019-06-07
Authors: Neel D Pasricha; Alex J Smith; Marc H Levin; Julie M Schallhorn; Alan S Verkman Journal: Transl Vis Sci Technol Date: 2020-10-15 Impact factor: 3.283