Bruce J Poburka1, Rita R Patel2, Diane M Bless3. 1. Department of Speech, Hearing, & Rehabilitation Services, Minnesota State University, Mankato, Minnesota. Electronic address: bruce.poburka@mnsu.edu. 2. Department of Speech and Hearing Sciences, Indiana University, Bloomington, Indiana. 3. Department of Surgery Division of Otolaryngology, School of Medicine and Public Health, University of Wisconsin Madison, Madison, Wisconsin.
Abstract
OBJECTIVE: The purpose of the study was to evaluate the inter-judge and intra-judge reliability of raters using the Voice-Vibratory Assessment with Laryngeal Imaging (VALI) rating form that was developed for assessing videostroboscopy and high-speed videoendoscopic (HSV) recordings. SUBJECTS AND METHODS: Nine speech-language pathologists with an average of 12.8 years of experience with laryngeal imaging were trained to use the VALI form for rating 66 de-identified and randomized samples with voice disorders. Inter-judge reliability for parameters with scale data (amplitude, mucosal wave, nonvibratory portion, supraglottic activity, phase closure, symmetry, and regularity or periodicity) was assessed with intraclass correlations, and parameters with nominal data (glottal closure, vertical level, and free edge contour) were assessed with Fleiss' kappa. Intra-judge reliability was assessed using the Spearman rho statistic for scale data and percentage of concordant pairs for nominal data. RESULTS: Inter-judge reliability for parameters with scale data ranged from 0.57 to 0.96 for stroboscopy and from 0.81 to 0.94 for HSV. For nominal parameters, correlations ranged from 0.18 to 0.35 for stroboscopy and from 0.13 to 0.33 for HSV. Intra-judge reliability correlations for parameters with scale data ranged from 0.19 to 0.87 for stroboscopy and from 0.28 to 0.85 for HSV. For parameters with nominal data, percentage of concordance ranged from 44% to 78% for stroboscopy and from 52% to 89% for HSV. CONCLUSIONS: The VALI rating form and the training protocol is a first, a priori developed rating form that includes visual-perceptual ratings of both stroboscopy and HSV. The current form can be used to make reliable visual-perceptual judgments for selected features of vibratory motion from stroboscopy and HSV.
OBJECTIVE: The purpose of the study was to evaluate the inter-judge and intra-judge reliability of raters using the Voice-Vibratory Assessment with Laryngeal Imaging (VALI) rating form that was developed for assessing videostroboscopy and high-speed videoendoscopic (HSV) recordings. SUBJECTS AND METHODS: Nine speech-language pathologists with an average of 12.8 years of experience with laryngeal imaging were trained to use the VALI form for rating 66 de-identified and randomized samples with voice disorders. Inter-judge reliability for parameters with scale data (amplitude, mucosal wave, nonvibratory portion, supraglottic activity, phase closure, symmetry, and regularity or periodicity) was assessed with intraclass correlations, and parameters with nominal data (glottal closure, vertical level, and free edge contour) were assessed with Fleiss' kappa. Intra-judge reliability was assessed using the Spearman rho statistic for scale data and percentage of concordant pairs for nominal data. RESULTS: Inter-judge reliability for parameters with scale data ranged from 0.57 to 0.96 for stroboscopy and from 0.81 to 0.94 for HSV. For nominal parameters, correlations ranged from 0.18 to 0.35 for stroboscopy and from 0.13 to 0.33 for HSV. Intra-judge reliability correlations for parameters with scale data ranged from 0.19 to 0.87 for stroboscopy and from 0.28 to 0.85 for HSV. For parameters with nominal data, percentage of concordance ranged from 44% to 78% for stroboscopy and from 52% to 89% for HSV. CONCLUSIONS: The VALI rating form and the training protocol is a first, a priori developed rating form that includes visual-perceptual ratings of both stroboscopy and HSV. The current form can be used to make reliable visual-perceptual judgments for selected features of vibratory motion from stroboscopy and HSV.
Authors: Victoria S McKenna; Manuel E Diaz-Cadiz; Adrianna C Shembel; Nicole M Enos; Cara E Stepp Journal: J Speech Lang Hear Res Date: 2019-04-15 Impact factor: 2.297
Authors: Jennifer M Vojtech; Roxanne K Segina; Daniel P Buckley; Katharine R Kolin; Monique C Tardif; J Pieter Noordzij; Cara E Stepp Journal: J Acoust Soc Am Date: 2019-11 Impact factor: 1.840
Authors: Maria E Powell; Dimitar D Deliyski; Steven M Zeitels; James A Burns; Robert E Hillman; Terri Treman Gerlach; Daryush D Mehta Journal: J Voice Date: 2019-04-17 Impact factor: 2.009
Authors: Mara R Kapsner-Smith; Manuel E Díaz-Cádiz; Jennifer M Vojtech; Daniel P Buckley; Daryush D Mehta; Robert E Hillman; Lauren F Tracy; J Pieter Noordzij; Tanya L Eadie; Cara E Stepp Journal: J Speech Lang Hear Res Date: 2022-03-10 Impact factor: 2.674