Lisa F Everton1,2, Jacqueline K Benfield3, Emilia Michou4,5, Shaheen Hamdy4, Philip M Bath1,6. 1. Stroke Trials Unit, Division of Mental Health and Clinical Neuroscience, University of Nottingham, United Kingdom. 2. Speech and Language Therapy, Nottingham University Hospitals NHS Trust, United Kingdom. 3. Vascular Medicine, Division of Medical Sciences and Graduate Entry Medicine, University of Nottingham, Royal Derby Hospital Centre, United Kingdom. 4. Gastrointestinal Sciences, Division of Diabetes, Endocrinology & Gastroenterology, School of Medical Sciences, The University of Manchester and the Manchester Academic Health Science Centre, United Kingdom. 5. Department of Speech and Language Therapy, School of Health Rehabilitation Sciences, University of Patras, Greece. 6. Stroke Medicine, Nottingham University Hospitals NHS Trust, United Kingdom.
Abstract
PURPOSE: Information on reliability of outcome measures used to assess the effectiveness of interventions in dysphagia rehabilitation is lacking, particularly when used by different research groups. Here, we report on reliability of the penetration-aspiration scale (PAS) and temporal and clearance measures, determined using videofluoroscopy. METHOD: Secondary analysis used videofluoroscopies from the Swallowing Treatment using Electrical Pharyngeal Stimulation trial in subacute stroke. PAS scores (719 scores from 18 participants) were evaluated and compared to the original PAS scores from the trial. Five conditions were assessed, including reliability for every swallow and overall mean of the worst PAS score. Operational rules for assessing temporal and clearance measures were also developed using the same data, and reliability of these rules was assessed. Reliability of component-level and derivative-level scores was assessed using the intraclass correlation coefficient (ICC) and weighted kappa. RESULTS: Image quality was variable. Interrater reliability for the overall mean of the worst PAS score was excellent (ICC = .914, 95% confidence interval [CI] [.853, .951]) but moderate for every swallow in the bolus (ICC = .743, 95% CI [.708, .775]). Intrarater reliability for PAS was excellent (all conditions). Excellent reliability (both inter- and intrarater > .90) was seen for temporal measures of stage transition duration (ICC = .998, 95% CI [.993, .999] and ICC = .995, 95% CI [.987, .998], respectively) as well as initiation of laryngeal closure and pharyngeal transit time and all individual swallow events. Strong scores were obtained for some clearance measures; others were moderate or weak. CONCLUSIONS: Interrater reliability for PAS is acceptable but depends on how the PAS scores are handled in the analysis. Interrater reliability for most temporal measures was high, although some measures required additional training. No clearance measures had excellent reliability. SUPPLEMENTAL MATERIAL: https://doi.org/10.23641/asha.19090088.
PURPOSE: Information on reliability of outcome measures used to assess the effectiveness of interventions in dysphagia rehabilitation is lacking, particularly when used by different research groups. Here, we report on reliability of the penetration-aspiration scale (PAS) and temporal and clearance measures, determined using videofluoroscopy. METHOD: Secondary analysis used videofluoroscopies from the Swallowing Treatment using Electrical Pharyngeal Stimulation trial in subacute stroke. PAS scores (719 scores from 18 participants) were evaluated and compared to the original PAS scores from the trial. Five conditions were assessed, including reliability for every swallow and overall mean of the worst PAS score. Operational rules for assessing temporal and clearance measures were also developed using the same data, and reliability of these rules was assessed. Reliability of component-level and derivative-level scores was assessed using the intraclass correlation coefficient (ICC) and weighted kappa. RESULTS: Image quality was variable. Interrater reliability for the overall mean of the worst PAS score was excellent (ICC = .914, 95% confidence interval [CI] [.853, .951]) but moderate for every swallow in the bolus (ICC = .743, 95% CI [.708, .775]). Intrarater reliability for PAS was excellent (all conditions). Excellent reliability (both inter- and intrarater > .90) was seen for temporal measures of stage transition duration (ICC = .998, 95% CI [.993, .999] and ICC = .995, 95% CI [.987, .998], respectively) as well as initiation of laryngeal closure and pharyngeal transit time and all individual swallow events. Strong scores were obtained for some clearance measures; others were moderate or weak. CONCLUSIONS: Interrater reliability for PAS is acceptable but depends on how the PAS scores are handled in the analysis. Interrater reliability for most temporal measures was high, although some measures required additional training. No clearance measures had excellent reliability. SUPPLEMENTAL MATERIAL: https://doi.org/10.23641/asha.19090088.
Authors: Ana Rita Gatto; Paula Cristina Cola; Roberta Gonçalves da Silva; André Augusto Spadotto; Priscila Watson Ribeiro; Arthur Oscar Schelp; Lidia Raquel de Carvalho; Maria Aparecida Coelho de Arruda Henry Journal: Codas Date: 2013
Authors: Catriona M Steele; Mark T Bayley; Melanie Peladeau-Pigeon; Ahmed Nagy; Ashwini M Namasivayam; Shauna L Stokely; Talia Wolkin Journal: Dysphagia Date: 2016-03-02 Impact factor: 3.438