Karen Baker1, Louise Barrett2, E Diane Playford1, Trefor Aspden3, Afsane Riazi3, Jeremy Hobart2. 1. Department of Brain Repair and Rehabilitation, UCL Institute of Neurology, London, UK. 2. Clinical Neurology Research Group, Plymouth University Peninsula Schools of Medicine and Dentistry, Plymouth, UK. 3. Department of Psychology, Royal Holloway University of London, Egham, Surrey, UK.
Abstract
OBJECTIVE: Despite a growing call to use patient-reported outcomes in clinical research, few are available for measuring upper limb function post-stroke. We examined the Disabilities of the Arm, Shoulder and Hand (DASH) to evaluate its measurement performance in acute stroke. In doing so, we compared results from traditional and modern psychometric methods. METHODS: 172 people with acute stroke completed the DASH. Those with upper limb impairments completed the DASH again at 6 weeks (n=99). Data (n=271) were analysed using two psychometric paradigms: traditional psychometric (Classical Test Theory, CTT) analyses examined data completeness, scaling assumptions, targeting, reliability and responsiveness; Rasch Measurement Theory (RMT) analyses examined scale-to-sample targeting, scale performance and person measurement. RESULTS: CTT analyses implied the DASH was psychometrically robust in this sample. Data completeness was high, criteria for scaling assumptions were satisfied (item-total correlations 0.55-0.95), targeting was good, internal consistency reliability was high (Cronbach's α=0.99) and responsiveness was clinically moderate (effect size=0.51). However, RMT analyses identified important limitations: scale-to-sample targeting was suboptimal, 4 items had disordered response category thresholds, 16 items exhibited misfit, 3 pairs of items had high residual correlations (>0.60) and 84 person fit residuals exceeded the recommended range. CONCLUSIONS: RMT methods identified limitations missed by CTT and indicate areas for improvement of the DASH as an upper limb measure for acute stroke. Findings, similar to those identified in multiple sclerosis, highlight the need for scales to have strong conceptual underpinnings, with their development and modification guided by sophisticated psychometric methods. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/
OBJECTIVE: Despite a growing call to use patient-reported outcomes in clinical research, few are available for measuring upper limb function post-stroke. We examined the Disabilities of the Arm, Shoulder and Hand (DASH) to evaluate its measurement performance in acute stroke. In doing so, we compared results from traditional and modern psychometric methods. METHODS: 172 people with acute stroke completed the DASH. Those with upper limb impairments completed the DASH again at 6 weeks (n=99). Data (n=271) were analysed using two psychometric paradigms: traditional psychometric (Classical Test Theory, CTT) analyses examined data completeness, scaling assumptions, targeting, reliability and responsiveness; Rasch Measurement Theory (RMT) analyses examined scale-to-sample targeting, scale performance and person measurement. RESULTS: CTT analyses implied the DASH was psychometrically robust in this sample. Data completeness was high, criteria for scaling assumptions were satisfied (item-total correlations 0.55-0.95), targeting was good, internal consistency reliability was high (Cronbach's α=0.99) and responsiveness was clinically moderate (effect size=0.51). However, RMT analyses identified important limitations: scale-to-sample targeting was suboptimal, 4 items had disordered response category thresholds, 16 items exhibited misfit, 3 pairs of items had high residual correlations (>0.60) and 84 person fit residuals exceeded the recommended range. CONCLUSIONS: RMT methods identified limitations missed by CTT and indicate areas for improvement of the DASH as an upper limb measure for acute stroke. Findings, similar to those identified in multiple sclerosis, highlight the need for scales to have strong conceptual underpinnings, with their development and modification guided by sophisticated psychometric methods. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/