Benjamin D Schalet1, Michael A Kallen2, Allen W Heinemann3, Anne Deutsch4, Karon F Cook2, Linda Foster5, David Cella2. 1. Department of Medical Social Sciences, Feinberg School of Medicine, Northwestern University, Chicago, IL. Electronic address: b-schalet@nortwestern.edu. 2. Department of Medical Social Sciences, Feinberg School of Medicine, Northwestern University, Chicago, IL. 3. Center for Rehabilitation Outcomes Research, Shirley Ryan AbilityLab, Chicago, IL; Department of Physical Medicine and Rehabilitation, Feinberg School of Medicine, Northwestern University, Chicago, IL. 4. Center for Rehabilitation Outcomes Research, Shirley Ryan AbilityLab, Chicago, IL; Department of Physical Medicine and Rehabilitation, Feinberg School of Medicine, Northwestern University, Chicago, IL; Quality Measurement and Health Policy Program, eHealth, Quality & Analytics Division, RTI International, Chicago, IL. 5. Alexian Brothers Rehabilitation Hospital, Elk Grove Village, IL.
Abstract
OBJECTIVE: To evaluate the Patient-Reported Outcomes Measurement Information System (PROMIS) pain interference items for use in a quality measure and to compare the resulting quality score, along with internal reliability and validity, to a similar item set in the Minimum Data Set Version 3.0 (MDS). DESIGN: Cross-sectional, observational study. SETTING: One freestanding inpatient rehabilitation facility (IRF) and one large hospital-based IRF. PARTICIPANTS: Patients with neurologic disorders. Of 1055 consecutive admissions, 26% were excluded based on clinician-determined cognitive impairment or emotional distress. Of the remainder, 50% consented and completed the survey near the end of their IRF stay (N = 391). Of these, more than half (57%) reported pain over the last day (n = 224). MEASUREMENTS: Psychometric statistics and quality scores were computed from a 55-question survey, including the MDS and PROMIS pain interference items. RESULTS: Estimates for internal reliability were higher for the PROMIS 2-item scale compared to the MDS: Cronbach α (0.86 vs 0.48) and interitem correlations (0.75 vs 0.31). The PROMIS-2 items were better able to detect differences in patients with mild and severe pain intensity (Cohen d = 1.57) relative to the corresponding MDS items (Cohen d = 0.81). Two quality scores based on the PROMIS-2 items, reflecting low and high levels of pain interference, showed 46% or 12% of patients meeting these thresholds. This compared to a 30% rate when patients were classified by the MDS as experiencing pain interference. CONCLUSIONS: PROMIS pain interference items appear to be more internally consistent than similar MDS items. The graded PROMIS items permit the creation of multiple quality scores, showing predictable overlap with corresponding MDS quality scores. Because PROMIS items provide finer distinctions, they allow greater latitude in reporting quality scores. We recommend further study of pain interference scores across IRFs to improve their reliability and validity.
OBJECTIVE: To evaluate the Patient-Reported Outcomes Measurement Information System (PROMIS) pain interference items for use in a quality measure and to compare the resulting quality score, along with internal reliability and validity, to a similar item set in the Minimum Data Set Version 3.0 (MDS). DESIGN: Cross-sectional, observational study. SETTING: One freestanding inpatient rehabilitation facility (IRF) and one large hospital-based IRF. PARTICIPANTS: Patients with neurologic disorders. Of 1055 consecutive admissions, 26% were excluded based on clinician-determined cognitive impairment or emotional distress. Of the remainder, 50% consented and completed the survey near the end of their IRF stay (N = 391). Of these, more than half (57%) reported pain over the last day (n = 224). MEASUREMENTS: Psychometric statistics and quality scores were computed from a 55-question survey, including the MDS and PROMIS pain interference items. RESULTS: Estimates for internal reliability were higher for the PROMIS 2-item scale compared to the MDS: Cronbach α (0.86 vs 0.48) and interitem correlations (0.75 vs 0.31). The PROMIS-2 items were better able to detect differences in patients with mild and severe pain intensity (Cohen d = 1.57) relative to the corresponding MDS items (Cohen d = 0.81). Two quality scores based on the PROMIS-2 items, reflecting low and high levels of pain interference, showed 46% or 12% of patients meeting these thresholds. This compared to a 30% rate when patients were classified by the MDS as experiencing pain interference. CONCLUSIONS: PROMIS pain interference items appear to be more internally consistent than similar MDS items. The graded PROMIS items permit the creation of multiple quality scores, showing predictable overlap with corresponding MDS quality scores. Because PROMIS items provide finer distinctions, they allow greater latitude in reporting quality scores. We recommend further study of pain interference scores across IRFs to improve their reliability and validity.
Authors: Peter G Passias; Samantha R Horn; Frank A Segreto; Cole A Bortz; Katherine E Pierce; Dennis Vasquez-Montes; John Moon; Christopher G Varlotta; Tina Raman; Nicholas J Frangella; Nicholas Stekas; Renaud Lafage; Virginie Lafage; Michael C Gerling; Themistocles S Protopsaltis; Aaron J Buckland; Charla R Fischer Journal: Global Spine J Date: 2019-06-09
Authors: Karl Swedberg; Desmond Cawley; Inger Ekman; Heather L Rogers; Darijana Antonic; Daiga Behmane; Ida Björkman; Nicky Britten; Sandra C Buttigieg; Vivienne Byers; Mats Börjesson; Kirsten Corazzini; Andreas Fors; Bradi Granger; Boban Joksimoski; Roman Lewandowski; Virgilijus Sakalauskas; Einav Srulovici; Jan Törnell; Sara Wallström; Axel Wolf; Helen M Lloyd Journal: Health Sci Rep Date: 2021-06-06
Authors: Xiaodan Tang; Benjamin D Schalet; Man Hung; Darrel S Brodke; Charles L Saltzman; David Cella Journal: Spine J Date: 2021-02-19 Impact factor: 4.297
Authors: Laura Cano-García; Natalia Mena-Vázquez; Sara Manrique-Arija; Rocío Redondo-Rodriguez; Carmen María Romero-Barco; Antonio Fernández-Nebro Journal: Diagnostics (Basel) Date: 2021-12-02