Ewout B Smit1, Hylco Bouwstra2, Leo D Roorda3, Johannes Hans C van der Wouden2, Elizabeth Lizette M Wattel2, Cees M P M Hertogh2, Caroline B Terwee4. 1. Department of Medicine for Older People, Amsterdam Public Health, Amsterdam UMC, Vrije Universiteit Amsterdam, Amsterdam, the Netherlands. Electronic address: eb.smit@amsterdamumc.nl. 2. Department of Medicine for Older People, Amsterdam Public Health, Amsterdam UMC, Vrije Universiteit Amsterdam, Amsterdam, the Netherlands. 3. Amsterdam Rehabilitation Research Center, Reade, Amsterdam, the Netherlands. 4. Department of Epidemiology and Biostatistics, Amsterdam UMC, Vrije Universiteit Amsterdam, Amsterdam, the Netherlands.
Abstract
OBJECTIVES: To study the test-retest reliability and measurement error, construct validity, responsiveness, interpretability, and floor/ceiling effects of a Patient-Reported Outcomes Measurement Information System (PROMIS) short form designed to measure physical function in geriatric rehabilitation patients (PROMIS-PF-GR). DESIGN: Prospective cohort. SETTING AND PARTICIPANTS: Inpatient geriatric rehabilitation patients. METHODS: We evaluated the test-retest reliability by re-administering PROMIS-PF-GR 3 to 5 days after the admission measurement. The intraclass correlation coefficient (ICC) was calculated to determine test-retest reliability; an ICC of ≥0.70 was considered sufficient. Measurement error was established by calculating the standard error of measurement and smallest detectable change. Construct validity and responsiveness were determined by testing a priori formulated hypotheses (criterion: ≥75% hypothesis not rejected). Interpretability was evaluated by calculating the minimal important change using predictive modeling and a global rating as criterion for change. Floor/ceiling effects were established by calculating the percentage patients with the minimum/maximum raw score (criterion: ≤15%) at admission and discharge. RESULTS: A total of 207 patients participated in the study [mean ± standard deviation age (80 ± 8.3 years), 58% female]. More than one-half of patients (56%) reported to be improved during rehabilitation. The ICC was 0.79 (95% confidence interval 0.70-0.84), the standardized error of measurement was 3.8, and the smallest detectable change 10.6. None of the 4 hypotheses for construct validity were rejected; 2 out of 5 hypotheses for responsiveness were rejected. The minimal important change was 8.0 (95% confidence interval 4.1-12.5). No floor/ceiling effects were found. CONCLUSIONS AND IMPLICATIONS: The PROMIS-PG-GR showed sufficient test-retest reliability, measurement error, and construct validity. We did not find sufficient evidence for responsiveness, which may be due to the unexplained weak correlation between the PROMIS change score and the Global Rating Scale. We still recommend the use the PROMIS-PG-GR for measuring self-reported physical function in geriatric rehabilitation.
OBJECTIVES: To study the test-retest reliability and measurement error, construct validity, responsiveness, interpretability, and floor/ceiling effects of a Patient-Reported Outcomes Measurement Information System (PROMIS) short form designed to measure physical function in geriatric rehabilitation patients (PROMIS-PF-GR). DESIGN: Prospective cohort. SETTING AND PARTICIPANTS: Inpatient geriatric rehabilitation patients. METHODS: We evaluated the test-retest reliability by re-administering PROMIS-PF-GR 3 to 5 days after the admission measurement. The intraclass correlation coefficient (ICC) was calculated to determine test-retest reliability; an ICC of ≥0.70 was considered sufficient. Measurement error was established by calculating the standard error of measurement and smallest detectable change. Construct validity and responsiveness were determined by testing a priori formulated hypotheses (criterion: ≥75% hypothesis not rejected). Interpretability was evaluated by calculating the minimal important change using predictive modeling and a global rating as criterion for change. Floor/ceiling effects were established by calculating the percentage patients with the minimum/maximum raw score (criterion: ≤15%) at admission and discharge. RESULTS: A total of 207 patients participated in the study [mean ± standard deviation age (80 ± 8.3 years), 58% female]. More than one-half of patients (56%) reported to be improved during rehabilitation. The ICC was 0.79 (95% confidence interval 0.70-0.84), the standardized error of measurement was 3.8, and the smallest detectable change 10.6. None of the 4 hypotheses for construct validity were rejected; 2 out of 5 hypotheses for responsiveness were rejected. The minimal important change was 8.0 (95% confidence interval 4.1-12.5). No floor/ceiling effects were found. CONCLUSIONS AND IMPLICATIONS: The PROMIS-PG-GR showed sufficient test-retest reliability, measurement error, and construct validity. We did not find sufficient evidence for responsiveness, which may be due to the unexplained weak correlation between the PROMIS change score and the Global Rating Scale. We still recommend the use the PROMIS-PG-GR for measuring self-reported physical function in geriatric rehabilitation.
Authors: Sean R Smith; Mary Vargo; David S Zucker; Samman Shahpar; Lynn H Gerber; Maryanne Henderson; Gina Jay; Andrea L Cheville Journal: Cancer Date: 2022-07-05 Impact factor: 6.921
Authors: Caroline B Terwee; John Devin Peipert; Robert Chapman; Jin-Shei Lai; Berend Terluin; David Cella; Philip Griffith; Lidwine B Mokkink Journal: Qual Life Res Date: 2021-07-10 Impact factor: 4.147