S Nolte1,2, A Mierke3, H F Fischer3,4, M Rose3,5. 1. Department of Psychosomatic Medicine, Center for Internal Medicine and Dermatology, Charité - Universitätsmedizin Berlin, Charitéplatz 1, 10117, Berlin, Germany. sandra.nolte@charite.de. 2. Population Health Strategic Research Centre, School of Health and Social Development, Deakin University, Burwood, VIC, 3125, Australia. sandra.nolte@charite.de. 3. Department of Psychosomatic Medicine, Center for Internal Medicine and Dermatology, Charité - Universitätsmedizin Berlin, Charitéplatz 1, 10117, Berlin, Germany. 4. Institute for Social Medicine, Epidemiology and Health Economics, Charité - Universitätsmedizin Berlin, Berlin, Germany. 5. Quantitative Health Sciences, Outcomes Measurement Science, University of Massachusetts Medical School, Worcester, MA, USA.
Abstract
OBJECTIVE: Significant life events such as severe health status changes or intensive medical treatment often trigger response shifts in individuals that may hamper the comparison of measurements over time. Drawing from the Oort model, this study aims at detecting response shift at the item level in psychosomatic inpatients and evaluating its impact on the validity of comparing repeated measurements. STUDY DESIGN AND SETTING: Complete pretest and posttest data were available from 1188 patients who had filled out the ICD-10 Symptom Rating (ISR) scale at admission and discharge, on average 24 days after intake. Reconceptualization, reprioritization, and recalibration response shifts were explored applying tests of measurement invariance. In the item-level approach, all model parameters were constrained to be equal between pretest and posttest. If non-invariance was detected, these were linked to the different types of response shift. RESULTS: When constraining across-occasion model parameters, model fit worsened as indicated by a significant Satorra-Bentler Chi-square difference test suggesting potential presence of response shifts. A close examination revealed presence of two types of response shift, i.e., (non)uniform recalibration and both higher- and lower-level reconceptualization response shifts leading to four model adjustments. CONCLUSIONS: Our analyses suggest that psychosomatic inpatients experienced some response shifts during their hospital stay. According to the hierarchy of measurement invariance, however, only one of the detected non-invariances is critical for unbiased mean comparisons over time, which did not have a substantial impact on estimating change. Hence, the use of the ISR can be recommended for outcomes assessment in clinical routine, as change score estimates do not seem hampered by response shift effects.
OBJECTIVE: Significant life events such as severe health status changes or intensive medical treatment often trigger response shifts in individuals that may hamper the comparison of measurements over time. Drawing from the Oort model, this study aims at detecting response shift at the item level in psychosomatic inpatients and evaluating its impact on the validity of comparing repeated measurements. STUDY DESIGN AND SETTING: Complete pretest and posttest data were available from 1188 patients who had filled out the ICD-10 Symptom Rating (ISR) scale at admission and discharge, on average 24 days after intake. Reconceptualization, reprioritization, and recalibration response shifts were explored applying tests of measurement invariance. In the item-level approach, all model parameters were constrained to be equal between pretest and posttest. If non-invariance was detected, these were linked to the different types of response shift. RESULTS: When constraining across-occasion model parameters, model fit worsened as indicated by a significant Satorra-Bentler Chi-square difference test suggesting potential presence of response shifts. A close examination revealed presence of two types of response shift, i.e., (non)uniform recalibration and both higher- and lower-level reconceptualization response shifts leading to four model adjustments. CONCLUSIONS: Our analyses suggest that psychosomatic inpatients experienced some response shifts during their hospital stay. According to the hierarchy of measurement invariance, however, only one of the detected non-invariances is critical for unbiased mean comparisons over time, which did not have a substantial impact on estimating change. Hence, the use of the ISR can be recommended for outcomes assessment in clinical routine, as change score estimates do not seem hampered by response shift effects.
Authors: Carolyn E Schwartz; Rita Bode; Nicholas Repucci; Janine Becker; Mirjam A G Sprangers; Peter M Fayers Journal: Qual Life Res Date: 2006-09-26 Impact factor: 4.147
Authors: Sara Ahmed; Richard A Berzon; Dennis A Revicki; William R Lenderking; Carol M Moinpour; Ethan Basch; Bryce B Reeve; Albert W Wu Journal: Med Care Date: 2012-12 Impact factor: 2.983
Authors: Ingrid V E Carlier; Wessel A van Eeden; Kim de Jong; Erik J Giltay; Martijn S van Noorden; Christina van der Feltz-Cornelis; Frans G Zitman; Henk Kelderman; Albert M van Hemert Journal: Int J Methods Psychiatr Res Date: 2019-06-17 Impact factor: 4.035
Authors: M G E Verdam; W van Ballegooijen; C J M Holtmaat; H Knoop; J Lancee; F J Oort; H Riper; A van Straten; I M Verdonck-de Leeuw; M de Wit; T van der Zweerde; M A G Sprangers Journal: PLoS One Date: 2021-05-25 Impact factor: 3.240