OBJECTIVE: This simulation study was designed to provide data on the performance of Oort's procedure (OP) for response shift (RS) detection (regarding type I error, power, and overall performance), according to sample characteristics, at item level. A specific objective was to assess the impact of using different information criteria (IC), as alternatives to the LRT (likelihood-ratio test), for global assessment of RS occurrence. METHODS: Responses to five binary items at two times of measurement were simulated. Thirty-six combinations of sample characteristics [sample size (n), "true change," correlations between the two latent variables and presence/absence of uniform recalibration RS (ur)] were considered. A thousand datasets were generated for each combination. RS detection was performed on each dataset following OP. Type I error and power of the global assessment of RS occurrence, as well as overall performance of the OP, were assessed. RESULTS: The estimated type I error was close to 5 % for the LRT and lower than 5 % for the IC. The estimated power was higher for the LRT as compared to the AIC, which was the highest among the other IC. For the LRT, the estimated power for n = 100 and for the combination of n = 200 and ur = 1 item was below 80 %. Otherwise, for other combinations of sample characteristics, the estimated power was above 90 %. CONCLUSION: For the LRT, higher values of power were estimated compared to IC with appropriate values of type I error. These results were consistent with Oort's proposal to use the LRT as the criterion to assess global RS occurrence.
OBJECTIVE: This simulation study was designed to provide data on the performance of Oort's procedure (OP) for response shift (RS) detection (regarding type I error, power, and overall performance), according to sample characteristics, at item level. A specific objective was to assess the impact of using different information criteria (IC), as alternatives to the LRT (likelihood-ratio test), for global assessment of RS occurrence. METHODS: Responses to five binary items at two times of measurement were simulated. Thirty-six combinations of sample characteristics [sample size (n), "true change," correlations between the two latent variables and presence/absence of uniform recalibration RS (ur)] were considered. A thousand datasets were generated for each combination. RS detection was performed on each dataset following OP. Type I error and power of the global assessment of RS occurrence, as well as overall performance of the OP, were assessed. RESULTS: The estimated type I error was close to 5 % for the LRT and lower than 5 % for the IC. The estimated power was higher for the LRT as compared to the AIC, which was the highest among the other IC. For the LRT, the estimated power for n = 100 and for the combination of n = 200 and ur = 1 item was below 80 %. Otherwise, for other combinations of sample characteristics, the estimated power was above 90 %. CONCLUSION: For the LRT, higher values of power were estimated compared to IC with appropriate values of type I error. These results were consistent with Oort's proposal to use the LRT as the criterion to assess global RS occurrence.
Authors: Aynslie M Hinds; Tolulope T Sajobi; Véronique Sebille; Richard Sawatzky; Lisa M Lix Journal: Qual Life Res Date: 2018-04-20 Impact factor: 4.147
Authors: Silvia Testa; Daniela Di Cuonzo; Giuliana Ritorto; Laura Fanchini; Sara Bustreo; Patrizia Racca; Rosalba Rosato Journal: Health Qual Life Outcomes Date: 2021-01-06 Impact factor: 3.186