Rosalie Gorter1, Jean-Paul Fox2, Adri Apeldoorn3, Jos Twisk4. 1. Department of Epidemiology & Biostatistics, VU University Medical Centre, Amsterdam, The Netherlands; EMGO+ Institute for Health and Care Research, Amsterdam, The Netherlands. Electronic address: r.gorter@vumc.nl. 2. Department of Research Methodology, Measurement, and Data Analysis, Faculty of Behavioural, Management & Social Sciences, University of Twente, Enschede, The Netherlands. 3. Department of Epidemiology & Biostatistics, VU University Medical Centre, Amsterdam, The Netherlands; Rehabilitation Department, Medical Centre Alkmaar, Alkmaar, The Netherlands. 4. Department of Epidemiology & Biostatistics, VU University Medical Centre, Amsterdam, The Netherlands.
Abstract
OBJECTIVE: In randomized controlled trials (RCTs), outcome variables are often patient-reported outcomes measured with questionnaires. Ideally, all available item information is used for score construction, which requires an item response theory (IRT) measurement model. However, in practice, the classical test theory measurement model (sum scores) is mostly used, and differences between response patterns leading to the same sum score are ignored. The enhanced differentiation between scores with IRT enables more precise estimation of individual trajectories over time and group effects. The objective of this study was to show the advantages of using IRT scores instead of sum scores when analyzing RCTs. STUDY DESIGN AND SETTING: Two studies are presented, a real-life RCT, and a simulation study. Both IRT and sum scores are used to measure the construct and are subsequently used as outcomes for effect calculation. RESULTS: The bias in RCT results is conditional on the measurement model that was used to construct the scores. A bias in estimated trend of around one standard deviation was found when sum scores were used, where IRT showed negligible bias. CONCLUSION: Accurate statistical inferences are made from an RCT study when using IRT to estimate construct measurements. The use of sum scores leads to incorrect RCT results. Copyright Â
OBJECTIVE: In randomized controlled trials (RCTs), outcome variables are often patient-reported outcomes measured with questionnaires. Ideally, all available item information is used for score construction, which requires an item response theory (IRT) measurement model. However, in practice, the classical test theory measurement model (sum scores) is mostly used, and differences between response patterns leading to the same sum score are ignored. The enhanced differentiation between scores with IRT enables more precise estimation of individual trajectories over time and group effects. The objective of this study was to show the advantages of using IRT scores instead of sum scores when analyzing RCTs. STUDY DESIGN AND SETTING: Two studies are presented, a real-life RCT, and a simulation study. Both IRT and sum scores are used to measure the construct and are subsequently used as outcomes for effect calculation. RESULTS: The bias in RCT results is conditional on the measurement model that was used to construct the scores. A bias in estimated trend of around one standard deviation was found when sum scores were used, where IRT showed negligible bias. CONCLUSION: Accurate statistical inferences are made from an RCT study when using IRT to estimate construct measurements. The use of sum scores leads to incorrect RCT results. Copyright Â
Authors: Felix Fischer; Chris Gibbons; Joël Coste; Jose M Valderas; Matthias Rose; Alain Leplège Journal: Qual Life Res Date: 2018-01-19 Impact factor: 4.147
Authors: Ken-Wei Chang; Chih-Ming Lin; Chen-Wen Yen; Chia-Chi Yang; Toshiaki Tanaka; Lan-Yuen Guo Journal: Int J Environ Res Public Health Date: 2021-03-01 Impact factor: 3.390