Francesco Cottone1, Amelie Anota2,3, Franck Bonnetain2,3, Gary S Collins4, Fabio Efficace1. 1. Italian Group for Adult Hematologic Diseases (GIMEMA) Data Center and Health Outcomes Research Unit, Rome, Italy. 2. Quality of Life in Oncology Clinical Research Platform, Besançon, France. 3. University Hospital of Besançon, Methodology and Quality of Life in Oncology Unit, Besançon, France. 4. Centre for Statistics in Medicine, University of Oxford, Oxford, UK.
Abstract
PURPOSE: The aim of this study was to investigate the potential added value of combining propensity score (PS) methods with multivariable linear regression (MLR) in estimating the average treatment effect on the treated (ATT) in nonrandomized studies with health-related quality of life (HRQoL) outcomes. METHODS: We first used simulations to compare the performances of different PS-based methods, either alone or in combination with further MLR adjustment, in estimating ATT. PS methods were, respectively, optimal pair (OPM) and full (OFM) PS matching, subclassification on the PS (SBC), and the inverse probability of treatment weighting (IPTW). We simulated several scenarios, according to different sample sizes, proportions of treated vs untreated subjects, and types of HRQoL outcomes. We also applied the same methods to a real clinical data set. RESULTS: OPM and IPTW provided the closest Type I error to the nominal threshold α = 0.05 across all scenarios. Overall, both methods showed also lower variability in estimates than SBC and OFM. SBC performed worst, generally providing the highest levels of bias. Further MLR adjustment lessened bias for all methods, however providing higher Type I error for SBC and OFM. In the real case, all methods provided similar ATT estimates except for one outcome. CONCLUSIONS: Our findings suggest that for sample sizes up to n = 200, OPM and IPTW are to be preferred to OFM and SBC in estimating ATT on HRQoL outcomes. Specifically, OPM performed best in sample sizes of n ≥ 80, IPTW for smaller sample sizes. Additional MLR adjustment can further improve ATT estimates.
PURPOSE: The aim of this study was to investigate the potential added value of combining propensity score (PS) methods with multivariable linear regression (MLR) in estimating the average treatment effect on the treated (ATT) in nonrandomized studies with health-related quality of life (HRQoL) outcomes. METHODS: We first used simulations to compare the performances of different PS-based methods, either alone or in combination with further MLR adjustment, in estimating ATT. PS methods were, respectively, optimal pair (OPM) and full (OFM) PS matching, subclassification on the PS (SBC), and the inverse probability of treatment weighting (IPTW). We simulated several scenarios, according to different sample sizes, proportions of treated vs untreated subjects, and types of HRQoL outcomes. We also applied the same methods to a real clinical data set. RESULTS:OPM and IPTW provided the closest Type I error to the nominal threshold α = 0.05 across all scenarios. Overall, both methods showed also lower variability in estimates than SBC and OFM. SBC performed worst, generally providing the highest levels of bias. Further MLR adjustment lessened bias for all methods, however providing higher Type I error for SBC and OFM. In the real case, all methods provided similar ATT estimates except for one outcome. CONCLUSIONS: Our findings suggest that for sample sizes up to n = 200, OPM and IPTW are to be preferred to OFM and SBC in estimating ATT on HRQoL outcomes. Specifically, OPM performed best in sample sizes of n ≥ 80, IPTW for smaller sample sizes. Additional MLR adjustment can further improve ATT estimates.