M Maria Glymour1, Quynh C Nguyen, Roland Matsouaka, Eric J Tchetgen Tchetgen, Nicole M Schmidt, Theresa L Osypuk. 1. From the aDepartment of Epidemiology & Biostatistics, University of California, San Francisco, CA; bDepartment of Health Promotion and Education, College of Health, University of Utah, Salt Lake City, UT; cDepartment of Biostatistics, dDepartment of Epidemiology, Harvard School of Public Health, Boston, MA; eBouvé College of Health Sciences, Institute for Urban Health Research, Northeastern University, Boston, MA (also former affiliation for Drs. Nguyen and Osypuk); and fDivision of Epidemiology and Community Health, University of Minnesota School of Public Health, Minneapolis, MN.
Abstract
BACKGROUND: We describe bias resulting from individualized treatment selection, which occurs when treatment has heterogeneous effects and individuals selectively choose treatments of greatest benefit to themselves. This pernicious bias may confound estimates from observational studies and lead to important misinterpretation of intent-to-treat analyses of randomized trials. Despite the potentially serious threat to inferences, individualized treatment selection has rarely been formally described or assessed. METHODS: The Moving To Opportunity trial randomly assigned subsidized rental vouchers to low-income families in high-poverty public housing. We assessed the Kessler-6 psychological distress and Behavior Problems Index outcomes for 2,829 adolescents 4-7 years after randomization. Among families randomly assigned to receive vouchers, we estimated probability of moving (treatment), predicted by prerandomization characteristics (c statistic = 0.63). We categorized families into tertiles of this estimated probability of moving, and compared instrumental variable effect estimates for moving on behavior problems index and Kessler-6 across tertiles. RESULTS: Instrumental variable estimated effects of moving on behavioral problems index were most adverse for boys least likely to move (b = 0.93; 95% confidence interval: 0.33, 1.53) compared with boys most likely to move (b = 0.14; 95% confidence interval: -0.15, 0.44; P = 0.02 for treatment × tertile interaction). Effects on Kessler-6 were more beneficial for girls least likely to move compared with girls most likely to move (-0.62 vs. 0.02; interaction; P = 0.03). CONCLUSIONS: Evidence of individualized treatment selection differed by child gender and outcome and should be evaluated in randomized trial reports, especially when heterogeneous treatment effects are likely and nonadherence is common.
RCT Entities:
BACKGROUND: We describe bias resulting from individualized treatment selection, which occurs when treatment has heterogeneous effects and individuals selectively choose treatments of greatest benefit to themselves. This pernicious bias may confound estimates from observational studies and lead to important misinterpretation of intent-to-treat analyses of randomized trials. Despite the potentially serious threat to inferences, individualized treatment selection has rarely been formally described or assessed. METHODS: The Moving To Opportunity trial randomly assigned subsidized rental vouchers to low-income families in high-poverty public housing. We assessed the Kessler-6 psychological distress and Behavior Problems Index outcomes for 2,829 adolescents 4-7 years after randomization. Among families randomly assigned to receive vouchers, we estimated probability of moving (treatment), predicted by prerandomization characteristics (c statistic = 0.63). We categorized families into tertiles of this estimated probability of moving, and compared instrumental variable effect estimates for moving on behavior problems index and Kessler-6 across tertiles. RESULTS: Instrumental variable estimated effects of moving on behavioral problems index were most adverse for boys least likely to move (b = 0.93; 95% confidence interval: 0.33, 1.53) compared with boys most likely to move (b = 0.14; 95% confidence interval: -0.15, 0.44; P = 0.02 for treatment × tertile interaction). Effects on Kessler-6 were more beneficial for girls least likely to move compared with girls most likely to move (-0.62 vs. 0.02; interaction; P = 0.03). CONCLUSIONS: Evidence of individualized treatment selection differed by child gender and outcome and should be evaluated in randomized trial reports, especially when heterogeneous treatment effects are likely and nonadherence is common.
Authors: Jens Ludwig; Lisa Sanbonmatsu; Lisa Gennetian; Emma Adam; Greg J Duncan; Lawrence F Katz; Ronald C Kessler; Jeffrey R Kling; Stacy Tessler Lindau; Robert C Whitaker; Thomas W McDade Journal: N Engl J Med Date: 2011-10-20 Impact factor: 91.245
Authors: Theresa L Osypuk; Eric J Tchetgen Tchetgen; Dolores Acevedo-Garcia; Felton J Earls; Alisa Lincoln; Nicole M Schmidt; M Maria Glymour Journal: Arch Gen Psychiatry Date: 2012-12
Authors: D Brown; M Benzeval; V Gayle; S Macintyre; D O'Reilly; A H Leyland Journal: J Epidemiol Community Health Date: 2012-02-06 Impact factor: 3.710