Emily A Vertosick1, Melissa Assel2, Andrew J Vickers3. 1. Department of Epidemiology and Biostatistics, Memorial Sloan Kettering Cancer Center, 485 Lexington Avenue, 2nd Floor, New York, NY 10017, United States. Electronic address: vertosie@mskcc.org. 2. Department of Epidemiology and Biostatistics, Memorial Sloan Kettering Cancer Center, 485 Lexington Avenue, 2nd Floor, New York, NY 10017, United States. Electronic address: asselm@mskcc.org. 3. Department of Epidemiology and Biostatistics, Memorial Sloan Kettering Cancer Center, 485 Lexington Avenue, 2nd Floor, New York, NY 10017, United States. Electronic address: vickersa@mskcc.org.
Abstract
BACKGROUND: Instrumental variables analysis is a methodology to mitigate the effects of measured and unmeasured confounding in observational studies of treatment effects. Geographic area is increasingly used as an instrument. METHODS: We conducted a literature review to determine the properties of geographic area in studies of cancer treatments. We identified cancer studies performed in the United States which incorporated instrumental variable analysis with area-wide treatment rate within a geographic region as the instrument. We assessed the degree of treatment variability between geographic regions, assessed balance of measured confounders afforded by geographic area and compared the results of instrumental variable analysis to those of multivariable methods. RESULTS: Geographic region as an instrument was relatively common, with 22 eligible studies identified, many of which were published in high-impact journals. Treatment rates did not vary greatly by geographic region. Covariates were not balanced by the instrument in the majority of studies. Eight out of eleven studies found statistically significant effects of treatment on multivariable analysis but not for instrumental variables, with the central estimates of the instrumental variables analysis generally being closer to the null. CONCLUSIONS: We recommend caution and an investigation of IV assumptions when considering the use of geographic region as an instrument in observational studies of cancer treatments. The value of geographic region as an instrument should be critically evaluated in other areas of medicine.
BACKGROUND: Instrumental variables analysis is a methodology to mitigate the effects of measured and unmeasured confounding in observational studies of treatment effects. Geographic area is increasingly used as an instrument. METHODS: We conducted a literature review to determine the properties of geographic area in studies of cancer treatments. We identified cancer studies performed in the United States which incorporated instrumental variable analysis with area-wide treatment rate within a geographic region as the instrument. We assessed the degree of treatment variability between geographic regions, assessed balance of measured confounders afforded by geographic area and compared the results of instrumental variable analysis to those of multivariable methods. RESULTS: Geographic region as an instrument was relatively common, with 22 eligible studies identified, many of which were published in high-impact journals. Treatment rates did not vary greatly by geographic region. Covariates were not balanced by the instrument in the majority of studies. Eight out of eleven studies found statistically significant effects of treatment on multivariable analysis but not for instrumental variables, with the central estimates of the instrumental variables analysis generally being closer to the null. CONCLUSIONS: We recommend caution and an investigation of IV assumptions when considering the use of geographic region as an instrument in observational studies of cancer treatments. The value of geographic region as an instrument should be critically evaluated in other areas of medicine.
Authors: Grace L Lu-Yao; Peter C Albertsen; Dirk F Moore; Weichung Shih; Yong Lin; Robert S DiPaola; Siu-Long Yao Journal: JAMA Intern Med Date: 2014-09 Impact factor: 21.873
Authors: Akiko M Saito; Mary Beth Landrum; Bridget A Neville; John Z Ayanian; Jane C Weeks; Craig C Earle Journal: J Palliat Med Date: 2011-07-18 Impact factor: 2.947
Authors: Justin E Bekelman; Nandita Mitra; Elizabeth A Handorf; Robert G Uzzo; Stephen A Hahn; Daniel Polsky; Katrina Armstrong Journal: J Clin Oncol Date: 2015-01-05 Impact factor: 44.544
Authors: Jeremy A Rassen; M Alan Brookhart; Robert J Glynn; Murray A Mittleman; Sebastian Schneeweiss Journal: J Clin Epidemiol Date: 2009-04-08 Impact factor: 6.437
Authors: Juan P Wisnivesky; Ethan Halm; Marcelo Bonomi; Charles Powell; Emilia Bagiella Journal: Am J Respir Crit Care Med Date: 2009-11-05 Impact factor: 21.405