Thomas B Newman1,2,3, Eric Vittinghoff1, Charles E McCulloch1. 1. Department of Epidemiology and Biostatistics, Division of Clinical Epidemiology, University of California, San Francisco (TBN, EV, CEM) 2. Department of Pediatrics, Division of General Pediatrics, University of California, San Francisco (TBN) 3. Kaiser Permanente Medical Care Program, Division of Research, Oakland, CA (TBN)
Abstract
BACKGROUND: Use of instrumental variables is gaining popularity as a method of controlling for confounding by indication in observational studies of treatments. OBJECTIVES: To illustrate how unmeasured instrument-level treatment substitution can distort effect size estimates using as an example an instrumental variable analysis of phototherapy for neonatal jaundice. DESIGN: Retrospective cohort study. SETTING: Northern California Kaiser Permanente Hospitals. PATIENTS: The authors studied 20,731 newborns ≥ 2000 g and ≥ 35 weeks' gestation born 1995-2004 with a "qualifying" total serum bilirubin (TSB) level within 3 mg/dL of the 2004 American Academy of Pediatrics (AAP) phototherapy threshold who did not have a positive direct antiglobulin test. MEASUREMENTS: The intervention was inpatient phototherapy within 8 hours of the qualifying TSB. The outcome was a TSB level exceeding the AAP exchange transfusion threshold <48 hours from the qualifying TSB. The instrumental variable was a measure of the frequency of phototherapy use at the newborn's birth hospital. The unmeasured substituted treatment was supplementation with infant formula, assessed by chart review in a sample from the same cohort. RESULTS: In total, 128 infants (0.62%) exceeded the exchange transfusion threshold. Logistic and propensity analyses yielded crude odds ratios of ~0.5 for phototherapy efficacy, decreasing to ~0.2 with control for confounding by indication. Instrumental variable analyses suggested much greater phototherapy efficacy (e.g., odds ratios of 0.02-0.05). However, chart reviews revealed greater use of infant formula (which also lowers bilirubin levels) in hospitals that used more phototherapy (r = 0.56; P = 0.02), an association not present at the individual level (r = 0.13). CONCLUSIONS: Instrumental variable analyses may provide biased estimates of treatment efficacy if there are cointerventions or confounders associated with treatment at the level of the instrument, although even when these associations may not exist in individuals.
BACKGROUND: Use of instrumental variables is gaining popularity as a method of controlling for confounding by indication in observational studies of treatments. OBJECTIVES: To illustrate how unmeasured instrument-level treatment substitution can distort effect size estimates using as an example an instrumental variable analysis of phototherapy for neonatal jaundice. DESIGN: Retrospective cohort study. SETTING: Northern California Kaiser Permanente Hospitals. PATIENTS: The authors studied 20,731 newborns ≥ 2000 g and ≥ 35 weeks' gestation born 1995-2004 with a "qualifying" total serum bilirubin (TSB) level within 3 mg/dL of the 2004 American Academy of Pediatrics (AAP) phototherapy threshold who did not have a positive direct antiglobulin test. MEASUREMENTS: The intervention was inpatient phototherapy within 8 hours of the qualifying TSB. The outcome was a TSB level exceeding the AAP exchange transfusion threshold <48 hours from the qualifying TSB. The instrumental variable was a measure of the frequency of phototherapy use at the newborn's birth hospital. The unmeasured substituted treatment was supplementation with infant formula, assessed by chart review in a sample from the same cohort. RESULTS: In total, 128 infants (0.62%) exceeded the exchange transfusion threshold. Logistic and propensity analyses yielded crude odds ratios of ~0.5 for phototherapy efficacy, decreasing to ~0.2 with control for confounding by indication. Instrumental variable analyses suggested much greater phototherapy efficacy (e.g., odds ratios of 0.02-0.05). However, chart reviews revealed greater use of infant formula (which also lowers bilirubin levels) in hospitals that used more phototherapy (r = 0.56; P = 0.02), an association not present at the individual level (r = 0.13). CONCLUSIONS: Instrumental variable analyses may provide biased estimates of treatment efficacy if there are cointerventions or confounders associated with treatment at the level of the instrument, although even when these associations may not exist in individuals.
Authors: Olaf H Klungel; Edwin P Martens; Bruce M Psaty; Diederik E Grobbee; Sean D Sullivan; Bruno H Ch Stricker; Hubert G M Leufkens; A de Boer Journal: J Clin Epidemiol Date: 2004-12 Impact factor: 6.437
Authors: Thérèse A Stukel; Elliott S Fisher; David E Wennberg; David A Alter; Daniel J Gottlieb; Marian J Vermeulen Journal: JAMA Date: 2007-01-17 Impact factor: 56.272
Authors: Tahaniyat Lalani; Christopher H Cabell; Daniel K Benjamin; Ovidiu Lasca; Christoph Naber; Vance G Fowler; G Ralph Corey; Vivian H Chu; Michael Fenely; Orathai Pachirat; Ru-San Tan; Richard Watkin; Adina Ionac; Asuncion Moreno; Carlos A Mestres; José Casabé; Natalia Chipigina; Damon P Eisen; Denis Spelman; Francois Delahaye; Gail Peterson; Lars Olaison; Andrew Wang Journal: Circulation Date: 2010-02-16 Impact factor: 29.690
Authors: Maria Rosa Costanzo; R S Johannes; Michael Pine; Vikas Gupta; Mitchell Saltzberg; Joel Hay; Clyde W Yancy; Gregg C Fonarow Journal: Am Heart J Date: 2007-08 Impact factor: 4.749