Frank de Vocht1,2,3, Srinivasa Vittal Katikireddi4, Cheryl McQuire5,6, Kate Tilling5,7, Matthew Hickman5, Peter Craig4. 1. Population Health Sciences, Bristol Medical School, University of Bristol, Canynge Hall, 39 Whatley Road, Bristol, BS8 2PS, UK. frank.devocht@bristol.ac.uk. 2. NIHR School for Public Health Research, Newcastle, UK. frank.devocht@bristol.ac.uk. 3. NIHR Applied Research Collaboration West, Bristol, UK. frank.devocht@bristol.ac.uk. 4. MRC/CSO Social and Public Health Sciences Unit, University of Glasgow, Bristol, UK. 5. Population Health Sciences, Bristol Medical School, University of Bristol, Canynge Hall, 39 Whatley Road, Bristol, BS8 2PS, UK. 6. NIHR School for Public Health Research, Newcastle, UK. 7. MRC IEU, University of Bristol, Bristol, UK.
Abstract
BACKGROUND: Natural or quasi experiments are appealing for public health research because they enable the evaluation of events or interventions that are difficult or impossible to manipulate experimentally, such as many policy and health system reforms. However, there remains ambiguity in the literature about their definition and how they differ from randomized controlled experiments and from other observational designs. We conceptualise natural experiments in the context of public health evaluations and align the study design to the Target Trial Framework. METHODS: A literature search was conducted, and key methodological papers were used to develop this work. Peer-reviewed papers were supplemented by grey literature. RESULTS: Natural experiment studies (NES) combine features of experiments and non-experiments. They differ from planned experiments, such as randomized controlled trials, in that exposure allocation is not controlled by researchers. They differ from other observational designs in that they evaluate the impact of events or process that leads to differences in exposure. As a result they are, in theory, less susceptible to bias than other observational study designs. Importantly, causal inference relies heavily on the assumption that exposure allocation can be considered 'as-if randomized'. The target trial framework provides a systematic basis for evaluating this assumption and the other design elements that underpin the causal claims that can be made from NES. CONCLUSIONS: NES should be considered a type of study design rather than a set of tools for analyses of non-randomized interventions. Alignment of NES to the Target Trial framework will clarify the strength of evidence underpinning claims about the effectiveness of public health interventions.
BACKGROUND: Natural or quasi experiments are appealing for public health research because they enable the evaluation of events or interventions that are difficult or impossible to manipulate experimentally, such as many policy and health system reforms. However, there remains ambiguity in the literature about their definition and how they differ from randomized controlled experiments and from other observational designs. We conceptualise natural experiments in the context of public health evaluations and align the study design to the Target Trial Framework. METHODS: A literature search was conducted, and key methodological papers were used to develop this work. Peer-reviewed papers were supplemented by grey literature. RESULTS: Natural experiment studies (NES) combine features of experiments and non-experiments. They differ from planned experiments, such as randomized controlled trials, in that exposure allocation is not controlled by researchers. They differ from other observational designs in that they evaluate the impact of events or process that leads to differences in exposure. As a result they are, in theory, less susceptible to bias than other observational study designs. Importantly, causal inference relies heavily on the assumption that exposure allocation can be considered 'as-if randomized'. The target trial framework provides a systematic basis for evaluating this assumption and the other design elements that underpin the causal claims that can be made from NES. CONCLUSIONS: NES should be considered a type of study design rather than a set of tools for analyses of non-randomized interventions. Alignment of NES to the Target Trial framework will clarify the strength of evidence underpinning claims about the effectiveness of public health interventions.
Entities:
Keywords:
Evaluations; Natural experiments; Public health; Public health policy; Quasi experiments
Authors: Gordon Guyatt; Andrew D Oxman; Elie A Akl; Regina Kunz; Gunn Vist; Jan Brozek; Susan Norris; Yngve Falck-Ytter; Paul Glasziou; Hans DeBeer; Roman Jaeschke; David Rind; Joerg Meerpohl; Philipp Dahm; Holger J Schünemann Journal: J Clin Epidemiol Date: 2010-12-31 Impact factor: 6.437
Authors: Penny A Cook; Suzy C Hargreaves; Elizabeth J Burns; Frank de Vocht; Steve Parrott; Margaret Coffey; Suzanne Audrey; Cathy Ure; Paul Duffy; David Ottiwell; Kiran Kenth; Susan Hare; Kate Ardern Journal: BMC Public Health Date: 2018-04-19 Impact factor: 3.295
Authors: Joshua Petimar; Maricelle Ramirez; Sheryl L Rifas-Shiman; Stephanie Linakis; Jewel Mullen; Christina A Roberto; Jason P Block Journal: Int J Behav Nutr Phys Act Date: 2019-11-04 Impact factor: 6.457
Authors: Jennie C Parnham; Kiara Chang; Christopher Millett; Anthony A Laverty; Stephanie von Hinke; Jonathan Pearson-Stuttard; Frank de Vocht; Martin White; Eszter P Vamos Journal: Nutrients Date: 2022-04-12 Impact factor: 6.706
Authors: Amy Yau; Nicolas Berger; Cherry Law; Laura Cornelsen; Robert Greener; Jean Adams; Emma J Boyland; Thomas Burgoine; Frank de Vocht; Matt Egan; Vanessa Er; Amelia A Lake; Karen Lock; Oliver Mytton; Mark Petticrew; Claire Thompson; Martin White; Steven Cummins Journal: PLoS Med Date: 2022-02-17 Impact factor: 11.069
Authors: Bente Øvrebø; Tonje H Stea; Ingunn H Bergh; Elling Bere; Pål Surén; Per Magnus; Petur B Juliusson; Andrew K Wills Journal: PLoS Med Date: 2022-01-18 Impact factor: 11.069