Stephen O'Neill1,2, Noemi Kreif2,3, Matt Sutton4,5, Richard Grieve2. 1. J.E. Cairnes School of Business and Economics, National University of Ireland Galway, Galway, Ireland. 2. Department of Health Services Research and Policy, London School of Hygiene and Tropical Medicine, London, UK. 3. Centre for Health Economics, University of York, York, UK. 4. Health Organisation, Policy and Economics, School of Health Sciences, University of Manchester, Manchester, UK. 5. Melbourne Institute of Applied Economic and Social Research, University of Melbourne, Melbourne, Victoria, Australia.
Abstract
OBJECTIVE: To compare interactive fixed effects (IFE) and generalized synthetic control (GSC) methods to methods prevalent in health policy evaluation and re-evaluate the impact of the hip fracture best practice tariffs introduced for hospitals in England in 2010. DATA SOURCES: Simulations and Hospital Episode Statistics. STUDY DESIGN: Best practice tariffs aimed to incentivize providers to deliver care in line with guidelines. Under the scheme, 62 providers received an additional payment for each hip fracture admission, while 49 providers did not. We estimate the impact using difference-in-differences (DiD), synthetic control (SC), IFE, and GSC methods. We contrast the estimation methods' performance in a Monte Carlo simulation study. PRINCIPAL FINDINGS: Unlike DiD, SC, and IFE methods, the GSC method provided reliable estimates across a range of simulation scenarios and was preferred for this case study. The introduction of best practice tariffs led to a 5.9 (confidence interval: 2.0 to 9.9) percentage point increase in the proportion of patients having surgery within 48 hours and a statistically insignificant 0.6 (confidence interval: -1.4 to 0.4) percentage point reduction in 30-day mortality. CONCLUSIONS: The GSC approach is an attractive method for health policy evaluation. We cannot be confident that best practice tariffs were effective.
OBJECTIVE: To compare interactive fixed effects (IFE) and generalized synthetic control (GSC) methods to methods prevalent in health policy evaluation and re-evaluate the impact of the hip fracture best practice tariffs introduced for hospitals in England in 2010. DATA SOURCES: Simulations and Hospital Episode Statistics. STUDY DESIGN: Best practice tariffs aimed to incentivize providers to deliver care in line with guidelines. Under the scheme, 62 providers received an additional payment for each hip fracture admission, while 49 providers did not. We estimate the impact using difference-in-differences (DiD), synthetic control (SC), IFE, and GSC methods. We contrast the estimation methods' performance in a Monte Carlo simulation study. PRINCIPAL FINDINGS: Unlike DiD, SC, and IFE methods, the GSC method provided reliable estimates across a range of simulation scenarios and was preferred for this case study. The introduction of best practice tariffs led to a 5.9 (confidence interval: 2.0 to 9.9) percentage point increase in the proportion of patients having surgery within 48 hours and a statistically insignificant 0.6 (confidence interval: -1.4 to 0.4) percentage point reduction in 30-day mortality. CONCLUSIONS: The GSC approach is an attractive method for health policy evaluation. We cannot be confident that best practice tariffs were effective.
Authors: Andrew M Ryan; James F Burgess; Michael F Pesko; William B Borden; Justin B Dimick Journal: Health Serv Res Date: 2014-07-15 Impact factor: 3.402
Authors: Pantelis Samartsidis; Natasha N Martin; Victor De Gruttola; Frank De Vocht; Sharon Hutchinson; Judith J Lok; Amy Puenpatom; Rui Wang; Matthew Hickman; Daniela De Angelis Journal: Stat Commun Infect Dis Date: 2021-10-11
Authors: Yonghong Li; Bo Sun; Changlin Yang; Xianghua Zhuang; Liancheng Huang; Qingqing Wang; Peng Bi; Yan Wang; Xiaoyuan Yao; Yibin Cheng Journal: Int J Environ Res Public Health Date: 2022-02-22 Impact factor: 3.390