Manuel Gomes1, Richard Grieve1, Richard Nixon2, W J Edmunds3. 1. Department of Health Services Research and Policy, London School of Hygiene and Tropical Medicine, London,zzm321990UK (MG, RG) 2. Modeling and Simulation Group, Novartis Pharma AG, Basel, Switzerland (RN) 3. Department of Infectious Disease Epidemiology, London School of Hygiene and Tropical Medicine, London, UK (WJE)
Abstract
INTRODUCTION: The best data for cost-effectiveness analyses (CEAs) of group-level interventions often come from cluster randomized trials (CRTs), where randomization is by cluster (e.g., the hospital attended), not by individual. METHODS: for these CEAs need to recognize both the correlation between costs and outcomes and that these data may be dependent on the cluster. General checklists and methodological guidance for critically appraising CEA ignore these issues. This article develops a new checklist and applies it in a systematic review of CEAs that use CRTs. METHODS: The authors developed a checklist for CEAs that use CRTs, informed by a conceptual review of statistical methods. This checklist included criteria such as whether the analysis allowed for both clustering and the correlation between individuals' costs and outcomes. The authors undertook a systematic literature review of full economic evaluations that used CRTs. The quality of studies was assessed with the new checklist and by the "Drummond checklist." RESULTS: The authors identified 62 papers that met the inclusion criteria. On average, studies satisfied 9 of the 10 criteria for the checklist but only 20% of criteria for the new checklist. More than 40% of studies adopted statistical methods that completely ignored clustering, and 75% disregarded any correlation between costs and outcomes. Only 4 studies employed appropriate statistical methods that allowed for both clustering and correlation. CONCLUSIONS: Most economic evaluations that use data from CRTs ignored clustering or correlation. Statistical methods that address these issues are available, and their use should be encouraged. The new checklist can supplement generic CEA guidelines and highlight where research practice can be improved.
INTRODUCTION: The best data for cost-effectiveness analyses (CEAs) of group-level interventions often come from cluster randomized trials (CRTs), where randomization is by cluster (e.g., the hospital attended), not by individual. METHODS: for these CEAs need to recognize both the correlation between costs and outcomes and that these data may be dependent on the cluster. General checklists and methodological guidance for critically appraising CEA ignore these issues. This article develops a new checklist and applies it in a systematic review of CEAs that use CRTs. METHODS: The authors developed a checklist for CEAs that use CRTs, informed by a conceptual review of statistical methods. This checklist included criteria such as whether the analysis allowed for both clustering and the correlation between individuals' costs and outcomes. The authors undertook a systematic literature review of full economic evaluations that used CRTs. The quality of studies was assessed with the new checklist and by the "Drummond checklist." RESULTS: The authors identified 62 papers that met the inclusion criteria. On average, studies satisfied 9 of the 10 criteria for the checklist but only 20% of criteria for the new checklist. More than 40% of studies adopted statistical methods that completely ignored clustering, and 75% disregarded any correlation between costs and outcomes. Only 4 studies employed appropriate statistical methods that allowed for both clustering and correlation. CONCLUSIONS: Most economic evaluations that use data from CRTs ignored clustering or correlation. Statistical methods that address these issues are available, and their use should be encouraged. The new checklist can supplement generic CEA guidelines and highlight where research practice can be improved.
Authors: Ângela Jornada Ben; Johanna M van Dongen; Mohamed El Alili; Martijn W Heymans; Jos W R Twisk; Janet L MacNeil-Vroomen; Maartje de Wit; Susan E M van Dijk; Teddy Oosterhuis; Judith E Bosmans Journal: Eur J Health Econ Date: 2022-09-26
Authors: Christine Buttorff; Rebecca S Hock; Helen A Weiss; Smita Naik; Ricardo Araya; Betty R Kirkwood; Daniel Chisholm; Vikram Patel Journal: Bull World Health Organ Date: 2012-09-14 Impact factor: 9.408
Authors: Mark E Bensink; Linda H Eaton; Megan L Morrison; Wendy A Cook; R Randall Curtis; Deborah B Gordon; Anjana Kundu; Ardith Z Doorenbos Journal: Nurs Res Date: 2013 Jul-Aug Impact factor: 2.381
Authors: Felix Achana; Daniel Gallacher; Raymond Oppong; Sungwook Kim; Stavros Petrou; James Mason; Michael Crowther Journal: Med Decis Making Date: 2021-04-05 Impact factor: 2.583
Authors: Manuel Gomes; Edmond S-W Ng; Richard Grieve; Richard Nixon; James Carpenter; Simon G Thompson Journal: Med Decis Making Date: 2011-10-19 Impact factor: 2.583
Authors: Paul Stallard; Gordon Taylor; Rob Anderson; Harry Daniels; Neil Simpson; Rhiannon Phillips; Elena Skryabina Journal: Trials Date: 2012-11-27 Impact factor: 2.279