Cynthia P Iglesias1, Alexander Thompson2, Wolf H Rogowski3,4, Katherine Payne5. 1. Department of Health Sciences, Centre for Health Economics and the Hull and York Medical School, University of York, York, UK. 2. Manchester Centre for Health Economics, The University of Manchester, 4th Floor, Jean McFarlane Building, Oxford Road, Manchester, M13 9PL, UK. 3. Helmholtz Zentrum München, German Research Center for Environmental Health, Institute of Health Economics and Health Care Management, Neuherberg, Germany. 4. Department of Health Care Management, Institute of Public Health and Nursing Research, Health Sciences, University of Bremen, Bremen, Germany. 5. Manchester Centre for Health Economics, The University of Manchester, 4th Floor, Jean McFarlane Building, Oxford Road, Manchester, M13 9PL, UK. Katherine.payne@manchester.ac.uk.
Abstract
INTRODUCTION: Expert judgement has a role in model-based economic evaluations (EEs) of healthcare interventions. This study aimed to produce reporting criteria for two types of study design to use expert judgement in model-based EE: (i) an expert elicitation (quantitative) study; and (ii) a Delphi study to collate (qualitative) expert opinion. METHODS: A two-round online Delphi process identified the degree of consensus for four core definitions (expert; expert parameter values; expert elicitation study; expert opinion) and two sets of reporting criteria in a purposive sample of experts. The initial set of reporting criteria comprised 17 statements for reporting a study to elicit parameter values and/or distributions and 11 statements for reporting a Delphi survey to obtain expert opinion. Fifty experts were invited to become members of the Delphi process panel by e-mail. Data analysis summarised the extent of agreement (using a pre-defined 75 % 'consensus' threshold) on the definitions and suggested reporting criteria. Free-text comments were analysed using thematic analysis. RESULTS: The final panel comprised 12 experts. Consensus was achieved for the definitions of expert (88 %); expert parameter values (83 %); and expert elicitation study (83 %). The panel recommended criteria to use when reporting an expert elicitation study (16 criteria) and a Delphi study to collate expert opinion (11 criteria). CONCLUSION: This study has produced guidelines for reporting two types of study design to use expert judgement in model-based EE: (i) an expert elicitation study requiring 16 reporting criteria; and (ii) a Delphi study to collate expert opinion requiring 11 reporting criteria.
INTRODUCTION: Expert judgement has a role in model-based economic evaluations (EEs) of healthcare interventions. This study aimed to produce reporting criteria for two types of study design to use expert judgement in model-based EE: (i) an expert elicitation (quantitative) study; and (ii) a Delphi study to collate (qualitative) expert opinion. METHODS: A two-round online Delphi process identified the degree of consensus for four core definitions (expert; expert parameter values; expert elicitation study; expert opinion) and two sets of reporting criteria in a purposive sample of experts. The initial set of reporting criteria comprised 17 statements for reporting a study to elicit parameter values and/or distributions and 11 statements for reporting a Delphi survey to obtain expert opinion. Fifty experts were invited to become members of the Delphi process panel by e-mail. Data analysis summarised the extent of agreement (using a pre-defined 75 % 'consensus' threshold) on the definitions and suggested reporting criteria. Free-text comments were analysed using thematic analysis. RESULTS: The final panel comprised 12 experts. Consensus was achieved for the definitions of expert (88 %); expert parameter values (83 %); and expert elicitation study (83 %). The panel recommended criteria to use when reporting an expert elicitation study (16 criteria) and a Delphi study to collate expert opinion (11 criteria). CONCLUSION: This study has produced guidelines for reporting two types of study design to use expert judgement in model-based EE: (i) an expert elicitation study requiring 16 reporting criteria; and (ii) a Delphi study to collate expert opinion requiring 11 reporting criteria.
Authors: Silvia Evers; Mariëlle Goossens; Henrica de Vet; Maurits van Tulder; André Ament Journal: Int J Technol Assess Health Care Date: 2005 Impact factor: 2.188
Authors: Don Husereau; Michael Drummond; Stavros Petrou; Chris Carswell; David Moher; Dan Greenberg; Federico Augustovski; Andrew H Briggs; Josephine Mauskopf; Elizabeth Loder Journal: BMJ Date: 2013-03-25
Authors: Laura Bojke; Bogdan Grigore; Dina Jankovic; Jaime Peters; Marta Soares; Ken Stein Journal: Pharmacoeconomics Date: 2017-09 Impact factor: 4.981
Authors: David T Levy; Rafael Meza; Zhe Yuan; Yameng Li; Christopher Cadham; Luz Maria Sanchez-Romero; Nargiz Travis; Marie Knoll; Alex C Liber; Ritesh Mistry; Jana L Hirschtick; Nancy L Fleischer; Sarah Skolnick; Andrew F Brouwer; Cliff Douglas; Jihyoun Jeon; Steven Cook; Kenneth E Warner Journal: Tob Control Date: 2021-09-02 Impact factor: 6.953
Authors: Valérie D V Sankatsing; Karolina Juraniec; Sabine E Grimm; Manuela A Joore; Ruud M Pijnappel; Harry J de Koning; Nicolien T van Ravesteyn Journal: Radiology Date: 2020-08-04 Impact factor: 11.105
Authors: Laura Bojke; Marta Soares; Karl Claxton; Abigail Colson; Aimée Fox; Christopher Jackson; Dina Jankovic; Alec Morton; Linda Sharples; Andrea Taylor Journal: Health Technol Assess Date: 2021-06 Impact factor: 4.014
Authors: David Dimmock; Sara Caylor; Bryce Waldman; Wendy Benson; Christina Ashburner; Jason L Carmichael; Jeanne Carroll; Elaine Cham; Shimul Chowdhury; John Cleary; Arthur D'Harlingue; A Doshi; Katarzyna Ellsworth; Carolina I Galarreta; Charlotte Hobbs; Kathleen Houtchens; Juliette Hunt; Priscilla Joe; Maries Joseph; Robert H Kaplan; Stephen F Kingsmore; Jason Knight; Aaina Kochhar; Richard G Kronick; Jolie Limon; Madelena Martin; Katherine A Rauen; Adam Schwarz; Suma P Shankar; Rosanna Spicer; Mario Augusto Rojas; Ofelia Vargas-Shiraishi; Kristen Wigby; Neda Zadeh; Lauge Farnaes Journal: Am J Hum Genet Date: 2021-06-04 Impact factor: 11.025
Authors: Jörn M Schattenberg; Jeffrey V Lazarus; Philip N Newsome; Lawrence Serfaty; Alessio Aghemo; Salvador Augustin; Emmanuel Tsochatzis; Victor de Ledinghen; Elisabetta Bugianesi; Manuel Romero-Gomez; Heike Bantel; Stephen D Ryder; Jerome Boursier; Vincent Leroy; Javier Crespo; Laurent Castera; Lefteris Floros; Vincenzo Atella; Jorge Mestre-Ferrandiz; Rachel Elliott; Achim Kautz; Alice Morgan; Sally Hartmanis; Sharad Vasudevan; Lynne Pezzullo; Aldo Trylesinski; Sandrine Cure; Victoria Higgins; Vlad Ratziu Journal: Liver Int Date: 2021-03-18 Impact factor: 5.828
Authors: Michael Wagner; Christina Jaki; Ruth M Löllgen; Lukas Mileder; Fabian Eibensteiner; Valentin Ritschl; Philipp Steinbauer; Maximilian Gottstein; Kamal Abulebda; Aaron Calhoun; Isabel T Gross Journal: Pediatr Crit Care Med Date: 2021-06-01 Impact factor: 3.971