Anna Heath1, Gianluca Baio2. 1. Department of Statistical Science, University College London, London, UK. Electronic address: anna.heath.14@ucl.ac.uk. 2. Department of Statistical Science, University College London, London, UK.
Abstract
OBJECTIVE: The expected value of sample information (EVSI) quantifies the economic benefit of reducing uncertainty in a health economic model by collecting additional information. This has the potential to improve the allocation of research budgets. Despite this, practical EVSI evaluations are limited partly due to the computational cost of estimating this value using the gold-standard nested simulation methods. Recently, however, Heath et al. developed an estimation procedure that reduces the number of simulations required for this gold-standard calculation. Up to this point, this new method has been presented in purely technical terms. STUDY DESIGN: This study presents the practical application of this new method to aid its implementation. We use a worked example to illustrate the key steps of the EVSI estimation procedure before discussing its optimal implementation using a practical health economic model. METHODS: The worked example is based on a three-parameter linear health economic model. The more realistic model evaluates the cost-effectiveness of a new chemotherapy treatment, which aims to reduce the number of side effects experienced by patients. We use a Markov model structure to evaluate the health economic profile of experiencing side effects. RESULTS: This EVSI estimation method offers accurate estimation within a feasible computation time, seconds compared to days, even for more complex model structures. The EVSI estimation is more accurate if a greater number of nested samples are used, even for a fixed computational cost. CONCLUSIONS: This new method reduces the computational cost of estimating the EVSI by nested simulation.
OBJECTIVE: The expected value of sample information (EVSI) quantifies the economic benefit of reducing uncertainty in a health economic model by collecting additional information. This has the potential to improve the allocation of research budgets. Despite this, practical EVSI evaluations are limited partly due to the computational cost of estimating this value using the gold-standard nested simulation methods. Recently, however, Heath et al. developed an estimation procedure that reduces the number of simulations required for this gold-standard calculation. Up to this point, this new method has been presented in purely technical terms. STUDY DESIGN: This study presents the practical application of this new method to aid its implementation. We use a worked example to illustrate the key steps of the EVSI estimation procedure before discussing its optimal implementation using a practical health economic model. METHODS: The worked example is based on a three-parameter linear health economic model. The more realistic model evaluates the cost-effectiveness of a new chemotherapy treatment, which aims to reduce the number of side effects experienced by patients. We use a Markov model structure to evaluate the health economic profile of experiencing side effects. RESULTS: This EVSI estimation method offers accurate estimation within a feasible computation time, seconds compared to days, even for more complex model structures. The EVSI estimation is more accurate if a greater number of nested samples are used, even for a fixed computational cost. CONCLUSIONS: This new method reduces the computational cost of estimating the EVSI by nested simulation.
Authors: Gordon Cs Smith; Alexandros A Moraitis; David Wastlund; Jim G Thornton; Aris Papageorghiou; Julia Sanders; Alexander Ep Heazell; Stephen C Robson; Ulla Sovio; Peter Brocklehurst; Edward Cf Wilson Journal: Health Technol Assess Date: 2021-02 Impact factor: 4.014
Authors: Anna Heath; Natalia Kunst; Christopher Jackson; Mark Strong; Fernando Alarid-Escudero; Jeremy D Goldhaber-Fiebert; Gianluca Baio; Nicolas A Menzies; Hawre Jalal Journal: Med Decis Making Date: 2020-04-16 Impact factor: 2.583
Authors: Natalia Kunst; Edward C F Wilson; David Glynn; Fernando Alarid-Escudero; Gianluca Baio; Alan Brennan; Michael Fairley; Jeremy D Goldhaber-Fiebert; Chris Jackson; Hawre Jalal; Nicolas A Menzies; Mark Strong; Howard Thom; Anna Heath Journal: Value Health Date: 2020-05-27 Impact factor: 5.725