Lucy Kanya1, Sabina Sanghera2, Alex Lewin3, Julia Fox-Rushby4. 1. Health Economics Research Group, Brunel University, Kingston Lane, Uxbridge, UB8 3PH, England, UK. Electronic address: L.Kanya@lse.ac.uk. 2. Health Economics Research Group, Brunel University, Kingston Lane, Uxbridge, UB8 3PH, England, UK; Bristol Medical School (Population Health Sciences), Bristol University, 1-5 Whiteladies Road, Bristol, England, UK. Electronic address: Sabina.sanghera@bristol.ac.uk. 3. Department of Mathematics and Statistics, Brunel University, Kingston Lane, Uxbridge, UB8 3PH, England, UK. Electronic address: Alex.Lewin@lshtm.ac.uk. 4. Health Economics Research Group, Brunel University, Kingston Lane, Uxbridge, UB8 3PH, England, UK. Electronic address: Julia.Fox-Rushby@kcl.ac.uk.
Abstract
BACKGROUND: The contingent valuation (CV) method is used to estimate the willingness to pay (WTP) for services and products to inform cost benefit analyses (CBA). A long-standing criticism that stated WTP estimates may be poor indicators of actual WTP, calls into question their validity and the use of such estimates for welfare evaluation, especially in the health sector. Available evidence on the validity of CV studies so far is inconclusive. We systematically reviewed the literature to (1) synthesize the evidence on the criterion validity of WTP/willingness to accept (WTA), (2) undertake a meta-analysis, pooling evidence on the extent of variation between stated and actual WTP values and, (3) explore the reasons for the variation. METHODS: Eight electronic databases were searched, along with citations and reference reviews. 50 papers detailing 159 comparisons were identified and reviewed using a standard proforma. Two reviewers each were involved in the paper selection, review and data extraction. Meta-analysis was conducted using random effects models for ratios of means and percentage differences separately. Meta-bias was investigated using funnel plots. RESULTS: Hypothetical WTP was on average 3.2 times greater than actual WTP, with a range of 0.7-11.8 and 5.7 (0.0-13.6) for ratios of means and percentage differences respectively. However, key methodological differences between surveys of hypothetical and actual values were found. In the meta-analysis, high levels of heterogeneity existed. The overall effect size for mean summaries was 1.79 (1.56-2.04) and 2.37 (1.93-2.80) for percent summaries. Regression analyses identified mixed results on the influence of the different experimental protocols on the variation between stated and actual WTP values. Results indicating publication bias did not account for differences in study design. CONCLUSIONS: The evidence on the criterion validity for CV studies is more mixed than authors are representing because substantial differences in study design between hypothetical and actual WTP/WTA surveys are not accounted for.
BACKGROUND: The contingent valuation (CV) method is used to estimate the willingness to pay (WTP) for services and products to inform cost benefit analyses (CBA). A long-standing criticism that stated WTP estimates may be poor indicators of actual WTP, calls into question their validity and the use of such estimates for welfare evaluation, especially in the health sector. Available evidence on the validity of CV studies so far is inconclusive. We systematically reviewed the literature to (1) synthesize the evidence on the criterion validity of WTP/willingness to accept (WTA), (2) undertake a meta-analysis, pooling evidence on the extent of variation between stated and actual WTP values and, (3) explore the reasons for the variation. METHODS: Eight electronic databases were searched, along with citations and reference reviews. 50 papers detailing 159 comparisons were identified and reviewed using a standard proforma. Two reviewers each were involved in the paper selection, review and data extraction. Meta-analysis was conducted using random effects models for ratios of means and percentage differences separately. Meta-bias was investigated using funnel plots. RESULTS: Hypothetical WTP was on average 3.2 times greater than actual WTP, with a range of 0.7-11.8 and 5.7 (0.0-13.6) for ratios of means and percentage differences respectively. However, key methodological differences between surveys of hypothetical and actual values were found. In the meta-analysis, high levels of heterogeneity existed. The overall effect size for mean summaries was 1.79 (1.56-2.04) and 2.37 (1.93-2.80) for percent summaries. Regression analyses identified mixed results on the influence of the different experimental protocols on the variation between stated and actual WTP values. Results indicating publication bias did not account for differences in study design. CONCLUSIONS: The evidence on the criterion validity for CV studies is more mixed than authors are representing because substantial differences in study design between hypothetical and actual WTP/WTA surveys are not accounted for.
Authors: Jennifer Bruder; Lauren M Burakowski; Taeyong Park; Reem Al-Haddad; Sara Al-Hemaidi; Amal Al-Korbi; Almayasa Al-Naimi Journal: Front Psychol Date: 2022-05-31
Authors: Pascal Geldsetzer; Alexander Sauer; Joel M Francis; Eric Mboggo; Sharon Lwezaula; David Sando; Wafaie Fawzi; Nzovu Ulenga; Till Bärnighausen Journal: Health Policy Plan Date: 2021-02-16 Impact factor: 3.344