Esther W de Bekker-Grob1, Joffre D Swait2, Habtamu Tilahun Kassahun3, Michiel C J Bliemer4, Marcel F Jonker2, Jorien Veldwijk2, Karen Cong3, John M Rose5, Bas Donkers6. 1. Erasmus Choice Modelling Centre, Erasmus University Rotterdam, Rotterdam, The Netherlands; Erasmus School of Health Policy & Management, Erasmus University Rotterdam, Rotterdam, The Netherlands. Electronic address: debekker-grob@eshpm.eur.nl. 2. Erasmus Choice Modelling Centre, Erasmus University Rotterdam, Rotterdam, The Netherlands; Erasmus School of Health Policy & Management, Erasmus University Rotterdam, Rotterdam, The Netherlands. 3. Australian Rivers Institute, Griffith University, Brisbane, Queensland, Australia. 4. Business School, University of Sydney, Sydney, New South Wales, Australia. 5. Business School, University of Technology Sydney, Sydney, New South Wales, Australia. 6. Erasmus Choice Modelling Centre, Erasmus University Rotterdam, Rotterdam, The Netherlands; Department of Business Economics, Erasmus School of Economics, Erasmus University Rotterdam, Rotterdam, The Netherlands.
Abstract
BACKGROUND: Lack of evidence about the external validity of discrete choice experiments (DCEs) is one of the barriers that inhibit greater use of DCEs in healthcare decision making. OBJECTIVES: To determine whether the number of alternatives in a DCE choice task should reflect the actual decision context, and how complex the choice model needs to be to be able to predict real-world healthcare choices. METHODS: Six DCEs were used, which varied in (1) medical condition (involving choices for influenza vaccination or colorectal cancer screening) and (2) the number of alternatives per choice task. For each medical condition, 1200 respondents were randomized to one of the DCE formats. The data were analyzed in a systematic way using random-utility-maximization choice processes. RESULTS: Irrespective of the number of alternatives per choice task, the choice for influenza vaccination and colorectal cancer screening was correctly predicted by DCE at an aggregate level, if scale and preference heterogeneity were taken into account. At an individual level, 3 alternatives per choice task and the use of a heteroskedastic error component model plus observed preference heterogeneity seemed to be most promising (correctly predicting >93% of choices). CONCLUSIONS: Our study shows that DCEs are able to predict choices-mimicking real-world decisions-if at least scale and preference heterogeneity are taken into account. Patient characteristics (eg, numeracy, decision-making style, and general attitude for and experience with the health intervention) seem to play a crucial role. Further research is needed to determine whether this result remains in other contexts.
BACKGROUND: Lack of evidence about the external validity of discrete choice experiments (DCEs) is one of the barriers that inhibit greater use of DCEs in healthcare decision making. OBJECTIVES: To determine whether the number of alternatives in a DCE choice task should reflect the actual decision context, and how complex the choice model needs to be to be able to predict real-world healthcare choices. METHODS: Six DCEs were used, which varied in (1) medical condition (involving choices for influenza vaccination or colorectal cancer screening) and (2) the number of alternatives per choice task. For each medical condition, 1200 respondents were randomized to one of the DCE formats. The data were analyzed in a systematic way using random-utility-maximization choice processes. RESULTS: Irrespective of the number of alternatives per choice task, the choice for influenza vaccination and colorectal cancer screening was correctly predicted by DCE at an aggregate level, if scale and preference heterogeneity were taken into account. At an individual level, 3 alternatives per choice task and the use of a heteroskedastic error component model plus observed preference heterogeneity seemed to be most promising (correctly predicting >93% of choices). CONCLUSIONS: Our study shows that DCEs are able to predict choices-mimicking real-world decisions-if at least scale and preference heterogeneity are taken into account. Patient characteristics (eg, numeracy, decision-making style, and general attitude for and experience with the health intervention) seem to play a crucial role. Further research is needed to determine whether this result remains in other contexts.
Authors: Esther W de Bekker-Grob; Bas Donkers; Jorien Veldwijk; Marcel F Jonker; Sylvia Buis; Jan Huisman; Patrick Bindels Journal: Patient Date: 2020-11-05 Impact factor: 3.883
Authors: Niek Mouter; Marion Collewet; G Ardine de Wit; Adrienne Rotteveel; Mattijs S Lambooij; Roselinde Kessels Journal: Value Health Date: 2021-03-10 Impact factor: 5.725