Ilene L Hollin1, Ellen Janssen2, Marcella A Kelley3,4, John F P Bridges5,6. 1. Department of Health Services Administration and Policy, Temple University College of Public Health, Ritter Annex, 1301 Cecil B. Moore Ave Rm. 537, Philadelphia, PA, 19122, USA. ilene.hollin@temple.edu. 2. Department of Health Policy and Management, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, USA. 3. Department of Pharmaceutical and Health Economics, School of Pharmacy, University of Southern California, Los Angeles, CA, USA. 4. Leonard D. Schaeffer Center for Health Policy and Economics, University of Southern California, Los Angeles, CA, USA. 5. Department of Biomedical Informatics, The Ohio State University College of Medicine, Columbus, OH, USA. 6. Department of Health Behavior and Society, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, USA.
Abstract
BACKGROUND: Researchers and policy makers have long suspected that people have differing, and potentially nefarious, motivations for participating in stated-preference studies such as discrete-choice experiments (DCE). While anecdotes and theories exist on why people participate in surveys, there is a paucity of evidence exploring variation in preferences for participating in stated-preference studies. METHODS: We used a DCE to estimate preferences for participating in preference research among an online survey panel sample. Preferences for the characteristics of a study to be conducted at a local hospital were assessed across five attributes (validity, relevance, bias, burden, time and payment) and described across three levels using a starring system. A D-efficient experimental design was used to construct three blocks of 12 choice tasks with two profiles each. Respondents were also asked about factors that motivated their choices. Mixed logistic regression was used to analyze the aggregate sample and latent class analysis identified segments of respondents. RESULTS: 629 respondents completed the experiment. In aggregate "study validity" was most important. Latent class results identified two segments based on underlying motivations: a quality-focused segment (76%) who focused most on validity, relevance, and bias and a convenience-focused segment (24%) who focused most on reimbursement and time. Quality-focused respondents spent more time completing the survey (p < 0.001) and were more likely to identify data quality (p < 0.01) and societal well-being (p < 0.01) as motivations to participate. CONCLUSIONS: This information can be used to better understand variability in motivations to participate in stated-preference surveys and the impact of motivations on response quality.
BACKGROUND: Researchers and policy makers have long suspected that people have differing, and potentially nefarious, motivations for participating in stated-preference studies such as discrete-choice experiments (DCE). While anecdotes and theories exist on why people participate in surveys, there is a paucity of evidence exploring variation in preferences for participating in stated-preference studies. METHODS: We used a DCE to estimate preferences for participating in preference research among an online survey panel sample. Preferences for the characteristics of a study to be conducted at a local hospital were assessed across five attributes (validity, relevance, bias, burden, time and payment) and described across three levels using a starring system. A D-efficient experimental design was used to construct three blocks of 12 choice tasks with two profiles each. Respondents were also asked about factors that motivated their choices. Mixed logistic regression was used to analyze the aggregate sample and latent class analysis identified segments of respondents. RESULTS: 629 respondents completed the experiment. In aggregate "study validity" was most important. Latent class results identified two segments based on underlying motivations: a quality-focused segment (76%) who focused most on validity, relevance, and bias and a convenience-focused segment (24%) who focused most on reimbursement and time. Quality-focused respondents spent more time completing the survey (p < 0.001) and were more likely to identify data quality (p < 0.01) and societal well-being (p < 0.01) as motivations to participate. CONCLUSIONS: This information can be used to better understand variability in motivations to participate in stated-preference surveys and the impact of motivations on response quality.
Authors: John F P Bridges; A Brett Hauber; Deborah Marshall; Andrew Lloyd; Lisa A Prosser; Dean A Regier; F Reed Johnson; Josephine Mauskopf Journal: Value Health Date: 2011-04-22 Impact factor: 5.725
Authors: A Brett Hauber; Juan Marcos González; Catharina G M Groothuis-Oudshoorn; Thomas Prior; Deborah A Marshall; Charles Cunningham; Maarten J IJzerman; John F P Bridges Journal: Value Health Date: 2016-05-12 Impact factor: 5.725
Authors: F Reed Johnson; Emily Lancsar; Deborah Marshall; Vikram Kilambi; Axel Mühlbacher; Dean A Regier; Brian W Bresnahan; Barbara Kanninen; John F P Bridges Journal: Value Health Date: 2013 Jan-Feb Impact factor: 5.725