BACKGROUND: Patients' values are fundamental to decision models, cost-effectiveness analyses, and pharmacoeconomic analyses. The standard methods used to assess how patients value different health states are inherently quantitative. People without strong quantitative skills (i.e., low numeracy) may not be able to complete these tasks in a meaningful way. METHODS: To determine whether the validity of utility assessments depends on the respondent's level of numeracy, the authors conducted in-person interviews and written surveys and assessed utility for the current health for 96 women volunteers. Numeracy was measured using a previously validated 3-item scale. The authors examined the correlation between self-reported health and utility for current health (assessed using the standard gamble, time trade-off, and visual analog techniques) across levels of numeracy. For half of the women, the authors also assessed standard gamble utility for 3 imagined health states (breast cancer, heart disease, and osteoporosis) and asked how much the women feared each disease. RESULTS: Respondent ages ranged from 50 to 79 years (mean = 63), all were high school graduates, and 52% had a college or postgraduate degree. Twenty-six percent answered 0 or only 1 of the numeracy questions correctly, 37% answered 2 correctly, and 37% answered all 3 correctly. Among women with the lowest level of numeracy, the correlation between utility for current health and self-reported health was in the wrong direction (i.e., worse health valued higher than better health): for standard gamble, Spearman r=-0.16, P = 0.44;for time trade-off, Spearman r=-0.13, P=0.54. Among the most numerate women, the authors observed a fair to moderate positive correlation with both standard gamble (Spearman r=0.22, P=0.19) and time trade-off (Spearman r=0.50, P=0.002). In contrast, using the visual analog scale, the authors observed a substantial correlation in the expected direction at all levels of numeracy (Spearman r= 0.82, 0.50, and 0.60 for women answering 0-1, 2, and 3 numeracy questions, respectively; all Ps < or = 0.003). With regard to the imagined health states, the most feared disease had the lowest utility for 35% of the women with the lowest numeracy compared to 76% of the women with the highest numeracy (P=0.03). CONCLUSIONS: The validity of standard utility assessments is related to the subject's facility with numbers. Limited numeracy may be an important barrier to meaningfully assessing patients' values using the standard gamble and time trade-off techniques.
BACKGROUND:Patients' values are fundamental to decision models, cost-effectiveness analyses, and pharmacoeconomic analyses. The standard methods used to assess how patients value different health states are inherently quantitative. People without strong quantitative skills (i.e., low numeracy) may not be able to complete these tasks in a meaningful way. METHODS: To determine whether the validity of utility assessments depends on the respondent's level of numeracy, the authors conducted in-person interviews and written surveys and assessed utility for the current health for 96 women volunteers. Numeracy was measured using a previously validated 3-item scale. The authors examined the correlation between self-reported health and utility for current health (assessed using the standard gamble, time trade-off, and visual analog techniques) across levels of numeracy. For half of the women, the authors also assessed standard gamble utility for 3 imagined health states (breast cancer, heart disease, and osteoporosis) and asked how much the women feared each disease. RESULTS: Respondent ages ranged from 50 to 79 years (mean = 63), all were high school graduates, and 52% had a college or postgraduate degree. Twenty-six percent answered 0 or only 1 of the numeracy questions correctly, 37% answered 2 correctly, and 37% answered all 3 correctly. Among women with the lowest level of numeracy, the correlation between utility for current health and self-reported health was in the wrong direction (i.e., worse health valued higher than better health): for standard gamble, Spearman r=-0.16, P = 0.44;for time trade-off, Spearman r=-0.13, P=0.54. Among the most numerate women, the authors observed a fair to moderate positive correlation with both standard gamble (Spearman r=0.22, P=0.19) and time trade-off (Spearman r=0.50, P=0.002). In contrast, using the visual analog scale, the authors observed a substantial correlation in the expected direction at all levels of numeracy (Spearman r= 0.82, 0.50, and 0.60 for women answering 0-1, 2, and 3 numeracy questions, respectively; all Ps < or = 0.003). With regard to the imagined health states, the most feared disease had the lowest utility for 35% of the women with the lowest numeracy compared to 76% of the women with the highest numeracy (P=0.03). CONCLUSIONS: The validity of standard utility assessments is related to the subject's facility with numbers. Limited numeracy may be an important barrier to meaningfully assessing patients' values using the standard gamble and time trade-off techniques.