OBJECTIVE: To explore the response rate benefits and data limitations of mixing telephone and web survey modes in a health-related research study. DATA SOURCES/STUDY SETTING: We conducted a survey of salaried employees from one large employer in the manufacturing sector in the summer of 2005. STUDY DESIGN: We randomized 751 subjects, all of whom had previously completed a web survey, to complete a health-related survey either by telephone (with web follow-up for nonrespondents) or over the web (with telephone follow-up). PRINCIPAL FINDINGS:Survey response rates were significantly higher for the mixed mode survey than they would have been if we fielded either an exclusively telephone or web survey (25 and 12 percent higher, respectively). Telephone respondents were more likely to provide socially desirable responses to personal lifestyle questions and web respondents provided more missing data when questions were difficult or did not relate to their circumstances. Telephone respondents were also more likely to "agree" to knowledge statements and provide the same response across a series of items with similar response scales than were web respondents. CONCLUSIONS: Mixed mode telephone/web surveys can substantially boost response rates over single-mode surveys. Modal differences in responses can be minimized by handling missing data options consistently in the two modes, avoiding agree/disagree formats, and not including questions on personal lifestyle or other sensitive issues.
RCT Entities:
OBJECTIVE: To explore the response rate benefits and data limitations of mixing telephone and web survey modes in a health-related research study. DATA SOURCES/STUDY SETTING: We conducted a survey of salaried employees from one large employer in the manufacturing sector in the summer of 2005. STUDY DESIGN: We randomized 751 subjects, all of whom had previously completed a web survey, to complete a health-related survey either by telephone (with web follow-up for nonrespondents) or over the web (with telephone follow-up). PRINCIPAL FINDINGS: Survey response rates were significantly higher for the mixed mode survey than they would have been if we fielded either an exclusively telephone or web survey (25 and 12 percent higher, respectively). Telephone respondents were more likely to provide socially desirable responses to personal lifestyle questions and web respondents provided more missing data when questions were difficult or did not relate to their circumstances. Telephone respondents were also more likely to "agree" to knowledge statements and provide the same response across a series of items with similar response scales than were web respondents. CONCLUSIONS: Mixed mode telephone/web surveys can substantially boost response rates over single-mode surveys. Modal differences in responses can be minimized by handling missing data options consistently in the two modes, avoiding agree/disagree formats, and not including questions on personal lifestyle or other sensitive issues.
Authors: Charles F Turner; Maria A Villarroel; Susan M Rogers; Elizabeth Eggleston; Laxminarayana Ganapathi; Anthony M Roman; Alia Al-Tayyib Journal: Addiction Date: 2005-10 Impact factor: 6.526
Authors: Claudia Rutherford; Daniel Costa; Rebecca Mercieca-Bebber; Holly Rice; Liam Gabb; Madeleine King Journal: Qual Life Res Date: 2015-09-03 Impact factor: 4.147
Authors: Rachel Grob; Mark Schlesinger; Andrew M Parker; Dale Shaller; Lacey Rose Barre; Steven C Martino; Melissa L Finucane; Lise Rybowski; Jennifer L Cerully Journal: Health Serv Res Date: 2016-04-29 Impact factor: 3.402
Authors: Charles B Fleming; Gina Marchesini; Jenna Elgin; Kevin P Haggerty; Danielle Woodward; Robert D Abbott; Richard F Catalano Journal: Field methods Date: 2013-11-01
Authors: Mark Schlesinger; Rachel Grob; Dale Shaller; Steven C Martino; Andrew M Parker; Lise Rybowski; Melissa L Finucane; Jennifer L Cerully Journal: Med Care Res Rev Date: 2018-10-06 Impact factor: 3.929