| Literature DB >> 20529365 |
Timothy J Beebe1, Enrique Rey, Jeanette Y Ziegenfuss, Sarah Jenkins, Kandace Lackore, Nicholas J Talley, Richard G Locke.
Abstract
BACKGROUND: Evidence suggests that survey response rates are decreasing and that the level of survey response can be influenced by questionnaire length and the use of pre-notification. The goal of the present investigation was determine the effect of questionnaire length and pre-notification type (letter vs. postcard) on measures of survey quality, including response rates, response times (days to return the survey), and item nonresponse.Entities:
Mesh:
Year: 2010 PMID: 20529365 PMCID: PMC2891795 DOI: 10.1186/1471-2288-10-50
Source DB: PubMed Journal: BMC Med Res Methodol ISSN: 1471-2288 Impact factor: 4.615
Figure 1Randomization and response rates of sample population. Note: Response rates did not differ significantly between the 2 and 4 page conditions
Age, gender, and race distribution of sample population
| 2 × 2 Factorial Design | |||||
|---|---|---|---|---|---|
| Overall (N) | 780 | 188 | 191 | 199 | 202 |
| Gender | |||||
| Female | 392 (50.3) | 96 (51.1) | 97 (50.8) | 101 (50.8) | 98 (48.5) |
| Male | 388 (49.7) | 92 (48.9) | 94 (49.2) | 98 (49.2) | 104 (51.5) |
| Age | |||||
| 25 - 29 | 114 (14.6) | 24 (12.8) | 31 (16.2) | 24 (12.1) | 35 (17.3) |
| 30 - 39 | 199 (25.5) | 50 (26.6) | 49 (25.6) | 52 (26.1) | 48 (23.8) |
| 40 - 49 | 211 (27.1) | 49 (26.1) | 49 (25.6) | 61 (30.6) | 52 (25.7) |
| 50 - 59 | 187 (24.0) | 47 (25.0) | 48 (25.1) | 45 (22.6) | 47 (23.3) |
| 60 - 65 | 69 (8.8) | 18 (9.6) | 14 (7.3) | 17 (8.5) | 20 (9.9) |
| Mean (SD) | 43.8 (11.2) | 44.3 (11.3) | 43.3 (11.1) | 43.9 (10.9) | 43.8 (11.6) |
| Race | |||||
| White | 582 (74.6) | 140 (74.5) | 151 (79.1) | 147 (73.9) | 144 (71.3) |
| Non-white * | 58 (7.4) | 17 (9.0) | 10 (5.2) | 15 (7.5) | 16 (7.9) |
| Unknown/Other | 140 (18.0) | 31 (16.5) | 30 (15.7) | 37 (18.6) | 42 (20.8) |
Note: In the factorial design, the distributions of gender, age, and race were not statistically significantly different between survey lengths or notification types.
* "Non-white" includes: American Indian/Alaskan Native, Black or African American, Native Hawaiian/Pacific Islander, and Asian.
Response rates overall and by design characteristics, by gender, race, and age
| 2 × 2 Factorial Design | |||||
|---|---|---|---|---|---|
| Overall | 363 (46.5) | 169 (44.6) | 194 (48.4) | 179 (46.3) | 184 (46.8) |
| Gender | |||||
| Female | 212 (54.1) | 105 (54.4) | 107 (53.8) | 108 (54.8) | 104 (53.3) |
| Male | 151 (38.9) | 64 (34.4) | 87 (43.1) | 71 (37.4) | 80 (40.4) |
| P value† | < 0.0001 | 0.007 | 0.03 | 0.0006 | 0.01 |
| Race | |||||
| White | 306 (52.6) | 147 (50.5) | 159 (54.6) | 151 (52.6) | 155 (52.5) |
| Non-white * | 14 (24.14) | 6 (22.2) | 8 (25.8) | 5 (15.6) | 9 (34.6) |
| Unknown/Other | 43 (30.7) | 16 (26.2) | 27 (34.2) | 23 (33.8) | 20 (27.8) |
| P value† | < 0.0001 | < 0.0001 | 0.0002 | < 0.0001 | 0.0003 |
| Age | |||||
| 25 - 29 | 35 (30.7) | 12 (21.8) | 23 (39.0) | 12 (25.0) | 23 (34.8) |
| 30 - 39 | 81 (40.7) | 32 (32.3) | 49 (49.0) | 42 (41.2) | 39 (40.2) |
| 40 - 49 | 107 (50.7) | 51 (52.0) | 56 (49.6) | 57 (51.8) | 50 (49.5) |
| 50 - 59 | 103 (55.1) | 56 (59.0) | 47 (51.1) | 50 (54.4) | 53 (55.8) |
| 60 - 65 | 37 (53.6) | 18 (56.2) | 19 (51.4) | 18 (51.4) | 19 (55.9) |
| P value† | 0.0002 | < 0.0001 | 0.63 | 0.008 | 0.04 |
†P-values comparing response rates within condition from chi-square test or Fisher's exact test where appropriate.
Note: In the factorial design, response rates did not differ significantly by survey length (p = 0.29) or by notification type (p = 0.87). Combining pages and notification into 4 separate groups, the p-value for the difference in response rate was 0.56 (results not shown).
* "Non-white" includes: American Indian/Alaskan Native, Black or African American, Native Hawaiian/Pacific Islander, and Asian.
Logistic Regression Results, odds ratios comparing likelihood of response.
| Variable | OR | 95% CI | P-value | |
|---|---|---|---|---|
| Notify: Postcard vs. Letter | 1.04 | 0.77 | 1.39 | 0.80 |
| Pages: 2 vs 4 | 0.81 | 0.60 | 1.09 | 0.16 |
| Age: 1 year increase | 1.03 | 1.01 | 1.04 | 0.0001 |
| Sex: Female vs Male | 1.86 | 1.38 | 2.50 | <.0001 |
| Race: White vs non-white* | 3.35 | 1.77 | 6.35 | 0.0002 |
| Race: White vs other/unknown | 2.23 | 1.49 | 3.35 | 0.0001 |
| Notify: Postcard vs. Letter | 1.05 | 0.78 | 1.42 | 0.73 |
| Pages: 2 vs 4 (for 25-year-olds) | 0.34 | 0.19 | 0.62 | 0.0004 |
| Pages: 2 vs 4 (for 35-year-olds) | 0.53 | 0.36 | 0.79 | 0.0015 |
| Pages: 2 vs 4 (for 45-year-olds) | 0.84 | 0.62 | 1.13 | 0.25 |
| Pages: 2 vs 4 (for 55-year-olds) | 1.32 | 0.87 | 2.00 | 0.19 |
| Sex: Female vs Male | 1.86 | 1.38 | 2.50 | <.0001 |
| Race: White vs non-white* | 3.40 | 1.79 | 6.47 | 0.0002 |
| Race: White vs other/unknown | 2.33 | 1.55 | 3.50 | <.0001 |
Notes: Age was modeled continuously, therefore, the significant interaction in the second model was summarized by calculating the odds ratios at select points across the age range. P-value for survey length-by-age interaction = 0.001. There was no significant interaction found between notification method and survey length (p = 0.25).
* "Non-white" includes: American Indian/Alaskan Native, Black or African American, Native Hawaiian/Pacific Islander, and Asian.