| Literature DB >> 32571269 |
Michaela Goodwin1, Tanya Walsh2, William Whittaker3, Richard Emsley4, Matt Sutton3, Martin Tickle2, Michael P Kelly5, Iain A Pretty2.
Abstract
BACKGROUND: High response rates are essential when questionnaires are used within research, as representativeness can affect the validity of studies and the ability to generalise the findings to a wider population. The study aimed to measure the response rate to questionnaires from a large longitudinal epidemiological study and sought to determine if any changes made throughout data collection had a positive impact on the response to questionnaires and addressed any imbalance in response rates by participants' levels of deprivation.Entities:
Keywords: RCT; deprivation; non-response bias; questionnaires; response rates
Mesh:
Year: 2020 PMID: 32571269 PMCID: PMC7309972 DOI: 10.1186/s12874-020-01034-7
Source DB: PubMed Journal: BMC Med Res Methodol ISSN: 1471-2288 Impact factor: 4.615
Behaviour change constructs and descriptions relevant to questionnaire response. (Based on Cane et al (2012) [12] and on Duncan’s et al (2015) [3]
| Theoretical domain that could be targeted | Theoretical domain constructs |
|---|---|
Detail original consent and encourage return of questionnaire as soon as possible | |
Target both immediate goals (completing questionnaire) and longer term goals | |
Provide information on the number of people taking part and completing the questionnaire if appzropriate | |
Specific information about the benefits of taking part and what the consequences will be if people do not complete the information. Detail what the expectations of the outcomes will be | |
Detail an example of where, when, and how behaviour will be performed. | |
Introduce or define environmental or social stimulus with the purpose of prompting or cueing the behaviour. | |
Changes made in each wave of the study
| Wave | Time period | Description of questionnaire distribution | Changes between waves | |
|---|---|---|---|---|
| 1st attempt | 2nd attempt | |||
| Wave 1 | 4 months | Questionnaire and cover letter (V1) sent via email or post (stamped addressed envelope included) | Questionnaire resent via post | - |
| Wave 2 | 4 months | Questionnaire layout updated and cover letter (V2), sent via email or post (stamped addressed envelope included) | Questionnaire resent via post | Cover letter updated to utilise behaviour change techniques designed to increase response, free pen included, questionnaire updated |
| Wave 3 | 4 months | Questionnaire and cover letter (V2), sent via email or post (stamped addressed envelope included) | Reminder by: Postcard Telephone call Questionnaire resent | RCT conducted for those who did not complete the questionnaire on the first send out to determine if one reminder was more effective or reduced bias |
Fig. 1Flow chart of methods used to increase questionnaire response for each wave
Fig. 2Flow diagram of response for each wave
Fig. 3Flow chart showing IMD by response for each wave
Logistic regression for response by reminder and deprivation (Model 1)
| Variable | Odds Ratio | Standard Error | 95% CI | |
|---|---|---|---|---|
| Resent telephone (ref) | 1.00 | - | - | - |
| Resent questionnaire | 1.99 | 0.387 | 0.074 | 0.93-4.26 |
| Resent postcard | 1.17 | 0.422 | 0.705 | 0.51-2.68 |
| Deprivation score | 0.98 | 0.012 | 0.042 | 0.96-0.99 |
Model x2 (3) = 8.463 p = 0.037 Nagelkerke R2= 0.048 = 4.8% variance explained
Logistic regression for response by reminder and deprivation (Model 2- interaction)
| Variable | Odds Ratio | Standard Error | 95% CI | |
|---|---|---|---|---|
| Resent telephone (ref) | 1.00 | - | - | - |
| Resent questionnaire | 5.77 | 0.833 | 0.035 | 1.13-29.55 |
| Resent postcard | 5.49 | 0.891 | 0.056 | 0.96-31.52 |
| Deprivation score | 1.01 | 0.021 | 0.562 | 0.97-1.05 |
| Resent telephone * deprivation score | ||||
| Resent questionnaire * deprivation score | 0.96 | 0.027 | 0.137 | 0.91-1.01 |
| Resent postcard * deprivation score | 0.94 | 0.033 | 0.051 | 0.88-1.00 |
Model x2 (5) = 13.701 p = 0.026 Nagelkerke R2= 0.072 = 7.2% variance explained
Population and sample difference in deprivation quintiles
| Quintile 1 (least deprived) | Quintile 2 | Quintile 3 | Quintile 4 | Quintile 5 (most deprived) | |
|---|---|---|---|---|---|
| Population | 7% | 16% | 21% | 30% | 26% |
| Sample of those consented | 8% | 17% | 22% | 29% | 24% |
| Sample of those responding | 10% | 21% | 26% | 26% | 17% |
| Difference between responded and population | 3% | 5% | 5% | -4% | -9% |
IMD Quintile by IMD score
| Quintile group | IMD score range |
|---|---|
| 1 | ≤ 8.49 (Least deprived) |
| 2 | 8.5 - 13.79 |
| 3 | 13.8 - 21.35 |
| 4 | 21.36 - 34.17 |
| 5 | ≥ 34.18 (Most deprived) |