Famke J M Mölenberg1,2, Chris de Vries3, Alex Burdorf4, Frank J van Lenthe4. 1. Department of Public Health, Erasmus MC, University Medical Center Rotterdam, P.O. Box 2040, 3000, CA, Rotterdam, The Netherlands. f.molenberg@erasmusmc.nl. 2. Department of Research and Business Intelligence, Municipality of Rotterdam, Rotterdam, The Netherlands. f.molenberg@erasmusmc.nl. 3. Department of Research and Business Intelligence, Municipality of Rotterdam, Rotterdam, The Netherlands. 4. Department of Public Health, Erasmus MC, University Medical Center Rotterdam, P.O. Box 2040, 3000, CA, Rotterdam, The Netherlands.
Abstract
BACKGROUND: Most health surveys have experienced a decline in response rates. A structured approach to evaluate whether a decreasing - and potentially more selective - response over time biased estimated trends in health behaviours is lacking. We developed a framework to explore the role of differential non-response over time. This framework was applied to a repeated cross-sectional survey in which the response rate gradually declined. METHODS: We used data from a survey conducted biannually between 1995 and 2017 in the city of Rotterdam, The Netherlands. Information on the sociodemographic determinants of age, sex, and ethnicity was available for respondents and non-respondents. The main outcome measures of prevalence of sport participation and watching TV were only available for respondents. The framework consisted of four steps: 1) investigating the sociodemographic determinants of responding to the survey and the difference in response over time between sociodemographic groups; 2) estimating variation in health behaviour over time; 3) comparing weighted and unweighted prevalence estimates of health behaviour over time; and 4) comparing associations between sociodemographic determinants and health behaviour over time. RESULTS: The overall response rate per survey declined from 47% in 1995 to 15% in 2017. The probability of responding was higher among older people, females, and those with a Western background. The response rate declined in all subgroups, and a faster decline was observed among younger persons and those with a non-Western ethnicity as compared to older persons and those with a Western ethnicity. Variation in health behaviours remained constant. Prevalence estimates and associations did not follow the changes in response over time. On the contrary, the difference in probability of participating in sport gradually decreased between males and females, while no differential change in the response rate was observed. CONCLUSIONS: Providing insights on non-response patterns over time is essential to understand whether declines in response rates may have influenced estimated trends in health behaviours. The framework outlined in this study can be used for this purpose. In our example, in spite of a major decline in response rate, there was no evidence that the risk of non-response bias increased over time.
BACKGROUND: Most health surveys have experienced a decline in response rates. A structured approach to evaluate whether a decreasing - and potentially more selective - response over time biased estimated trends in health behaviours is lacking. We developed a framework to explore the role of differential non-response over time. This framework was applied to a repeated cross-sectional survey in which the response rate gradually declined. METHODS: We used data from a survey conducted biannually between 1995 and 2017 in the city of Rotterdam, The Netherlands. Information on the sociodemographic determinants of age, sex, and ethnicity was available for respondents and non-respondents. The main outcome measures of prevalence of sport participation and watching TV were only available for respondents. The framework consisted of four steps: 1) investigating the sociodemographic determinants of responding to the survey and the difference in response over time between sociodemographic groups; 2) estimating variation in health behaviour over time; 3) comparing weighted and unweighted prevalence estimates of health behaviour over time; and 4) comparing associations between sociodemographic determinants and health behaviour over time. RESULTS: The overall response rate per survey declined from 47% in 1995 to 15% in 2017. The probability of responding was higher among older people, females, and those with a Western background. The response rate declined in all subgroups, and a faster decline was observed among younger persons and those with a non-Western ethnicity as compared to older persons and those with a Western ethnicity. Variation in health behaviours remained constant. Prevalence estimates and associations did not follow the changes in response over time. On the contrary, the difference in probability of participating in sport gradually decreased between males and females, while no differential change in the response rate was observed. CONCLUSIONS: Providing insights on non-response patterns over time is essential to understand whether declines in response rates may have influenced estimated trends in health behaviours. The framework outlined in this study can be used for this purpose. In our example, in spite of a major decline in response rate, there was no evidence that the risk of non-response bias increased over time.
Entities:
Keywords:
Epidemiological methods; Health surveys; Non-response bias; Response; Surveys and questionnaires
Authors: Marielle A Beenackers; Carlijn B M Kamphuis; Katrina Giskes; Johannes Brug; Anton E Kunst; Alex Burdorf; Frank J van Lenthe Journal: Int J Behav Nutr Phys Act Date: 2012-09-19 Impact factor: 6.457
Authors: Joel W Hotchkiss; Carolyn Davies; Linsay Gray; Catherine Bromley; Simon Capewell; Alastair H Leyland Journal: BMJ Open Date: 2011-08-09 Impact factor: 2.692
Authors: Jennifer S Mindell; Simona Giampaoli; Antje Goesswald; Panagiotis Kamtsiuris; Charlotte Mann; Satu Männistö; Karen Morgan; Nicola J Shelton; W M Monique Verschuren; Hanna Tolonen Journal: BMC Med Res Methodol Date: 2015-10-05 Impact factor: 4.615
Authors: Emily McBride; Hiromi Mase; Robert S Kerrison; Laura A V Marlow; Jo Waller Journal: BMC Med Res Methodol Date: 2021-12-18 Impact factor: 4.615