Nancy Santesso1, Angela M Barbara2, Rakhshan Kamran2, Sita Akkinepally3, John Cairney4, Elie A Akl5, Holger J Schünemann2. 1. Department of Health Research Methods, Evidence and Impact, McMaster University, Hamilton, Ontario, Canada. Electronic address: santesna@mcmaster.ca. 2. Department of Health Research Methods, Evidence and Impact, McMaster University, Hamilton, Ontario, Canada. 3. Chautauqua Medical Services, Great Lakes Physician Practice, Fredonia, New York, United States. 4. Faculty of Kinesiology and Physical Education, University of Toronto, Toronto, Canada. 5. Department of Internal Medicine, American University of Beirut, Beirut, Lebanon.
Abstract
OBJECTIVES: Surveys can inform important health care questions. However, should decision-makers believe strong conclusions that authors of surveys report? Objectives of this systematic survey of surveys are to describe the characteristics and conduct of surveys and investigate the association of the conduct with the conclusions. STUDY DESIGN AND SETTING: We randomly selected 180 surveys published over 1 year in core clinical journals that included a self-report instrument to elicit knowledge, attitudes, behaviors, and experiences regarding health. Study selection and abstraction was independent and in duplicate. We calculated frequencies of descriptive data. We conducted multivariable logistic regression analyses to assess the association of strong or weak conclusions with survey methods. RESULTS: Our results suggest that authors who validate questions in their survey make strong conclusions. We found that strong conclusions may not be associated with response rates or number of respondents. However, it did not appear that journal impact factor was related to strong conclusions. CONCLUSION: Our results suggest that users of surveys should not rely on the conclusions of authors. A critical appraisal tool for users of surveys and guidance for authors about factors to consider when making conclusions would be helpful.
OBJECTIVES: Surveys can inform important health care questions. However, should decision-makers believe strong conclusions that authors of surveys report? Objectives of this systematic survey of surveys are to describe the characteristics and conduct of surveys and investigate the association of the conduct with the conclusions. STUDY DESIGN AND SETTING: We randomly selected 180 surveys published over 1 year in core clinical journals that included a self-report instrument to elicit knowledge, attitudes, behaviors, and experiences regarding health. Study selection and abstraction was independent and in duplicate. We calculated frequencies of descriptive data. We conducted multivariable logistic regression analyses to assess the association of strong or weak conclusions with survey methods. RESULTS: Our results suggest that authors who validate questions in their survey make strong conclusions. We found that strong conclusions may not be associated with response rates or number of respondents. However, it did not appear that journal impact factor was related to strong conclusions. CONCLUSION: Our results suggest that users of surveys should not rely on the conclusions of authors. A critical appraisal tool for users of surveys and guidance for authors about factors to consider when making conclusions would be helpful.
Authors: Augusta Silveira; Teresa Sequeira; Joaquim Gonçalves; Pedro Lopes Ferreira Journal: Health Qual Life Outcomes Date: 2022-05-21 Impact factor: 3.077
Authors: Jennifer A Watt; Areti Angeliki Veroniki; Andrea C Tricco; Sharon E Straus Journal: BMC Med Res Methodol Date: 2021-02-26 Impact factor: 4.615
Authors: Ebba K Lindqvist; Niels Noordzij; Shiv Chopra; Alfonso Navia; Laura Cappuyns; Amr Khalaf; Oscar F Fernandez Diaz; Juan Enrique Berner; Linda Monshizadeh; Robert X Murphy Journal: Plast Reconstr Surg Glob Open Date: 2022-10-07