Nancy E Mayo1,2, Nikki Ow3, Miho Asano4, Sorayya Askari5, Ruth Barclay6, Sabrina Figueiredo7, Melanie Hawkins8, Stanley Hum9, Mehmet Inceer10, Navaldeep Kaur11, Ayse Kuspinar12, Kedar K V Mate13, Ana Maria Moga10, Maryam Mozafarinia14. 1. School of Physical and Occupational Therapy, Divisions of Clinical Epidemiology, Geriatrics, Experimental Medicine, Department of Medicine, McGill University, Center for Outcomes Research and Evaluation (CORE) McGill University Health Centre (MUHC)-Research Institute, Montreal, Canada. nancy.mayo@mcgill.ca. 2. School of Physical and Occupational Therapy, Divisions of Clinical Epidemiology, Geriatrics, Experimental Medicine, Faculty of Medicine and Health Sciences, McGill University, Center for Outcomes Research and Evaluation (CORE) McGill University Health Centre-Research Institute (RI-MUHC), Montreal, QC, Canada. nancy.mayo@mcgill.ca. 3. Occupational Science and Occupational Therapy, Faculty of Medicine, University of British Columbia, Foundry Central Office, Vancouver, Canada. 4. Saw Swee Hock School of Public Health, National University of Singapore, Singapore, Singapore. 5. School of Occupational Therapy, Dalhousie University, Halifax, Canada. 6. Department of Physical Therapy, College of Rehabilitation Sciences, Rady Faculty of Health Sciences, University of Manitoba, Winnipeg, Canada. 7. Department of Clinical Research and Leadership, School of Medicine and Health Sciences, George Washington University, Washington, DC, USA. 8. Centre for Global Health and Equity, Faculty of Health, Arts and Design, Swinburne University of Technology, Melbourne, Australia. 9. Brain Health Outcomes Platform, Montreal Neurological Institute and Hospital, Montreal, Canada. 10. School of Physical and Occupational Therapy, Faculty of Medicine and Health Sciences, McGill University, Center for Outcomes Research and Evaluation (CORE) McGill University Health Centre (MUHC)-Research Institute, Montreal, Canada. 11. Department of Physical Therapy, Rehabilitation Sciences Institute, University of Toronto, Toronto, Canada. 12. School of Rehabilitation Science, McMaster University, Hamilton, ON, Canada. 13. Centre for Neurological Restoration, Cleveland Clinic, Cleveland, USA. 14. Division of Experimental Medicine, Faculty of Medicine and Health Sciences, McGill University, Center for Outcomes Research and Evaluation (CORE) McGill University Health Centre (MUHC)-Research Institute, Montreal, Canada.
Abstract
PURPOSE: Strongly framed research questions are clear as to the population (P), the exposures or interventions (E/I), comparison groups (C), outcomes (O), time when relevant (T), and what the investigator wants to know. A solid framework sets up the measurement model, analysis, and anticipated results. The purpose of this study was to estimate the extent to which research questions in journals that focused on patient-reported outcome measures (PROM) and quality of life (QOL) are clear. METHODS: All 440 research articles published in four PROM journals in 2020. excluding reviews, psychometric, and qualitative papers, were reviewed. Research questions were classified as: (i) adequately framed (ii) poorly framed; or (iii) unframed based on clarity criteria. Examples from each journal were presented and reframed to match results in the article. RESULTS: Of 440 articles, 195 (44.3%) were classified as adequately framed; 230 (52.2%) as poorly framed; and 15 (3.4%) as unframed. There was heterogeneity across journals (Chi-square: 20.8; 6 df; p = 0.002). Only 29% were framed according to what the investigators wanted to know; 72% were framed like a "to do" list; and 6% were framed as a research agenda. CONCLUSION: Almost half of the questions were poorly framed or unframed a practice that could contribute to research wastage. Even "adequately framed" questions rarely stated what they wanted to know a priori, increasing the risk of biased reporting. Researchers, reviewers, and editors should encourage the use established frameworks for research questions.
PURPOSE: Strongly framed research questions are clear as to the population (P), the exposures or interventions (E/I), comparison groups (C), outcomes (O), time when relevant (T), and what the investigator wants to know. A solid framework sets up the measurement model, analysis, and anticipated results. The purpose of this study was to estimate the extent to which research questions in journals that focused on patient-reported outcome measures (PROM) and quality of life (QOL) are clear. METHODS: All 440 research articles published in four PROM journals in 2020. excluding reviews, psychometric, and qualitative papers, were reviewed. Research questions were classified as: (i) adequately framed (ii) poorly framed; or (iii) unframed based on clarity criteria. Examples from each journal were presented and reframed to match results in the article. RESULTS: Of 440 articles, 195 (44.3%) were classified as adequately framed; 230 (52.2%) as poorly framed; and 15 (3.4%) as unframed. There was heterogeneity across journals (Chi-square: 20.8; 6 df; p = 0.002). Only 29% were framed according to what the investigators wanted to know; 72% were framed like a "to do" list; and 6% were framed as a research agenda. CONCLUSION: Almost half of the questions were poorly framed or unframed a practice that could contribute to research wastage. Even "adequately framed" questions rarely stated what they wanted to know a priori, increasing the risk of biased reporting. Researchers, reviewers, and editors should encourage the use established frameworks for research questions.