Russell E Glasgow1, Amy G Huebschmann2, Ross C Brownson3. 1. Department of Family Medicine, University of Colorado School of Medicine, Aurora, Colorado; University of Colorado Adult and Child Consortium of Outcomes Research and Delivery Science Program, Aurora, Colorado. Electronic address: russell.glasgow@ucdenver.edu. 2. University of Colorado Adult and Child Consortium of Outcomes Research and Delivery Science Program, Aurora, Colorado; Division of General Internal Medicine, University of Colorado School of Medicine, Aurora, Colorado; University of Colorado Center for Women's Health Research, Aurora, Colorado. 3. Prevention Research Center, Brown School, Washington University, St. Louis, Missouri; Department of Surgery, Division of Public Health Sciences, and Alvin J. Siteman Cancer Center, Washington University School of Medicine, Washington University, St. Louis, Missouri.
Abstract
INTRODUCTION: There are major problems with failure to replicate research findings. Contributing to this problem is a failure to report on factors related to external validity. Frequently, researchers have little knowledge whether findings apply more generally, especially to low-resource settings and underserved populations. The CONSORT flow diagram has improved reporting on variables related to internal validity, but it has very limited detail on issues related to external validity. A recent CONSORT update and other publications have called for more transparent reporting on external validity and context, and information regarding the sustainability of interventions. All of these elements influence the generalizability of findings from outcomes research. METHODS: Drawing on theory, a prior meeting, and recent recommendations for reporting factors related to external validity, the authors propose an expansion of the basic CONSORT flow diagram for clinical trials to concisely summarize these data that recent CONSORT statements and other guidelines have recommended. RESULTS: The authors propose the use of an expanded CONSORT figure and illustrate its utility with an example. The expanded CONSORT figure adds data about participation and representativeness at the levels of settings and staff, and about intervention sustainability after project support ends. The authors provide an expanded CONSORT figure reporting template, and demonstrate its use. CONCLUSIONS: Improving transparent reporting on external validity by using the proposed expanded CONSORT figure would help to address both the scientific replication crisis and health equity concerns. This figure provides a method to efficiently address the representativeness, generalizability, and sustainability of outcomes research.
INTRODUCTION: There are major problems with failure to replicate research findings. Contributing to this problem is a failure to report on factors related to external validity. Frequently, researchers have little knowledge whether findings apply more generally, especially to low-resource settings and underserved populations. The CONSORT flow diagram has improved reporting on variables related to internal validity, but it has very limited detail on issues related to external validity. A recent CONSORT update and other publications have called for more transparent reporting on external validity and context, and information regarding the sustainability of interventions. All of these elements influence the generalizability of findings from outcomes research. METHODS: Drawing on theory, a prior meeting, and recent recommendations for reporting factors related to external validity, the authors propose an expansion of the basic CONSORT flow diagram for clinical trials to concisely summarize these data that recent CONSORT statements and other guidelines have recommended. RESULTS: The authors propose the use of an expanded CONSORT figure and illustrate its utility with an example. The expanded CONSORT figure adds data about participation and representativeness at the levels of settings and staff, and about intervention sustainability after project support ends. The authors provide an expanded CONSORT figure reporting template, and demonstrate its use. CONCLUSIONS: Improving transparent reporting on external validity by using the proposed expanded CONSORT figure would help to address both the scientific replication crisis and health equity concerns. This figure provides a method to efficiently address the representativeness, generalizability, and sustainability of outcomes research.
Authors: Courtney Barnes; Sam McCrabb; Fiona Stacey; Nicole Nathan; Sze Lin Yoong; Alice Grady; Rachel Sutherland; Rebecca Hodder; Christine Innes-Hughes; Marc Davies; Luke Wolfenden Journal: Transl Behav Med Date: 2021-07-29 Impact factor: 3.046
Authors: Daniel D Matlock; Colleen K McIlvennan; Jocelyn S Thompson; Megan A Morris; Grace Venechuk; Shannon M Dunlay; Shane J LaRue; Eldrin F Lewis; Chetan B Patel; Laura Blue; Erin L Chaussee; Russell E Glasgow; Mary Norine Walsh; Larry A Allen Journal: Med Decis Making Date: 2020-04 Impact factor: 2.583
Authors: Jennifer C Sanchez-Flack; Annie Herman; Joanna Buscemi; Angela Kong; Alexis Bains; Marian L Fitzgibbon Journal: Transl Behav Med Date: 2020-10-12 Impact factor: 3.046
Authors: Renaldo M Bernard; Claudia Toppo; Alberto Raggi; Marleen de Mul; Carlota de Miquel; Maria Teresa Pugliese; Christina M van der Feltz-Cornelis; Ana Ortiz-Tallo; Luis Salvador-Carulla; Sue Lukersmith; Leona Hakkaart-van Roijen; Dorota Merecz-Kot; Kaja Staszewska; Carla Sabariego Journal: J Med Internet Res Date: 2022-06-01 Impact factor: 7.076
Authors: Russell E Glasgow; Catherine Battaglia; Marina McCreight; Roman Aydiko Ayele; Borsika Adrienn Rabin Journal: Front Public Health Date: 2020-05-27
Authors: Minna Aittasalo; Johanna Tiilikainen; Kari Tokola; Jaana Suni; Harri Sievänen; Henri Vähä-Ypyä; Tommi Vasankari; Timo Seimelä; Pasi Metsäpuro; Charlie Foster; Sylvia Titze Journal: Int J Environ Res Public Health Date: 2019-05-13 Impact factor: 3.390
Authors: Russell E Glasgow; Samantha M Harden; Bridget Gaglio; Borsika Rabin; Matthew Lee Smith; Gwenndolyn C Porter; Marcia G Ory; Paul A Estabrooks Journal: Front Public Health Date: 2019-03-29
Authors: Kiley B Vander Wyst; Micah L Olson; Elva Hooker; Erica G Soltero; Yolando P Konopken; Colleen S Keller; Felipe G Castro; Allison N Williams; Arlene D R Fernández; Donald L Patrick; Stephanie L Ayers; Houchun H Hu; Armando Peña; Janiel Pimentel; William C Knowler; Gabriel Q Shaibi Journal: Trials Date: 2020-08-14 Impact factor: 2.279