Susan L Norris1, Haley K Holmer1, Rongwei Fu1, Lauren A Ogden1, Meera S Viswanathan2, Ahmed M Abou-Setta3. 1. Department of Medical Informatics and Clinical Epidemiology, Oregon Health & Science University, Portland, OR, 97239, USA. 2. RTI International 3040 Cornwallis Road, PO Box 12194 Research Triangle Park, NC, 27709, USA. 3. George & Fay Yee Centre for Healthcare Innovation, University of Manitoba, 820 Sherbrook Street, Winnipeg, MB R3T 2N2, Canada.
Abstract
OBJECTIVE: This study aimed to examine selective outcome reporting (SOR) and selective analysis reporting (SAR) in randomized controlled trials (RCTs) and to explore the usefulness of trial registries for identifying SOR and SAR. STUDY DESIGN AND SETTING: We selected one "index outcome" for each of three comparative effectiveness reviews (CERs) of pharmacotherapy and extracted data on this outcome from trial registries and from study publications. RESULTS: Among 50 RCTs published since 2005 and reporting the index outcome, only 50% were listed in registries; 90% of RCTs were assessed as having SOR or SAR. The index outcome in the registry was different from that in the publication in 75% of trials in two CERs, and not specified at all in the third. Reported outcomes and analyses were not consistent between the publication's methods section and the results section in 33% and 46% of the two CERs where the index outcome was a benefit. There were no statistically significant predictors of SOR and SAR in our small sample where some predictors lacked variability. CONCLUSION: The SOR and SAR were frequent in this pilot study, and the most common type of SOR was the publication of outcomes that were not pre-specified. Trial registries were of little use in identifying SOR and of no use in identifying SAR.
OBJECTIVE: This study aimed to examine selective outcome reporting (SOR) and selective analysis reporting (SAR) in randomized controlled trials (RCTs) and to explore the usefulness of trial registries for identifying SOR and SAR. STUDY DESIGN AND SETTING: We selected one "index outcome" for each of three comparative effectiveness reviews (CERs) of pharmacotherapy and extracted data on this outcome from trial registries and from study publications. RESULTS: Among 50 RCTs published since 2005 and reporting the index outcome, only 50% were listed in registries; 90% of RCTs were assessed as having SOR or SAR. The index outcome in the registry was different from that in the publication in 75% of trials in two CERs, and not specified at all in the third. Reported outcomes and analyses were not consistent between the publication's methods section and the results section in 33% and 46% of the two CERs where the index outcome was a benefit. There were no statistically significant predictors of SOR and SAR in our small sample where some predictors lacked variability. CONCLUSION: The SOR and SAR were frequent in this pilot study, and the most common type of SOR was the publication of outcomes that were not pre-specified. Trial registries were of little use in identifying SOR and of no use in identifying SAR.
Authors: Guowei Li; Luciana P F Abbade; Ikunna Nwosu; Yanling Jin; Alvin Leenus; Muhammad Maaz; Mei Wang; Meha Bhatt; Laura Zielinski; Nitika Sanger; Bianca Bantoto; Candice Luo; Ieta Shams; Hamnah Shahid; Yaping Chang; Guangwen Sun; Lawrence Mbuagbaw; Zainab Samaan; Mitchell A H Levine; Jonathan D Adachi; Lehana Thabane Journal: BMC Med Res Methodol Date: 2018-01-11 Impact factor: 4.615