Annelieke M Roest1, Peter de Jonge1, Craig D Williams2, Ymkje Anna de Vries1, Robert A Schoevers1, Erick H Turner3. 1. Interdisciplinary Center Psychopathology and Emotion Regulation, Department of Psychiatry, University of Groningen, University Medical Center Groningen, Groningen, the Netherlands. 2. College of Pharmacy, Oregon State and Oregon Health and Science University, Portland. 3. Departments of Psychiatry and Pharmacology, Oregon Health and Science University, Portland.
Abstract
IMPORTANCE: Studies have shown that the scientific literature has overestimated the efficacy of antidepressants for depression, but other indications for these drugs have not been considered. OBJECTIVE: To examine reporting biases in double-blind, placebo-controlled trials on the pharmacologic treatment of anxiety disorders and quantify the extent to which these biases inflate estimates of drug efficacy. DATA SOURCES AND STUDY SELECTION: We included reviews obtained from the US Food and Drug Administration (FDA) for premarketing trials of 9 second-generation antidepressants in the treatment of anxiety disorders. A systematic search for matching publications (until December 19, 2012) was performed using PubMed, EMBASE, and the Cochrane Central Register of Controlled Trials. DATA EXTRACTION AND SYNTHESIS: Double data extraction was performed for the FDA reviews and the journal articles. The Hedges g value was calculated as the measure of effect size. MAIN OUTCOMES AND MEASURES: Reporting bias was examined and classified as study publication bias, outcome reporting bias, or spin (abstract conclusion not consistent with published results on primary end point). Separate meta-analyses were conducted for the 2 sources, and the effect of publication status on the effect estimates was examined using meta-regression. RESULTS: The findings of 41 of the 57 trials (72%) were positive according to the FDA, but 43 of the 45 published article conclusions (96%) were positive (P < .001). Trials that the FDA determined as positive were 5 times more likely to be published in agreement with that determination compared with trials determined as not positive (risk ratio, 5.20; 95% CI, 1.87 to 14.45; P < .001). We found evidence for study publication bias (P < .001), outcome reporting bias (P = .02), and spin (P = .02). The pooled effect size based on the published literature (Hedges g, 0.38; 95% CI, 0.33 to 0.42; P < .001) was 15% higher than the effect size based on the FDA data (Hedges g, 0.33; 95% CI, 0.29 to 0.38; P < .001), but this difference was not statistically significant (β = 0.04; 95% CI, -0.02 to 0.10; P = .18). CONCLUSIONS AND RELEVANCE: Various reporting biases were present for trials on the efficacy of FDA-approved second-generation antidepressants for anxiety disorders. Although these biases did not significantly inflate estimates of drug efficacy, reporting biases led to significant increases in the number of positive findings in the literature.
IMPORTANCE: Studies have shown that the scientific literature has overestimated the efficacy of antidepressants for depression, but other indications for these drugs have not been considered. OBJECTIVE: To examine reporting biases in double-blind, placebo-controlled trials on the pharmacologic treatment of anxiety disorders and quantify the extent to which these biases inflate estimates of drug efficacy. DATA SOURCES AND STUDY SELECTION: We included reviews obtained from the US Food and Drug Administration (FDA) for premarketing trials of 9 second-generation antidepressants in the treatment of anxiety disorders. A systematic search for matching publications (until December 19, 2012) was performed using PubMed, EMBASE, and the Cochrane Central Register of Controlled Trials. DATA EXTRACTION AND SYNTHESIS: Double data extraction was performed for the FDA reviews and the journal articles. The Hedges g value was calculated as the measure of effect size. MAIN OUTCOMES AND MEASURES: Reporting bias was examined and classified as study publication bias, outcome reporting bias, or spin (abstract conclusion not consistent with published results on primary end point). Separate meta-analyses were conducted for the 2 sources, and the effect of publication status on the effect estimates was examined using meta-regression. RESULTS: The findings of 41 of the 57 trials (72%) were positive according to the FDA, but 43 of the 45 published article conclusions (96%) were positive (P < .001). Trials that the FDA determined as positive were 5 times more likely to be published in agreement with that determination compared with trials determined as not positive (risk ratio, 5.20; 95% CI, 1.87 to 14.45; P < .001). We found evidence for study publication bias (P < .001), outcome reporting bias (P = .02), and spin (P = .02). The pooled effect size based on the published literature (Hedges g, 0.38; 95% CI, 0.33 to 0.42; P < .001) was 15% higher than the effect size based on the FDA data (Hedges g, 0.33; 95% CI, 0.29 to 0.38; P < .001), but this difference was not statistically significant (β = 0.04; 95% CI, -0.02 to 0.10; P = .18). CONCLUSIONS AND RELEVANCE: Various reporting biases were present for trials on the efficacy of FDA-approved second-generation antidepressants for anxiety disorders. Although these biases did not significantly inflate estimates of drug efficacy, reporting biases led to significant increases in the number of positive findings in the literature.
Authors: Lian Van Der Krieke; Bertus F Jeronimus; Frank J Blaauw; Rob B K Wanders; Ando C Emerencia; Hendrika M Schenk; Stijn De Vos; Evelien Snippe; Marieke Wichers; Johanna T W Wigman; Elisabeth H Bos; Klaas J Wardenaar; Peter De Jonge Journal: Int J Methods Psychiatr Res Date: 2015-09-22 Impact factor: 4.035
Authors: Lin Wang; Benjamin Rouse; Arielle Marks-Anglin; Rui Duan; Qiyuan Shi; Kevin Quach; Yong Chen; Christopher Cameron; Christopher H Schmid; Tianjing Li Journal: J Clin Epidemiol Date: 2019-06-18 Impact factor: 6.437
Authors: Rei Monden; Stijn de Vos; Richard Morey; Eric-Jan Wagenmakers; Peter de Jonge; Annelieke M Roest Journal: Int J Methods Psychiatr Res Date: 2016-05-24 Impact factor: 4.035
Authors: A Dehmoobad Sharifabadi; D A Korevaar; T A McGrath; N van Es; R A Frank; L Cherpak; W Dang; J P Salameh; F Nguyen; C Stanley; M D F McInnes Journal: Eur Radiol Date: 2018-03-21 Impact factor: 5.315
Authors: Casey S Greene; Lana X Garmire; Jack A Gilbert; Marylyn D Ritchie; Lawrence E Hunter Journal: Nat Genet Date: 2017-03-30 Impact factor: 38.330
Authors: A M Roest; P de Jonge; C W W Lim; D J Stein; A Al-Hamzawi; J Alonso; C Benjet; R Bruffaerts; B Bunting; J M Caldas-de-Almeida; M Ciutan; G de Girolamo; C Hu; D Levinson; Y Nakamura; F Navarro-Mateu; M Piazza; J Posada-Villa; Y Torres; B Wojtyniak; R C Kessler; K M Scott Journal: J Psychosom Res Date: 2017-03-24 Impact factor: 3.006
Authors: Cosima Locher; Helen Koechlin; Sean R Zion; Christoph Werner; Daniel S Pine; Irving Kirsch; Ronald C Kessler; Joe Kossowsky Journal: JAMA Psychiatry Date: 2017-10-01 Impact factor: 21.596