INTRODUCTION: Our objective was to assess the hypothesis that there are variations of the proportion of articles reporting a significant effect, with a higher percentage of those articles published in journals with impact factors. METHODS: The contents of 5 orthodontic journals (American Journal of Orthodontics and Dentofacial Orthopedics, Angle Orthodontist, European Journal of Orthodontics, Journal of Orthodontics, and Orthodontics and Craniofacial Research), published between 2004 and 2008, were hand-searched. Articles with statistical analysis of data were included in the study and classified into 4 categories: behavior and psychology, biomaterials and biomechanics, diagnostic procedures and treatment, and craniofacial growth, morphology, and genetics. In total, 2622 articles were examined, with 1785 included in the analysis. Univariate and multivariate logistic regression analyses were applied with statistical significance as the dependent variable, and whether the journal had an impact factor, the subject, and the year were the independent predictors. RESULTS: A higher percentage of articles showed significant results relative to those without significant associations (on average, 88% vs 12%) for those journals. Overall, these journals published significantly more studies with significant results, ranging from 75% to 90% (P = 0.02). Multivariate modeling showed that journals with impact factors had a 100% increased probability of publishing a statistically significant result compared with journals with no impact factor (odds ratio [OR], 1.99; 95% CI, 1.19-3.31). Compared with articles on biomaterials and biomechanics, all other subject categories showed lower probabilities of significant results. Nonsignificant findings in behavior and psychology and diagnosis and treatment were 1.8 (OR, 1.75; 95% CI, 1.51-2.67) and 3.5 (OR, 3.50; 95% CI, 2.27-5.37) times more likely to be published, respectively. CONCLUSIONS: Journals seem to prefer reporting significant results; this might be because of authors' perceptions of the importance of their findings and editors' and reviewers' preferences for significant results. The implication of this factor in the reliability of systematic reviews is discussed.
INTRODUCTION: Our objective was to assess the hypothesis that there are variations of the proportion of articles reporting a significant effect, with a higher percentage of those articles published in journals with impact factors. METHODS: The contents of 5 orthodontic journals (American Journal of Orthodontics and Dentofacial Orthopedics, Angle Orthodontist, European Journal of Orthodontics, Journal of Orthodontics, and Orthodontics and Craniofacial Research), published between 2004 and 2008, were hand-searched. Articles with statistical analysis of data were included in the study and classified into 4 categories: behavior and psychology, biomaterials and biomechanics, diagnostic procedures and treatment, and craniofacial growth, morphology, and genetics. In total, 2622 articles were examined, with 1785 included in the analysis. Univariate and multivariate logistic regression analyses were applied with statistical significance as the dependent variable, and whether the journal had an impact factor, the subject, and the year were the independent predictors. RESULTS: A higher percentage of articles showed significant results relative to those without significant associations (on average, 88% vs 12%) for those journals. Overall, these journals published significantly more studies with significant results, ranging from 75% to 90% (P = 0.02). Multivariate modeling showed that journals with impact factors had a 100% increased probability of publishing a statistically significant result compared with journals with no impact factor (odds ratio [OR], 1.99; 95% CI, 1.19-3.31). Compared with articles on biomaterials and biomechanics, all other subject categories showed lower probabilities of significant results. Nonsignificant findings in behavior and psychology and diagnosis and treatment were 1.8 (OR, 1.75; 95% CI, 1.51-2.67) and 3.5 (OR, 3.50; 95% CI, 2.27-5.37) times more likely to be published, respectively. CONCLUSIONS: Journals seem to prefer reporting significant results; this might be because of authors' perceptions of the importance of their findings and editors' and reviewers' preferences for significant results. The implication of this factor in the reliability of systematic reviews is discussed.
Authors: Carmen Giurgescu; Barbara L McFarlin; Jeneen Lomax; Cindy Craddock; Amy Albrecht Journal: J Midwifery Womens Health Date: 2011 Jul-Aug Impact factor: 2.388
Authors: Christina Kien; Barbara Nußbaumer; Kylie J Thaler; Ursula Griebler; Megan G Van Noord; Petra Wagner; Gerald Gartlehner Journal: BMC Health Serv Res Date: 2014-11-13 Impact factor: 2.655
Authors: Victor A Sanchez-Azanza; Raúl López-Penadés; Lucía Buil-Legaz; Eva Aguilar-Mediavilla; Daniel Adrover-Roig Journal: PLoS One Date: 2017-04-20 Impact factor: 3.240
Authors: Humam Saltaji; Greta G Cummings; Susan Armijo-Olivo; Michael P Major; Maryam Amin; Paul W Major; Lisa Hartling; Carlos Flores-Mir Journal: PLoS One Date: 2013-09-30 Impact factor: 3.240
Authors: Emmanuelle Kempf; Jennifer A de Beyer; Jonathan Cook; Jane Holmes; Seid Mohammed; Tri-Long Nguyên; Iveta Simera; Marialena Trivella; Douglas G Altman; Sally Hopewell; Karel G M Moons; Raphael Porcher; Johannes B Reitsma; Willi Sauerbrei; Gary S Collins Journal: Br J Cancer Date: 2018-10-24 Impact factor: 7.640