Alexandre Paim Diaz1, Jair C Soares1, Paolo Brambilla2, Allan H Young3, Sudhakar Selvaraj4. 1. Louis. A. Faillace, MD, Department of Psychiatry and Behavioral Sciences, The University of Texas Health Science Center at Houston, 1941 East Rd, Houston, TX 77054. 2. Department of Neurosciences and Mental Health, Fondazione IRCCS Ca' Granda Ospedale Maggiore Policlinico, Milano, Italy; Department of Pathophysiology and Transplantation, University of Milan, Milan, Italy. 3. Department of Psychological Medicine, Institute of Psychiatry, Psychology and Neuroscience, King's College London & South London and Maudsley NHS Foundation Trust, Bethlem Royal Hospital, Monks Orchard Road, Beckenham, Kent, BR3 3BX, United Kingdom. 4. Louis. A. Faillace, MD, Department of Psychiatry and Behavioral Sciences, The University of Texas Health Science Center at Houston, 1941 East Rd, Houston, TX 77054. Electronic address: sudhakar.selvaraj@uth.tmc.edu.
Abstract
BACKGROUND: Metrics of journal's impact factor may suggest the journal's influence in a particular field, but they have been used inadvertently as a measure of the journal and individual publications' scientific quality. METHODS: We assessed how scientific journals in the field of psychiatry and mental health are ranked (top 20) according to the scores of distinct metrics (Eigenfactor score, Google Scholar Metrics, Journal Citation Reports, Scimago Journal & Country Rank, and Source Normalized Impact per Paper), described their main characteristics and perfomed a spearman's correlation analyses to investigate to which extent these metrics are associated. We also discussed the limitations of dealing with these metrics and the rankings they provide as a proxy of the journal's quality. RESULTS: Only 5 (12.5%) journals appear in all metrics (JAMA Psychiatry, American Journal of Psychiatry, Molecular Psychiatry, Schizophrenia Bulletin, and the Journal of Child Psychology and Psychiatry), more than one-third of the journals show up in only one and less than half (42.5%) appear in three or more. Only JAMA Psychiatry is in one of the first five positions of all metrics. No journal ranked in the same position across the metrics. On the other hand, we found the correlations between all the metrics were statistically significant. LIMITATIONS: The metrics included are not exhaustive. CONCLUSIONS: Although each metric provides a particular ranking, they are highly correlated. Rankings also change according to distinct subject categories in which they are assessed. We suggest less emphasis should be given to Journal Metrics to infer journal's quality.
BACKGROUND: Metrics of journal's impact factor may suggest the journal's influence in a particular field, but they have been used inadvertently as a measure of the journal and individual publications' scientific quality. METHODS: We assessed how scientific journals in the field of psychiatry and mental health are ranked (top 20) according to the scores of distinct metrics (Eigenfactor score, Google Scholar Metrics, Journal Citation Reports, Scimago Journal & Country Rank, and Source Normalized Impact per Paper), described their main characteristics and perfomed a spearman's correlation analyses to investigate to which extent these metrics are associated. We also discussed the limitations of dealing with these metrics and the rankings they provide as a proxy of the journal's quality. RESULTS: Only 5 (12.5%) journals appear in all metrics (JAMA Psychiatry, American Journal of Psychiatry, Molecular Psychiatry, Schizophrenia Bulletin, and the Journal of Child Psychology and Psychiatry), more than one-third of the journals show up in only one and less than half (42.5%) appear in three or more. Only JAMA Psychiatry is in one of the first five positions of all metrics. No journal ranked in the same position across the metrics. On the other hand, we found the correlations between all the metrics were statistically significant. LIMITATIONS: The metrics included are not exhaustive. CONCLUSIONS: Although each metric provides a particular ranking, they are highly correlated. Rankings also change according to distinct subject categories in which they are assessed. We suggest less emphasis should be given to Journal Metrics to infer journal's quality.