Literature DB >> 33796272

Use of the journal impact factor for assessing individual articles: Statistically flawed or not?

Ludo Waltman1, Vincent A Traag1.   

Abstract

Most scientometricians reject the use of the journal impact factor for assessing individual articles and their authors. The well-known San Francisco Declaration on Research Assessment also strongly objects against this way of using the impact factor. Arguments against the use of the impact factor at the level of individual articles are often based on statistical considerations. The skewness of journal citation distributions typically plays a central role in these arguments. We present a theoretical analysis of statistical arguments against the use of the impact factor at the level of individual articles. Our analysis shows that these arguments do not support the conclusion that the impact factor should not be used for assessing individual articles. Using computer simulations, we demonstrate that under certain conditions the number of citations an article has received is a more accurate indicator of the value of the article than the impact factor. However, under other conditions, the impact factor is a more accurate indicator. It is important to critically discuss the dominant role of the impact factor in research evaluations, but the discussion should not be based on misplaced statistical arguments. Instead, the primary focus should be on the socio-technical implications of the use of the impact factor. Copyright:
© 2021 Waltman L and Traag VA.

Entities:  

Keywords:  Journal impact factor; citation; research assessment; research evaluation; skewness

Year:  2020        PMID: 33796272      PMCID: PMC7974631.2          DOI: 10.12688/f1000research.23418.2

Source DB:  PubMed          Journal:  F1000Res        ISSN: 2046-1402


  4 in total

1.  Bibliometric Analysis of Major Neurosurgical Publications 2011-2020, Part 2: Journal, Author, Yearly Publication Trends, and Citation Related Metrics.

Authors:  Kanwaljeet Garg; Bipin Chaurasia; Andrew J Gienapp; Bruno Splavski; Kenan I Arnautovic
Journal:  Acta Inform Med       Date:  2022-03

2.  Measuring the growing impact of BOSEM: halfway there or living on a prayer?

Authors:  Patrick J Owen; Daniel Ludovic Belavy; Diana Gai Robinson; Nash Anderson; Amy Harwood; Yorgi Mavros; Nicola Sewry; Evert Verhagen
Journal:  BMJ Open Sport Exerc Med       Date:  2022-08-02

3.  A comparison of scientometric data and publication policies of ophthalmology journals.

Authors:  Ibrahim Ethem Ay; Gokhan Tazegul; Yaşar Duranoğlu
Journal:  Indian J Ophthalmol       Date:  2022-05       Impact factor: 2.969

4.  Anchoring effects in the assessment of papers: The proposal for an empirical survey of citing authors.

Authors:  Lutz Bornmann; Christian Ganser; Alexander Tekles
Journal:  PLoS One       Date:  2021-09-29       Impact factor: 3.240

  4 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.