Kavin Sundaram1, Jared Warren1, Hiba K Anis1, Alison K Klika1, Nicolas S Piuzzi2. 1. Department of Orthopedic Surgery, Cleveland Clinic, 9500 Euclid Ave/A41, Cleveland, OH, 44195, USA. 2. Department of Orthopedic Surgery, Cleveland Clinic, 9500 Euclid Ave/A41, Cleveland, OH, 44195, USA. piuzzin@ccf.org.
Abstract
BACKGROUND: The impact factor (IF) is the most commonly used bibliometric method for rating academic journals. However, the practice of journals' self-citation may artificially elevate the IF. Additional bibliometric methods including Eigenfactor scale, SCImago Journal Ranking (SJR), and corrected IF (cIF) have been created. Comparing general-interest and specialized orthopaedic journals, the aims of this study were to assess: (1) the effect of journal´s self-citation on IF; (2) differences in bibliometric analysis; and (3) to determine thresholds for monitoring self-citation practices by defining the self-citation in orthopaedic research (SCOR) Threshold. METHODS: The journal citation reports and SCImago Journal and Country Rank databases were queried for orthopaedic journals from 1997 to 2017. The following bibliometrics were compared between general-interest and specialized journals: IF, cIF, Eigenfactor, self-citation rates, and SJR. A novel metric, the cIF ratio, was proposed to represent the relationship between a journal's IF and cIF. Thresholds for cIF were based on statistical outliers of cIF ratio within general-interest and specialized journals were calculated. Outliers were defined as data points that were greater than the third quartile by 1.5 times the interquartile range using the last 10 years studied (2007-2017). RESULTS: Specialized orthopaedic journals had a higher median self-citation rates compared to general-interest journals (11.85% vs. 6.36%, p < 0.001). Overall, cIF ratio declined over study period, and general-interest journals had a lower cIF ratio than specialized journals (8.77% vs. 19.54%, p < 0.001). Overall, general-interest journals had more favourable values for the bibliometric indices studied compared to specialized journals The SCOR threshold for cIF ratio was determined as 25.4% for general-interest journals and 53.3% for specialized journals. CONCLUSION: Overall, self-citation occurs at a higher rate in specialized versus general-interest orthopaedic journals. We propose the use of a cIF ratio along with the SCOR threshold as a tool to evaluate and monitor journal self-citation practices in orthopaedic research.
BACKGROUND: The impact factor (IF) is the most commonly used bibliometric method for rating academic journals. However, the practice of journals' self-citation may artificially elevate the IF. Additional bibliometric methods including Eigenfactor scale, SCImago Journal Ranking (SJR), and corrected IF (cIF) have been created. Comparing general-interest and specialized orthopaedic journals, the aims of this study were to assess: (1) the effect of journal´s self-citation on IF; (2) differences in bibliometric analysis; and (3) to determine thresholds for monitoring self-citation practices by defining the self-citation in orthopaedic research (SCOR) Threshold. METHODS: The journal citation reports and SCImago Journal and Country Rank databases were queried for orthopaedic journals from 1997 to 2017. The following bibliometrics were compared between general-interest and specialized journals: IF, cIF, Eigenfactor, self-citation rates, and SJR. A novel metric, the cIF ratio, was proposed to represent the relationship between a journal's IF and cIF. Thresholds for cIF were based on statistical outliers of cIF ratio within general-interest and specialized journals were calculated. Outliers were defined as data points that were greater than the third quartile by 1.5 times the interquartile range using the last 10 years studied (2007-2017). RESULTS: Specialized orthopaedic journals had a higher median self-citation rates compared to general-interest journals (11.85% vs. 6.36%, p < 0.001). Overall, cIF ratio declined over study period, and general-interest journals had a lower cIF ratio than specialized journals (8.77% vs. 19.54%, p < 0.001). Overall, general-interest journals had more favourable values for the bibliometric indices studied compared to specialized journals The SCOR threshold for cIF ratio was determined as 25.4% for general-interest journals and 53.3% for specialized journals. CONCLUSION: Overall, self-citation occurs at a higher rate in specialized versus general-interest orthopaedic journals. We propose the use of a cIF ratio along with the SCOR threshold as a tool to evaluate and monitor journal self-citation practices in orthopaedic research.
Authors: Joseph S Butler; Arjun S Sebastian; I David Kaye; Scott C Wagner; Patrick B Morrissey; Gregory D Schroeder; Christopher K Kepler; Alexander R Vaccaro Journal: Clin Spine Surg Date: 2017-05 Impact factor: 1.876
Authors: Christian B van der Pol; Matthew D F McInnes; William Petrcich; Adam S Tunis; Ramez Hanna Journal: PLoS One Date: 2015-03-16 Impact factor: 3.240
Authors: Teng L Teng; Mariano E Menendez; Kanu Okike; Charles Cassidy; Matthew Salzler Journal: Clin Orthop Relat Res Date: 2020-12 Impact factor: 4.755