D B T Robinson1, A G M T Powell2, J Waterman1, L Hopkins1, O P James1, R J Egan3,4, W G Lewis1. 1. Health Education and Improvement Wales' School of Surgery, Ty Dysgu, Nantgarw, UK. 2. Division of Cancer and Genetics, Cardiff University, Heath Park, Cardiff, UK. 3. Morriston Hospital, Cwmrhydceirw, Swansea, UK. 4. Swansea University, Singleton Park, Sketty, Swansea, UK.
Abstract
BACKGROUND: Bibliometric and Altmetric analyses provide different perspectives regarding research impact. This study aimed to determine whether Altmetric score was associated with citation rate independent of established bibliometrics. METHODS: Citations related to a previous cohort of 100 most cited articles in surgery were collected and a 3-year interval citation gain calculated. Citation count, citation rate index, Altmetric score, 5-year impact factor, and Oxford Centre for Evidence-Based Medicine levels were used to estimate citation rate prospect. RESULTS: The median interval citation gain was 161 (i.q.r. 83-281); 74 and 62 articles had an increase in citation rate index (median increase 2.8 (i.q.r. -0.1 to 7.7)) and Altmetric score (median increase 3 (0-4)) respectively. Receiver operating characteristic (ROC) curve analysis revealed that citation rate index (area under the curve (AUC) 0.86, 95 per cent c.i. 0.79 to 0.93; P < 0.001) and Altmetric score (AUC 0.65, 0.55 to 0.76; P = 0.008) were associated with higher interval citation gain. An Altmetric score critical threshold of 2 or more was associated with a better interval citation gain when dichotomized at the interval citation gain median (odds ratio (OR) 4.94, 95 per cent c.i. 1.99 to 12.26; P = 0.001) or upper quartile (OR 4.13, 1.60 to 10.66; P = 0.003). Multivariable analysis revealed only citation rate index to be independently associated with interval citation gain when dichotomized at the median (OR 18.22, 6.70 to 49.55; P < 0.001) or upper quartile (OR 19.30, 4.23 to 88.15; P < 0.001). CONCLUSION: Citation rate index and Altmetric score appear to be important predictors of interval citation gain, and better at predicting future citations than the historical and established impact factor and Oxford Centre for Evidence-Based Medicine quality descriptors.
BACKGROUND: Bibliometric and Altmetric analyses provide different perspectives regarding research impact. This study aimed to determine whether Altmetric score was associated with citation rate independent of established bibliometrics. METHODS: Citations related to a previous cohort of 100 most cited articles in surgery were collected and a 3-year interval citation gain calculated. Citation count, citation rate index, Altmetric score, 5-year impact factor, and Oxford Centre for Evidence-Based Medicine levels were used to estimate citation rate prospect. RESULTS: The median interval citation gain was 161 (i.q.r. 83-281); 74 and 62 articles had an increase in citation rate index (median increase 2.8 (i.q.r. -0.1 to 7.7)) and Altmetric score (median increase 3 (0-4)) respectively. Receiver operating characteristic (ROC) curve analysis revealed that citation rate index (area under the curve (AUC) 0.86, 95 per cent c.i. 0.79 to 0.93; P < 0.001) and Altmetric score (AUC 0.65, 0.55 to 0.76; P = 0.008) were associated with higher interval citation gain. An Altmetric score critical threshold of 2 or more was associated with a better interval citation gain when dichotomized at the interval citation gain median (odds ratio (OR) 4.94, 95 per cent c.i. 1.99 to 12.26; P = 0.001) or upper quartile (OR 4.13, 1.60 to 10.66; P = 0.003). Multivariable analysis revealed only citation rate index to be independently associated with interval citation gain when dichotomized at the median (OR 18.22, 6.70 to 49.55; P < 0.001) or upper quartile (OR 19.30, 4.23 to 88.15; P < 0.001). CONCLUSION: Citation rate index and Altmetric score appear to be important predictors of interval citation gain, and better at predicting future citations than the historical and established impact factor and Oxford Centre for Evidence-Based Medicine quality descriptors.
Authors: L Norgren; W R Hiatt; J A Dormandy; M R Nehler; K A Harris; F G R Fowkes; Kevin Bell; Joseph Caporusso; Isabelle Durand-Zaleski; Kimihiro Komori; Johannes Lammer; Christos Liapis; Salvatore Novo; Mahmood Razavi; Johns Robbs; Nicholaas Schaper; Hiroshi Shigematsu; Marc Sapoval; Christopher White; John White; Denis Clement; Mark Creager; Michael Jaff; Emile Mohler; Robert B Rutherford; Peter Sheehan; Henrik Sillesen; Kenneth Rosenfield Journal: Eur J Vasc Endovasc Surg Date: 2006-11-29 Impact factor: 7.069
Authors: Alba Manuel Vázquez; Raquel Latorre Fragua; Aylhin López Marcano; Carmen Ramiro Pérez; Vladimir Arteaga Peralta; Roberto de la Plaza-Llamas; José Manuel Ramia Journal: Cir Esp (Engl Ed) Date: 2018-12-11
Authors: David B T Robinson; Luke Hopkins; Chris Brown; Tarig Abdelrahman; Arfon G Powell; Richard J Egan; Wyn G Lewis Journal: World J Surg Date: 2019-04 Impact factor: 3.352
Authors: René Adam; Valérie Delvart; Gérard Pascal; Adrian Valeanu; Denis Castaing; Daniel Azoulay; Sylvie Giacchetti; Bernard Paule; Francis Kunstlinger; Odile Ghémard; Francis Levi; Henri Bismuth Journal: Ann Surg Date: 2004-10 Impact factor: 12.969
Authors: Sonal Grover; Adam D Elwood; Jharna M Patel; Cande V Ananth; Justin S Brandt Journal: Am J Obstet Gynecol Date: 2022-03-11 Impact factor: 10.693