| Literature DB >> 23573211 |
Nasir Ahmad Aziz1, Maarten Pieter Rozing.
Abstract
Current metrics for estimating a scientist's academic performance treat the author's publications as if these were solely attributable to the author. However, this approach ignores the substantive contributions of co-authors, leading to misjudgments about the individual's own scientific merits and consequently to misallocation of funding resources and academic positions. This problem is becoming the more urgent in the biomedical field where the number of collaborations is growing rapidly, making it increasingly harder to support the best scientists. Therefore, here we introduce a simple harmonic weighing algorithm for correcting citations and citation-based metrics such as the h-index for co-authorships. This weighing algorithm can account for both the nvumber of co-authors and the sequence of authors on a paper. We then derive a measure called the 'profit (p)-index', which estimates the contribution of co-authors to the work of a given author. By using samples of researchers from a renowned Dutch University hospital, Spinoza Prize laureates (the most prestigious Dutch science award), and Nobel Prize laureates in Physiology or Medicine, we show that the contribution of co-authors to the work of a particular author is generally substantial (i.e., about 80%) and that researchers' relative rankings change materially when adjusted for the contributions of co-authors. Interestingly, although the top University hospital researchers had the highest h-indices, this appeared to be due to their significantly higher p-indices. Importantly, the ranking completely reversed when using the profit adjusted h-indices, with the Nobel laureates having the highest, the Spinoza Prize laureates having an intermediate, and the top University hospital researchers having the lowest profit adjusted h-indices, respectively, suggesting that exceptional researchers are characterized by a relatively high degree of scientific independency/originality. The concepts and methods introduced here may thus provide a more fair impression of a scientist's autonomous academic performance.Entities:
Mesh:
Year: 2013 PMID: 23573211 PMCID: PMC3616037 DOI: 10.1371/journal.pone.0059814
Source DB: PubMed Journal: PLoS One ISSN: 1932-6203 Impact factor: 3.240
Characteristics of 161 University Medical Centre researchers.
| Mean |
| Median | Mode |
| Minimum | Maximum | |
| No. of papers per subject | 232.5 | 17.88 | 153 | 117 | 226.84 | 9 | 1556 |
| Total no. of citations per subject | 5940.57 | 511.32 | 3966 | 751 | 6487.86 | 28 | 34232 |
| No. of co-authors per paper | 7.12 | 0.19 | 6.75 | 3.08 | 2.39 | 3.08 | 22.97 |
|
| 34.60 | 1.44 | 32 | 28 | 18.26 | 3 | 83 |
|
| 13.02 | 0.57 | 12 | 10 | 7.22 | 2 | 42 |
|
| 0.79 | 0.0042 | 0.794 | .52 | 0.05 | 0.52 | 0.90 |
|
| 0.61 | 0.0066 | 0.63 | .60 | 0.08 | 0.29 | 0.79 |
| No. monograph equivalents | 46.91 | 3.47 | 31.55 | 2.55 | 43.99 | 2.55 | 254.38 |
Multiple modes exist. The smallest value is shown. SE: standard error of the mean; SD: standard deviation; h –index: profit adjusted h-index; p-index: profit index; p-index: profit h-index.
Figure 1The distribution of the profit (p)-index.
Among the University Medical Centre researchers (n = 161), the p-index was approximately normally distributed with a mean of 0.79 and a standard deviation of 0.05 (see also ).
Figure 2The relative contribution of co-authors.
Among the University Medical Centre researchers (n = 161), there was a non-significant trend for the association between the p-index and the h-index (ρ = +0.15, p = 0.067), while the pindex and the h-index were only weakly associated (ρ = +0.17, p = 0.031), suggesting that the relative contribution of co-authors to the work of an author is relatively stable over his/her scientific career.
Scientists’ relative rankings change substantially when using the profit adjusted h-index.
| Ranking among 161 peers | Based on the | Based on the | ||
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Two scenarios are displayed here: In the second column the 161 University Medical Centre scientists are ranked according to their h-index, whereas in the third column they are ranked according to their profit adjusted h (h)-index (only the top 15 subjects are shown). Note the substantial changes in the rankings when the h-index is used instead of the h-index.
h-index = profit adjusted h-index.
Comparisons between University Medical Centre researchers (top 15 with highest h- index) and Spinoza and Nobel laureates in the biomedical field.
| University Medical Centre researchers (n = 15) | Spinoza laureates (n = 12) | Nobel laureates (n = 27) | |
| Total no. of citations | 22679 | 11528 | 21078 |
| No. co-authors | 7.1 | 6.3 | 4.5 |
|
| 71 | 55 | 68 (49–83) |
|
| 26 | 27.5 | 36 |
|
| 0.80 | 0.73 | 0.60 |
|
| 0.63 | 0.52 | 0.43 |
| Monograph equivalents | 134 | 73 | 99 |
Values are indicated as median (25th–75th percentiles). The Mann-Whitney U test was used to assess differences in medians:
p<0.05 for the comparison between University Medical Centre researchers and Spinoza laureates,
p<0.05 for the comparison between University Medical Centre researchers and Nobel laureates,
p<0.05 for the comparison between Spinoza and Nobel laureates. h –index: profit adjusted h-index; p-index: profit index; p –index: profit h –index.
Figure 3Comparison between University Medical Centre researchers (top 15 with highest h -index), Spinoza laureates and Nobel laureates in the biomedical field with respect to different citation metrics.
The horizontal lines within the boxes represent the median values, the edges of the boxes indicate the interquartile range, and the outer horizontal lines indicate the minimum and maximum values. Data are given for: A. h-index; B. profit adjusted h-index (h-index); C. profit index (p-index); D. profit h-index (pindex). * Denotes p-values smaller than 0.05. P-values were calculated using the Mann-Whitney U test and indicate differences in median values. Please refer to Table 3 for the statistical outcomes of the other comparisons.