Literature DB >> 23723423

We have met the enemy, and it is us.

Mark Johnston.   

Abstract

Entities:  

Mesh:

Year:  2013        PMID: 23723423      PMCID: PMC3730911          DOI: 10.1534/genetics.113.153486

Source DB:  PubMed          Journal:  Genetics        ISSN: 0016-6731            Impact factor:   4.562


× No keyword cloud information.
MANY of us have long railed against the journal impact factor. We continue to rail with the publication of the San Francisco Declaration on Research Assessment, signed by me and others, and endorsed by the Genetics Society of America (and other august groups). We rail for good reason, because a metric that was primarily intended for use by librarians to evaluate the value of journals for their patrons has become a measure of individual scientists’ productivity, something for which it is wholly unsuited. A journal’s impact factor says nothing about any individual article published in that journal. This is most starkly illustrated by instances where only one highly cited article is responsible for most of a journal’s impact factor. How does the impact of that single article reflect on any other article published in the journal? Clearly, it does not. Yet some scientists list in their CVs (and will tell you in conversation) the impact factor of each journal in which their articles were published. Surely they recognize the fallacy of that. Why do they do it? Because they also recognize that hiring and promotion and grant evaluation committees put weight on the journal impact factor (claims to the contrary of people serving on those committees ring hollow). If you are an academic scientist, you undoubtedly have sat on such committees and heard your colleagues praise a candidate because of the several articles he or she has published in Cell (2011 impact factor = 32.403), Science (2011 impact factor = 31.201), or Nature (2011 impact factor = 36.280). We—the senior scientists who populate those committees that are so important to scientists’ careers (and to science!)—are responsible! If we didn't value so much the high impact factor journals, our (mostly junior) colleagues would not pay so much attention to the impact factor. The enemy is us! Why do the high impact factor journals command so much influence? It's simply because they are the most selective. If an article gets published in one of those journals, we think it must be important and significant. After all, it was one of very few chosen for publication. The articles were stringently vetted and came out on top of a very big heap. And everybody wins because the members of the hiring and promotion and grant evaluation committees don't necessarily have to invest the considerable time it would take to read (and understand) the candidate’s work. What’s the problem? The problem is: who did the vetting? Yes, the articles underwent peer review, so it's likely that knowledgeable, well-regarded, practicing scientists who are experts in the field judged the work. But who decided that the article was worthy of being peer-reviewed in the first place (a benefit enjoyed by only a few of the manuscripts submitted to the high impact factor journals)? Who ensured that the peer reviewers are knowledgeable, well-regarded scientists with relevant expertise? And who synthesized the comments of the peer reviewers into a decision on the significance, impact, and value of the work that resulted in its selection for publication in a high impact factor journal? In many cases, it was someone with little experience as a practicing scientist (and often with no experience as an independent investigator). Is that a problem? I believe it is. Science is best governed by scientists, as it largely was in the biomedical sciences before the rise of the high impact factor journals. I believe decisions as important as who gets hired, promoted, and funded should be influenced by editors who have trekked the same trail as the authors, who know from hard-won experience what it takes to tell a significant story. Of course, experience does not ensure wisdom, but recent, relevant experience breeds sound judgment. It seems obvious that the endorsement of peers should carry more weight than the assent of administrators, but the hegemony of the high impact factor journals results in the opposite. Why do we endow inexperienced scientists with so much influence over such important decisions? What’s needed to correct this situation is nothing less than a change in our culture. Those of us sitting on hiring and promotion and grant review committees must evaluate our colleagues’ work for its content rather than its cloak. We must judge it ourselves and not cede our responsibility to others by automatically being impressed by the selectivity an article has realized. We—practicing scientists—must reclaim responsibility for setting the standards of our field. And the junior scientists? Until the culture changes, they have little choice but to strive to get their work published in the high impact factor journals. Eventually those scientists will start to populate the hiring and promotion and grant review committees. I am hopeful they'll know what to do. Only when we change the culture will the pernicious grip of the high impact factor journals (and the impact factor) be broken. But it won't happen unless each of us takes responsibility for setting the standards of our field—when we're serving on grant review panels, when we're sitting on hiring and promotion committees, in conversations with our colleagues in the hallway, and when we're in our labs considering journals for our next submission. Only when we effect a change in our culture can we stop railing against the impact factor.
  5 in total

1.  Impacted science: impact is not importance.

Authors:  Arturo Casadevall; Ferric C Fang
Journal:  mBio       Date:  2015-10-13       Impact factor: 7.867

2.  An enduring enthusiasm for academic science, but with concerns.

Authors:  John R Pringle
Journal:  Mol Biol Cell       Date:  2013-11       Impact factor: 4.138

3.  Relative Citation Ratio (RCR): A New Metric That Uses Citation Rates to Measure Influence at the Article Level.

Authors:  B Ian Hutchins; Xin Yuan; James M Anderson; George M Santangelo
Journal:  PLoS Biol       Date:  2016-09-06       Impact factor: 8.029

4.  Five years post-DORA: promoting best practices for research assessment.

Authors:  Sandra L Schmid
Journal:  Mol Biol Cell       Date:  2017-11-01       Impact factor: 4.138

5.  Article-level assessment of influence and translation in biomedical research.

Authors:  George M Santangelo
Journal:  Mol Biol Cell       Date:  2017-06-01       Impact factor: 4.138

  5 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.