Isuru Ranasinghe1, Abbas Shojaee1, Behnood Bikdeli1, Aakriti Gupta1, Ruijun Chen1, Joseph S Ross1, Frederick A Masoudi1, John A Spertus1, Brahmajee K Nallamothu1, Harlan M Krumholz2. 1. From Center for Outcomes Research and Evaluation, Yale-New Haven Hospital, New Haven, CT (I.R., A.S., B.B., A.G., R.C., J.S.R., H.M.K.); Discipline of Medicine, University of Adelaide, South Australia (I.R.); Section of General Internal Medicine, Department of Internal Medicine, Yale University, New Haven, CT (J.S.R.); Robert Wood Johnson Clinical Scholars Program, Department of Internal Medicine, Yale University, New Haven, CT (J.S.R., H.M.K.); Health Policy and Management, School of Public Health, Yale University, New Haven, CT (J.S.R., H.M.K.); Division of Cardiology, Department of Medicine, University of Colorado Anschutz Medical Campus, Aurora (F.A.M.); University of Missouri-Kansas City, School of Medicine, Biomedical & Health Informatics (J.A.S.); Saint Luke's Mid America Heart Institute, University of Missouri-Kansas City (J.A.S.); Department of Internal Medicine and Center for Healthcare Outcomes and Policy, University of Michigan, Ann Arbor (B.K.N.); and Section of Cardiovascular Medicine, Department of Internal Medicine, Yale University, New Haven, CT (H.M.K.). 2. From Center for Outcomes Research and Evaluation, Yale-New Haven Hospital, New Haven, CT (I.R., A.S., B.B., A.G., R.C., J.S.R., H.M.K.); Discipline of Medicine, University of Adelaide, South Australia (I.R.); Section of General Internal Medicine, Department of Internal Medicine, Yale University, New Haven, CT (J.S.R.); Robert Wood Johnson Clinical Scholars Program, Department of Internal Medicine, Yale University, New Haven, CT (J.S.R., H.M.K.); Health Policy and Management, School of Public Health, Yale University, New Haven, CT (J.S.R., H.M.K.); Division of Cardiology, Department of Medicine, University of Colorado Anschutz Medical Campus, Aurora (F.A.M.); University of Missouri-Kansas City, School of Medicine, Biomedical & Health Informatics (J.A.S.); Saint Luke's Mid America Heart Institute, University of Missouri-Kansas City (J.A.S.); Department of Internal Medicine and Center for Healthcare Outcomes and Policy, University of Michigan, Ann Arbor (B.K.N.); and Section of Cardiovascular Medicine, Department of Internal Medicine, Yale University, New Haven, CT (H.M.K.). harlan.krumholz@yale.edu.
Abstract
BACKGROUND: The extent to which articles are cited is a surrogate of the impact and importance of the research conducted; poorly cited articles may identify research of limited use and potential wasted investments. We assessed trends in the rates of poorly cited articles and journals in the cardiovascular literature from 1997 to 2007. METHODS AND RESULTS: We identified original articles published in cardiovascular journals and indexed in the Scopus citation database from 1997 to 2007. We defined poorly cited articles as those with ≤5 citations in the 5 years following publication and poorly cited journals as those with >75% of journal content poorly cited. We identified 164 377 articles in 222 cardiovascular journals from 1997 to 2007. From 1997 to 2007, the number of cardiovascular articles and journals increased by 56.9% and 75.2%, respectively. Of all the articles, 75 550 (46.0%) were poorly cited, of which 25 650 (15.6% overall) had no citations. From 1997 to 2007, the proportion of poorly cited articles declined slightly (52.1%-46.2%, trend P<0.001), although the absolute number of poorly cited articles increased by 2595 (trend P<0.001). At a journal level, 44% of cardiovascular journals had more than three-fourths of the journal's content poorly cited at 5 years. CONCLUSION: Nearly half of all peer-reviewed articles published in cardiovascular journals are poorly cited 5 years after publication, and many are not cited at all. The cardiovascular literature and the number of poorly cited articles both increased substantially from 1997 to 2007. The high proportion of poorly cited articles and journals suggests inefficiencies in the cardiovascular research enterprise.
BACKGROUND: The extent to which articles are cited is a surrogate of the impact and importance of the research conducted; poorly cited articles may identify research of limited use and potential wasted investments. We assessed trends in the rates of poorly cited articles and journals in the cardiovascular literature from 1997 to 2007. METHODS AND RESULTS: We identified original articles published in cardiovascular journals and indexed in the Scopus citation database from 1997 to 2007. We defined poorly cited articles as those with ≤5 citations in the 5 years following publication and poorly cited journals as those with >75% of journal content poorly cited. We identified 164 377 articles in 222 cardiovascular journals from 1997 to 2007. From 1997 to 2007, the number of cardiovascular articles and journals increased by 56.9% and 75.2%, respectively. Of all the articles, 75 550 (46.0%) were poorly cited, of which 25 650 (15.6% overall) had no citations. From 1997 to 2007, the proportion of poorly cited articles declined slightly (52.1%-46.2%, trend P<0.001), although the absolute number of poorly cited articles increased by 2595 (trend P<0.001). At a journal level, 44% of cardiovascular journals had more than three-fourths of the journal's content poorly cited at 5 years. CONCLUSION: Nearly half of all peer-reviewed articles published in cardiovascular journals are poorly cited 5 years after publication, and many are not cited at all. The cardiovascular literature and the number of poorly cited articles both increased substantially from 1997 to 2007. The high proportion of poorly cited articles and journals suggests inefficiencies in the cardiovascular research enterprise.
Authors: Vanash M Patel; Hutan Ashrafian; Kamran Ahmed; Sonal Arora; Sejal Jiwan; Jeremy K Nicholson; Ara Darzi; Thanos Athanasiou Journal: J R Soc Med Date: 2011-06 Impact factor: 5.344
Authors: Iain Chalmers; Michael B Bracken; Ben Djulbegovic; Silvio Garattini; Jonathan Grant; A Metin Gülmezoglu; David W Howells; John P A Ioannidis; Sandy Oliver Journal: Lancet Date: 2014-01-08 Impact factor: 79.321
Authors: Joseph S Ross; Gregory K Mulvey; Elizabeth M Hines; Steven E Nissen; Harlan M Krumholz Journal: PLoS Med Date: 2009-09-08 Impact factor: 11.069
Authors: John T Wilson; Carter J Boyd; Jared Halstrom; Aseel Dib; Kimberly Martin; Michael D Johnson Journal: Indian J Orthop Date: 2020-07-10 Impact factor: 1.251
Authors: Zachary R Burns; Carter J Boyd; Zachary W Sollie; Hua A Fang; Kimberly D Martin; Robert J Dabal Journal: J Surg Res Date: 2020-10-06 Impact factor: 2.192
Authors: Carter J Boyd; Jason J Patel; Edgar Soto; Srikanth Kurapati; Kimberly D Martin; Timothy W King Journal: J Surg Res Date: 2020-04-10 Impact factor: 2.192
Authors: F Daniel Ramirez; Pouya Motazedian; Richard G Jung; Pietro Di Santo; Zachary D MacDonald; Robert Moreland; Trevor Simard; Aisling A Clancy; Juan J Russo; Vivian A Welch; George A Wells; Benjamin Hibbert Journal: Circ Res Date: 2017-04-03 Impact factor: 17.367
Authors: Milena Maria de Araújo Lima Barbosa; Angela Maria Belloni Cuenca; Karoline de Oliveira; Ivan França Junior; Maria do Carmo Avamilano Alvarez; Larissa Yuko Omae Journal: Rev Saude Publica Date: 2019-09-23 Impact factor: 2.106