Jonathan D Eldredge1, Philip J Kroth1, Cristina Murray-Krezan1, Chad M Hantak1, Edward F Weagel1, Gale G Hannigan1. 1. jeldredge@ unm.edu , Associate Professor, Biomedical Informatics Research, Training and Scholarship, Health Sciences Library and Informatics Center/Family and Community Medicine, University of New Mexico, MSC09 5100, Albuquerque, NM 87131-0001; pkroth@salud.unm.edu , Director, Biomedical Informatics, Research, Training and Scholarship, and Associate Professor and Section Chief for Clinical Informatics, Divisions of Translational Informatics and General Internal Medicine, Department of Internal Medicine, School of Medicine, University of New Mexico, MSC09 5100, Albuquerque, NM 87131-0001; cmurray-krezan@unm.edu , Research Assistant Professor, Department of Internal Medicine, Division of Epidemiology, Biostatistics, and Preventive Medicine, University of New Mexico, MSC10 0555, Albuquerque, NM 87131-0001; MHantak@unm.edu , Analyst/Programmer, Clinical and Translational Sciences Center, University of New Mexico, MSC 08 4635, Albuquerque, NM 87131-0001; EdWeagel@unm.edu , Biomedical Informatics Manager, Clinical and Translational Sciences Center, University of New Mexico, MSC 08 4635, Albuquerque, NM 87131-0001; ghannigan@salud.unm.edu , Research Professor, Health\Sciences Library and Informatics Center, University of New Mexico, MSC 09 5100, Albuquerque, NM 87131-0001.
Abstract
OBJECTIVE: The research tested the accuracy of the VIVO Harvester software in identifying publications authored by faculty members affiliated with a National Institutes of Health Clinical and Translational Sciences Award (CTSA) site. METHODS: Health sciences librarians created "gold standard" lists of references for the years 2001 to 2011 from PubMed for twenty-five randomly selected investigators from one CTSA site. These gold standard lists were compared to the same twenty-five investigators' reference lists produced by VIVO Harvester. The authors subjected the discrepancies between the lists to sensitivity and specificity analyses. RESULTS: The VIVO Harvester correctly identified only about 65% of the total eligible PubMed references for the years 2001-2011 for the CTSA-affiliated investigators. The identified references produced by VIVO Harvester were precise yet incomplete. The sensitivity rate was 0.65, and the specificity rate was 1.00. CONCLUSION: While the references produced by VIVO Harvester could be confirmed in PubMed, the VIVO Harvester retrieved only two-thirds of the required references from PubMed. National Institutes of Health CTSA sites will need to supplement VIVO Harvester-produced references with the expert searching skills of health sciences librarians. IMPLICATIONS: Health sciences librarians with searching skills need to alert their CTSA sites about these deficiencies and offer their skills to advance their sites' missions.
RCT Entities:
OBJECTIVE: The research tested the accuracy of the VIVO Harvester software in identifying publications authored by faculty members affiliated with a National Institutes of Health Clinical and Translational Sciences Award (CTSA) site. METHODS: Health sciences librarians created "gold standard" lists of references for the years 2001 to 2011 from PubMed for twenty-five randomly selected investigators from one CTSA site. These gold standard lists were compared to the same twenty-five investigators' reference lists produced by VIVO Harvester. The authors subjected the discrepancies between the lists to sensitivity and specificity analyses. RESULTS: The VIVO Harvester correctly identified only about 65% of the total eligible PubMed references for the years 2001-2011 for the CTSA-affiliated investigators. The identified references produced by VIVO Harvester were precise yet incomplete. The sensitivity rate was 0.65, and the specificity rate was 1.00. CONCLUSION: While the references produced by VIVO Harvester could be confirmed in PubMed, the VIVO Harvester retrieved only two-thirds of the required references from PubMed. National Institutes of Health CTSA sites will need to supplement VIVO Harvester-produced references with the expert searching skills of health sciences librarians. IMPLICATIONS: Health sciences librarians with searching skills need to alert their CTSA sites about these deficiencies and offer their skills to advance their sites' missions.