Paul Levay1, Nicola Ainsworth2, Rachel Kettle2, Antony Morgan2. 1. National Institute for Health and Care Excellence, Guidance Information Services, Manchester, UK. 2. National Institute for Health and Care Excellence, Centre for Public Health, Manchester, UK.
Abstract
AIM: To examine how effectively forwards citation searching with Web of Science (WOS) or Google Scholar (GS) identified evidence to support public health guidance published by the National Institute for Health and Care Excellence. METHOD: Forwards citation searching was performed using GS on a base set of 46 publications and replicated using WOS. OUTCOMES: WOS and GS were compared in terms of recall; precision; number needed to read (NNR); administrative time and costs; and screening time and costs. Outcomes for all publications were compared with those for a subset of highly important publications. RESULTS: The searches identified 43 relevant publications. The WOS process had 86.05% recall and 1.58% precision. The GS process had 90.7% recall and 1.62% precision. The NNR to identify one relevant publication was 63.3 with WOS and 61.72 with GS. There were nine highly important publications. WOS had 100% recall, 0.38% precision and NNR of 260.22. GS had 88.89% recall, 0.33% precision and NNR of 300.88. Administering the WOS results took 4 h and cost £88-£136, compared with 75 h and £1650-£2550 with GS. CONCLUSION: WOS is recommended over GS, as citation searching was more effective, while the administrative and screening times and costs were lower.
AIM: To examine how effectively forwards citation searching with Web of Science (WOS) or Google Scholar (GS) identified evidence to support public health guidance published by the National Institute for Health and Care Excellence. METHOD: Forwards citation searching was performed using GS on a base set of 46 publications and replicated using WOS. OUTCOMES: WOS and GS were compared in terms of recall; precision; number needed to read (NNR); administrative time and costs; and screening time and costs. Outcomes for all publications were compared with those for a subset of highly important publications. RESULTS: The searches identified 43 relevant publications. The WOS process had 86.05% recall and 1.58% precision. The GS process had 90.7% recall and 1.62% precision. The NNR to identify one relevant publication was 63.3 with WOS and 61.72 with GS. There were nine highly important publications. WOS had 100% recall, 0.38% precision and NNR of 260.22. GS had 88.89% recall, 0.33% precision and NNR of 300.88. Administering the WOS results took 4 h and cost £88-£136, compared with 75 h and £1650-£2550 with GS. CONCLUSION: WOS is recommended over GS, as citation searching was more effective, while the administrative and screening times and costs were lower.
Authors: Käthe Goossen; Solveig Tenckhoff; Pascal Probst; Kathrin Grummich; André L Mihaljevic; Markus W Büchler; Markus K Diener Journal: Langenbecks Arch Surg Date: 2017-12-05 Impact factor: 3.445
Authors: Chris Cooper; Andrew Booth; Jo Varley-Campbell; Nicky Britten; Ruth Garside Journal: BMC Med Res Methodol Date: 2018-08-14 Impact factor: 4.615