A H Noel-Storr1, G Dooley2, S Wisniewski3, J Glanville4, J Thomas5, S Cox6, R Featherstone7, R Foxlee7. 1. Radcliffe Department of Medicine, Cochrane Dementia and Cognitive Improvement Group, Oxford University, Oxford, UK. Electronic address: anna.noel-storr@rdm.ox.ac.uk. 2. Metaxis Ltd, Oxford, UK. 3. Radcliffe Department of Medicine, Cochrane Dementia and Cognitive Improvement Group, Oxford University, Oxford, UK; Cochrane Editorial and Methods Department, Cochrane, London, UK. 4. York Health Economics Consortium, University of York, Oxford, UK. 5. EPPI-Centre, University College London, Oxford, UK. 6. Cochrane ENT, NDS, Oxford University, Oxford, UK. 7. Cochrane Editorial and Methods Department, Cochrane, London, UK.
Abstract
BACKGROUND AND OBJECTIVES: The Cochrane Central Register of Controlled Trials (CENTRAL) is compiled from a number of sources, including PubMed and Embase. Since 2017, we have increased the number of sources feeding into CENTRAL and improved the efficiency of our processes through the use of application programming interfaces, machine learning, and crowdsourcing.Our objectives were twofold: (1) Assess the effectiveness of Cochrane's centralized search and screening processes to correctly identify references to published reports which are eligible for inclusion in Cochrane systematic reviews of randomized controlled trials (RCTs). (2) Identify opportunities to improve the performance of Cochrane's centralized search and screening processes to identify references to eligible trials. METHODS: We identified all references to RCTs (either published journal articles or trial registration records) with a publication or registration date between 1st January 2017 and 31st December 2018 that had been included in a Cochrane intervention review. We then viewed an audit trail for each included reference to determine if it had been identified by our centralized search process and subsequently added to CENTRAL. RESULTS: We identified 650 references to included studies with a publication year of 2017 or 2018. Of those, 634 (97.5%) had been captured by Cochrane's Centralised Search Service. Sixteen references had been missed by the Cochrane's Centralised Search Service: six had PubMed-not-MEDLINE status, four were missed by the centralized Embase search, three had been misclassified by Cochrane Crowd, one was from a journal not indexed in MEDLINE or Embase, one had only been added to Embase in 2019, and one reference had been rejected by the automated RCT machine learning classifier. Of the sixteen missed references, eight were the main or only publication to the trial in the review in which it had been included. CONCLUSION: This analysis has shown that Cochrane's centralized search and screening processes are highly sensitive. It has also helped us to understand better why some references to eligible RCTs have been missed. The CSS is playing a critical role in helping to populate CENTRAL and is moving us toward making CENTRAL a comprehensive repository of RCTs.
BACKGROUND AND OBJECTIVES: The Cochrane Central Register of Controlled Trials (CENTRAL) is compiled from a number of sources, including PubMed and Embase. Since 2017, we have increased the number of sources feeding into CENTRAL and improved the efficiency of our processes through the use of application programming interfaces, machine learning, and crowdsourcing.Our objectives were twofold: (1) Assess the effectiveness of Cochrane's centralized search and screening processes to correctly identify references to published reports which are eligible for inclusion in Cochrane systematic reviews of randomized controlled trials (RCTs). (2) Identify opportunities to improve the performance of Cochrane's centralized search and screening processes to identify references to eligible trials. METHODS: We identified all references to RCTs (either published journal articles or trial registration records) with a publication or registration date between 1st January 2017 and 31st December 2018 that had been included in a Cochrane intervention review. We then viewed an audit trail for each included reference to determine if it had been identified by our centralized search process and subsequently added to CENTRAL. RESULTS: We identified 650 references to included studies with a publication year of 2017 or 2018. Of those, 634 (97.5%) had been captured by Cochrane's Centralised Search Service. Sixteen references had been missed by the Cochrane's Centralised Search Service: six had PubMed-not-MEDLINE status, four were missed by the centralized Embase search, three had been misclassified by Cochrane Crowd, one was from a journal not indexed in MEDLINE or Embase, one had only been added to Embase in 2019, and one reference had been rejected by the automated RCT machine learning classifier. Of the sixteen missed references, eight were the main or only publication to the trial in the review in which it had been included. CONCLUSION: This analysis has shown that Cochrane's centralized search and screening processes are highly sensitive. It has also helped us to understand better why some references to eligible RCTs have been missed. The CSS is playing a critical role in helping to populate CENTRAL and is moving us toward making CENTRAL a comprehensive repository of RCTs.
Authors: Monika Geretsegger; Laura Fusar-Poli; Cochavit Elefant; Karin A Mössler; Giovanni Vitale; Christian Gold Journal: Cochrane Database Syst Rev Date: 2022-05-09
Authors: Elizabeth Allen; Alice R Rumbold; Amy Keir; Carmel T Collins; Jennifer Gillis; Hiroki Suganuma Journal: Cochrane Database Syst Rev Date: 2021-10-21
Authors: Anna H Noel-Storr; Patrick Redmond; Guillaume Lamé; Elisa Liberati; Sarah Kelly; Lucy Miller; Gordon Dooley; Andy Paterson; Jenni Burt Journal: BMC Med Res Methodol Date: 2021-04-26 Impact factor: 4.615
Authors: Katie O'Hearn; Cameron MacDonald; Anne Tsampalieros; Leo Kadota; Ryan Sandarage; Supun Kotteduwa Jayawarden; Michele Datko; John M Reynolds; Thanh Bui; Shagufta Sultan; Margaret Sampson; Misty Pratt; Nick Barrowman; Nassr Nama; Matthew Page; James Dayre McNally Journal: BMC Med Res Methodol Date: 2021-07-08 Impact factor: 4.615