OBJECTIVE: To compare the performance of MEDLINE searches using index test(s) and target condition (subject searches) with the same searches combined with methodological filters for test accuracy studies. STUDY DESIGN AND SETTING: We derived a reference set of 506 test accuracy studies indexed on MEDLINE from seven systematic reviews that conducted extensive searches. We compared the performance of "subject" with "filtered" searches (same searches combined with each of 22 filters). Outcome measures were number of reference set records missed, sensitivity, number needed to read (NNR), and precision (Number of reference set studies identified for every 100 records screened). RESULTS: Subject searches missed 47 of the 506 reference studies; filtered searches missed an additional 21 to 241 studies. Sensitivity was 91% for subject searches and ranged from 43% to 87% for filtered searches. The NNR was 56 (precision 2%) for subject searches and ranged from 7 to 51 (precision 2-15%) for filtered searches. CONCLUSIONS: Filtered searches miss additional studies compared with searches based on index test and target condition. None of the existing filters provided reductions in the NNR for acceptable sensitivity; currently available methodological filters should not be used to identify studies for inclusion in test accuracy reviews.
OBJECTIVE: To compare the performance of MEDLINE searches using index test(s) and target condition (subject searches) with the same searches combined with methodological filters for test accuracy studies. STUDY DESIGN AND SETTING: We derived a reference set of 506 test accuracy studies indexed on MEDLINE from seven systematic reviews that conducted extensive searches. We compared the performance of "subject" with "filtered" searches (same searches combined with each of 22 filters). Outcome measures were number of reference set records missed, sensitivity, number needed to read (NNR), and precision (Number of reference set studies identified for every 100 records screened). RESULTS: Subject searches missed 47 of the 506 reference studies; filtered searches missed an additional 21 to 241 studies. Sensitivity was 91% for subject searches and ranged from 43% to 87% for filtered searches. The NNR was 56 (precision 2%) for subject searches and ranged from 7 to 51 (precision 2-15%) for filtered searches. CONCLUSIONS: Filtered searches miss additional studies compared with searches based on index test and target condition. None of the existing filters provided reductions in the NNR for acceptable sensitivity; currently available methodological filters should not be used to identify studies for inclusion in test accuracy reviews.
Authors: Ingrid Arevalo-Rodriguez; Nadja Smailagic; Marta Roqué I Figuls; Agustín Ciapponi; Erick Sanchez-Perez; Antri Giannakou; Olga L Pedraza; Xavier Bonfill Cosp; Sarah Cullum Journal: Cochrane Database Syst Rev Date: 2015-03-05
Authors: Daniel Molano Franco; Ingrid Arevalo-Rodriguez; Marta Roqué I Figuls; Nadia G Montero Oleas; Xavier Nuvials; Javier Zamora Journal: Cochrane Database Syst Rev Date: 2019-04-30
Authors: Hilary A Archer; Nadja Smailagic; Christeena John; Robin B Holmes; Yemisi Takwoingi; Elizabeth J Coulthard; Sarah Cullum Journal: Cochrane Database Syst Rev Date: 2015-06-23
Authors: Daniel H J Davis; Sam T Creavin; Jennifer L Y Yip; Anna H Noel-Storr; Carol Brayne; Sarah Cullum Journal: Cochrane Database Syst Rev Date: 2015-10-29
Authors: Lee Hooper; Asmaa Abdelhamid; Natalie J Attreed; Wayne W Campbell; Adam M Channell; Philippe Chassagne; Kennith R Culp; Stephen J Fletcher; Matthew B Fortes; Nigel Fuller; Phyllis M Gaspar; Daniel J Gilbert; Adam C Heathcote; Mohannad W Kafri; Fumiko Kajii; Gregor Lindner; Gary W Mack; Janet C Mentes; Paolo Merlani; Rowan A Needham; Marcel G M Olde Rikkert; Andreas Perren; James Powers; Sheila C Ranson; Patrick Ritz; Anne M Rowat; Fredrik Sjöstrand; Alexandra C Smith; Jodi J D Stookey; Nancy A Stotts; David R Thomas; Angela Vivanti; Bonnie J Wakefield; Nana Waldréus; Neil P Walsh; Sean Ward; John F Potter; Paul Hunter Journal: Cochrane Database Syst Rev Date: 2015-04-30
Authors: Sam T Creavin; Susanna Wisniewski; Anna H Noel-Storr; Clare M Trevelyan; Thomas Hampton; Dane Rayment; Victoria M Thom; Kirsty J E Nash; Hosam Elhamoui; Rowena Milligan; Anish S Patel; Demitra V Tsivos; Tracey Wing; Emma Phillips; Sophie M Kellman; Hannah L Shackleton; Georgina F Singleton; Bethany E Neale; Martha E Watton; Sarah Cullum Journal: Cochrane Database Syst Rev Date: 2016-01-13
Authors: Rebecca Beynon; Mariska M G Leeflang; Steve McDonald; Anne Eisinga; Ruth L Mitchell; Penny Whiting; Julie M Glanville Journal: Cochrane Database Syst Rev Date: 2013-09-11
Authors: Daniel Hj Davis; Sam T Creavin; Anna Noel-Storr; Terry J Quinn; Nadja Smailagic; Chris Hyde; Carol Brayne; Rupert McShane; Sarah Cullum Journal: Cochrane Database Syst Rev Date: 2013-03-28