Angela May Eady1, Nancy L Wilczynski, R Brian Haynes. 1. Health Information Research Unit, Department of Clinical Epidemiology and Biostatistics, McMaster University, 1200 Main Street West, Hamilton, Ontario, Canada.
Abstract
OBJECTIVE: This study evaluated search strategies for finding high-quality studies on treatment and systematic reviews in PsycINFO. STUDY DESIGN AND SETTING: Sixty-four journals were hand searched at McMaster University. Methodologic criteria were applied to clinically relevant articles to identify "pass" and "fail" articles; 4,985 candidate terms were compiled, 7,463 combinations for therapy articles, and 5,246 combinations for reviews. Candidate search strategy results were compared with hand searches. The proposed strategies served as "diagnostic tests" for sound studies; the hand searches were the "gold standard." Sensitivity, specificity, precision, and accuracy were calculated. RESULTS: Of 716 treatment articles, 233 (32.5%) met criteria for scientific merit, and 58 (11.5%) of 506 review articles met criteria for systematic reviews. For treatment studies, combined terms had a peak sensitivity of 97.9% (specificity 52.2%). Maximum specificity was 97.7% (sensitivity 51.5%). Sensitivity and specificity were each 79% when optimizing both while minimizing their difference. For review articles, combined terms had a peak sensitivity of 81.0% (specificity 54.4%). Maximum specificity was 98.1% (sensitivity 51.7%). Sensitivity and specificity were each 65% when optimizing both while minimizing their difference. CONCLUSIONS: Empirically derived search strategies can achieve high sensitivity and specificity for retrieving sound treatment studies and review articles from PsycINFO.
OBJECTIVE: This study evaluated search strategies for finding high-quality studies on treatment and systematic reviews in PsycINFO. STUDY DESIGN AND SETTING: Sixty-four journals were hand searched at McMaster University. Methodologic criteria were applied to clinically relevant articles to identify "pass" and "fail" articles; 4,985 candidate terms were compiled, 7,463 combinations for therapy articles, and 5,246 combinations for reviews. Candidate search strategy results were compared with hand searches. The proposed strategies served as "diagnostic tests" for sound studies; the hand searches were the "gold standard." Sensitivity, specificity, precision, and accuracy were calculated. RESULTS: Of 716 treatment articles, 233 (32.5%) met criteria for scientific merit, and 58 (11.5%) of 506 review articles met criteria for systematic reviews. For treatment studies, combined terms had a peak sensitivity of 97.9% (specificity 52.2%). Maximum specificity was 97.7% (sensitivity 51.5%). Sensitivity and specificity were each 79% when optimizing both while minimizing their difference. For review articles, combined terms had a peak sensitivity of 81.0% (specificity 54.4%). Maximum specificity was 98.1% (sensitivity 51.7%). Sensitivity and specificity were each 65% when optimizing both while minimizing their difference. CONCLUSIONS: Empirically derived search strategies can achieve high sensitivity and specificity for retrieving sound treatment studies and review articles from PsycINFO.
Authors: Thomas V Merluzzi; James E Pustejovsky; Errol J Philip; Stephanie J Sohl; Mark Berendsen; John M Salsman Journal: Psychooncology Date: 2019-07-09 Impact factor: 3.894
Authors: Brian A Primack; Mary V Carroll; Megan McNamara; Mary Lou Klem; Brandy King; Michael Rich; Chun W Chan; Smita Nayak Journal: Am J Prev Med Date: 2012-06 Impact factor: 5.043
Authors: Emma Loveman; Lena Al-Khudairy; Rebecca E Johnson; Wendy Robertson; Jill L Colquitt; Emma L Mead; Louisa J Ells; Maria-Inti Metzendorf; Karen Rees Journal: Cochrane Database Syst Rev Date: 2015-12-21
Authors: Emma Mead; Tamara Brown; Karen Rees; Liane B Azevedo; Victoria Whittaker; Dan Jones; Joan Olajide; Giulia M Mainardi; Eva Corpeleijn; Claire O'Malley; Elizabeth Beardsmore; Lena Al-Khudairy; Louise Baur; Maria-Inti Metzendorf; Alessandro Demaio; Louisa J Ells Journal: Cochrane Database Syst Rev Date: 2017-06-22
Authors: Lena Al-Khudairy; Emma Loveman; Jill L Colquitt; Emma Mead; Rebecca E Johnson; Hannah Fraser; Joan Olajide; Marie Murphy; Rochelle Marian Velho; Claire O'Malley; Liane B Azevedo; Louisa J Ells; Maria-Inti Metzendorf; Karen Rees Journal: Cochrane Database Syst Rev Date: 2017-06-22