OBJECTIVE: Apply and compare two methods that identify signals for the need to update systematic reviews, using three Evidence-based Practice Center reports on omega-3 fatty acids as test cases. STUDY DESIGN AND SETTING: We applied the RAND method, which uses domain (subject matter) expert guidance, and a modified Ottawa method, which uses quantitative and qualitative signals. For both methods, we conducted focused electronic literature searches of recent studies using the key terms from the original reports. We assessed the agreement between the methods and qualitatively assessed the merits of each system. RESULTS: Agreement between the two methods was "substantial" or better (kappa>0.62) in three of the four systematic reviews. Overall agreement between the methods was "substantial" (kappa=0.64, 95% confidence interval [CI] 0.45-0.83). CONCLUSION: The RAND and modified Ottawa methods appear to provide similar signals for the possible need to update systematic reviews in this pilot study. Future evaluation with a broader range of clinical topics and eventual comparisons between signals to update reports and the results of full evidence review updates will be needed. We propose a hybrid approach combining the best features of both methods, which should allow efficient review and assessment of the need to update.
OBJECTIVE: Apply and compare two methods that identify signals for the need to update systematic reviews, using three Evidence-based Practice Center reports on omega-3 fatty acids as test cases. STUDY DESIGN AND SETTING: We applied the RAND method, which uses domain (subject matter) expert guidance, and a modified Ottawa method, which uses quantitative and qualitative signals. For both methods, we conducted focused electronic literature searches of recent studies using the key terms from the original reports. We assessed the agreement between the methods and qualitatively assessed the merits of each system. RESULTS: Agreement between the two methods was "substantial" or better (kappa>0.62) in three of the four systematic reviews. Overall agreement between the methods was "substantial" (kappa=0.64, 95% confidence interval [CI] 0.45-0.83). CONCLUSION: The RAND and modified Ottawa methods appear to provide similar signals for the possible need to update systematic reviews in this pilot study. Future evaluation with a broader range of clinical topics and eventual comparisons between signals to update reports and the results of full evidence review updates will be needed. We propose a hybrid approach combining the best features of both methods, which should allow efficient review and assessment of the need to update.
Authors: Ethan M Balk; Tanya A Horsley; Sydne J Newberry; Alice H Lichtenstein; Elizabeth A Yetley; Howard M Schachter; David Moher; Catherine H MacLean; Joseph Lau Journal: Am J Clin Nutr Date: 2007-06 Impact factor: 7.045
Authors: Ethan M Balk; Alice H Lichtenstein; Mei Chung; Bruce Kupelnick; Priscilla Chew; Joseph Lau Journal: Atherosclerosis Date: 2005-08-09 Impact factor: 5.162
Authors: Ethan M Balk; Alice H Lichtenstein; Mei Chung; Bruce Kupelnick; Priscilla Chew; Joseph Lau Journal: Atherosclerosis Date: 2006-03-10 Impact factor: 5.162
Authors: Chantelle Garritty; Alexander Tsertsvadze; Andrea C Tricco; Margaret Sampson; David Moher Journal: PLoS One Date: 2010-04-01 Impact factor: 3.240
Authors: Katelynn Crick; Denise Thomson; Ricardo M Fernandes; Megan Nuspl; Dean T Eurich; Brian H Rowe; Lisa Hartling Journal: BMC Pediatr Date: 2017-07-11 Impact factor: 2.125
Authors: Nadera Ahmadzai; Sydne J Newberry; Margaret A Maglione; Alexander Tsertsvadze; Mohammed T Ansari; Susanne Hempel; Aneesa Motala; Sophia Tsouros; Jennifer J Schneider Chafen; Roberta Shanman; David Moher; Paul G Shekelle Journal: Syst Rev Date: 2013-11-14
Authors: Paul Garner; Sally Hopewell; Jackie Chandler; Harriet MacLehose; Holger J Schünemann; Elie A Akl; Joseph Beyene; Stephanie Chang; Rachel Churchill; Karin Dearness; Gordon Guyatt; Carol Lefebvre; Beth Liles; Rachel Marshall; Laura Martínez García; Chris Mavergames; Mona Nasser; Amir Qaseem; Margaret Sampson; Karla Soares-Weiser; Yemisi Takwoingi; Lehana Thabane; Marialena Trivella; Peter Tugwell; Emma Welsh; Ed C Wilson; Holger J Schünemann Journal: BMJ Date: 2016-07-20