Sam Adie1, David Ma, Ian A Harris, Justine M Naylor, Jonathan C Craig. 1. *South Western Sydney Clinical School, University of New South Wales †Whitlam Orthopaedic Research Centre, Ingham Institute for Applied Medical Research, Liverpool, New South Wales ‡School of Public Health, University of Sydney, Sydney, New South Wales §Centre for Kidney Research, The Children's Hospital at Westmead, Sydney, Australia.
Abstract
BACKGROUND: Meta-analyses are useful tools for summarizing surgical evidence as they aim to encompass multiple sources of information on a particular research question, but they may be prone to methodological and reporting biases. We evaluated the conduct and reporting of meta-analyses of surgical interventions. METHODS AND FINDINGS: We performed a systematic review of 150 meta-analyses of randomized trials of surgical interventions published between January 2010 and June 2011. A comprehensive search strategy was executed using MEDLINE, EMBASE, and the Cochrane Database of Systematic Reviews. Data were independently extracted by 2 authors using the PRISMA statement (preferred reporting items for systematic reviews and meta-analyses, a standardized quality of reporting guideline) and AMSTAR (a tool for methodological quality). Descriptive statistics were used for individual items, and as a measure of overall compliance, PRISMA and AMSTAR scores were calculated as the sum of adequately reported domains. A median of 8 trials (interquartile range = 8) was included in each meta-analysis. One third of all meta-analyses had an author with a background in epidemiology and/or statistics. Forty-four percent were published in PRISMA-endorsing journals with a median impact factor of 3.5. There was moderate compliance with PRISMA, with an average of 71% of items reported, but poorer compliance with AMSTAR, with 48% of items adequately described, on average. CONCLUSIONS: Substantial gaps in the conduct and reporting of meta-analyses within the surgical literature exist, mainly in the specification of aims and/or objectives, the use of preplanned protocols, and the evaluation of potential bias at the review (rather than trial) level. Editorial insistence on using reporting guidelines would improve this situation.
BACKGROUND: Meta-analyses are useful tools for summarizing surgical evidence as they aim to encompass multiple sources of information on a particular research question, but they may be prone to methodological and reporting biases. We evaluated the conduct and reporting of meta-analyses of surgical interventions. METHODS AND FINDINGS: We performed a systematic review of 150 meta-analyses of randomized trials of surgical interventions published between January 2010 and June 2011. A comprehensive search strategy was executed using MEDLINE, EMBASE, and the Cochrane Database of Systematic Reviews. Data were independently extracted by 2 authors using the PRISMA statement (preferred reporting items for systematic reviews and meta-analyses, a standardized quality of reporting guideline) and AMSTAR (a tool for methodological quality). Descriptive statistics were used for individual items, and as a measure of overall compliance, PRISMA and AMSTAR scores were calculated as the sum of adequately reported domains. A median of 8 trials (interquartile range = 8) was included in each meta-analysis. One third of all meta-analyses had an author with a background in epidemiology and/or statistics. Forty-four percent were published in PRISMA-endorsing journals with a median impact factor of 3.5. There was moderate compliance with PRISMA, with an average of 71% of items reported, but poorer compliance with AMSTAR, with 48% of items adequately described, on average. CONCLUSIONS: Substantial gaps in the conduct and reporting of meta-analyses within the surgical literature exist, mainly in the specification of aims and/or objectives, the use of preplanned protocols, and the evaluation of potential bias at the review (rather than trial) level. Editorial insistence on using reporting guidelines would improve this situation.
Authors: Crystian B Oliveira; Mark R Elkins; Ítalo Ribeiro Lemes; Danilo de Oliveira Silva; Ronaldo V Briani; Henrique Luiz Monteiro; Fábio Mícolis de Azevedo; Rafael Zambelli Pinto Journal: Braz J Phys Ther Date: 2017-10-26 Impact factor: 3.377