| Literature DB >> 20416114 |
Laura J Rosen1, Michal Ben Noach, Elliot Rosenberg.
Abstract
BACKGROUND: The systematic review (SR) lies at the core of evidence-based medicine. While it may appear that the SR provides a reliable summary of existing evidence, standards of SR conduct differ. The objective of this research was to examine systematic review (SR) methods used by the Cochrane Collaboration ("Cochrane") and the Task Force on Community Preventive Services ("the Guide") for evaluation of effectiveness of tobacco control interventions.Entities:
Mesh:
Year: 2010 PMID: 20416114 PMCID: PMC2873512 DOI: 10.1186/1471-2288-10-34
Source DB: PubMed Journal: BMC Med Res Methodol ISSN: 1471-2288 Impact factor: 4.615
Distribution of reviews by reviewer, setting, and level of study design
| Level* | Setting** | ||||
|---|---|---|---|---|---|
| Clinical | Clinical System | Community | Mixed | Total | |
| Level 1 | 16 (84) | 1 (50) | 3 (23) | 6 (50) | 26 |
| Level 2 | 3 (16) | 0 (0) | 0 (0) | 4 (33) | 7 |
| Level 3 | 0 (0) | 0 (0) | 5 (38) | 2 (16) | 7 |
| Level 4 | 0 (0) | 1 (50) | 5 (38) | 0 (0) | 6 |
| All levels | 19 (100) | 2 (100) | 13 (100) | 12 (100) | 46 |
| Level 1 | 0 (0) | 0 (0) | 4 (33) | 0 (0) | 4 |
| Level 2 | 0 (0) | 0 (0) | 0 (0) | 0 (0) | 0 |
| Level 3 | 0 (0) | 0 (0) | 0 (0) | 1 (100) | 1 |
| Level 4 | 0 (0) | 5 (100) | 8 (67) | 0 (0) | 13 |
| All levels | 0 (0) | 5 (100) | 12 (100) | 1 (100) | 18 |
* Level: Level 1 (only RCTs included in review), Level 2 (At least one quasi-randomized study included in review), Level 3 (At least one controlled trial included in review), Level 4 (At least one non-controlled trial, such as interrupted time series, included in review).
**Setting: Clinical (interventions aimed at individuals in a clinical setting), Clinical system (interventions involving the healthcare system, such as subsidies for cessation medications or provider training), Community (interventions aimed at individuals in the community), or Mixed (included trials involving interventions in two or more of the above).
Distribution of reviews by reviewer, setting, and method of data synthesis
| Synthesis Method* | Setting** | ||||
|---|---|---|---|---|---|
| Clinical | Clinical System | Community | Mixed | All | |
| Meta-analysis | 17 (89) | 1 (50) | 3 (23) | 9 (75) | 30 |
| Median | 0 (0) | 0 (0) | 0 (0) | 0 (0) | 0 |
| Narrative | 2 (11) | 1 (50) | 10 (77) | 3 (25) | 16 |
| All levels | 19 (100) | 2 (100) | 13 (100) | 12 (100) | 46 |
| Meta-analysis | 0.0 (0) | 0 (0) | 0 (0) | 0 (0) | 0 |
| Median | 0.0 (0) | 5 (100) | 10 (83.3) | 1 (100) | 16 |
| Narrative | 0.0 (0) | 0 (0) | 2 (16.7) | 0 (0) | 2 |
| All levels | 0.0 (0) | 5 (100) | 12 (100) | 1 (100) | 18 |
* Synthesis Method: Meta-analysis (indicating a pooled statistic), calculation of the median (median of effect sizes taken without any accompanying p-value), or narrative.
** Setting: Clinical (interventions aimed at individuals in a clinical setting), Clinical system (interventions involving the healthcare system, such as subsidies for cessation medications or provider training), Community, or Mixed (included trials involving interventions in two or more of the above).
Distribution of reviews by reviewer, setting, and methodological criteria
| Combined methodological criteria* | Setting** | ||||
|---|---|---|---|---|---|
| Clinical | Clinical System | Community | Mixed | All | |
| RCTs with pooling | 14 (74) | 0 (0) | 2 (15) | 4 (33) | 20 |
| RCTs/CTs with pooling | 3 (16) | 0 (0) | 1 (8) | 5 (42) | 9 |
| Other | 2 (11) | 2 (100) | 10 (77) | 3 (25) | 17 |
| All levels | 19 (100) | 2 (100) | 13 (100) | 12 (100) | 46 |
| RCTs with pooling | 0 (0) | 0 (0) | 3 (25) | 0 (0) | 3 |
| RCTs/CTs with pooling | 0 (0) | 0 (0) | 0 (0) | 1 (100) | 1 |
| Other | 0 (0) | 5 (100) | 9 (75) | 0 (0) | 14 |
| All levels | 0 (0) | 5 (100) | 12 (100) | 1 (100) | 18 |
* Combined methodological criteria: RCTs with pooling (Randomized controlled trials only, with quantitatively pooled results), RCTS/CTs with pooling (Randomized controlled trials or Controlled Trials only, with quantitatively pooled results), Other (any study design, any type of synthesis)
** Setting: Clinical (interventions aimed at individuals in a clinical setting), Clinical system (interventions involving the healthcare system, such as subsidies for cessation medications or provider training), Community, or Mixed (included trials involving interventions in two or more of the above).
Figure 1Quorum trees of Cochrane and Guide systematic reviews by intervention setting and design rigor.