| Literature DB >> 35918107 |
Audrey Wise1, Deepika Mannem2, Wade Arthur3, Ryan Ottwell3, Benjamin Greiner4, Derek Srouji5, Daniel Wildes5, Micah Hartwell3,6, Drew N Wright7, Jam Khojasteh8, Matthew Vassar3,6.
Abstract
OBJECTIVES: Spin is a reporting practice in which study results are misrepresented by overestimating efficacy or underestimating harm. Prevalence of spin varies between clinical specialties, and estimates are based almost entirely on clinical trials. Little is known about spin in systematic reviews.Entities:
Keywords: Adult cardiology; Coronary heart disease; Ischaemic heart disease; Myocardial infarction
Mesh:
Substances:
Year: 2022 PMID: 35918107 PMCID: PMC9351322 DOI: 10.1136/bmjopen-2021-049421
Source DB: PubMed Journal: BMJ Open ISSN: 2044-6055 Impact factor: 3.006
Figure 1Search queries.
Spin types and frequencies in abstracts (n=185)
| Nine most severe types of spin | No. (%), containing spin |
| (1) Conclusion contains recommendations for clinical practice not supported by the findings. | 10 (5.4) |
| (2) Title claims or suggests a beneficial effect of the experimental intervention not supported by the findings. | 2 (1.1) |
| (3) Selective reporting of or overemphasis on efficacy outcomes or analysis favouring the beneficial effect of the experimental intervention. | 42 (22.7) |
| (4) Conclusion claims safety based on non-statistically significant results with a wide CI.* | 6 (15.0) |
| (5) Conclusion claims the beneficial effect of the experimental treatment despite high risk of bias in primary studies. | 6 (3.2) |
| (6) Selective reporting of or overemphasis on harm outcomes or analysis favouring the safety of the experimental intervention. | 0 (0) |
| (7) Conclusion extrapolates the review’s findings to a different intervention (ie, claiming efficacy of one specific intervention although the review covers a class of several interventions). | 1 (0.5) |
| (8) Conclusion extrapolates the review’s findings from a surrogate marker or a specific outcome to the global improvement of the disease. | 0 (0) |
| (9) Conclusion claims the beneficial effect of the experimental treatment despite reporting bias. | 3 (1.6) |
*Safety not assessed in 145, n=40.
Figure 2Preferred Reporting Items for Systematic Reviews and Meta-Analyses flow diagram of study selection. ACS, acute coronary syndrome.
General characteristics of systematic reviews and meta-analyses
| Characteristics | No. (%) of articles (n=185) | OR (95% CI) | ||
| Total (%) | Abstract contains spin | Unadjusted | Adjusted | |
| Article mentions adherence to PRISMA | ||||
| No | 106 (17.8) | 36 (19.5) | 1 (Reference) | 1 (Reference) |
| Yes | 79 (42.7) | 23 (12.4) | 0.67 (0.34 to 1.32) | 0.42 (0.16 to 1.07) |
| Publishing journal recommends adherence to PRISMA | ||||
| No | 124 (67.0) | 43 (23.2) | 1 (Reference) | 1 (Reference) |
| Yes | 61 (33) | 16 (8.6) | 0.80 (0.43 to 1.50) | 0.65 (0.29 to 1.46) |
| Funding source | ||||
| Not funded | 44 (23.8) | 16 (8.6) | 1 (Reference) | 1 (Reference) |
| Industry | 11 (5.9) | 4 (2.2) | 1.00 (0.25 to 3.95) | 1.27 (0.23 to 7.04) |
| Not mentioned | 93 (50.3) | 26 (14.1) | 0.68 (0.32 to 1.46) | 0.62 (0.23 to 1.64) |
| Private | 20 (10.8) | 7 (3.8) | 0.94 (0.31 to 2.85) | 0.86 (0.23 to 3.17) |
| Public | 17 (9.2) | 6 (3.2) | 0.95 (0.30 to 3.07) | 0.96 (0.24 to 3.76) |
| AMSTAR-2 rating | ||||
| High | 24 (13) | 7 (3.8) | 1 (Reference) | 1 (Reference) |
| Moderate | 110 (59.5) | 7 (3.8) | 1.13 (0.32 to 3.98) | 0.93 (0.23 to 3.87) |
| Low | 29 (15.7) | 12 (6.5) | 1.71 (0.54 to 5.41) | 1.68 (0.44 to 6.49) |
| Critically low | 110 (59.5) | 33 (17.8) | 1.04 (0.39 to 2.75) | 1.19 (0.38 to 3.77) |
| Journal impact factor*, M (SD) | 7.80 (11.52) | 6.90 (8.45) | 0.99 (0.96 to 1.02) | 1.01 (0.97 to 1.05) |
| Publication year (1991–2020) | 1.05 (1.00 to 1.11) | 1.09 (1.00 to 1.18) | ||
*18 journals did not have an impact factor.
AMSTAR, A MeaSurement Tool to Assess systematic Reviews; PRISMA, Preferred Reporting Items for Systematic Reviews and Meta-Analyses.
AMSTAR-2 Items and frequency of responses (n=185)
| AMSTAR-2 item | Response, n (%) | ||
| Yes | No | Partial yes | |
| (1) Did the research questions and inclusion criteria for the review include the elements of PICO? | 185 (100) | 0 (0) | 0 (0) |
| (2) Did the report of the review contain an explicit statement that the review methods were established prior to the conduct of the review and did the report justify any significant deviations from the protocol? | 75 (40.5) | 108 (58.4) | 2 (1.1) |
| (3) Did the review authors explain their selection of the study designs for inclusion in the review? | 151 (81.6) | 25 (13.5) | 9 (4.9) |
| (4) Did the review authors use a comprehensive literature search strategy? | 55 (29.7) | 42 (22.7) | 88 (47.6) |
| (5) Did the review authors perform study selection in duplicate? | 128 (69.2) | 57 (30.8) | 0 (0) |
| (6) Did the review authors perform data extraction in duplicate? | 126 (68.1) | 59 (31.2) | 0 (0) |
| (7) Did the review authors provide a list of excluded studies and justify the exclusions? | 6 (3.2) | 51 (27.6) | 128 (69.1) |
| (8) Did the review authors describe the included studies in adequate detail? | 137 (74.1) | 12 (6.5) | 36 (19.4) |
| (9) Did the review authors use a satisfactory technique for assessing the risk of bias (RoB) in individual studies that were included in the review? | 53 (28.6) | 127 (68.6) | 5 (2.7) |
| (10) Did the review authors report on the sources of funding for the studies included in the review? | 7 (3.8) | 178 (96.2) | 0 (0) |
| (11) If meta-analysis was performed, did the review authors use appropriate methods for statistical combination of results?* | 142 (76.8) | 34 (18.4) | 0 (0) |
| (12) If meta-analysis was performed, did the review authors assess the potential impact of RoB in individual studies on the results of the meta-analysis or other evidence synthesis?* | 72 (38.9) | 103 (55.1) | 0 (0) |
| (13) Did the review authors account for RoB in primary studies when interpreting/discussing the results of the review? | 74 (40.0) | 111 (60.0) | 0 (0) |
| (14) Did the review authors provide a satisfactory explanation for, and discussion of, any heterogeneity observed in the results of the review? | 145 (78.4) | 40 (21.6) | 0 (0) |
| (15) If they performed quantitative synthesis did the review authors carry out an adequate investigation of publication bias (small study bias) and discuss its likely impact on the results of the review?* | 110 (59.5) | 66 (35.7) | 0 (0) |
| (16) Did the review authors report any potential sources of conflict of interest, including any funding they received for conducting the review? | 127 (68.6) | 58 (31.4) | 0 (0) |
*Nine articles did not perform a meta-analysis, thus n=176.
PICO, this mneumonic is used to answer healthcare related questions and stands for P- patient, problem or population, I- intervention, C- comparison, control or comparator, and O- outcome(s).