| Literature DB >> 28814337 |
Christopher J Oliver1,2, Stephen P Myers3.
Abstract
The public safety of α-tocopherol has been called in question by several meta-analyses which have raised concern among regulatory authorities. The objective of this study was to evaluate the Cochrane Database Systematic Review 2012 (CD007176) which concludes that α-tocopherol forms of vitamin E have a statistically significant effect on mortality, by assessing the trials and datasets used and determining their effect upon the primary outcome.The Alpha-Tocopherol, Beta-Carotene Cancer Prevention Study (ATBC), a factorial design study of Finnish smokers was a pivotal paper in the Cochrane Review owing to the high mortality rate observed which resulted in a substantial weighting (42.6%) in the meta-analysis. The Cochrane meta-analysis used a 3 cell analytical method comparing all vitamin E cells (vitamin E alone plus vitamin E + β-carotene) to the placebo only cell. This had the unfortunate effect of incorrectly inflating the mortality risk attributed to vitamin E by not balancing the contribution to mortality of the β-carotene intervention. Re-analysis of the ATBC trial using data derived from the more generally accepted 'inside the table' (2 cell - vitamin E versus placebo) or 'at the margins' (4 cell - all vitamin E versus all non-vitamin E) analytical methods demonstrates a statistically non-significant result.The data from the ATBC study has been given in 5 datasets (the trial alone and four extended post-trial follow-up time periods). Using the 3 cell analysis method only the 6 and 8-year (used in the meta-analysis) follow-up periods were statistically significant. Using the 2 or 4 cell method the outcome remains non-significant over all time periods.The impartiality of excluding trials with zero mortality is also examined and questioned.This paper raises concerns overall as to the appropriateness of datasets chosen, the validity of methods and generalisability of results when using meta-analysis as a tool to determine safety. Issues raised in this paper are not unique to the Cochrane study in question. Until we have new tools, there may be a need to rely on conventional narrative systematic literature synthesis in the assessment of safety or contain our results to specific sub-populations where more conclusive results can be determined.Entities:
Mesh:
Substances:
Year: 2017 PMID: 28814337 PMCID: PMC5565069 DOI: 10.1186/s12906-017-1906-x
Source DB: PubMed Journal: BMC Complement Altern Med ISSN: 1472-6882 Impact factor: 3.659
“At the margins” (4 cell) and “inside the cell” (2 cell) factorial design analysis
Legend: A simple factorial design (2 × 2) has 4 separate treatment arms represented by the 4 cells inside the Table (A, B, C and D). In the ATBC study [7] the four treatments were: cell A - active vitamin E with active β-carotene; cell B - active β-carotene with placebo vitamin E; cell C - active vitamin E with placebo β-carotene; and cell D - placebo vitamin E with placebo β-carotene. An ‘inside the table’ analysis uses two cells and compares active vitamin E alone (cell C) to all placebo (cell D) or compares active vitamin E alone (cell C) to active β-carotene alone (cell B); an ‘at the margins’ analysis uses 4 cells and compares all active vitamin E against and all placebo vitamin E (margin cell A + C vs margin cell B + D). The analysis used in the Cochrane review [3] uses 3 cells and compares all active vitamin E (margin cell A + C) to placebo (cell D)
Sensitivity analyses of Risk Ratio (RR) low risk of bias data subset by a) removing ATBC study, and b) adding fictitious dataset to original low risk of bias trials
| Analysis | Vitamin E | Control | ATBC Weighting | Low bias Subgroup RR | 95% CIs |
| Figure |
|---|---|---|---|---|---|---|---|
| Per Bjelakovic A11 | 11,689/97523 | 7561/73721 | 42.6 | 1.03 | 1.00–1.05 | 0.04 | S1 |
| Per Bjelakovic A11 minus ATBC 2003Low | 6256/82959 | 4956/66434 | 0.0 | 1.01 | 0.98–1.05 | 0.44 | S2 |
| Per Bjelakovic A11 plus Fictitious Trial | 12,664/195046 | 8298/147442 | 40.0 | 1.03 | 1.00–1.05 | 0.04 | S3 |
an/N – number of deaths/total number of participants
Risk ratio (RR) according to ATBC study period analysed using three methods - ‘inside the table’ (2 cell), ‘at the margins’ (4 cell) and Bjelakovic (3 cell) - utilising the Bjelakovic low risk of bias dataset (A11)
| Trial Period | Active | Control | ATBC Weighting | Low risk Bias Subset RR | 95% CIs |
| Figure |
|---|---|---|---|---|---|---|---|
| At the Margins Analysis (4 cell analysis) | |||||||
| All Vit E | All non-Vit E | ||||||
| April 1985–April 1993b | 1800/14564 | 1770/14569 | 21.5 | 1.01 | 0.98–1.05 | 0.34 | S4 |
| April 1985–April 1996 | 2993/14564 | 3019/14569 | 33.8 | 1.01 | 0.98–1.03 | 0.70 | S5 |
| April 1985–April 1999 | 4453/14564 | 4415/14569 | 46.2 | 1.01 | 0.99–1.04 | 0.37 | S6 |
| April 1985–April 2001 | 5433/14564 | 5398/14569 | 53.7 | 1.01 | 0.99–1.03 | 0.40 | S7 |
| April 1985–April 2011 | 10,182/14564 | 10,074/14569 | 81.7 | 1.01 | 1.00–1.03 | 0.11 | S8 |
| Inside the Table Analysis (2 cell analysis) | |||||||
| Vit E Alone | Placebo | ||||||
| April 1985–April 1993a | 868/7286 | 851/7287 | 11.6 | 1.01 | 0.98–1.05 | 0.38 | S9 |
| April 1985–April 1996 | 1434/7286 | 1449/7287 | 19.5 | 1.01 | 0.98–1.04 | 0.59 | S10 |
| April 1985–April 1999 | 2167/7286 | 2117/7287 | 29.0 | 1.02 | 0.99–1.05 | 0.24 | S11 |
| April 1985–April 2001 | 2671/7286 | 2605/7287 | 35.7 | 1.02 | 0.99–1.05 | 0.18 | S12 |
| April 1985–April 2011 | 5065/7286 | 5022/7287 | 68.8 | 1.01 | 0.99–1.03 | 0.28 | S13 |
| Bjelakovic (3 cell analysis) | |||||||
| All Vit E | Placebo | ||||||
| April 1985–April 1993a | 1800/14564 | 851/7287 | 15.0 | 1.02 | 0.99–1.06 | 0.19 | S14 |
| April 1985–April 1996 | 2993/14564 | 1449/7287 | 24.7 | 1.02 | 0.99–1.05 | 0.20 | S15 |
| April 1985–April 1999 | 4453/14564 | 2117/7287 | 35.4 | 1.03 | 1.00–1.06 | 0.04 | S16 |
| April 1985–April 2001c | 5433/14564 | 2605/7287 | 42.6 | 1.03 | 1.00–1.05 | 0.04 | S1 |
| April 1985–April 2011 | 10,182/14564 | 5022/7287 | 74.6 | 1.01 | 1.00–1.03 | 0.09 | S17 |
an/N – number of deaths/total number of participants, bTrial period, cDataset used by Bjelakovic et al. [3] analysis