| Literature DB >> 31034248 |
Nadir Yehya1,2, Michael O Harhay3,4, Martha A Q Curley2,5,6, David A Schoenfeld7,8,9, Ron W Reeder10.
Abstract
Ventilator-free days (VFDs) are a commonly reported composite outcome measure in acute respiratory distress syndrome trials. VFDs combine survival and duration of ventilation in a manner that summarizes the "net effect" of an intervention on these two outcomes. However, this combining of outcome measures makes VFDs difficult to understand and analyze, which contributes to imprecise interpretations. We discuss the strengths and limitations of VFDs and other "failure-free day" composites, and we provide a framework for when and how to use these outcome measures. We also provide a comprehensive discussion of the different analytic methods for analyzing and interpreting VFDs, including Student's t tests and rank-sum tests, as well as competing risk regressions treating extubation as the primary outcome and death as the competing risk. Using simulations, we illustrate how the statistical test with optimal power depends on the relative contributions of mortality and ventilator duration on the composite effect size. Finally, we recommend a simple analysis and reporting framework using the competing risk approach, which provides clear information on the effect size of an intervention, a statistical test and measure of confidence with the ability to adjust for baseline factors and allow interim monitoring for trials. We emphasize that any approach to analyzing a composite outcome, including other "failure-free day" constructs, should also be accompanied by an examination of the components.Entities:
Keywords: ARDS; VFDs; acute respiratory distress syndrome; competing risk regression; ventilator-free days
Mesh:
Year: 2019 PMID: 31034248 PMCID: PMC6812447 DOI: 10.1164/rccm.201810-2050CP
Source DB: PubMed Journal: Am J Respir Crit Care Med ISSN: 1073-449X Impact factor: 21.405
Iterations of Failure-Free Days in Emergency and Critical Care Trials
| Outcome | Time Frame ( | Primary or Secondary Outcome | References |
|---|---|---|---|
| Ventilator-free days | 28 | Primary | |
| 60 | Primary | ||
| 180 | Secondary | ||
| Vasopressor-free days | 28 | Secondary | |
| Kidney failure–free days | 28 | Primary | |
| Renal replacement therapy–free days | 28 | Secondary | |
| Delirium-/coma-free days | 14 | Primary | |
| Organ failure–free days | 14 | Secondary | |
| 28 | Secondary | ||
| ICU-free days | 7 | Secondary | |
| 28 | Primary | ||
| 180 | Secondary | ||
| Hospital-free days | 28 | Primary |
Figure 1.Different clinical trajectories of subjects assigned to (A) 0 or (B) 14 ventilator-free days. A criticism of ventilator-free days is that the “net effect” being reported does not adequately discriminate between these distinct patient outcomes.
Power Calculations for Different Statistical Tests in Which Primary Outcome of Interest Is Ventilator Duration Censored at 28 Days
| Effects | Mortality | Ventilator Days among Survivors | Power | |||||
|---|---|---|---|---|---|---|---|---|
| Fine and Gray Regression | Gray’s Test | Log-Rank Test | Rank-Sum Test | Student’s | Fisher’s Exact Test | |||
| Mortality only | 76% | 75% | 76% | 55% | 71% | |||
| Treatment | 15% | 7 | ||||||
| Control | 25% | 7 | ||||||
| Strong mortality and weak duration | 89% | 85% | ||||||
| Treatment | 15% | 6 | ||||||
| Control | 25% | 7 | ||||||
| Moderate mortality and duration | 79% | 79% | 79% | 81% | 33% | |||
| Treatment | 15% | 5 | ||||||
| Control | 20% | 6.5 | ||||||
| Weak mortality and strong duration | 85% | 84% | 85% | 90% | 5% | |||
| Treatment | 15% | 5 | ||||||
| Control | 16% | 8 | ||||||
| Duration only | 79% | 77% | 79% | 86% | 4% | |||
| Treatment | 15% | 5 | ||||||
| Control | 15% | 8 | ||||||
| Conflicting | 5% | 5% | 5% | 14% | 5% | |||
| Treatment | 15% | 6.5 | ||||||
| Control | 20% | 5 | ||||||
The highest power for any scenario is in bold.
Results are each based on 3,000 simulated trials with 300 subjects in each of two treatment groups, a two-sided alternative hypothesis, and a type I error rate of α = 0.05.
Mortality is simulated according to a Bernoulli distribution.
Duration of ventilation among survivors is simulated according to an exponential distribution.
Deaths were set as higher than any duration for log-rank test.
Owing to computational limits, the normal approximation with continuity correction was used for the Wilcoxon rank-sum test.
For Fisher’s exact test, the outcome is mortality; duration of ventilation is ignored. It is provided here for comparison with the other tests.
Recommendations for Defining, Analyzing, and Reporting Ventilator-Free Days
| Recommendation | Rationale | Comments |
|---|---|---|
| Define VFDs explicitly | Facilitates comparison between and across interventions, trials, and meta-analyses | Day 0 (day of randomization) |
| Time frame (28 d) | ||
| Successful extubation (extubation >48 h without reintubation in a 28-d survivor) | ||
| Interval reintubations (count from last successful extubation) | ||
| Death before 28 d (VFD = 0 to penalize nonsurvival, regardless of intubation status) | ||
| Death after 28 d (censor after 28 d; use 28-d ventilation and survival status for calculating VFDs) | ||
| Noninvasive support (do not count) | ||
| Tracheostomy (treat as all invasive ventilation) | ||
| Use competing risk regression to analyze VFDs | Valid, comprehensible estimate of the combined effect; allows adjustment for baseline variables; allows for interim monitoring | The power calculation is for the “net effect” size (SHR) in which duration of ventilation is the primary outcome and death is the competing event |
| Wilcoxon rank-sum test has higher power if effect is primarily driven by ventilator duration | ||
| Report effect size, confidence interval, and | Reporting of the primary “net effect” size and confidence of estimate | Competing risk allows this (SHR); Wilcoxon rank-sum test does not |
| Report effect size, confidence interval, and | Transparent reporting of whether one or both components is driving the effect | Adjust for the same baseline factors as in the primary analysis of the composite |
| Report cumulative incidence function for the components of interest |
Definition of abbreviations: SHR = subdistribution hazard ratio; VFD = ventilator-free days.
Proposed Alternative Reporting of Trial Data in Which Primary Outcome of Interest Is Ventilator Duration
| ARMA | ALVEOLI | FACTT | ALTA | OMEGA | |
|---|---|---|---|---|---|
| Intervention | Low VT | Higher PEEP | Conservative | Albuterol | Supplements |
| Control | High VT | Lower PEEP | Liberal | Placebo | Formula |
| Extubated alive (composite) | |||||
| SHR | 1.30 | 0.91 | 1.30 | 0.79 | 0.73 |
| 95% CI | 1.09 to 1.54 | 0.75 to 1.11 | 1.12 to 1.51 | 0.60 to 1.02 | 0.56 to 0.97 |
| | 0.003 | 0.356 | 0.072 | 0.027 | |
| 28-d mortality | |||||
| Intervention | 24% | 22% | 26% | 20% | 22% |
| Control | 34% | 22% | 29% | 14% | 13% |
| RR 28-d mortality | 0.70 | 1.04 | 0.86 | 1.47 | 1.70 |
| 95% CI | 0.57 to 0.87 | 0.76 to 1.42 | 0.69 to 1.08 | 0.87 to 2.51 | 0.99 to 2.91 |
| 0.001 | 0.810 | 0.186 | 0.159 | 0.049 | |
| Mean ± SD ventilator days in 28-d survivors | |||||
| Intervention | 8.9 ± 7.1 | 8.3 ± 6.0 | 8.2 ± 5.8 | 6.8 ± 6.0 | 7.3 ± 5.2 |
| Control | 8.6 ± 7.8 | 8.7 ± 6.2 | 10.3 ± 6.4 | 7.1 ± 5.9 | 6.9 ± 5.1 |
| Δ Mean ventilator days in survivors | 0.26 | −0.32 | −2.02 | −0.24 | 0.46 |
| 95% CI | −0.96 to 1.47 | −1.57 to 0.93 | −2.95 to −1.10 | −1.88 to 1.39 | −1.01 to 1.93 |
| Student’s | 0.680 | 0.619 | 0.770 | 0.539 |
Definition of abbreviations: ALTA = Albuterol for the Treatment of Acute Lung Injury; ALVEOLI = Assessment of Low Tidal Volume and Elevated End-expiratory Volume to Obviate Lung Injury; ARMA = Respiratory Management in ARDS; CI = confidence interval; FACTT = Fluid and Catheter Treatment Trial; OMEGA = Omega Nutritional Supplement Trial; PEEP = positive end-expiratory pressure; RR = risk ratio; SHR = subdistribution hazard ratio.
Figure 2.Cumulative incidence functions for the primary event (extubation) in five ARDSNet (Acute Respiratory Distress Syndrome Clinical Network) trials. The subdistribution hazard ratio (SHR) and 95% confidence intervals are provided. Intervention (blue) and control (red) arms are displayed, and SHR greater than 1 is interpreted as greater hazard of intact extubation. ARMA (Respiratory Management in ARDS) and FACTT (Fluid and Catheter Treatment Trial) demonstrated a benefit of the intervention related to the probability of extubation, whereas OMEGA (Omega Nutritional Supplement Trial) demonstrated harm. ALTA = Albuterol for the Treatment of Acute Lung Injury; ALVEOLI = Assessment of Low Tidal Volume and Elevated End-expiratory Volume to Obviate Lung Injury; PEEP = positive end-expiratory pressure.