Jonathan D Casey1, Matthew W Semler1. 1. Division of Allergy, Pulmonary, and Critical Care Medicine, Vanderbilt University School of Medicine, Nashville, Tennessee.
Randomized trials, the most reliable method for determining the
effect of a treatment on patient outcomes, have traditionally reported the average
effect of a treatment across the whole study population. Bedside clinicians have long
recognized that a given treatment can benefit some patients while conveying no benefit
(or even harm) to other patients with the same illness (“heterogeneity of
treatment effect”) (1, 2). Ideally, clinicians would be able to make
decisions using estimates of treatment effect that were both 1)
evidence-based and 2) personalized to the individual patient. If
“evidence-based individual treatment effects” are the promised land, how
can critical care get there?In this issue of the Journal, Bellomo and colleagues (pp. 1253–1261) demonstrate an important early step in this journey
(3). In a secondary analysis of the ATHOS-3
(Angiotensin II for the Treatment of High-Output Shock) trial (4), they examine how biologic measures along the proposed
mechanistic pathway for angiotensin II infusion modify the effect of the treatment on
outcomes, posing the question, “Can bedside measurement of serum renin levels
identify which patients will benefit from treatment with angiotensin II?”The original ATHOS-3 trial randomized 344 patients with catecholamine-resistant
vasodilatory shock to infusion of angiotensin II or placebo. Angiotensin II increased
mean arterial pressure at 3 hours (the primary outcome). Although 28-day mortality was
numerically lower in the angiotensin II group, the difference was not statistically
significant (hazard ratio, 0.78; 95% confidence interval, 0.57–1.07;
P = 0.12).The ATHOS-3 trial derived from the hypothesis that decreased angiotensin-converting
enzyme activity in shock produces a relative deficiency of angiotensin II and resultant
elevations in renin and angiotensin I. The hypothesis of this secondary analysis, that
angiotensin II infusion might be more effective among patients with higher serum renin
levels (as a surrogate for decreased angiotensin converting enzyme activity, decreased
angiotensin II, and increased angiotensin I), was a natural next step in striving to
understand which patients with shock benefit from treatment with angiotensin II (5).To test this hypothesis, the authors analyzed specimens from the ATHOS-3 trial obtained
from 255 patients at the time of randomization and from 200 patients at 3 hours after
initiation of the study drug. The authors found that 1) most patients
had elevated renin levels, 2) renin levels correlated moderately with
angiotensin I levels and weakly with the ratio of angiotensin I to angiotensin II, and
3) renin levels at randomization appeared to potentially modify the
effect of angiotensin II infusion on mortality.The investigators are to be applauded for incorporating into a rigorous randomized trial
the collection of specimens in a manner that allowed the evaluation of the mechanism of
action and heterogeneity of the treatment effect. These results are critical to
understanding the mechanistic effects of angiotensin II infusion in shock and to
planning future research.As for the enticing question, “Can bedside measurement of serum renin levels
identify which patients will benefit from angiotensin II?”, the answer is
“not yet.” Like all post hoc analyses, these results
require prospective validation. Because the original ATHOS-3 trial was not stratified by
baseline renin levels (which were unavailable at randomization), the apparent
differences in mortality between angiotensin II and placebo in the higher-renin subgroup
may result from chance imbalances in baseline characteristics. For example, in this
subgroup, patients assigned to placebo had numerically greater norepinephrine receipt,
Model for End-Stage Liver Disease scores, and prevalence of acute respiratory distress
syndrome and acute kidney injury at baseline. Furthermore, the primary analysis
dichotomized patients with “high” versus “low” renin levels
using the median renin level for the trial population. This arbitrary cut point does not
represent a biologically meaningful threshold. When the authors examined the effect of
angiotensin II versus placebo across the full range of baseline renin levels as a
continuous variable, the baseline renin level did not appear to modify the effect of
angiotensin II on mortality (see Figure 4 in Reference 3). Finally, the effect of angiotensin II on
mortality has been proposed to be mediated through blood pressure—the primary
outcome of the ATHOS-3 trial. In the current study, baseline renin level did not modify
the effect of angiotensin II infusion on mean arterial blood pressure.Designing randomized trials to assess for heterogeneity of treatment effect by biologic
measures of the proposed mechanistic pathway is one important step toward evidence-based
individual treatment effects, but it is not the only step. Bellomo and colleagues (3) apply a traditional
“one-variable-at-a-time” approach to evaluating for heterogeneity of
treatment effect (6). A complete understanding
of how individual patients will respond to treatment, however, may require simultaneous
consideration of the interaction among multiple related variables (e.g., intravascular
volume, left ventricular ejection fraction, tissue oxygen saturation, and exogenous
catecholamine receipt). For example, euvolemic patients with
“inappropriately” high renin levels might benefit from angiotensin II
infusion, whereas hypovolemic patients with “appropriately” high renin
levels might be harmed by angiotensin II infusion. The number of potential effect
modifiers and their theoretical combinations may outpace traditional methods for
analyzing randomized trials (7).Building the tools clinicians need to make evidence-based treatment decisions for
individual patients will require investment on multiple fronts. In the long term, we
believe randomized trials in critical care should:Be large enough to estimate, with adequate
statistical power, treatment effects for individuals or small groups of
patients, rather than average treatment
effects.Enroll broad and
representative enough patient populations to estimate treatment effects for
the full range of individuals who might be exposed to an intervention in
practice. Specifically, trials should only exclude patients for whom an
incontrovertible pathophysiologic rationale suggests they will not respond
to the treatment (e.g., absence of the molecular target) (8). This approach allows a
comprehensive understanding of which patients do and do not benefit from a
treatment and avoids inappropriately depriving patients of a treatment from
which they would have benefited in cases in which the treatment’s
mechanism is multimodal or incompletely
understood.Extract data
automatically from the electronic health record to generate large volumes of
granular data on physiology and response to treatment (9) and develop innovative, inexpensive approaches to
targeted assessment of mechanistic
biomarkers.Address in design,
analysis, and dissemination the complex patterns of covariates and
interactions that determine the effects of treatment on outcomes for
individual patients. Analysis of randomized trials using advanced approaches
to regression analysis or machine learning may inform both mechanistic
understanding and treatment decisions (10, 11). Computerized
clinician decision-support tools may help translate increasingly
sophisticated estimates of individual treatment effect into clinical
care.In summary, we thank Bellomo and colleagues (3)
for their informative analysis of how hormone levels along the
renin–angiotensin–aldosterone system may help identify which patients
benefit from angiotensin II infusion. We challenge future randomized trials in critical
care to innovate robust approaches to generating the evidence-based estimates of
treatment effect for individual patients that clinicians and patients need to make
informed, personalized treatment decisions.
Authors: Theodore J Iwashyna; James F Burke; Jeremy B Sussman; Hallie C Prescott; Rodney A Hayward; Derek C Angus Journal: Am J Respir Crit Care Med Date: 2015-11-01 Impact factor: 21.405
Authors: Hallie C Prescott; Carolyn S Calfee; B Taylor Thompson; Derek C Angus; Vincent X Liu Journal: Am J Respir Crit Care Med Date: 2016-07-15 Impact factor: 21.405
Authors: Aditya Biswas; Chirag R Parikh; Harold I Feldman; Amit X Garg; Stephen Latham; Haiqun Lin; Paul M Palevsky; Ugochukwu Ugwuowo; F Perry Wilson Journal: Clin J Am Soc Nephrol Date: 2018-03-29 Impact factor: 8.237
Authors: Ashish Khanna; Shane W English; Xueyuan S Wang; Kealy Ham; James Tumlin; Harold Szerlip; Laurence W Busse; Laith Altaweel; Timothy E Albertson; Caleb Mackey; Michael T McCurdy; David W Boldt; Stefan Chock; Paul J Young; Kenneth Krell; Richard G Wunderink; Marlies Ostermann; Raghavan Murugan; Michelle N Gong; Rakshit Panwar; Johanna Hästbacka; Raphael Favory; Balasubramanian Venkatesh; B Taylor Thompson; Rinaldo Bellomo; Jeffrey Jensen; Stew Kroll; Lakhmir S Chawla; George F Tidmarsh; Adam M Deane Journal: N Engl J Med Date: 2017-05-21 Impact factor: 91.245
Authors: Michael O Harhay; Jonathan D Casey; Marina Clement; Sean P Collins; Étienne Gayat; Michelle Ng Gong; Samir Jaber; Pierre-François Laterre; John C Marshall; Michael A Matthay; Rhonda E Monroe; Todd W Rice; Eileen Rubin; Wesley H Self; Alexandre Mebazaa Journal: Intensive Care Med Date: 2020-02-18 Impact factor: 17.440
Authors: Rinaldo Bellomo; Richard G Wunderink; Harold Szerlip; Shane W English; Laurence W Busse; Adam M Deane; Ashish K Khanna; Michael T McCurdy; Marlies Ostermann; Paul J Young; Damian R Handisides; Lakhmir S Chawla; George F Tidmarsh; Timothy E Albertson Journal: Crit Care Date: 2020-02-06 Impact factor: 9.097
Authors: Rinaldo Bellomo; Lui G Forni; Laurence W Busse; Michael T McCurdy; Kealy R Ham; David W Boldt; Johanna Hästbacka; Ashish K Khanna; Timothy E Albertson; James Tumlin; Kristine Storey; Damian Handisides; George F Tidmarsh; Lakhmir S Chawla; Marlies Ostermann Journal: Am J Respir Crit Care Med Date: 2020-11-01 Impact factor: 21.405
Authors: Robinder G Khemani; Jessica T Lee; David Wu; Edward J Schenck; Margaret M Hayes; Patricia A Kritek; Gökhan M Mutlu; Hayley B Gershengorn; Rémi Coudroy Journal: Am J Respir Crit Care Med Date: 2021-05-01 Impact factor: 21.405