Andreas B Gevaert1,2, Semra Tibebu3, Mamas A Mamas4, Neal G Ravindra5,6, Shun Fu Lee7,8, Tariq Ahmad5,9, Dennis T Ko10,11, James L Januzzi12,13,14, Harriette G C Van Spall3,7,8,15. 1. Research Group Cardiovascular Diseases, GENCOR Department, University of Antwerp, Antwerp, Belgium. 2. Department of Cardiology, Antwerp University Hospital (UZA), Edegem, Belgium. 3. ICES, McMaster University, Hamilton, Ontario, Canada. 4. Keele Cardiovascular Research Group, Centre for Prognosis Research, Keele University, Stoke on Trent, UK. 5. Section of Cardiovascular Medicine, School of Medicine, Yale University, New Haven, CT, USA. 6. Department of Computer Science, Yale University, New Haven, CT, USA. 7. Department of Health Research Methods, Evidence and Impact, McMaster University, Hamilton, Ontario, Canada. 8. Population Health Research Institute, Hamilton, Ontario, Canada. 9. Center for Outcomes Research and Evaluation, Yale New Haven Health, New Haven, CT, USA. 10. ICES, University of Toronto, Hamilton, Ontario, Canada. 11. Department of Medicine, University of Toronto, Toronto, Ontario, Canada. 12. Cardiology Division, Massachusetts General Hospital, Boston, MA, USA. 13. Harvard Medical School, Boston, MA, USA. 14. Baim Institute for Clinical Research, Boston, MA, USA. 15. Department of Medicine, McMaster University, Hamilton, Ontario, Canada.
Abstract
AIMS: Heart failure (HF) guidelines place patients into 3 discrete groups according to left ventricular ejection fraction (LVEF): reduced (<40%), mid-range (40-49%), and preserved LVEF (≥50%). We assessed whether clinical phenogroups offer better prognostication than LVEF. METHODS AND RESULTS: This was a sub-study of the Patient-Centered Care Transitions in HF trial. We analysed baseline characteristics of hospitalized patients in whom LVEF was recorded. We used unsupervised machine learning to identify clinical phenogroups and, thereafter, determined associations between phenogroups and outcomes. Primary outcome was the composite of all-cause death or rehospitalization at 6 and 12 months. Secondary outcome was the composite cardiovascular death or HF rehospitalization at 6 and 12 months. Cluster analysis of 1693 patients revealed six discrete phenogroups, each characterized by a predominant comorbidity: coronary heart disease, valvular heart disease, atrial fibrillation (AF), sleep apnoea, chronic obstructive pulmonary disease (COPD), or few comorbidities. Phenogroups were LVEF independent, with each phenogroup encompassing a wide range of LVEFs. For the primary composite outcome at 6 months, the hazard ratios (HRs) for phenogroups ranged from 1.25 [95% confidence interval (CI) 1.00-1.58 for AF] to 2.04 (95% CI 1.62-2.57 for COPD) (log-rank P < 0.001); and at 12 months, the HRs for phenogroups ranged from 1.15 (95% CI 0.94-1.41 for AF) to 1.87 (95% 1.52-3.20 for COPD) (P < 0.002). LVEF-based classifications did not separate patients into different risk categories for the primary outcomes at 6 months (P = 0.69) and 12 months (P = 0.30). Phenogroups also stratified risk of the secondary composite outcome at 6 and 12 months more effectively than LVEF. CONCLUSION: Among patients hospitalized for HF, clinical phenotypes generated by unsupervised machine learning provided greater prognostic information for a composite of clinical endpoints at 6 and 12 months compared with LVEF-based categories. TRIAL REGISTRATION: ClinicalTrials.gov Identifier: NCT02112227.
AIMS: Heart failure (HF) guidelines place patients into 3 discrete groups according to left ventricular ejection fraction (LVEF): reduced (<40%), mid-range (40-49%), and preserved LVEF (≥50%). We assessed whether clinical phenogroups offer better prognostication than LVEF. METHODS AND RESULTS: This was a sub-study of the Patient-Centered Care Transitions in HF trial. We analysed baseline characteristics of hospitalized patients in whom LVEF was recorded. We used unsupervised machine learning to identify clinical phenogroups and, thereafter, determined associations between phenogroups and outcomes. Primary outcome was the composite of all-cause death or rehospitalization at 6 and 12 months. Secondary outcome was the composite cardiovascular death or HF rehospitalization at 6 and 12 months. Cluster analysis of 1693 patients revealed six discrete phenogroups, each characterized by a predominant comorbidity: coronary heart disease, valvular heart disease, atrial fibrillation (AF), sleep apnoea, chronic obstructive pulmonary disease (COPD), or few comorbidities. Phenogroups were LVEF independent, with each phenogroup encompassing a wide range of LVEFs. For the primary composite outcome at 6 months, the hazard ratios (HRs) for phenogroups ranged from 1.25 [95% confidence interval (CI) 1.00-1.58 for AF] to 2.04 (95% CI 1.62-2.57 for COPD) (log-rank P < 0.001); and at 12 months, the HRs for phenogroups ranged from 1.15 (95% CI 0.94-1.41 for AF) to 1.87 (95% 1.52-3.20 for COPD) (P < 0.002). LVEF-based classifications did not separate patients into different risk categories for the primary outcomes at 6 months (P = 0.69) and 12 months (P = 0.30). Phenogroups also stratified risk of the secondary composite outcome at 6 and 12 months more effectively than LVEF. CONCLUSION: Among patients hospitalized for HF, clinical phenotypes generated by unsupervised machine learning provided greater prognostic information for a composite of clinical endpoints at 6 and 12 months compared with LVEF-based categories. TRIAL REGISTRATION: ClinicalTrials.gov Identifier: NCT02112227.
Current guidelines for the diagnosis and treatment of heart failure (HF) classify patients into three groups according to left ventricular (LV) ejection fraction (LVEF).
,
An LVEF of 40–49% (mid‐range LVEF [mrEF]) is used to separate patients with HF and reduced ejection fraction (HFrEF; LVEF <40%) from those with HF and preserved ejection fraction (HFpEF; LVEF ≥50%), although the HFmrEF category is much debated, with some arguing for HFrEF and HFpEF to meet at an LVEF of 45%.
Regardless, these cut‐offs were established because patients with a lower LVEF have higher mortality and risk of hospitalization.
Most large randomized trials in HF restricted their population to patients with an LVEF below 40% to maximize event rates, an approach which has shown important clinical benefit for several drugs and devices.
In society guidelines, these therapies have accordingly been recommended for HFrEF patients,
,
while current evidence indicates that many treatments are effective in HF patients with LVEF well above 40%.
,
,
,While LVEF remains an informative characteristic for therapeutic decisions in HF, emerging data suggest that classifying patients with HF according to LVEF categories has several disadvantages. There are shared epidemiological features between patients with HFrEF, HFmrEF, and HFpEF, and pathophysiologic mechanisms may not be mutually exclusive.
In addition, LVEF measurement varies greatly among methods and observers,
and LVEF alone is not a good predictor of adverse outcomes.
Alternatively, HF can be considered a heterogeneous syndrome in which disease progression is associated with a dynamic evolution of functional and structural changes, leading to unique disease trajectories, and creating a spectrum of phenogroups with overlapping and distinct characteristics.
However, clear evidence that characteristics of HF patients form a continuum across LVEF is still lacking. Also, the role of comorbidities in classification of HF is uncertain as comorbidities are underreported in HF trials.Novel data‐driven methods have been developed for classification or phenotyping of complex chronic medical disorders, incorporating recent advances in artificial intelligence.
These alternative classification methods have been applied to patients with HF and were found to be superior to LVEF‐based classification in characterizing patient subgroups.
,
,
,
,In this study, we aimed to identify distinct clinical phenogroups among patients with HF using unsupervised machine learning analysis. Unsupervised machine learning looks for historically undetected patterns in a dataset without human‐labelled data or supervision. We hypothesized that a phenotype‐based classification system would be more effective than guideline‐recommended LVEF categories in predicting outcomes following hospital discharge.
Methods
Population
This was a sub‐study of the Patient‐Centered Care Transitions in HF (PACT‐HF) multicentre stepped wedge cluster randomized clinical trial,
,
which enrolled 2494 adults hospitalized for HF across 10 tertiary or quaternary care urban hospitals in Ontario, Canada. Patients were included if HF was considered the primary reason for hospitalization, and if rule‐out criteria for HF were not met. Rule‐out criteria were as follows: Boston criteria <5, and/or B type natriuretic peptide <50 pg/mL or N‐terminal pro brain natriuretic peptide (NT‐proBNP) <300 pg/mL.
,
Hospitals were randomized to sequentially deliver an intensive patient‐centred transitional care program or usual care.
The primary and secondary clinical outcomes have been reported.This study complies with the Declaration of Helsinki. Because services were evidence‐informed and considered quality improvement, the PACT‐HF study protocol was approved by all institutional research ethics boards with waiver of written consent. Patients provided verbal informed consent for study participation.
The use of data in this project was authorized under section 45 of Ontario's Personal Health Information Protection Act, which does not require review by a Research Ethics Board.
Measurements
Only baseline values were included to create a cross‐sectional sample. Trained nurse clinicians extracted laboratory values and LVEF from charts and transmitted them to the study centre via electronic case report forms. LVEF values were obtained from the most recent echocardiogram or radionuclide ventriculogram during the preceding 12 months. Baseline demographics and clinical characteristics were extracted from administrative databases using a 5 year lookback (supporting information, Table
S1). Comorbidities were extracted using International Classification of Diseases‐10 codes. Using unique encoded identifiers, clinical trial data were linked to the administrative databases (e.g. Canadian Institute for Health Information) accessed at ICES (formerly known as the Institute for Clinical Evaluative Sciences).
ICES is an independent, non‐profit research institute whose legal status under Ontario's health information privacy law allows it to collect and analyse health care and demographic data, without consent, for health system evaluation and improvement. These datasets (supporting information, Table
S1) were linked using unique encoded identifiers and analysed at ICES.
Outcomes
Primary outcome was the first occurrence of all‐cause death or all‐cause rehospitalization at 6 and 12 months. Secondary outcome was the first occurrence of cardiovascular death or HF rehospitalization at 6 and 12 months. All outcomes were measured relative to the discharge date of the index HF hospitalization, defined as the first unplanned hospitalization for HF in a participating hospital during the study period.
Statistical analysis
Baseline characteristics were summarized using mean and standard deviation (SD) or median and interquartile range (IQR) for continuous variables, and count and percentages for categorical variables. Baseline characteristics were compared using one‐way analysis of variance, Kruskal–Wallis test or χ
2 test where appropriate.Each baseline characteristic was assessed for an association with LVEF using Spearman's rank correlation coefficient (r) and univariable linear regression analysis reporting mean difference, 95% confidence intervals (CIs), and R
2 value. Given that LVEF was not normally distributed, the analysis was repeated with LVEF values categorized per 10% using interval regression analysis, obtaining a pseudo R
2 value. A multivariable linear regression model was constructed with clinically relevant, independent baseline variables. Mean differences were reported with 95% CIs, and a two‐sided P value of 0.05 was considered to be significant. Associations were defined as strong, moderate, or weak based on a Spearman's r value of >0.5, 0.5–0.3, or <0.3 respectively.
Cluster analysis
We included all independent variables in the dataset for further analysis: age, sex, weight, systolic blood pressure, glucose, creatinine, sodium, NT‐proBNP, troponin I, and history of hypertension, atrial fibrillation (AF), chronic obstructive pulmonary disease (COPD), severe valvular disease, and coronary revascularization. We did not consider the Charlson comorbidity index in the clustering analysis, as it encapsulates comorbidities already included in our analysis. We did not include classes of medication as these are typically prescribed based on LVEF. R v3.6.3 (R Foundation for Statistical Computing) and SAS v9.4 (SAS Institute) were used for machine learning and statistical analyses, respectively. Clustering of baseline characteristics was performed (i) independent of LVEF, (ii) according to guideline‐recommended categories of LVEF (<40, 40–49, and ≥50), and (iii) dividing LVEF in categories per 10% (<20, 20–29, 30–39, 40–49, 50–59, and ≥60). Gower's distance metric, which can handle categorical variables and missing values, was used to construct a dissimilarity matrix that served as an input to our clustering analysis, providing a pairwise comparison of observations. For missing values, two cases were compared if there was at least one variable where both had correct values. A majority of variables had <3% missing values. We performed agglomerative hierarchical clustering with Ward linkage (cluster R package). We used the elbow method, Dunn statistic, silhouette coefficient, and Hubert index (factoextra R package) to determine the optimal number of clusters. We constructed heatmaps using the ComplexHeatmap R package. We compared the performance of each of the 3 clustering approaches using six metrics to evaluate cluster stability, cohesion, separation, and information gain between analyses (details in Table S4 legend).
Survival analysis
We generated Kaplan–Meier survival curves for each clinical outcome and grouping and compared curves using the log‐rank test. We estimated hazard ratios (HRs) and CI, adjusted for age and sex, using Cox proportional hazards models. Violation of the proportional hazards assumption was determined through the analysis of Martingale residuals.
Results
Population characteristics
We included 1693 patients with available LVEF data in the analysis. LVEF was recorded at a median of 1 day post‐admission to hospital (IQR 45 days pre‐admission, to 3 days post‐admission). Baseline characteristics of the study population are displayed in Table
. Mean [SD] age was 77 [12] years, and 49% of the patients were female. Hypertension (76%), AF (57%), and diabetes (52%) were the most common comorbidities. Median (IQR) LVEF was 49 (33–58) percent. LVEF was abnormally distributed, with the histogram showing a peak at LVEF 50–54% (Figure S1).
Table 1
Baseline characteristics of the 1693 patients, stratified according to six phenogroups identified in cluster analysis
Characteristics
Overall
Phenogroup 1 (CAD)
Phenogroup 2 (VHD)
Phenogroup 3 (None)
Phenogroup 4 (AF)
Phenogroup 5 (COPD)
Phenogroup 6 (OSA)
P value
N
1693
433
173
298
371
251
167
LVEF, median (IQR), %
49 (33–58)
45 (30–55)
48 (30–55)
47 (30–57)
55 (40–60)
49 (33–58)
51 (33–59)
<0.001
Clinical characteristics
Age, mean (SD), years
77 (12)
77 (12)
80 (12)
75 (15)
82 (10)
77 (10)
71 (12)
<0.001
Female sex, no. (%)
828 (48.9)
91 (21.0)
60 (34.7)
159 (53.4)
364 (98.1)
80 (31.9)
74 (44.3)
<0.001
Weight, mean (SD), kg
95.9 (44.9)
101.0 (46.5)
83.1 (31.0)
94.8 (46.1)
86.1 (40.0)
96.6 (44.3)
118.1 (51.5)
<0.001
Systolic blood pressure, mean (SD), mmHg
137 (26)
137 (27)
128 (24)
144 (29)
136 (25)
135 (23)
135 (25)
<0.001
Heart rate, mean (SD), min−1
87 (23)
87 (24)
85 (22)
87 (20)
91 (26)
86 (24)
83 (21)
0.003
Respiratory rate, mean (SD), min−1
22 (5)
22 (5)
22 (6)
22 (5)
22 (5)
22 (6)
22 (5)
0.597
Comorbidities
Atrial fibrillation, no. (%)
965 (57.0)
271 (62.6)
105 (60.7)
0
348 (93.8)
148 (59.0)
93 (55.7)
<0.001
Cerebrovascular disease, no. (%)
173 (10.2)
102 (23.6)
13 (7.5)
0
≤10
46 (18.3)
≤10
<0.001
COPD, no. (%)
415 (24.5)
0
0
0
108 (29.1)
251 (100.0)
56 (33.5)
<0.001
Coronary revascularization, no. (%)
510 (30.1)
232 (53.6)
50 (28.9)
0
73 (19.7)
93 (37.1)
62 (37.1)
<0.001
Diabetes, no. (%)
879 (51.9)
212 (48.9)
50 (28.9)
149 (50.0)
197 (53.1)
137 (54.6)
124 (74.3)
<0.001
Hypertension, no. (%)
1292 (76.3)
324 (74.8)
124 (71.7)
198 (66.4)
293 (79.0)
205 (81.7)
148 (88.6)
<0.001
Severe valvular heart disease, no. (%)
325 (19.2)
15 (3.5)
173 (100.0)
0
96 (25.9)
18 (7.2)
23 (13.8)
<0.001
Sleep apnoea, no. (%)
198 (11.7)
≤10
≤10
0
0
29 (11.6)
167 (100.0)
<0.001
Charlson comorbidity score, mean (SD), points
2.6 (1.4)
2.54 (1.41)
2.27 (1.34)
2.43 (1.55)
2.50 (1.35)
2.92 (1.43)
2.87 (1.28)
<0.001
Laboratory analysis
Creatinine, mean (SD), μmol/L
137 (93)
150 (109)
150 (98)
139 (117)
114 (64)
133 (71)
140 (72)
<0.001
Blood urea nitrogen, mean (SD), mg/dL
12.1 (8.1)
12.3 (8.2)
14.1 (10.1)
11.1 (6.9)
11.2 (7.5)
12.0 (7.4)
13.5 (8.9)
<0.001
Sodium, mean (SD), mmol/L
137 (5)
137 (5)
137 (5)
138 (5)
137 (5)
138 (5.0)
138 (4)
0.173
Glucose, mean (SD), mmol/L
8.4 (4.2)
8.4 (4.0)
7.7 (4.3)
8.6 (4.2)
8.4 (3.9)
8.4 (3.7)
9.2 (5.3)
0.071
Troponin I, median (IQR), ng/L
0.04 (0.02–0.11)
0.05 (0.03–0.13)
0.05 (0.03–0.11)
0.05 (0.03–0.13)
0.03 (0.02–0.08)
0.04 (0.02–0.11)
0.04 (0.02–0.07)
<0.001
NT‐proBNP, median (IQR), ng/L
5090 (2453–9000)
6572 (2655–9000)
7668 (3430–9000)
4211 (2106–9000)
4720 (2475–9000)
4905 (2120–9000)
4260 (1902–8202)
<0.001
Current medication
ACE inhibitor, ARB or ARNI, no. (%)
936 (55.8)
243 (56.1)
85 (49.1)
182 (61.1)
183 (49.3)
136 (54.2)
94 (56.3)
0.013
Beta blocker, no. (%)
1,266 (74.8)
346 (79.9)
129 (74.6)
220 (73.8)
278 (74.9)
173 (68.9)
120 (71.9)
0.260
Mineralocorticoid receptor antagonist, no. (%)
351 (20.7)
95 (21.9)
40 (23.1)
67 (22.5)
67 (18.1)
37 (14.7)
45 (26.9)
0.222
Diuretic, no. (%)
1541 (91.0)
394 (91.0)
160 (92.5)
260 (87.2)
346 (93.3)
227 (90.4)
154 (92.2)
0.360
Acetylsalicylic acid, no. (%)
691 (40.8)
196 (45.3)
65 (37.6)
165 (55.4)
103 (27.8)
101 (40.2)
61 (36.5)
<0.001
ACE, angiotensin converting enzyme; AF, atrial fibrillation; ARB, angiotensin receptor blocker; ARNI, angiotensin receptor neprilysin inhibitor; CAD, coronary artery disease; COPD, chronic obstructive pulmonary disease; IQR, interquartile range; LVEF, left ventricular ejection fraction; NT‐proBNP, N‐terminal pro brain natriuretic peptide; OSA, obstructive sleep apnoea; SD, standard deviation; VHD, valvular heart disease. P value derived from one‐way analysis of variance (normal distribution) or Kruskal–Wallis test (skewed distribution).
Baseline characteristics of the 1693 patients, stratified according to six phenogroups identified in cluster analysisACE, angiotensin converting enzyme; AF, atrial fibrillation; ARB, angiotensin receptor blocker; ARNI, angiotensin receptor neprilysin inhibitor; CAD, coronary artery disease; COPD, chronic obstructive pulmonary disease; IQR, interquartile range; LVEF, left ventricular ejection fraction; NT‐proBNP, N‐terminal pro brain natriuretic peptide; OSA, obstructive sleep apnoea; SD, standard deviation; VHD, valvular heart disease. P value derived from one‐way analysis of variance (normal distribution) or Kruskal–Wallis test (skewed distribution).
Establishing phenogroups through clustering analysis
Clustering analysis of individual patients in an LVEF‐independent analysis identified six clusters as the optimal number of groupings (Figure S2). Patient characteristics stratified according to these six phenogroups are displayed in Figure
and Table
. Most phenogroups showed a high prevalence of a specific comorbidity: coronary artery disease (CAD, 54%, Phenogroup 1), valvular heart disease (VHD, 100%, Phenogroup 2), AF (94%, Phenogroup 4), COPD (100%, Phenogroup 5), and obstructive sleep apnoea (OSA, 100%, Phenogroup 6). Phenogroup 3 only had hypertension and diabetes as comorbidities (66% and 50%, respectively), labelled ‘few comorbidities’. Although LVEF significantly differed between groups, there was no clear between‐group clinical separation according to traditional LVEF categories: LVEF of most phenogroups ranged between 30% and 55%, except the AF phenogroup, which had a significantly higher LVEF than Phenogroups 1 through 5 (all P < 0.001, Figure S3) and the CAD phenogroup, which had a significantly lower LVEF than the AF, OSA, and COPD phenogroups (P < 0.001, P = 0.016, and P = 0.004, respectively, Figure S3).
Figure 1
Heatmaps of characteristics (rows) and LVEF categories (columns) of 1693 patients. (A) Patient characteristics stratified according to clusters identified by an unbiased, LVEF‐independent approach. (B) Patient characteristics stratified according to the three guideline‐recommended LVEF categories, reduced, mid‐range, and preserved EF. (C) Patient characteristics stratified according to six LVEF categories (per 10%). Darker means higher value, lighter means lower value. AF, atrial fibrillation; CAD, coronary artery disease, COPD, chronic obstructive pulmonary disease; EF, ejection fraction; LVEF, left ventricular ejection fraction; NT‐proBNP, N‐terminal pro brain natriuretic peptide; OSA, obstructive sleep apnoea; PCI/CABG, percutaneous coronary intervention or coronary artery bypass grafting; VHD, valvular heart disease.
Heatmaps of characteristics (rows) and LVEF categories (columns) of 1693 patients. (A) Patient characteristics stratified according to clusters identified by an unbiased, LVEF‐independent approach. (B) Patient characteristics stratified according to the three guideline‐recommended LVEF categories, reduced, mid‐range, and preserved EF. (C) Patient characteristics stratified according to six LVEF categories (per 10%). Darker means higher value, lighter means lower value. AF, atrial fibrillation; CAD, coronary artery disease, COPD, chronic obstructive pulmonary disease; EF, ejection fraction; LVEF, left ventricular ejection fraction; NT‐proBNP, N‐terminal pro brain natriuretic peptide; OSA, obstructive sleep apnoea; PCI/CABG, percutaneous coronary intervention or coronary artery bypass grafting; VHD, valvular heart disease.
Associations between clinical characteristics and left ventricular ejection fraction
Clustering analysis of characteristics and their association with the 3 guideline‐recommended LVEF categories (<40%, 40–49%, >50%) and 6 LVEF categories in per 10% increments is shown in Figure
and Table S2. Relative to LVEF > 50, LVEF <50% was associated with higher concentrations of NT‐proBNP (P < 0.001) and troponin (P < 0.001), and more prevalent history of coronary revascularization (P < 0.001, Table S2). LVEF >50% was associated with older age (P < .001), higher percentage of women (P < 0.001), and higher prevalence of AF (P < 0.001) relative to those with LVEF <50% (Table S2).Accordingly, in univariable linear regressions LVEF had a significant positive association with sex, age, systolic blood pressure, presence of AF, and presence of hypertension, and a significant negative association with NT‐proBNP and history of coronary revascularization (Table
). However, the associations were weak, with r values <0.3 (Table
). In multivariable linear regression analysis, age, systolic blood pressure, glucose, sodium, NT‐proBNP, and female sex had significant associations with LVEF (Table S3).
Table 2
Univariable associations of baseline characteristics and left ventricular ejection fraction
Mean difference and confidence intervals, R
2 value, and P value derived from univariable linear regression analysis.
r value derived from correlation analysis.
Pseudo R
2 value derived from interval regression analysis (six left ventricular ejection fraction categories using per 10% cut‐offs).
Per a unit of 10.
Per a unit of 100.
Univariable associations of baseline characteristics and left ventricular ejection fractionCI, confidence interval; COPD, chronic obstructive pulmonary disease; NT‐proBNP, N‐terminal pro brain natriuretic peptide.Mean difference and confidence intervals, R
2 value, and P value derived from univariable linear regression analysis.r value derived from correlation analysis.Pseudo R
2 value derived from interval regression analysis (six left ventricular ejection fraction categories using per 10% cut‐offs).Per a unit of 10.Per a unit of 100.
Cluster separation and stability
Comparative statistics for the clustering analyses demonstrated that the LVEF‐independent analysis provided the most separated clusters, but at the cost of cluster stability (Table S4). The LVEF‐independent analysis demonstrated the highest information gain when compared with three and six LVEF categories (Table S4), which means that the LVEF‐independent categorization has less ‘uncertainty’ or ‘noise’. The use of three LVEF categories resulted in an intermediate separation of clusters, with some overlap between categories, but the most ‘stable’ categorization of HF patients. This stability means that in a slightly different population (e.g. missing 1% of subjects), likely the same categorization would be obtained for the remaining subjects. The use of six LVEF categories had the lowest phenogroup cohesion and separation between categories and intermediate stability (Table S4).
Left ventricular ejection fraction and phenogroup‐based classifications and outcomes
The phenogroup‐based HF classification successfully stratified patients according to clinical outcomes (Table
, Figures
,
, S4, and S5). For the primary composite outcome of all‐cause death or rehospitalization at 6 months, the HRs for the phenogroups that ranged from 1.25 (95% CI 1.00–1.58 for phenogroup AF) to 2.04 (95% CI 1.62–2.57 for phenogroup COPD) (log‐rank P < 0.001, Figure
). For the primary composite outcome at 12 months, the HRs for phenogroups ranged from 1.15 (95% CI 0.94–1.41 for phenogroup AF) to 1.87 (95% CI 1.52–2.30 for phenogroup COPD) (P < 0.002, Figure
). For the secondary composite outcome of cardiovascular death or HF rehospitalization at 6 months, the HRs for phenogroups ranged from 1.15 (95% CI 0.85–1.56 for phenogroup CAD) to 1.68 (95% CI 1.19–2.36 for phenogroup VHD) (P = 0.002, Figure S4A); and at 12 months, the HRs ranged from 1.15 (95% CI 0.88–1.51 for phenogroup CAD) to 1.84 (95% CI 1.35–2.50 for phenogroup OSA) (P < 0.001, Figure S5A). Patients with COPD (Phenogroup 5) had the worst outcomes: 69% of patients died or were rehospitalized at 6 months, 79% at 12 months (Table
, Figure
). Patients with no major comorbidity (Phenogroup 3) had the best outcomes: 44% of patients died or were rehospitalized at 6 months, 59% at 12 months. Results were similar for the secondary outcomes (Table
, Figures S4 and S5), demonstrating early identification of risk using phenogroup classification.
Table 3
Primary and secondary clinical outcomes according to LVEF categories or LVEF‐independent clinical phenogroups
Grouping
Events (% of group with event)
Hazard ratio (95% CI)*
P value
Log‐rank P value
Events (% of group with event)
Hazard ratio (95% CI)*
P value
Log‐rank P value
Phenogroups
Composite of all‐cause death or rehospitalization at 6 months
Composite of all‐cause death or rehospitalization at 12 months
1 CAD
232 (54)
1.32 (1.05–1.64)
0.015
<0.001
282 (65)
1.22 (1.00–1.48)
0.045
<0.001
2 VHD
116 (67)
1.88 (1.46–2.42)
<0.001
134 (78)
1.70 (1.35–2.14)
<0.001
3 None
130 (44)
Reference
175 (59)
Reference
4 AF
206 (56)
1.25 (1.00–1.58)
0.054
249 (67)
1.15 (0.94–1.41)
0.174
5 COPD
173 (69)
2.04 (1.62–2.57)
<0.001
199 (79)
1.87 (1.52–2.30)
<0.001
6 OSA
99 (59)
1.63 (1.25–2.12)
<0.001
127 (76)
1.66 (1.32–2.09)
<0.001
LVEF, 3 categories
<40%
314 (55)
Reference
0.687
377 (66)
Reference
0.300
40–49%
157 (56)
0.96 (0.79–1.17)
0.711
194 (69)
1.01 (0.85–1.20)
0.906
≥50%
485 (58)
1.01 (0.87–1.17)
0.938
595 (71)
1.06 (0.93–1.21)
0.408
LVEF, 6 categories
<20%
22 (44)
Reference
0.401
28 (56)
Reference
0.338
20–29%
145 (57)
1.46 (0.93–2.29)
0.096
172 (68)
1.39 (0.93–2.08)
0.105
30–39%
147 (54)
1.27 (0.81–2.00)
0.291
177 (65)
1.23 (0.82–1.83)
0.316
40–49%
157 (56)
1.28 (0.82–2.01)
0.281
194 (69)
1.29 (0.86–1.92)
0.213
50–59%
274 (57)
1.28 (0.82–1.98)
0.275
344 (71)
1.32 (0.90–1.95)
.160
≥60%
211 (60)
1.42 (0.91–2.22)
0.121
251 (72)
1.39 (0.93–2.06)
0.104
Phenogroups
Composite of cardiovascular death or HF rehospitalization at 6 months
Composite of cardiovascular death or HF rehospitalization at 12 months
1 CAD
121 (28)
1.15 (0.85–1.56)
0.360
0.002
146 (34)
1.15 (0.88–1.51)
0.304
<0.001
2 VHD
65 (38)
1.68 (1.19–2.36)
0.003
80 (46)
1.75 (1.29–2.38)
<0.001
3 None
71 (24)
Reference
89 (30)
Reference
4 AF
106 (29)
1.17 (0.85–1.61)
0.328
143 (39)
1.27 (0.96–1.68)
0.091
5 COPD
89 (36)
1.63 (1.19–2.24)
0.002
115 (46)
1.77 (1.34–2.35)
<0.001
6 OSA
55 (33)
1.58 (1.11–2.25)
0.012
78 (47)
1.84 (1.35–2.50)
<0.001
LVEF, 3 categories
<40%
192 (33)
Reference
0.075
238 (41)
Reference
0.180
40–49%
80 (28)
0.78 (0.60–1.01)
0.063
101 (36)
0.80 (0.63–1.01)
0.056
≥50%
235 (28)
0.75 (0.62–0.92)
0.005
312 (37)
0.81 (0.68–0.97)
0.019
LVEF, 6 categories
<20%
17 (34)
Reference
0.096
23 (46)
Reference
0.193
20–29%
93 (37)
1.08 (0.64–1.81)
0.779
111 (44)
0.95 (0.61–1.49)
0.829
30–39%
82 (30)
0.79 (0.46–1.33)
0.367
104 (38)
0.73 (0.46–1.15)
0.170
40–49%
80 (28)
0.72 (0.42–1.22)
0.217
101 (36)
0.67 (0.42–1.05)
0.083
50–59%
141 (29)
0.71 (0.42–1.18)
0.184
187 (39)
0.70 (0.45–1.08)
0.110
≥60%
94 (27)
0.67 (0.40–1.14)
0.139
125 (36)
0.65 (0.41–1.03)
0.065
AF, atrial fibrillation; CAD, coronary artery disease; CI, confidence interval; COPD, chronic obstructive pulmonary disease; OSA, obstructive sleep apnoea; LVEF, left ventricular ejection fraction; VHD, valvular heart disease.
Adjusted for age and sex.
Figure 2
Survival curves of heart failure patients stratified according to LVEF‐based classifications or LVEF‐independent phenogroup‐based classification. Survival curves for all‐cause death or rehospitalization at 6 months, adjusted for age and sex. P value from log‐rank test. Survival differs significantly across groups using the LVEF‐independent phenogroup‐based classification (A) but not in LVEF‐based classifications (B,C). (A) Kaplan–Meier curves stratified according to phenogroups. (B) Kaplan–Meier curves stratified according to the three guideline‐recommended LVEF categories, reduced, mid‐range, and preserved EF. (C) Kaplan–Maier curves according to six LVEF categories (per 10%). AF, atrial fibrillation; CAD, coronary artery disease; COPD, chronic obstructive pulmonary disease; EF, ejection fraction; LVEF, left ventricular ejection fraction; OSA, obstructive sleep apnoea; VHD, valvular heart disease.
Figure 3
Survival curves of heart failure patients stratified according to LVEF‐based classifications or LVEF‐independent phenogroup‐based classification. Survival curves for all‐cause death or rehospitalization at 12 months, adjusted for age and sex. P value from log‐rank test. Survival differs significantly across groups using the LVEF‐independent phenogroup‐based classification (A) but not in LVEF‐based classifications (B,C). (A) Kaplan–Meier curves stratified according to phenogroups. (B) Kaplan–Meier curves stratified according to the three guideline‐recommended LVEF categories, reduced, mid‐range, and preserved EF. (C) Kaplan–Meier curves according to six LVEF categories (per 10%). AF, atrial fibrillation; CAD, coronary artery disease; COPD, chronic obstructive pulmonary disease; EF, ejection fraction; LVEF, left ventricular ejection fraction; OSA, obstructive sleep apnoea; VHD, valvular heart disease.
Primary and secondary clinical outcomes according to LVEF categories or LVEF‐independent clinical phenogroupsAF, atrial fibrillation; CAD, coronary artery disease; CI, confidence interval; COPD, chronic obstructive pulmonary disease; OSA, obstructive sleep apnoea; LVEF, left ventricular ejection fraction; VHD, valvular heart disease.Adjusted for age and sex.Survival curves of heart failure patients stratified according to LVEF‐based classifications or LVEF‐independent phenogroup‐based classification. Survival curves for all‐cause death or rehospitalization at 6 months, adjusted for age and sex. P value from log‐rank test. Survival differs significantly across groups using the LVEF‐independent phenogroup‐based classification (A) but not in LVEF‐based classifications (B,C). (A) Kaplan–Meier curves stratified according to phenogroups. (B) Kaplan–Meier curves stratified according to the three guideline‐recommended LVEF categories, reduced, mid‐range, and preserved EF. (C) Kaplan–Maier curves according to six LVEF categories (per 10%). AF, atrial fibrillation; CAD, coronary artery disease; COPD, chronic obstructive pulmonary disease; EF, ejection fraction; LVEF, left ventricular ejection fraction; OSA, obstructive sleep apnoea; VHD, valvular heart disease.Survival curves of heart failure patients stratified according to LVEF‐based classifications or LVEF‐independent phenogroup‐based classification. Survival curves for all‐cause death or rehospitalization at 12 months, adjusted for age and sex. P value from log‐rank test. Survival differs significantly across groups using the LVEF‐independent phenogroup‐based classification (A) but not in LVEF‐based classifications (B,C). (A) Kaplan–Meier curves stratified according to phenogroups. (B) Kaplan–Meier curves stratified according to the three guideline‐recommended LVEF categories, reduced, mid‐range, and preserved EF. (C) Kaplan–Meier curves according to six LVEF categories (per 10%). AF, atrial fibrillation; CAD, coronary artery disease; COPD, chronic obstructive pulmonary disease; EF, ejection fraction; LVEF, left ventricular ejection fraction; OSA, obstructive sleep apnoea; VHD, valvular heart disease.LVEF‐based groupings—either three or six categories—did not stratify clinical outcomes well, whether at 6 or 12 month outcomes (all P > 0.05, Table
, Figures
,
, S4B,C, and S5B,C). The exception was LVEF ≥50% in the three‐class grouping, which showed significantly less cardiovascular deaths or HF readmissions (HR 0.75, CI 0.62–0.92, P = 0.005).
Discussion
In this cohort of 1693 patients hospitalized for HF and enrolled in the Patient‐Centered Care Transitions in HF multicentre randomized clinical trial, we found that an unsupervised machine learning approach separated patients according to different comorbidity profiles or phenogroups, each of which included patients across the LVEF spectrum. The classification of patients by clinical phenogroups and independent of LVEF resulted in greater separation of clusters and better association with clinical outcomes at 6 and 12 months than classification based on LVEF categories. This pertained to both all‐cause and HF readmissions, and all‐cause and CV death. These results suggest that classifying HF patients based on clinical characteristics rather than LVEF categories provides relevant prognostic information, and that comorbidities are major drivers of outcomes in HF patients. Figure
summarizes our findings.
Figure 4
Summary of the study findings. We analysed baseline characteristics of 1693 patients with heart failure included in the Patient‐Centered Care Transitions in Heart Failure randomized clinical trial. Clustering analysis independent of LVEF, better separated survival curves, provided more information and less overlap of clinical phenogroups compared to guideline‐recommended subdivision in three LVEF‐based categories. Through clustering analysis, we found six clinical phenogroups mainly based on comorbidities. COPD, chronic obstructive pulmonary disease; HFmrEF, heart failure with mid‐range ejection fraction; HFpEF, heart failure with preserved ejection fraction; HFrEF, heart failure with reduced ejection fraction; HR, hazard ratio; LVEF, left ventricular ejection fraction.
Summary of the study findings. We analysed baseline characteristics of 1693 patients with heart failure included in the Patient‐Centered Care Transitions in Heart Failure randomized clinical trial. Clustering analysis independent of LVEF, better separated survival curves, provided more information and less overlap of clinical phenogroups compared to guideline‐recommended subdivision in three LVEF‐based categories. Through clustering analysis, we found six clinical phenogroups mainly based on comorbidities. COPD, chronic obstructive pulmonary disease; HFmrEF, heart failure with mid‐range ejection fraction; HFpEF, heart failure with preserved ejection fraction; HFrEF, heart failure with reduced ejection fraction; HR, hazard ratio; LVEF, left ventricular ejection fraction.The LVEF has served as an inclusion criterion for HF clinical trials, is recommended in guidelines to classify HF, and is a practical parameter to guide treatment decisions in HF; however, this classification approach has some disadvantages. First, LVEF estimates vary between techniques and repeat measurements, but are often treated as absolute.
,
Patients with an LVEF just above an established threshold for treatment may be denied HF therapies without recognition of the variation in LVEF estimates. Second, many epidemiological, pathophysiological, and clinical features are shared between patients with HFrEF, HFmrEF, and HFpEF. Similar pathophysiologic mechanisms across the LVEF spectrum include endothelial dysfunction, neurohumoral activation, myocardial fibrosis, and skeletal myopathy, among others.
,
Abnormalities of diastolic function are universally present in HFrEF, and systolic dysfunction—as evidenced by a reduction of global longitudinal strain and cardiac output reserve—is often present in HFpEF.
Activation of the renin–angiotensin–aldosterone system is not restricted to HFrEF,
yet therapies targeting the renin–angiotensin–aldosterone system are largely recommended for those with LVEF <40% based on the inclusion criterion used in historic HF trials.
Third, the relation of lower LVEF with increased mortality is only maintained until an LVEF of 45%. Above this value, LVEF is an unreliable prognosticator of mortality.
This may be due, in part, to increasing heterogeneity and varying pathophysiology among patients at the higher end of the LVEF spectrum.Our LVEF‐independent, phenotype‐driven approach provided the most information about patients, facilitated better separation between groups of patients (Figure
, Table S4), and better identified patients at risk for all‐cause rehospitalization and death as well as HF rehospitalization and CV death than LVEF‐based groupings (Table
, Figure
,
, S4, and S5). Our analysis confirms that comorbidities are a major driver of outcomes, regardless of LVEF. Our findings are consistent with previous studies that demonstrated an association between underlying comorbidities and outcomes in HF.
,
,
,
Among patients with HF, those with CAD had a similar mortality risk but increased risk of HF hospitalization as those without CAD
; those with AF had an increased risk of mortality than those without AF
; and those with COPD and OSA had and increased risk of mortality than those without COPD or OSA.
,
These associations were often independent of LVEF.We recognize that any phenogroup classification system that labels categories on the basis of a single comorbidity is simplistic and that comorbidities overlap between groups.
For example, the prevalence of AF in the VHD phenogroup was 61%, and the prevalence of CAD in the COPD and OSA groups was approximately 37%. This reflects the high burden of comorbidities in patients hospitalized with HF. However, the clustering algorithm determined, in an unsupervised manner, that patients with concurrent VHD and AF are more similar to patients with VHD alone than to patients with AF alone. The outcome analysis confirms that outcomes of HF patients with VHD (with or without AF) are significantly worse than outcomes of HF patients with AF (and no VHD).Our approach differs from prior approaches, which used artificial intelligence to provide a better separation of categories in patients with HF, but results are consistent overall.
,
,
,
,
Some of the previous models were trained a priori to predict clinical outcomes, thus satisfying a self‐fulfilling prophecy: groupings were based on clinical outcomes, and naturally performed better than LVEF at prediction.
The phenogroup approach in prior studies was also limited by the need to input dozens of complex variables to classify a patient.
,
,
Our analysis is different as it only included baseline patient characteristics—and not outcomes—in the clustering model; thus, it was not designed to predict outcomes. However, subsequent linkages to clinical outcomes proved that this unbiased, LVEF‐independent classification was superior to LVEF‐based classification in predicting outcomes. Additionally, our randomized clinical trial database provided granular characteristics, including contemporaneous LVEF and a 5 year lookback of comorbidities. Finally, linkage to provincial databases provided a wealth of clinical outcomes (all‐cause, CV, and HF events), while previous registry‐type datasets were typically limited to all‐cause death.The goal of our analysis was not to develop a risk prediction model, but to explore HF phenotypes and their associations with outcomes relative to an LVEF based classification system. As such, we did not formally compare our phenotype‐based approach to existing risk scores. The performance of this phenotype‐based classification scheme relative to validated risk models in HF
,
is unknown and the subject of further investigation. We have demonstrated in a prior work that simple clinical risk prediction indices can predict clinical outcomes with similar or better performance than complex and validated risk prediction scores in HF,
,
and it is possible that this simple phenotype‐based classification scheme may also compare favourably.Our findings have important applications. The external validation of our classification scheme is underway, and the results will inform the development of a decision tree to guide the risk assessment in patients hospitalized with HF. The classification scheme may also be useful to select subgroups of patients who are likely to respond to HF therapies in clinical trials, particularly within traditional categories that have been difficult to demonstrate treatment efficacy in. For example, few therapeutic options exist for patients with HFmrEF and HFpEF, and phenotype‐based selection criteria may be an effective way to facilitate homogeneity and response to targeted treatments in clinical trials.
,
We describe several phenogroups at higher risk of cardiovascular events, across the LVEF spectrum, which could inform design of future trials. Whether certain phenogroups respond differently to guideline‐directed medical therapy remains unknown but possible, and this should be explored in future trials.This study has some limitations. First, LVEF was sometimes obtained from a recent—rather than current—echocardiogram or nuclear ventriculogram. Second, we included a relatively large amount of categorical variables, which limited the number of combinations that can be produced in a hierarchy. Incorporation of more baseline characteristics, including other echocardiographic variables, could have further improved cluster‐based classification of HF patients. Hierarchical clustering algorithms such as the one used in this study tend to prioritize categorical variables over continuous variables and other clustering algorithms could have been considered to avoid prioritizing categorical variables.
We chose Gower's distance and hierarchical clustering because this combination could handle categorical variables and missing values. This approach combined good prognostic capability with ease of application to different HF populations, without the need for difficult algorithms. Third, event rates could have been impacted by factors not captured in our database, such as adherence to medical therapy and quality of care. Finally, we realize that our findings may not be generalizable to other populations. Patients in this pragmatic clinical trial were hospitalized for HF and may have had a comorbidity profile distinct from those in ambulatory care. External validation should be performed before clinical application.
Conclusion
In this sub‐study of the PACT‐HF trial that included patients hospitalized for HF, we found that unbiased classification of baseline characteristics through hierarchical cluster analysis (unsupervised machine learning) resulted in six phenogroups of patients characterized by different comorbidity profiles. While there were LVEF differences between phenogroups, the entire LVEF spectrum was represented in each phenogroup. The phenogroup classification provided superior prognostic information for all‐cause and CV endpoints at 6 months and 1 year compared with classification based on three or six LVEF categories. These findings suggest that comorbidities are major drivers of prognosis in HF patients. While LVEF remains a practical tool for therapeutic decision making in HF, our data suggest that phenogroup‐based classification may better inform the clinician about the risk of future events. In addition to external validation, future studies should focus on identifying treatment‐responsive phenogroups in an effort to more precisely guide treatment decisions.
Funding
The Patient‐Centered Care Transitions in Heart Failure trial was supported by peer‐reviewed grants from the Canadian Institutes of Health Research (135917) to H.G.C.V.; and Ontario Ministry of Health and Long‐Term Care Health System Research Fund (6686) to H.G.C.V.; as well as in‐kind support from the participating hospitals; Community Care Access Centers; and Roche Diagnostics. H.G.C.V. is supported by the Hamilton Health Sciences Career Award. This study was supported by ICES, which is funded by an annual grant from the Ontario Ministry of Health and Long‐Term Care (MOHLTC). Parts of this material are based on data and information compiled and provided by MOHLTC, Canadian Institute for Health Information, and IQVIA Canada. The analyses, conclusions, opinions, and statements expressed herein are solely those of the authors and do not reflect those of the funding or data sources; no endorsement is intended or should be inferred.
Conflicts of interest
None declared.Table S1. Provincial databases used for baseline characteristics and outcomes.Table S2. Baseline characteristics stratified according to LVEF categories.Table S3. Multivariable linear regression model assessing independent associations between baseline characteristics and LVEF.Table S4. Statistics assessing cluster properties.Figure S1. Distribution of LVEF across the study population.Figure S2. Metrics indicating the ideal number of clusters in the LVEF‐independent analysis.Figure S3. LVEF for each phenogroup.Figure S4. Survival curves for secondary outcome at 6 months.Figure S5. Survival curves for secondary outcome at 12 monthsClick here for additional data file.
Authors: Harriette G C Van Spall; Shun Fu Lee; Feng Xie; Urun Erbas Oz; Richard Perez; Peter R Mitoff; Manish Maingi; Michael C Tjandrawidjaja; Michael Heffernan; Mohammad I Zia; Liane Porepa; Mohamed Panju; Lehana Thabane; Ian D Graham; R Brian Haynes; Dilys Haughton; Kim D Simek; Dennis T Ko; Stuart J Connolly Journal: JAMA Date: 2019-02-26 Impact factor: 56.272
Authors: Lars H Lund; Brian Claggett; Jiankang Liu; Carolyn S Lam; Pardeep S Jhund; Giuseppe M Rosano; Karl Swedberg; Salim Yusuf; Christopher B Granger; Marc A Pfeffer; John J V McMurray; Scott D Solomon Journal: Eur J Heart Fail Date: 2018-02-12 Impact factor: 15.534
Authors: Scott D Solomon; Brian Claggett; Eldrin F Lewis; Akshay Desai; Inder Anand; Nancy K Sweitzer; Eileen O'Meara; Sanjiv J Shah; Sonja McKinlay; Jerome L Fleg; George Sopko; Bertram Pitt; Marc A Pfeffer Journal: Eur Heart J Date: 2015-09-15 Impact factor: 29.983
Authors: Scott D Solomon; Muthiah Vaduganathan; Brian L Claggett; Milton Packer; Michael Zile; Karl Swedberg; Jean Rouleau; Marc A Pfeffer; Akshay Desai; Lars H Lund; Lars Kober; Inder Anand; Nancy Sweitzer; Gerard Linssen; Bela Merkely; Juan Luis Arango; Dragos Vinereanu; Chen-Huan Chen; Michele Senni; Antonio Sibulo; Sergey Boytsov; Victor Shi; Adel Rizkala; Martin Lefkowitz; John J V McMurray Journal: Circulation Date: 2019-11-17 Impact factor: 29.690
Authors: David P Kao; James D Lewsey; Inder S Anand; Barry M Massie; Michael R Zile; Peter E Carson; Robert S McKelvie; Michel Komajda; John J V McMurray; JoAnn Lindenfeld Journal: Eur J Heart Fail Date: 2015-08-06 Impact factor: 15.534
Authors: John G F Cleland; Karina V Bunting; Marcus D Flather; Douglas G Altman; Jane Holmes; Andrew J S Coats; Luis Manzano; John J V McMurray; Frank Ruschitzka; Dirk J van Veldhuisen; Thomas G von Lueder; Michael Böhm; Bert Andersson; John Kjekshus; Milton Packer; Alan S Rigby; Giuseppe Rosano; Hans Wedel; Åke Hjalmarson; John Wikstrand; Dipak Kotecha Journal: Eur Heart J Date: 2018-01-01 Impact factor: 29.983
Authors: Jasper Tromp; Wan Ting Tay; Wouter Ouwerkerk; Tiew-Hwa Katherine Teng; Jonathan Yap; Michael R MacDonald; Kirsten Leineweber; John J V McMurray; Michael R Zile; Inder S Anand; A Mark Richards; Carolyn S P Lam Journal: PLoS Med Date: 2018-03-27 Impact factor: 11.069
Authors: Patricia A Pellikka; Lilin She; Thomas A Holly; Grace Lin; Padmini Varadarajan; Ramdas G Pai; Robert O Bonow; Gerald M Pohost; Julio A Panza; Daniel S Berman; David L Prior; Federico M Asch; Salvador Borges-Neto; Paul Grayburn; Hussein R Al-Khalidi; Karol Miszalski-Jamka; Patrice Desvigne-Nickens; Kerry L Lee; Eric J Velazquez; Jae K Oh Journal: JAMA Netw Open Date: 2018-08-03
Authors: Andreas B Gevaert; Semra Tibebu; Mamas A Mamas; Neal G Ravindra; Shun Fu Lee; Tariq Ahmad; Dennis T Ko; James L Januzzi; Harriette G C Van Spall Journal: ESC Heart Fail Date: 2021-05-02
Authors: Andreas B Gevaert; Stephan Mueller; Ephraim B Winzer; André Duvinage; Caroline M Van de Heyning; Elisabeth Pieske-Kraigher; Paul J Beckers; Frank Edelmann; Ulrik Wisløff; Burkert Pieske; Volker Adams; Martin Halle; Emeline M Van Craenenbroeck Journal: Front Physiol Date: 2022-02-10 Impact factor: 4.566
Authors: Andreas B Gevaert; Semra Tibebu; Mamas A Mamas; Neal G Ravindra; Shun Fu Lee; Tariq Ahmad; Dennis T Ko; James L Januzzi; Harriette G C Van Spall Journal: ESC Heart Fail Date: 2021-05-02