Literature DB >> 32720083

Machine learning versus conventional clinical methods in guiding management of heart failure patients-a systematic review.

George Bazoukis1, Stavros Stavrakis2, Jiandong Zhou3,4, Sandeep Chandra Bollepalli5, Gary Tse6, Qingpeng Zhang3,4, Jagmeet P Singh7, Antonis A Armoundas8,9.   

Abstract

Machine learning (ML) algorithms "learn" information directly from data, and their performance improves proportionally with the number of high-quality samples. The aim of our systematic review is to present the state of the art regarding the implementation of ML techniques in the management of heart failure (HF) patients. We manually searched MEDLINE and Cochrane databases as well the reference lists of the relevant review studies and included studies. Our search retrieved 122 relevant studies. These studies mainly refer to (a) the role of ML in the classification of HF patients into distinct categories which may require a different treatment strategy, (b) discrimination of HF patients from the healthy population or other diseases, (c) prediction of HF outcomes, (d) identification of HF patients from electronic records and identification of HF patients with similar characteristics who may benefit form a similar treatment strategy, (e) supporting the extraction of important data from clinical notes, and (f) prediction of outcomes in HF populations with implantable devices (left ventricular assist device, cardiac resynchronization therapy). We concluded that ML techniques may play an important role for the efficient construction of methodologies for diagnosis, management, and prediction of outcomes in HF patients.

Entities:  

Keywords:  Deep learning; Heart failure; Machine learning

Mesh:

Year:  2021        PMID: 32720083      PMCID: PMC7384870          DOI: 10.1007/s10741-020-10007-3

Source DB:  PubMed          Journal:  Heart Fail Rev        ISSN: 1382-4147            Impact factor:   4.214


Introduction

Heart failure (HF) is a clinical syndrome characterized by dyspnea, fatigue, and clinical signs of congestion leading to frequent hospitalizations, poor quality of life, and shortened life expectancy [1, 2]. HF is a global pandemic that affects approximately 1–2% of the adult population in developed countries [3], around 26 million people worldwide [4], rising to ≥ 10% among people > 70 years of age [3], while the considerable HF health expenditures (~ $31 billion, in the USA in 2012) [5] are expected to sharply increase with an aging population. Despite advancements in medical, device-based, and surgical management of HF, outcomes remain non-satisfactory even in Western developed countries [6]. Evidently, emphasis in investigating efficient research methodologies for HF management is one of the leading study directions that cannot be overlooked [7]. Recently, machine learning (ML) algorithms have used computational methods to “learn” information directly from data, and their performance has been shown to improve proportionally with the number of high-quality samples [8]. ML algorithms have been applied in different aspects of medicine [9, 10], including earlier disease detection [11, 12], improve diagnosis accuracy [13-16], identification of new physiological observations or patterns [17], development of personalized diagnostics and/or therapeutic approaches [18, 19], research purposes [20], etc. The aim of this systematic review is to present the state of the art regarding the utility of ML techniques in comparison with conventional methods, in improving outcomes in HF patients.

Methods

This systematic review was guided by the PRISMA statement for systematic reviews and meta-analyses [21].

Machine learning architectures

Machine learning is an emerging technology paradigm that enables computers to learn patterns and insights from the data without being explicitly programmed. Details of ML algorithms adopted for managing HF patients are provided in the Online Supplement.

Search strategy

MEDLINE and Cochrane library databases were manually searched (G.B., G.T.) without year or language restriction or any other limits until May 29, 2019. The following algorithm was used: “((Machine learning OR deep learning OR bayes OR regression tree OR k means clustering OR vector machine OR artificial neural networks OR random forests OR decision trees OR nearest neighbours) AND heart failure).” Furthermore, the reference list of all the included studies as well as relevant review articles were also searched.

Study inclusion/exclusion criteria

All studies that included data about the implementation of ML techniques in HF (diagnosis, severity classification, prediction of adverse outcomes, identification of HF patients in electronic records, etc.) were considered as relevant and included in the systematic review. Review studies, studies that did not include data regarding HF patients and studies in experimental models, were excluded either at the title/abstract or at the full-text level.

Data extraction and statistical analysis

The data extraction was performed by two independent investigators (G.B., J.Z.) and any disagreement was resolved by discussion. We used a recently proposed score by Qiao [22] for the quality assessment of ML studies (for details, please see the Online Supplement).

Results

Search results

As outlined in Supplementary Fig. 1, our search strategy revealed in total 122 relevant studies (one study provided data for two different outcomes [OS21]). Figure 1 summarizes the different areas of ML implementation in HF patients.
Fig. 1

Areas of application of machine learning in the management of heart failure patients

Areas of application of machine learning in the management of heart failure patients

Classification of HF patients

Our search retrieved four streams of studies regarding the implementation of ML techniques in patient classification, pertaining to HF with reduced ejection fraction (HFrEF), HF with preserved ejection fraction (HFpEF), and in different HFpEF subtypes. The variables for HF characteristics included demographics, clinical examination, laboratory exams, medical history, electrocardiographic data, echocardiographic data, and heart rate variability (HRV) (Supplementary Table 1). All studies were classified as intermediate-high quality (intermediate: 2 studies, high: 2 studies) in the quality assessment (Supplementary Table 9). This suggests that the provided outcomes are less prone to different kinds of bias. Modern classification methods have shown a better performance over conventional classification methods that could lead to better management in clinical practice (Table 1).
Table 1

Comparison of machine learning algorithms with traditional methods in the management of heart failure

AuthorJournalYearOutcomeComparison between machine learning and conventional methodsConclusion
Machine learning modelsConventional methods
Classification of HF patients
  Austin PCJournal of Clinical Epidemiology2013

Discrimination

HFpEF vs HFrEF

ModelAUCModelAUCConventional LR performed at least as well as modern methods
Regression tree0.683LR0.780
Bagged regression tree0.733
Random forest0.751
Boosted regression tree (depth 1)0.752
Boosted regression tree (depth 2)0.768
Boosted regression tree (depth 3)0.772
Boosted regression tree (depth 4)0.774
CRT response
  Kalscheur MMCirc Arrhythm Electropysiol2018All-cause mortality or HF hospitalization in CRT recipients

AUC values

RF model (0.74, 95% CI 0.72–0.76)

Sequential minimal optimization to train a SVM (0.67, 95% CI 0.65–0.68)

AUC values

Multivariate LR (0.67, 95% CI 0.65–0.69)

The improvement in AUC for the RF model was statistically significant compared to the other models, p < 0.001
Data extraction
  Zhang RBMC Med Inform Decis Mak2018HF information (NYHA) extraction from clinical notesRF, n-gram features → F-measure 93.78%, recall 92.23%, precision 95.40%, SVM → F-measure 93.52%, recall 93.21%, precision 93.84%LR → F-measure 90.42%, recall 90.82%, precision 90.03%ML-based methods outperformed a rule-based method. The best machine learning method was an RF
HF diagnosis
  Nirschi JJPlosOne2018HF diagnosis using biopsy images

AUC value

RF 0.952

Deep learning 0.974

AUC value

Pathologists 0.75

ML models outperformed conventional methods
  Rasmy LJ Biomed Inform2018HF diagnosis

AUC value

Recurrent NN 0.822

AUC value

LR 0.766

ML outperformed conventional methods
  Son CSJ Biomed Inform2012HF diagnosisRough sets based decision-making model → accuracy 97.5%, SENS 97.2%, SPE 97.7%, PPV 97.2%, NPV 97.7%, AUC 97.5%LR-based decision-making model → accuracy 88.7%, SENS 90.1%, SPE 87.5%, PPV 85.3%, NPV 91.7%, AUC 88.8%ML models outperformed conventional methods
  Wu JMed Care2010HF diagnosisBoosting using a less strict cut-off had better performance compared to SVMThe highest median AUC (0.77) was observed for LR with Bayesian information criterionLR and boosting were, both, superior to SVM
Identification of HF patients
  Blecker SJAMA Cardiology2016Identification of HF patientsML using notes and imaging reports → (developmental set) AUC 99%, SENS 92%, PPV 80%. (Validation SET) AUC 97%, SENS 84%, PPV 80%LR using structured data → (developmental set) AUC 96%, SENS 78%, PPV 80%. (Validation SET) AUC 95%, SENS 76%, PPV 80%ML models improved identification of HF patients
  Blecker SJ Card Fail2018Identification of HF hospitalizationML with use of both data → (developmental set) AUC 99%, SENS 98%, PPV 43%. (Validation SET) AUC 99%, SENS 98%, PPV 34%LR using structured data, notes, and imaging reports → (developmental set) AUC 96%, SENS 98%, PPV 14%. (Validation SET) AUC 96%, SENS 98%, PPV 15%ML models performed better in identifying decompensated HF
  Choi EJournal of AMIA2017Predicting HF diagnosis from EHR

AUC values

12-month observation →

NN model 0.777

MLP with 1 hidden layer 0.765

SVM 0.743

K-NN 0.730

AUC values

12-month observation →

LR 0.747

ML models performed better in detecting incident HF with a short observation window of 12–18 months
Prediction of outcomes
  Austin PCBiom J201230-day mortality

AUC values

Regression tree 0.674

Bagged trees 0.713

Random forests 0.752

Boosted trees—depth one 0.769

Boosted trees—depth two 0.788

Boosted trees—depth three 0.801

Boosted trees—depth four 0.811

AUC values

LR 0.773

Ensemble methods from the data mining and ML literature increase the predictive performance of regression trees, but may not lead to clear advantages over conventional LR models
  Austin PCJ Clin Epidemiol2010In-hospital mortality

AUC values

LR models

Regression trees 0.620–0.651

AUC values

LR 0.747–0.775

LR predicted in-hospital mortality in patients hospitalized with HF more accurately than did the regression trees
  Awan SEESC Heart Failure201930-day readmissions

AUC values

MLP 0.62

Weighted random forest 0.55

Weighted decision trees 0.53

Weighted SVM models 0.54

AUC values

LR 0.58

The proposed MLP-based approach is superior to other ML and regression techniques
  Fonarow GCJAMA2005In-hospital mortality

AUC values

CART model (derivation cohort 68.7%; validation cohort 66.8%)

AUC values

LR model (derivation cohort 75.9%; validation cohort 75.7%)

Based on AUC, the accuracy of the CART model (derivation cohort 68.7%; validation cohort 66.8%) was modestly less than that of the more complicated LR model (derivation cohort75.9%; validation cohort 75.7%)
  Frizzell JDJAMA Cardiol201630-day readmissions

C-statistics

Tree-augmented naive Bayesian network 0.618

RF 0.607

Gradient-boosted 0.614

Least absolute shrinkage and selection operator models 0.618

C-statistics

LR 0.624

ML methods showed limited predictive ability
  Golas SBBMC Med Inform Decis Mak201830-day readmissions

AUC values

Gradient boosting 0.650 ± 0.011

Maxout networks 0.695 ± 0.016

Deep unified networks 0.705 ± 0.015

AUC values

LR 0.664 ± 0.015

Deep learning techniques performed better than other traditional techniques
  Hearn JCirc Heart Fail2018Clinical deterioration (i.e., the need for mechanical circulatory support, listing for heart transplantation, or mortality from any cause)

AUC values

ppVo2 0.800 (0.753–0.838)

Staged LASSO 0.827 (0.785–0.867)

Staged NN 0.835 (0.795–0.880)

BxB LASSO 0.816 (0.767–0.866)

BxB NN 0.842 (0.794–0.882)

AUC values

CPET risk score 0.759 (0.709–0.799)

NN incorporating breath-by-breath data achieved the best performance
  Kwon JMEchocardiography2019Hospital mortality

AUC values

Deep learning 0.913

RF 0.835

AUC values

LR 0.835

MAGGIC score 0.806

GWTG score 0.783

The echocardiography-based deep learning model predicted in-hospital mortality among HD patients more accurately than existing prediction models
  Phillips KTAMIA Annu Symp Proc2005Mortality

AUC levels

Nearest neighbor 0.823

NN 0.802

Decision tree 0.4975

AUC values

Stepwise LR 0.734

Data mining methods outperform multiple logistic regression and traditional epidemiological methods
  Mortazavi BJCirc Cardiovasc Qual Outcomes2016HF readmissions

C-statistics

Boosting 0.678

C-statistics

LR 0.543

Boosting improved the c-statistic by 24.9% over LR
  Myers JInt J Cardiol2014Cardiovascular death

AUC values

Artificial NN 0.72

Cox PH models 0.69

AUC values

LR 0.70

An artificial NN model slightly improves upon conventional methods
  Panahiazar MStud Health Technol Inform20155-year mortality

AUC values

RF 62% (baseline set), 72% (extended set)

Decision tree 50% (baseline set), 50% (extended set)

SVM 55% (baseline set), 38% (extended set)

AdaBoost 61% (baseline set), 68% (extended set)

AUC values

LR 61% (baseline set), 73% (extended set)

LR and RF return more accurate models
  Subramanian DCirc Heart Fail20111-year mortality

C-statistics

Ensemble model using gentle boosting with 10-fold cross-validation 84%

C-statistics

Μultivariate LR model using time-series cytokine

Measurements 81%

The ensemble model showed significantly better performance
  Taslimitehrani VJ Biomed Inform20165-year survival

Precision

SVM 0.2,

CPXR (log) 0.721

Recall

SVM 0.5

CPXR (log) 0.615

Accuracy

SVM 0.66

CPXR 0.809

Precision

LR 0.513

Recall

LR 0.506

Accuracy

LR 0.717

CPXR is better than logistic regression, SVM, random forest and AdaBoost
  Turgeman LArtif Intell Med2016Hospital readmissions

AUC values

NN 0.589 (train), 0.639 (test)

Naïve Bayes 0.699 (train), 0.676 (test)

SVM 0.768 (train), 0.643 (test)

CART decision tree 0.529 (train), 0.556 (test)

Ensemble models C5 0.714 (train), 0.693 (test)

CHAID decision tree 0.671 (train), 0.691 (test)

AUC values

LR 0.642 (train), 0.699 (test)

A dynamic mixed-ensemble model combines a boosted C5.0 model as the base ensemble classifier and SVM model as a secondary classifier to control classification error for the minority class
  Wong WScientific World Journal2003Mortality (365 days models)

AUC values

MLP 69%

Radial basis function 67%

AUC values

LR 60%

NNs are able to outperform the LR in terms of sample prediction
  Yu SArtif Intell Med201530-day HF readmissions

AUC values

Linear SVM 0.65

Poly SVM 0.61

Cox PH 0.63

AUC values

Industry standard method (LACE) 0.56

The ML models performed better compared to standard method
  Zhang JInt J Cardiol2013Death or hospitalization

AUC values

Decision trees 79.7%

AUC values

LR 73.8%

Decision trees tended to perform better than LR models
  Zhu KMethods Inf Med201530-day readmissions

AUC values

RF 0.577

SVM 0.560

Conditional LR 1 = 0.576

Conditional LR 2 = 0.608

Conditional LR 3 = 0.615

AUC values

Standard LR 0.547

Stepwise LR 0.539

LR after combining ML outperforms standard classification models
  Zolfaghar KIn 2013 IEEE International Conference on Big Data2013HF readmissions

AUC values

Multicare health systems model

RF 62.25%

AUC values

Multicare health systems model

LR 63.78%

Yale model

LR 59.72%

ML random forest model does not outperform traditional LR model

AUC area under the receiver operating curve, CPET cardiopulmonary exercise test, HF heart failure, LR logistic regression, ML machine learning, MLP multilayer perceptron, NN neural networks, NPV negative prognostic value, PH proportional hazard, PPV positive prognostic value, ppVo2 predicted peak oxygen uptake, RF random forest, SENS sensitivity, SPE specificity, SVM support vector machine

Comparison of machine learning algorithms with traditional methods in the management of heart failure Discrimination HFpEF vs HFrEF AUC values RF model (0.74, 95% CI 0.72–0.76) Sequential minimal optimization to train a SVM (0.67, 95% CI 0.65–0.68) AUC values Multivariate LR (0.67, 95% CI 0.65–0.69) AUC value RF 0.952 Deep learning 0.974 AUC value Pathologists 0.75 AUC value Recurrent NN 0.822 AUC value LR 0.766 AUC values 12-month observation → NN model 0.777 MLP with 1 hidden layer 0.765 SVM 0.743 K-NN 0.730 AUC values 12-month observation → LR 0.747 AUC values Regression tree 0.674 Bagged trees 0.713 Random forests 0.752 Boosted trees—depth one 0.769 Boosted trees—depth two 0.788 Boosted trees—depth three 0.801 Boosted trees—depth four 0.811 AUC values LR 0.773 AUC values LR models Regression trees 0.620–0.651 AUC values LR 0.747–0.775 AUC values MLP 0.62 Weighted random forest 0.55 Weighted decision trees 0.53 Weighted SVM models 0.54 AUC values LR 0.58 AUC values CART model (derivation cohort 68.7%; validation cohort 66.8%) AUC values LR model (derivation cohort 75.9%; validation cohort 75.7%) C-statistics Tree-augmented naive Bayesian network 0.618 RF 0.607 Gradient-boosted 0.614 Least absolute shrinkage and selection operator models 0.618 C-statistics LR 0.624 AUC values Gradient boosting 0.650 ± 0.011 Maxout networks 0.695 ± 0.016 Deep unified networks 0.705 ± 0.015 AUC values LR 0.664 ± 0.015 AUC values ppVo2 0.800 (0.753–0.838) Staged LASSO 0.827 (0.785–0.867) Staged NN 0.835 (0.795–0.880) BxB LASSO 0.816 (0.767–0.866) BxB NN 0.842 (0.794–0.882) AUC values CPET risk score 0.759 (0.709–0.799) AUC values Deep learning 0.913 RF 0.835 AUC values LR 0.835 MAGGIC score 0.806 GWTG score 0.783 AUC levels Nearest neighbor 0.823 NN 0.802 Decision tree 0.4975 AUC values Stepwise LR 0.734 C-statistics Boosting 0.678 C-statistics LR 0.543 AUC values Artificial NN 0.72 Cox PH models 0.69 AUC values LR 0.70 AUC values RF 62% (baseline set), 72% (extended set) Decision tree 50% (baseline set), 50% (extended set) SVM 55% (baseline set), 38% (extended set) AdaBoost 61% (baseline set), 68% (extended set) AUC values LR 61% (baseline set), 73% (extended set) C-statistics Ensemble model using gentle boosting with 10-fold cross-validation 84% C-statistics Μultivariate LR model using time-series cytokine Measurements 81% Precision SVM 0.2, CPXR (log) 0.721 Recall SVM 0.5 CPXR (log) 0.615 Accuracy SVM 0.66 CPXR 0.809 Precision LR 0.513 Recall LR 0.506 Accuracy LR 0.717 AUC values NN 0.589 (train), 0.639 (test) Naïve Bayes 0.699 (train), 0.676 (test) SVM 0.768 (train), 0.643 (test) CART decision tree 0.529 (train), 0.556 (test) Ensemble models C5 0.714 (train), 0.693 (test) CHAID decision tree 0.671 (train), 0.691 (test) AUC values LR 0.642 (train), 0.699 (test) AUC values MLP 69% Radial basis function 67% AUC values LR 60% AUC values Linear SVM 0.65 Poly SVM 0.61 Cox PH 0.63 AUC values Industry standard method (LACE) 0.56 AUC values Decision trees 79.7% AUC values LR 73.8% AUC values RF 0.577 SVM 0.560 Conditional LR 1 = 0.576 Conditional LR 2 = 0.608 Conditional LR 3 = 0.615 AUC values Standard LR 0.547 Stepwise LR 0.539 AUC values Multicare health systems model RF 62.25% AUC values Multicare health systems model LR 63.78% Yale model LR 59.72% AUC area under the receiver operating curve, CPET cardiopulmonary exercise test, HF heart failure, LR logistic regression, ML machine learning, MLP multilayer perceptron, NN neural networks, NPV negative prognostic value, PH proportional hazard, PPV positive prognostic value, ppVo2 predicted peak oxygen uptake, RF random forest, SENS sensitivity, SPE specificity, SVM support vector machine

Discrimination of HF patients from subjects with no HF

Our search retrieved 30 studies regarding the discrimination of HF patients, from subjects with no HF (Supplementary Table 2). All studies were classified as intermediate-high quality (intermediate: 14 studies, high: 16 studies) in the quality assessment (Supplementary Table 9), suggesting that the provided outcomes are less prone to different kinds of bias (Table 1). The general process of ML techniques for HF discrimination in a non-acute setting is to estimate the probability of HF based on prior clinical history of the patient, the presenting symptoms, physical examination, and resting electrocardiogram. Application of ML techniques for HF discrimination on the available data is less time consuming and more accurate than traditionally used statistics or expert methods. Accurate HF discrimination via ML techniques allows for treatments and interventions to be delivered in a more efficient and targeted way, permits assessment of the HF patient’s progress, prevents condition worsening, affects positively the patient’s health, and contributes to decrease of medical costs. The main difference between the ML methods for HF discrimination lies in the different heart rate variability features employed to detect HF. Sanchez-Martinez et al. (2017) used multiple kernel learning method to differentiate cardiac and non-cardiac cause of breathlessness and revealed processes leading to HFpEF with a specificity as high as 90.9% [OS42]. It should be noted that many ML studies found that feature selection determines the performance of the model, and thus automatic feature selection scheme is needed. Such automatic feature selection is also an advantage of the latest ML methods.

Prediction of outcomes

Our search retrieved 58 studies regarding the implementation of ML techniques in the prediction of major outcomes in HF patients. Specifically, the measured outcomes that were studied include mortality, hospitalizations, decompensations, implantable cardioverter defibrillator (ICD) implantations for secondary prevention, need for mechanical circulatory support, heart transplantation, pump failure, myocardial infarction, strokes, and ventricular assist device implantation (Supplementary Table 3). All studies were classified as intermediate-high quality (intermediate: 39 studies, high: 21 studies) in the quality assessment (Supplementary Table 9). This suggests that the provided outcomes are less prone to different kinds of bias (Table 1). Existing studies utilize demographic, clinical, laboratory, and electrocardiographic data (short-term or long-term HRV measures) as the main predictors and incorporate multiple classifiers such as support vector machine (SVM), classification and regression trees (CART), k-nearest neighbor algorithm (k-NN). These methods can work well separately, or collectively through certain ensemble learning techniques [23].

Identification of HF patients with similar characteristics from electronic medical records

Our search retrieved 6 studies regarding the role of ML techniques in the identification of HF patients from a pool of hospitalized patients or identification of patients with similar characteristics (Supplementary Table 4). All studies were classified as intermediate-high quality (intermediate: 2 studies, high: 4 studies) in the quality assessment (Supplementary Table 9), suggesting that the provided outcomes are less prone to different kinds of bias. Specifically, Cikes et al. (2019) used unsupervised machine learning-based phenogrouping in HF to provide a clinically meaningful classification of a phenotypically heterogeneous HF cohort by integrating clinical parameters and full heart cycle imaging data [OS127]. Pakhomov et al. (2007) used predictive ML techniques and language processing contained in the electronic medical records, to identify patients with HF with 96% specificity [OS114]. Panahiazar et al. (2015) developed a multidimensional patient similarity assessment technique to leverage multiple types of information from the electronic health records and predicted a medication plan for each new patient on a cohort of HF patients with area under the curve (AUC) of 0.74 [OS116]. Blecker et al. (2016) employed ML techniques and improved real-time identification of hospitalized patients with HF using both structured and unstructured electronic health records data, demonstrating high efficiency of ML analytics [OS112]. Although the accuracy varies, existing studies demonstrated that it is feasible to use ML to facilitate individualized interventions for hospitalized patients with HF. Real-time identification of HF syndrome among hospitalized individuals is of great importance, as it likely to result in improvement of patient care and outcomes. Use of ML techniques for the identification of HF patients from electronic medical records and identification of HF patients with similar characteristics may lead to delivery of more tailored clinical care.

Decision support from clinical notes

Another meaningful consideration for the implementation of ML techniques is the extraction of important clinical data from diverse sources of narrative text. Our search found 3 studies regarding this aim (Supplementary Table 5). All studies were classified as high quality in the quality assessment (Supplementary Table 9). Kim et al. (2013) improved HF information extraction through developing a natural language processing-based application to extract congestive HF treatment performance measures from echocardiographic reports (i.e., the source domain) with high recall and precision (92.4% and 95.3%, respectively) [OS117]. Meystre et al. (2017) demonstrated that the rich and detailed clinical information extracted from narrative notes may help improve management and outpatient treatment of HF patients [OS118]. Zhang et al. (2018) used random forest-based model to identify New York Heart Association (NYHA) class from clinical notes, with F-measure 93.78% [OS119]. The extracted clinical and medical information is critical to the understanding of a patient’s clinical and medication status for better healthcare safety and quality. Furthermore, these algorithms can identify patients who do not receive appropriate HF medications and thus may help reduce the number of undertreated patients (Table 1).

Prediction of outcomes in left ventricular assist device (LVAD) patients

Our search retrieved 7 studies that focused on the prediction of outcomes in LVAD patients (Supplementary Table 6). All studies were classified as high quality in the quality assessment (Supplementary Table 9). Loghmanpour et al. (2015) developed a Bayesian network-based risk stratification model to predict the short-term and long-term LVAD mortality with approximately 95% accuracy in predicting mortality at 30 days post-implant [OS120]. Mason et al. (2010) employed neural networks and waveform analysis methods for the non-invasive prediction of the pulsatile LVAD (HeartMate XVE (Thoratec Corporation, Pleasanton, CA)) pump failure within 30 days post-implantation [OS123]. Wang et al. (2012) found that the decision tree method can quantitatively provide improved prognosis of RV support through encoding the non-linear, synergic interactions among pre-operative variables, with an AUC of 0.87 [OS125]. The method can be used as an effective prognostic tool for triage of LVAD therapy. Lüneburg et al. (2019) used a U-net convolutional neural network for driveline tube segmentation and showed that the deep learning techniques can efficiently recognize LVAD on driveline exit site images [OS126]. Michaels and Cowger provide a review of the HF risk assessment as a referral guide for advanced HF therapies [24]. LVAD therapy is a life-saving treatment option as a destination therapy for end-stage HF patients who are ineligible for heart transplantation. However, the identification of high-risk patients who are prone to LVAD complications or adverse outcomes is crucial for patient selection who will benefit from this therapy (Table 1).

Prediction of cardiac resynchronization therapy response

Our search retrieved 5 studies regarding the role of ML techniques in CRT response prediction to overcome the challenge of significant nonresponse rates of current guidelines (Supplementary Table 7). All studies were classified as intermediate-high (intermediate: 1 study, high: 4 studies) quality in the quality assessment (Supplementary Table 9). Kalscheur et al. (2018) employed random forest method to predict cardiac resynchronization therapy outcomes and showed that the ML method can utilize the information of bundle branch block morphology and QRS duration to derive the risk of the composite end point of all-cause mortality or HF hospitalization [OS128]. Feeny et al. (2019) analyzed CRT patients using ML techniques and showed that the performance can be improved incrementally by adding up to nine variables demonstrating that ML models have the potential to improve the shared decision-making in CRT [OS131]. Due to the high percentage of non-responders to CRT therapy [25], the reported performance of ML algorithms in the prediction of patients who will benefit from this treatment option is of great clinical importance. The implementation of ML algorithms in clinical practice is expected reduce the number of CRT patients who will not benefit by this high cost treatment option who is related with higher rates of peri- and post-procedural complications.

Prediction of other HF-related outcomes

Our search also retrieved 8 studies regarding the role of ML techniques in alternative outcomes (i.e., prediction of treatment adherence [OS137, OS138], prediction of adherence use of remote HF monitoring systems [OS133], association of HF symptoms with depression [OS134], prediction of LV filling pressures [OS132], chronic HF management [OS135], prediction of missing data in wireless health projects [OS136], pathways delineation of death in patients with LVAD [OS139] (Supplementary Table 8). All studies were classified as intermediate-high quality (intermediate: 2 studies, high: 6 studies) in the quality assessment (Supplementary Table 9). Specifically, Son et al. (2010) observed superior performance of support vector machine to predict medication adherence of patients with HF [OS138]. Karanasiou et al. (2016) found that ML methods can predict the medication/nutrition/physical activity adherence of patients with HF with an accuracy ranging from 0.82 to 0.91 [OS137]. Evangelista et al. (2017) predicted HF patient’s adherence use of remote health monitoring systems with ML with an accuracy that ranged from 87.5 to 94.5% [OS133]. Graven et al. (2018) revealed the relationship between HF and depression with random forest algorithms [OS134]. Dini et al. (2010) developed an echo-Doppler decision model to predict left ventricular filling pressure in patients with HF [26]. Specifically, patients were correctly allocated according to pulmonary capillary wedge pressure with a sensitivity of 87% and specificity of 90% [OS132]. Seese et al. (2019) used a hierarchical clustering ML approach to create a descriptive model for delineating the pathways to death in patients with a LVAD, suggesting that there are two predominant types of adverse events which lead to mortality associated with multiorgan dysfunction (group 1: bleeding and infection and group 2: renal and respiratory complications) [OS139]. Another application of ML techniques has aimed to improve follow-up monitoring and management of chronic HF patients, following hospitalization [OS135]. Finally, a significant problem in the implementation of wireless health projects is the presence of missing data due to system misuse, non-use, and failure. Suh et al. (2011) adopted ML techniques to predict both non-binomial and binomial data missing data in wireless health projects with accuracies ranged between 85.7 and 98.5% [OS136].

Discussion

The main finding of our systematic review is that ML techniques may play a unique role in the contemporary management of HF patients. This includes classification of HF patients into categories who will benefit from specific treatment strategies, discrimination of HF patients from no HF subjects or differential diagnosis of HF from other conditions with similar clinical presentation and prediction of outcomes in different patient populations, such as those with LVAD and CRT. An important advantage of ML techniques compared to conventional prognostic algorithms is that ML techniques do not assume linear relationships between variables and outcomes, thus resulting in better performance in identifying individualized outcome predictions [27]. Recent data show that ML algorithms outperform logistic regression models in the prediction of HF outcomes [28-30]. Specifically, the better accuracy of ML algorithms compared to conventional tools has been demonstrated for the prediction of mortality in the setting of acute HF [30], mortality and hospitalization for HFpEF [29], and hospital readmissions [31]. Nonetheless, there is still room for improvement of ML techniques in predicting outcomes in these patients. For example, in a recent study, ML algorithms showed limited improvement in the prediction of all-cause mortality and HF hospitalization compared to traditional logistic regression analysis when using binary variables, while after including continuous variables, ML approaches generally performed better than logistic regression modeling [28]. Early diagnosis of the HF syndrome is the cornerstone for the early initiation of appropriate treatment and improving patients’ prognosis. Therefore, existence of an objective, non-invasive, and low-cost tool for the diagnosis of HF is of great importance. Our search showed that ML techniques have a good discrimination performance in identifying HF patients by using different easily obtainable variables including demographics, clinical examination findings, echocardiographic parameters, electrocardiographic indices, etc. [OS24, OS26]. ML techniques can provide real-time identification of in-hospital patients with HF and extraction of important clinical as well as medication related information from unstructured data (i.e., clinical notes) that result in the improvement of HF management and treatment [OS113, OS114, OS117–119]. This is extremely important because hospitalized patients with HF often receive insufficient education and suboptimal transition of care planning, early post-discharge follow-up, or secondary prevention management, leading to high readmission rates, which in turn are associated with an unacceptably high rates of morbidity and mortality [OS153]. Classification of HF patients into subtypes with different prognosis and treatment needs is clinically important. Recent guidelines classify HF patients into HFpEF, HF with mid-range ejection fraction (HFmrEF) and HFrEF mainly using EF values [3]. However, this classification has some disadvantages especially due to the definition of HFpEF and HFmrEF patients. ML-based models can sufficiently classify HF patients (including the gray zone) using different clinical variables [OS18–21] The clinical implications for patient-specific classification of HF patients cannot be overemphasized. For example, in light of the favorable results of sacubitril-valsartan in women, but not men with HFpEF [OS154], it has been argued that a different cut-off value for EF should be used in women vs. men. In the future, ML techniques may be able to apply sex-specific classification criteria for HF patients, which will facilitate clinical decisions regarding implementation of appropriate therapy. Another example refers to phenomapping of patients with HFpEF to different phenotypic groups, with different prognosis and response to pharmacologic interventions, such as spironolactone [OS155]. Given that no pharmacologic therapy has been shown to improve clinical outcomes in HFpEF [OS156], identification of a subset of patients with HFpEF who might benefit from certain medications becomes of utmost importance. Our search showed that ML techniques have been applied successfully in the identification of high-risk patients and in the early initiation of appropriate treatment with the aim of reducing HF related mortality and hospitalizations. Different risk scores have been proposed for the identification of high-risk patients [OS140–142]. Specifically, Ahmad et al. [19] implement ML techniques to classify HF patients into four groups using the eight strongest derived predictors (age, creatinine, hemoglobin, weight, heart rate, systolic blood pressure, mean arterial pressure, and income) of mortality. This type of classification proved to be superior to current classification methods of HF patients, in terms of prognostication and response to medications, and may replace patient classification in different clinical settings. Prediction of patients who may respond to CRT therapy is of great importance [OS143, OS144]; however, approximately 30% of CRT recipients do not respond to this treatment [OS145]. ML techniques have been successfully implemented in creating score models with improved measure estimates regarding the prediction of CRT responders, compared to conventional techniques [OS146–148]. As a result, risk scores produced by employing ML techniques can become the cornerstone for appropriate CRT candidate selection. In addition, ML techniques have been implemented with success in predicting outcomes of LVAD patients, implying that ML techniques may play an even important role in the decision-making regarding LVAD candidates in the future. Furthermore, our review also found that ML techniques have been applied in other aspects of the management of HF patients, e.g., ML techniques can be applied in the identification of patients who may adhere to the prescribed medications or may need additional measured for treatment adherence [OS137, OS138]. Another significant role of ML techniques in the management of HF patients is the identification of HF patients who are at high risk for other comorbidities (i.e., depression) [OS134], or in remote HF monitoring systems resulting in improvement of HF clinical outcomes [OS133, OS149–151]. Effective ML techniques have been implemented to protect implantable devices from cybersecurity attacks [OS152]. Since ML algorithms have been implemented in identifying risk factors for predicting treatment-related discontinuations in various clinical settings [32, 33], identification of HF patients who are at increased risk of treatment discontinuation because of drug related adverse effects may be another important area for ML algorithm implementation. Finally, while a series of critical issues (i.e., the role of physicians and patients in the decision-making process, reliability, transparency, accountability, liability, handling of personal data, different kinds of bias, continuous monitoring of AI adverse events/system failure, cybersecurity, and system upgrading) have led to skepticism with respect to the implementation and adoption of AI algorithms in clinical practice, the ML impact on health economics, is expected to be beneficial to both patients and health insurance providers, justified by an earlier and more accurate diagnosis, reduction of unnecessary expensive diagnostic exams, and selection of optimal candidates for expensive treatment options. Consequently, the implementation of ML algorithms in clinical practice is a complex process and an integrated regulatory framework for the research, development and adoption of ML in medicine, is needed.

Study limitations

The following limitations should be considered: a quantitative synthesis was inappropriate because of the heterogeneity between the included studies regarding the reported outcomes and measured estimates. Therefore, the reported outcomes in each included study are prone to different kinds of biases mainly depended on the ML method that was used. Moreover, the outcomes of a number of studies should be interpreted with caution because of the small number of patients. Finally, our results should be interpreted in light of the fact the tool for quality assessment of the included studies is relatively new and has not been validated in multiple studies.

Conclusions

ML techniques play an important role in different aspects of the management of HF patients and show inspiring promise in the efficient construction of methodologies aiming to improve HF diagnosis, management, and prediction of outcomes in different clinical settings, with generally an improved performance compared to conventional techniques. While a regulatory framework for the implementation of ML in clinical practice is needed, intelligent analysis of health data with ML techniques still acts as auxiliary decisional role and at the moment cannot replace clinical cardiologists. (DOCX 517 kb)
  32 in total

Review 1.  2017 ACC/AHA/HFSA Focused Update of the 2013 ACCF/AHA Guideline for the Management of Heart Failure: A Report of the American College of Cardiology/American Heart Association Task Force on Clinical Practice Guidelines and the Heart Failure Society of America.

Authors:  Clyde W Yancy; Mariell Jessup; Biykem Bozkurt; Javed Butler; Donald E Casey; Monica M Colvin; Mark H Drazner; Gerasimos S Filippatos; Gregg C Fonarow; Michael M Givertz; Steven M Hollenberg; JoAnn Lindenfeld; Frederick A Masoudi; Patrick E McBride; Pamela N Peterson; Lynne Warner Stevenson; Cheryl Westlake
Journal:  Circulation       Date:  2017-04-28       Impact factor: 29.690

2.  Risk Factors for Discontinuation of Treatment for Neovascular Age-Related Macular Degeneration.

Authors:  Inger Westborg; Aldana Rosso
Journal:  Ophthalmic Epidemiol       Date:  2017-11-13       Impact factor: 1.648

3.  Machine learning versus traditional risk stratification methods in acute coronary syndrome: a pooled randomized clinical trial analysis.

Authors:  William J Gibson; Tarek Nafee; Ryan Travis; Megan Yee; Mathieu Kerneis; Magnus Ohman; C Michael Gibson
Journal:  J Thromb Thrombolysis       Date:  2020-01       Impact factor: 2.300

4.  Machine Learning Prediction of Mortality and Hospitalization in Heart Failure With Preserved Ejection Fraction.

Authors:  Suveen Angraal; Bobak J Mortazavi; Aakriti Gupta; Rohan Khera; Tariq Ahmad; Nihar R Desai; Daniel L Jacoby; Frederick A Masoudi; John A Spertus; Harlan M Krumholz
Journal:  JACC Heart Fail       Date:  2019-10-09       Impact factor: 12.035

Review 5.  Machine learning and radiology.

Authors:  Shijun Wang; Ronald M Summers
Journal:  Med Image Anal       Date:  2012-02-23       Impact factor: 8.545

Review 6.  Patient Selection for Destination LVAD Therapy: Predicting Success in the Short and Long Term.

Authors:  Alexander Michaels; Jennifer Cowger
Journal:  Curr Heart Fail Rep       Date:  2019-10

7.  Machine Learning Methods Improve Prognostication, Identify Clinically Distinct Phenotypes, and Detect Heterogeneity in Response to Therapy in a Large Cohort of Heart Failure Patients.

Authors:  Tariq Ahmad; Lars H Lund; Pooja Rao; Rohit Ghosh; Prashant Warier; Benjamin Vaccaro; Ulf Dahlström; Christopher M O'Connor; G Michael Felker; Nihar R Desai
Journal:  J Am Heart Assoc       Date:  2018-04-12       Impact factor: 5.501

8.  Pediatric Severe Sepsis Prediction Using Machine Learning.

Authors:  Sidney Le; Jana Hoffman; Christopher Barton; Julie C Fitzgerald; Angier Allen; Emily Pellegrini; Jacob Calvert; Ritankar Das
Journal:  Front Pediatr       Date:  2019-10-11       Impact factor: 3.418

Review 9.  Translational AI and Deep Learning in Diagnostic Pathology.

Authors:  Ahmed Serag; Adrian Ion-Margineanu; Hammad Qureshi; Ryan McMillan; Marie-Judith Saint Martin; Jim Diamond; Paul O'Reilly; Peter Hamilton
Journal:  Front Med (Lausanne)       Date:  2019-10-01

10.  Machine learning methodologies versus cardiovascular risk scores, in predicting disease risk.

Authors:  Alexandros C Dimopoulos; Mara Nikolaidou; Francisco Félix Caballero; Worrawat Engchuan; Albert Sanchez-Niubo; Holger Arndt; José Luis Ayuso-Mateos; Josep Maria Haro; Somnath Chatterji; Ekavi N Georgousopoulou; Christos Pitsavos; Demosthenes B Panagiotakos
Journal:  BMC Med Res Methodol       Date:  2018-12-29       Impact factor: 4.615

View more
  12 in total

Review 1.  Predicting Major Adverse Cardiovascular Events in Acute Coronary Syndrome: A Scoping Review of Machine Learning Approaches.

Authors:  Sara Chopannejad; Farahnaz Sadoughi; Rafat Bagherzadeh; Sakineh Shekarchi
Journal:  Appl Clin Inform       Date:  2022-05-26       Impact factor: 2.762

2.  Comparing Machine Learning Models and Statistical Models for Predicting Heart Failure Events: A Systematic Review and Meta-Analysis.

Authors:  Zhoujian Sun; Wei Dong; Hanrui Shi; Hong Ma; Lechao Cheng; Zhengxing Huang
Journal:  Front Cardiovasc Med       Date:  2022-04-06

3.  Predictive value of H2 FPEF score in patients with heart failure with preserved ejection fraction.

Authors:  Yuxi Sun; Niuniu Wang; Xiao Li; Yanli Zhang; Jie Yang; Gary Tse; Ying Liu
Journal:  ESC Heart Fail       Date:  2021-01-05

4.  Effect of angiotensin receptor neprilysin inhibitors on left atrial remodeling and prognosis in heart failure.

Authors:  Yuxi Sun; Shuang Song; Yanli Zhang; Wenqiong Mo; Xinxin Zhang; Ning Wang; Yunlong Xia; Gary Tse; Ying Liu
Journal:  ESC Heart Fail       Date:  2021-11-14

5.  An Optimized Machine Learning Model Accurately Predicts In-Hospital Outcomes at Admission to a Cardiac Unit.

Authors:  Sandeep Chandra Bollepalli; Ashish Kumar Sahani; Naved Aslam; Bishav Mohan; Kanchan Kulkarni; Abhishek Goyal; Bhupinder Singh; Gurbhej Singh; Ankit Mittal; Rohit Tandon; Shibba Takkar Chhabra; Gurpreet S Wander; Antonis A Armoundas
Journal:  Diagnostics (Basel)       Date:  2022-01-19

Review 6.  Advances in Cardiac Pacing: Arrhythmia Prediction, Prevention and Control Strategies.

Authors:  Mehrie Harshad Patel; Shrikanth Sampath; Anoushka Kapoor; Devanshi Narendra Damani; Nikitha Chellapuram; Apurva Bhavana Challa; Manmeet Pal Kaur; Richard D Walton; Stavros Stavrakis; Shivaram P Arunachalam; Kanchan Kulkarni
Journal:  Front Physiol       Date:  2021-12-02       Impact factor: 4.566

7.  Machine learning-based model for predicting 1 year mortality of hospitalized patients with heart failure.

Authors:  Takeshi Tohyama; Tomomi Ide; Masataka Ikeda; Hidetaka Kaku; Nobuyuki Enzan; Shouji Matsushima; Kouta Funakoshi; Junji Kishimoto; Koji Todaka; Hiroyuki Tsutsui
Journal:  ESC Heart Fail       Date:  2021-08-13

8.  Real-Time Arrhythmia Detection Using Hybrid Convolutional Neural Networks.

Authors:  Sandeep Chandra Bollepalli; Rahul K Sevakula; Wan-Tai M Au-Yeung; Mohamad B Kassab; Faisal M Merchant; George Bazoukis; Richard Boyer; Eric M Isselbacher; Antonis A Armoundas
Journal:  J Am Heart Assoc       Date:  2021-12-02       Impact factor: 6.106

9.  Derivation of an electronic frailty index for predicting short-term mortality in heart failure: a machine learning approach.

Authors:  Chengsheng Ju; Jiandong Zhou; Sharen Lee; Martin Sebastian Tan; Tong Liu; George Bazoukis; Kamalan Jeevaratnam; Esther W Y Chan; Ian Chi Kei Wong; Li Wei; Qingpeng Zhang; Gary Tse
Journal:  ESC Heart Fail       Date:  2021-06-03

10.  Real-time machine learning-based intensive care unit alarm classification without prior knowledge of the underlying rhythm.

Authors:  Wan-Tai M Au-Yeung; Rahul K Sevakula; Ashish K Sahani; Mohamad Kassab; Richard Boyer; Eric M Isselbacher; Antonis A Armoundas
Journal:  Eur Heart J Digit Health       Date:  2021-07-01
View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.