| Literature DB >> 35144983 |
Rashmi Nedadur1,2, Bo Wang2,3,4,5, Wendy Tsang6,7.
Abstract
Developments in artificial intelligence (AI) have led to an explosion of studies exploring its application to cardiovascular medicine. Due to the need for training and expertise, one area where AI could be impactful would be in the diagnosis and management of valvular heart disease. This is because AI can be applied to the multitude of data generated from clinical assessments, imaging and biochemical testing during the care of the patient. In the area of valvular heart disease, the focus of AI has been on the echocardiographic assessment and phenotyping of patient populations to identify high-risk groups. AI can assist image acquisition, view identification for review, and segmentation of valve and cardiac structures for automated analysis. Using image recognition algorithms, aortic and mitral valve disease states have been directly detected from the images themselves. Measurements obtained during echocardiographic valvular assessment have been integrated with other clinical data to identify novel aortic valve disease subgroups and describe new predictors of aortic valve disease progression. In the future, AI could integrate echocardiographic parameters with other clinical data for precision medical management of patients with valvular heart disease. © Author(s) (or their employer(s)) 2022. Re-use permitted under CC BY-NC. No commercial re-use. See rights and permissions. Published by BMJ.Entities:
Keywords: echocardiography; heart valve diseases
Mesh:
Year: 2022 PMID: 35144983 PMCID: PMC9554049 DOI: 10.1136/heartjnl-2021-319725
Source DB: PubMed Journal: Heart ISSN: 1355-6037 Impact factor: 7.365
Figure 1Pathway of a patient with valvular heart disease and areas of care where AI can improve assessment and management. The top left and right images are three-dimensional TTE images of the aortic valve in short axis during systole and diastole representing progression from a normal to a diseased state. Below are the stages of care (screening, surveillance, decision to intervene, intervention). AI can be applied to any type of patient data (ie, clinical notes, echo images) obtained at any of these stages. In turn, the collective set of data can be used by AI to improve management at various care stages. AI, artificial intelligence; TTE, transthoracic echocardiogram.
Figure 2(A) Characteristics of big data. (B) Common AI definitions. (C) Common model architectures used in AI depend on the purpose of modelling. With supervised learning, predictors are mapped to a known outcome. When the outcomes of interest are clinical, machine learning methods such as random forest and support vector machine are used. When the outcome of interest is imaging-based, then deep learning methods such as convolutional neural networks are used. (D) With unsupervised learning, the predictors are visualised on a plot to find natural clustering of the data. A typical use in valve disease studies has been in phenotyping to identify higher risk phenotypes. Methods used with unsupervised learning include topological data analysis, model-based clustering, agglomerative hierarchical clustering and clustering around medoids. AI, artificial intelligence.
Summary of AI applications by valve
| Valve | Pathology | AI application | ||||
| Image acquisition | View identification | Image segmentation | Disease state identification | Phenotyping | ||
| Aortic | Stenosis | x | x | x | x | |
| Regurgitation | x | x | x | |||
| Mitral | Stenosis | x | x | x | x | |
| Regurgitation | x | x | x | x | ||
| Pulmonary | Stenosis | No current literature. | ||||
| Regurgitation | ||||||
| Tricuspid | Stenosis | x | x | x | ||
| Regurgitation | x | x | x | |||
AI, artificial intelligence.
Figure 3Example images of commercial valve analysis software. Mitral valve models from (A) GE, (B) Philips and (C) TomTec. (D) An aortic valve model from Siemens. A, anterior; AL, anterolateral; Ao, aorta; L, left coronary cusp; N, non-coronary cusp; P, posterior; PM, posteromedial; R, right coronary cusp.
Non-commercial AI-driven algorithms for valvular detection in echocardiography
| Authors (year) | Data | Training data population | Outcome of interest | Algorithm used | Findings |
| Vafaeezadeh | 2044 TTE studies: 1597 had normal valves and 447 had prosthetic valves. | Patients with normal mitral valve and mitral valve prosthesis: both mechanical and biological. | Identification of prosthetic mitral valve from echo images. | 13 pretrained models with CNN architecture and fine-tuned via transfer learning. | All the models worked with incredible accuracy (>98%), but the EfficientNetB3 had the best AUC (99%) for the A4C and EfficientNetB4 had the best AUC (99%) for PLAX. However, these models were computationally more expensive for a small gain in AUC, so the authors concluded that the best model for this task is EfficientNetB2. |
| Corinzia | Training: 39 2D TTE. | Patients who were undergoing mitraclip: all patients had moderate to severe or severe MR. | Fully automated delineation of mitral valve annulus and both MV leaflets. | NN-MitralSeg, unsupervised MV segmentation algorithm based on neural collaborative filtering. | This model outperforms state-of-the-art unsupervised and supervised methods (NeuMF MF Dice coefficient of 0.482, with benchmark performance of 0.447), with best performance on low-quality videos or videos with sparse annotation. |
| Andreassen | 111 multiframe recordings from 3D TEE echocardiograms. | 4D echocardiographic images of the mitral valve. | Fully automated method for mitral annulus segmentation on 3D echocardiography. | CNN, specifically a U-Net architecture. | With no manual input, this methodology gave comparable results with those that required manual input (relative error of 6.1%±4.5% for perimeter measurements and 11.94%±10% for area measurement). |
| Costa | Training: 21 2D TTE echo videos in PLAX, 22 videos in A4C. Test: 6 videos in PLAX and A4C. | PLAX and A4C views from echos. | Automatic segmentation of mitral valve leaflets. | CNN, specifically a U-Net architecture. | This model is the first of its kind to perform segmentation of valve leaflets. |
A4C, apical 4-chamber view; AI, artificial intelligence; AML, anterior mitral valve leaflet; AUC, area under the receiver operator curve; CNN, convolutional neural network; 2D, two-dimensional; 3D, three-dimensional; 4D, four-dimensional; MR, mitral regurgitation; MV, mitral valve; PLAX, parasternal long-axis view; TEE, transoesophageal echocardiogram; TTE, transthoracic echocardiogram.
Figure 4(A) Deep learning workflow in automated image analysis. (B) A stepwise approach to assessing machine learning phenotyping studies from the study population and the data/predictor selection to the algorithm choice and assessment metrics. 2D, two-dimensional; 3D, three-dimensional; ROC, receiver operator curve.
Phenotyping studies using echocardiographic-derived parameters
| Authors (year) | Patients (n) | Training data | Outcome of interest | Inclusion criteria | Algorithm used | Findings | Validation |
| Wojnarski | 656 patients. |
Unsupervised training: the cross-sectional diameter of the aorta at each level taken from CT. Supervised training: 56 patient-level preoperative and echocardiographic variables trained to the outcome of the cluster label. |
Association of bicuspid valve with patterns of aortopathy. |
Patients with bicuspid aortic valve and aortic aneurysms for surgical repair. |
Unsupervised training: partitioning around medoids. Supervised training: polytomous random forest analysis to an outcome. |
Three aneurysm subtypes identified: those with root (13%), ascending (55%) and arch (32%) predominant. Severe valve regurgitation was most associated with the root phenotype (57%). AS was most commonly associated with arch phenotype (62%). Patient age increased as the extent of the aneurysm is more distal. Root phenotype had the highest male predominance (94%). |
The clustering and resulting phenotypes could be defined by algorithmic rules which were then used for manual phenotyping, giving 94% accuracy. Then during supervised training, variable importance for classification was studied, with the five most important measurements being peak AV gradient, mean AV gradient, LV inner diameter, LV relative wall thickness, and bicuspid or unicuspid valve. |
| Kwak | Training data: 398 patients. |
From 32 variables from demographics, physical examination, laboratory data, LV geometry, LV systolic function, LV diastolic function and aortic valve, 11 were used for clustering. 11 identified via dimensionality reduction, using Pearson coefficient and Bayesian information criteria that penalise model complexity. The 11 parameters in order of importance for clustering were haemoglobin, tricuspid regurgitant jet velocity, creatinine, left atrial volume, E-wave velocity, LVEF, BMI, heart rate, A-wave velocity, platelets and white cell count. |
Primary: all-cause mortality. Secondary: cardiac mortality, non-cardiac mortality and death after AVR. |
Newly diagnosed patients with moderate or severe AS. |
Training model: model-based clustering. Validation model: agglomerative hierarchical clustering (Ward’s method). |
Three clusters were identified: cluster 1 contained patients with depressed LVEF, more LV hypertrophy, more severe diastolic dysfunction and atrial fibrillation and had higher rates of cardiac death; cluster 2 contained elderly patients with comorbidities, specifically end-stage renal disease and had more non-cardiac death; cluster 3 was the lowest risk group with lowest event rates. These new labels showed improved discrimination (integrated discrimination improvement 0.029) and net reclassification improvement (0.294) for the outcome of 3-year all-cause mortality. |
On an independent sample of 262 patients, model-based clustering was repeated and similar trends were identified. The modelling was repeated using agglomerative hierarchical clustering and three similar clusters with similar clinical characteristics were identified. |
| Sengupta | 1052 patients with CT, MRI and echos from three centres, prospective cohort. |
Aortic valve area index, LV ejection fraction, aortic valve mean gradient, stroke volume indexed and aortic valve peak velocity. |
Progression to AVR or progression to death. |
Asymptomatic AS or discordant AS. |
Patient similarity analysis: topological data analysis. Then, using new labels, created a supervised ML classifier. |
High severity (57% of patients) and low severity (43% of patients) phenotypes. High severity group had higher aortic valve calcium score, more late gadolinium enhancement, higher BNP and high sensitivity troponin, and five times the risk of AVR. High severity patients who received AVR were also twice as likely to progress to death than all low severity patients. Echo-supervised classifier was very accurate and applied to the training data. |
High and low severity labels were used to train a supervised machine learning classifier that had AUC of 0.988. This algorithm had better discrimination (integrated discrimination improvement of 0.07) and reclassification (net reclassification improvement of 0.17) for the outcome of AVR at 5 years compared with traditional valve severity grading. |
| Casaclang-Verzosa | Training data: 346 patients with mild to severe AS. |
79 clinical and echocardiographic data (AVA, LVEF, LV mass index, relative wall thickness). |
Understanding the progression of disease from mild to severe AS. |
Patients with mild to severe AS. |
Topological data analysis. |
Topological data analysis created a Reeb graph that formed a loop with mild and severe AS on either spectrum and moderate AS forming two separate paths. Suggests that the path from mild to severe AS follows two prototypical paths via moderate AS. The severe AS area of the map was associated with higher mean gradient, LV mass index, E/e’, concentric hypertrophy and smaller AVA. This area of the Reeb graph associated with severe AS had 3.88 times the risk of valve intervention. When examining the two arms of moderate AS, although there was no difference in AVA, patients in the upper arm had lower EF, more frequently were men and had higher incidence of coronary artery disease. Patients in the upper arm had lower peak velocity, lower mean gradient, higher LV mass index and higher left atrial volume. In follow-up post-AVR, the patients’ loci in the Reeb graph regressed from the severe to the mild position. |
A murine model for which echos were performed at 3, 6, 9 and 12 months of age. Topological data analysis of mice echo measurements also showed a similar trend to human patterns of AS. In addition, longitudinal imaging of the murine model provided insight into the natural progression of AS, with mice moving along the spectrum from mild to severe AS over time. |
AS, aortic stenosis; AUC, area under the receiver operator curve; AV, aortic valve; AVA, aortic valve area; AVR, aortic valve replacement; BMI, body mass index; BNP, brain natriuretic protein; EF, ejection fraction; LV, left ventricular; LVEF, left ventricular ejection fraction; ML, machine learning.
Limitations in echo imaging that make artificial intelligence implementation in valve disease more challenging
| Image quality | Speckle noise, |
| Frame rate | Low frame rates, irregular frames resulting in fast and irregular motion of the valve leaflets. |
| Echogenicity | Lack of features to discriminate heart valve from adjacent myocardium, which have similar intensity and texture. |