Literature DB >> 35066774

Cascaded neural network-based CT image processing for aortic root analysis.

Nina Krüger1,2, Alexander Meyer3,4, Lennart Tautz5, Markus Hüllebrand6,5, Isaac Wamala6,3, Marius Pullig6, Markus Kofler3,4, Jörg Kempfert6,3,4, Simon Sündermann6,3,4, Volkmar Falk6,3,4,7,8, Anja Hennemuth6,3,4,5.   

Abstract

PURPOSE: Careful assessment of the aortic root is paramount to select an appropriate prosthesis for transcatheter aortic valve implantation (TAVI). Relevant information about the aortic root anatomy, such as the aortic annulus diameter, can be extracted from pre-interventional CT. In this work, we investigate a neural network-based approach for segmenting the aortic root as a basis for obtaining these parameters.
METHODS: To support valve prosthesis selection, geometric measures of the aortic root are extracted from the patient's CT scan using a cascade of convolutional neural networks (CNNs). First, the image is reduced to the aortic root, valve, and left ventricular outflow tract (LVOT); within that subimage, the aortic valve and ascending aorta are segmented; and finally, the region around the aortic annulus. From the segmented annulus region, we infer the annulus orientation using principal component analysis (PCA). The area-derived diameter of the annulus is approximated based on the segmentation of the aortic root and LVOT and the plane orientation resulting from the PCA.
RESULTS: The cascade of CNNs was trained using 90 expert-annotated contrast-enhanced CT scans routinely acquired for TAVI planning. Segmentation of the aorta and valve within the region of interest achieved an F1 score of 0.94 on the test set of 36 patients. The area-derived diameter within the annulus region was determined with a mean error below 2 mm between the automatic measurement and the diameter derived from annotations. The calculated diameters and resulting errors are comparable to published results of alternative approaches.
CONCLUSIONS: The cascaded neural network approach enabled the assessment of the aortic root with a relatively small training set. The processing time amounts to 30 s per patient, facilitating time-efficient, reproducible measurements. An extended training data set, including different levels of calcification or special cases (e.g., pre-implanted valves), could further improve this method's applicability and robustness.
© 2022. The Author(s).

Entities:  

Keywords:  CNN; CT; Deep learning; Image analysis; TAVI; U-Net

Mesh:

Year:  2022        PMID: 35066774      PMCID: PMC8873075          DOI: 10.1007/s11548-021-02554-3

Source DB:  PubMed          Journal:  Int J Comput Assist Radiol Surg        ISSN: 1861-6410            Impact factor:   2.924


Introduction

Transcatheter aortic valve implantation (TAVI) allows minimally invasive replacement of pathological aortic valves. However, purely image-based prosthetic valve selection is challenging. The aortic root comprises the whole aortic valve between the transition to the ascending aorta and the annulus at the base of the aortic valve cusps, which are attached to the LVOT Figure 1 shows the complex anatomy of the aortic valve region. The implant needs to fit tight to the aortic wall and must not cover the coronary artery branches. Its orientation should be similar to the original valve. Therefore, it is essential to carefully analyze the aortic root before surgery to determine the best prosthesis and appropriate placement strategy. The assessment of the aortic valve annulus is crucial for prosthesis selection. Corresponding parameters such as the annulus diameter are highly sensitive to the orientation of the measurement plane. Several studies investigated the reliability and repeatability of interactive measurements: Meyer et al. [10] observed a difference in resulting prosthesis size between two software solutions in 18% of the considered patients. Schuhbaeck et al. [14] report mean inter-observer differences of  mm with a maximum of 5.6 mm for the area-derived annulus diameter.
Fig. 1

The aortic root comprises the whole aortic valve between the transition to the ascending aorta and the annulus at the base of the aortic valve cusps, which are attached to the LVOT

The blue bounding box contains the complete TAVI planning CT scan. The preprocessing for the aortic root detection crops this volume to the yellow region of  mm centered at a point 128 mm above the image center (in HEAD direction, according to the DICOM information). The subimage in the red bounding box contains the aortic root. The first task in this work is the automatic extraction of this subimage Processing steps: 1. The region of interest (ROI) is extracted from the thorax CT scan. 2. The aorta is segmented in this ROI. 3. The annulus region is segmented. The annulus plane is inferred by principal component analysis, and the annulus diameter is approximated We aim to support aortic root analysis with a fully automatic, deterministic and patient-specific approach, facilitating standardization and reduction of effort for TAVI planning. We break down the task into a cascade of neural networks as suggested for related contexts [12]: We aim at developing an approach, applicable to a wide range of CT scanner models. We test our approach on expert-annotated routine clinical data acquired by different CT scanners and compare the suggested implant size based on the approximated annulus diameter with the implanted device size. Detection of a uniformly sized bounding box around the aortic valve; Segmentation of the aorta including aortic valve within this bounding box; Approximation of the area-derived annulus diameter based on the segmentation of the aortic valve and the annulus region.

Related work

This section discusses the reviewed literature on segmentation of the aortic root region in contrast-enhanced CT images. Lalys et al. presented a comprehensive pipeline for TAVI analysis, using atlas registration and deformable 3D snakes [8]. Their approach requires the placement of a point in the aortic root region. Elattar et al. used fuzzy classification and normalized cuts to segment the aortic root after detecting the centerline [3]. They reported smooth aortic root surfaces, possibly affecting accuracy in subsequent measurements. Gao et al. proposed atlas-based segmentation followed by surface model fitting, with atlas images from a publicly available database [4]. Waechter et al. segmented the aortic root region with a mean-shape model [15]. Astudillo et al. described a CNN-based segmentation in manually defined annulus planes [2]. The approaches from Astudillo et al. and Lalys et al. require manual interaction, hindering implementation as a fully automatic and deterministic processing tool. The aortic root models of Elattar et al., Gao et al. and Waechter et al. are smoothed or based on a smooth model. The model’s deformation is limited and thus only yields an approximation of the patient-specific anatomy. Given the reliable performance of CNN methods in recent years, our aim is a conceptually simple and fully automatic pipeline consisting of multiple hierarchical CNN steps.

Methods

We propose a neural network-based three-step segmentation approach for the anatomical structures of interest from CT images. The first step extracts the region of interest (ROI) around the aortic root and LVOT (see Fig. 2).
Fig. 2

The blue bounding box contains the complete TAVI planning CT scan. The preprocessing for the aortic root detection crops this volume to the yellow region of  mm centered at a point 128 mm above the image center (in HEAD direction, according to the DICOM information). The subimage in the red bounding box contains the aortic root. The first task in this work is the automatic extraction of this subimage

Each resulting subimage is resampled to an isotropic resolution of 0.6 mm. This is close to the original image resolution, which varies between 0.38 and 0.7 mm and ensures that processing with the given hardware is possible (see “Appendix”—hardware). In the second step, the aorta, including the aortic valve, is segmented within this ROI. This segmentation serves as additional input for estimating the annulus diameter. In the third step, the region around the aortic annulus is segmented, and the orientation of the annulus plane is determined using principal component analysis (PCA). Based on this information, we approximate the annulus diameter. Figure 3 visualizes the sequence of steps.
Fig. 3

Processing steps: 1. The region of interest (ROI) is extracted from the thorax CT scan. 2. The aorta is segmented in this ROI. 3. The annulus region is segmented. The annulus plane is inferred by principal component analysis, and the annulus diameter is approximated

Statistics: patient sex (F female, M male, U unknown); age, BMI and aortic valve calcification (mean ± standard deviation) for training, test and device sizing data set The volume of calcification was assessed within the aortic valve by thresholding the CT scan at a Hounsfield unit of 850

Data

Our data set comprises annotated 3D thorax CT scans of 126 patients from the German Heart Center Berlin and the Charité TAVI registry. We used 36 cases for testing. The remaining 90 cases were repeatedly split into 75 for training and 15 for validation in sixfold cross-validation. Further, we collected a data set of 640 patients, who successfully underwent a TAVI procedure, to test the suitability of our model for device selection. A procedure was deemed successful when no complications were documented. Here, we compared the size of the implanted valve with our approximated annulus diameter. Patient statistics can be seen in Table 1.
Table 1

Statistics: patient sex (F female, M male, U unknown); age, BMI and aortic valve calcification (mean ± standard deviation) for training, test and device sizing data set

Training (90 cases)Test (36 cases)Sizing (640 cases)
Sex60 F, 30 M12 F, 18 M, 6 U317 F, 323 M
Mean age80.4 ± 10.280.8 ± 5.478.9 ± 9.4
Mean BMI [kg/m\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$^2$$\end{document}2]27.8 ± 6.225.5 ± 5.128.1 ± 15.7
AV calcification [mm\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$^3$$\end{document}3]240 ± 212165 ± 288205 ± 203

The volume of calcification was assessed within the aortic valve by thresholding the CT scan at a Hounsfield unit of 850

All CTs of the training and sizing data set were acquired with Siemens scanners. In the test set, nine cases each were acquired with Siemens, Toshiba, Philips and GE scanners. The image volumes have slice dimensions of 512  512. The number of slices ranges from 273 to 1908, slice thickness 0.5–3 mm and spacing between slices 0.4–3 mm. The annotations shown in Fig. 4 were generated by domain experts using a custom MeVisLab1-based software prototype to obtain:The aorta mask includes lumen and valve without LVOT, and the cross-sectional contours show the outer contour of the aortic root and LVOT.
Fig. 4

The available expert annotations consist of a mask of the aortic lumen, the centerline of aorta and LVOT, cross-sectional contours of the aortic root and LVOT and manually placed hinge point markers

a mask of the aortic lumen, the centerline through the aorta and LVOT, cross-sectional contours of the aorta and LVOT perpendicular to the centerline and three markers, indicating the hinge points of the aortic valve cusps.

Model training

For image processing, we considered the U-Net architecture, which has been successfully applied in several biomedical image segmentation challenges.2 We trained a structurally identical CNN for each processing step [11]. The specific layer arrangement is illustrated in Fig. 5.
Fig. 5

Our CNN architecture inspired by the U-Net: It consists of a contracting and an expansive path

The available expert annotations consist of a mask of the aortic lumen, the centerline of aorta and LVOT, cross-sectional contours of the aortic root and LVOT and manually placed hinge point markers It consists of a contracting path and an expansive path. In our application, the contracting path has nine convolutional layers combined with batch normalization, ReLU activation, max pooling and dropout. The expansive path alternates convolutions with transposed, also called up-convolutions. As the last layer, a convolution with sigmoid activation is used, resulting in a voxel-wise classification of the input image. The neural network’s memory requirement depends on the number of filters, batch size and size of the input image. It has been shown that smaller batch sizes can improve accuracy and generalizability [5]. Thus, we selected a batch size of two for training. Given the size of the input images, the available hardware (see “Appendix”) allowed for a number of 18 filters in the first layer. Our CNN architecture inspired by the U-Net: It consists of a contracting and an expansive path The Hounsfield scale generally provides comparable intensities based on the tissue density. The usage of contrast agent, as well as differences in dosage settings, can, however, result in intensity variations. We apply intensity normalization using mean and standard deviation (see Fig. 6, for example).
Fig. 6

Example images acquired with different scanners. The relative intensity difference in the ROI (yellow circle) is reduced through the suggested intensity normalization. The lines mark the mean value within the ROI

In each epoch, each training image is augmented by translation. The image is randomly shifted between zero to five voxels in each direction. Because the patient orientation in the scanner is standardized, we performed no rotational augmentation. Deformations were not applied to avoid implausible anatomies. The Adam optimizer [6] is used with different loss functions to find the best approach for each step. We considered the binary cross-entropy, as well as its variation, the Focal Loss [9], as we assume that the enhanced focus on the misclassified examples is appropriate in our scenario with the strong class imbalance.where y is the target mask (1 if the voxel belongs to the segmentation and 0 otherwise) and the predicted probability for each of the n voxels to belong to the segmentation. Binary Cross-Entropy Focal Loss with We also evaluated the Tversky Loss, which is similar to the F1 score, but enables steering the emphasis on false-positive and false-negative classifications via the parameter [13], as well as the Focal Tversky Loss [1].An individual model for each step is obtained by selecting the four loss function and parameter combinations with the best results on a validation set of 15 patients after training on 75 patients, then training six structurally identical models in sixfold cross-validation per each of the four selected loss functions and averaging their outputs. We use this bagging approach to exploit the benefits of ensemble methods, exemplified by the results for step 1. Tversky Loss with Focal Tversky Loss with and Example images acquired with different scanners. The relative intensity difference in the ROI (yellow circle) is reduced through the suggested intensity normalization. The lines mark the mean value within the ROI

Step 1: Aortic valve detection

In the first step, the image is cropped to a ROI around the aortic root and LVOT: The ROI detection is performed on a low-resolution (isotropic voxel size of 2 mm) subimage with an extent of  mm placed 128 mm above the image center (in the HEAD direction provided by the DICOM information) to enable fast memory-efficient processing. This image is padded if the upper border is outside the original image (see Fig. 2). Training Based on the expert-defined aortic valve hinge points, an axis-aligned bounding box of  mm is placed in the image around the aortic root and LVOT, centered on the midpoint of the hinge points. This bounding box is used as a mask to learn the detection of the ROI. The labels for the training of the ROI segmentation are generated based on the aortic valve hinge points via the calculation of an axis-aligned enclosing bounding box. The labels for the ensuing aorta segmentation in step 2 are based on the aortic lumen, while the region around the annulus plane is defined by the cross-sectional contours of the aortic root and LVOT Segmentation postprocessing For each voxel in the input CT, the CNN returns a probability for this voxel to belong to the uniformly sized ROI. This is binarized with a threshold of 0.5, and a bounding box is drawn around all predicted voxels. This box is resized to the desired dimensions of  mm with the midpoint being the center of the predicted bounding box.

Step 2: Aorta segmentation

In the second step, a CNN is trained on the aorta segmentation within the ROI. The original images are resampled to an isotropic voxel size of 0.6 mm before being cropped to the ROI. Training The label generation for this step is based on the aortic lumen within the ROI (see Fig. 7).
Fig. 7

The labels for the training of the ROI segmentation are generated based on the aortic valve hinge points via the calculation of an axis-aligned enclosing bounding box. The labels for the ensuing aorta segmentation in step 2 are based on the aortic lumen, while the region around the annulus plane is defined by the cross-sectional contours of the aortic root and LVOT

Segmentation postprocessing No postprocessing is required in this step.

Step 3: Aortic root analysis

In the third step, the region around the aortic annulus plane, defined by the three hinge points, is segmented to deduce the orientation and midpoint of the annulus plane and enable measurements of the annulus region. As an output of step 3, the aorta segmentation from step 2 is reduced to the valve cusps and combined with the segmentation of the annulus region from step 3 to achieve a segmentation comprising valve cusps, annulus and LVOT. This segmentation is analyzed in cross sections oriented parallel to the derived annulus plane, and the diameter over all cross sections is measured to determine an approximation of the annulus diameter. Training Based on the expert-defined hinge point markers (Fig. 4), we estimate the orientation of the annulus plane. To train the CNN, we consider the mask of the aortic root and LVOT along a 10 mm margin in the direction of the plane normal, as visualized in Fig. 8. The margin of 10 mm was selected experimentally to achieve a mask that can be successfully trained while also yielding an ideal approximation of the annulus plane from PCA. With this 3D approach, we intend to make our analysis robust against the input uncertainty of the hinge points.
Fig. 8

Segmentation mask (yellow), aligned along the annulus plane, defined by the hinge points (black) with the aorta segmentation (red) for reference

Segmentation mask (yellow), aligned along the annulus plane, defined by the hinge points (black) with the aorta segmentation (red) for reference Segmentation postprocessing A PCA is applied to deduce the annulus plane from the predicted segmentation (see Fig. 9). PCA is a dimensionality reduction method, which reduces a data set to its uncorrelated components that maximize variance. By definition of our annulus plane region, its diameter parallel to the annulus plane should be larger than its height. According to the literature, an annulus diameter typically exceeds 17 mm [14] and the height of our segmentation mask is defined to be 10 mm. Thus, the two components with the highest variance describe the orientation of the annulus plane. The vector orthogonal to the two largest eigenvectors of the PCA is taken as an estimate of the plane’s normal vector. The center of gravity of the predicted segmentation estimates the midpoint of the annulus plane. This midpoint and normal vector allow for approximation of the annulus plane. In our training data set, the mean Euclidean distance between the midpoint of the three hinge points and the midpoint deduced from PCA is 1.5 mm and the mean angle difference between the resulting normal vectors is .
Fig. 9

Principal component analysis applied to the segmentation mask (yellow): The first two principal components maximize the variance of the underlying data while being perpendicular to each other. A plane results from the normal vector orthogonal to the two principal components. The plane’s midpoint is defined by the center of gravity of the underlying data

Principal component analysis applied to the segmentation mask (yellow): The first two principal components maximize the variance of the underlying data while being perpendicular to each other. A plane results from the normal vector orthogonal to the two principal components. The plane’s midpoint is defined by the center of gravity of the underlying data However, the result is misleading if a segmented annulus region has a height comparable to its diameter (Fig. 10).
Fig. 10

Calculation of the annulus plane orientation by principal component analysis can be distorted by a segmentation that has a comparable height and diameter; the minimal and maximal diameter should exceed the height to ensure correct calculation of the plane’s normal vector

Calculation of the annulus plane orientation by principal component analysis can be distorted by a segmentation that has a comparable height and diameter; the minimal and maximal diameter should exceed the height to ensure correct calculation of the plane’s normal vector To ensure that the PCA detects the correct orientation, the predicted segmentation of the annulus region is masked with the contour of the segmentation from step 2 (see Fig. 11). Undesired segments are removed by only considering the largest connected component. The input of the PCA is thereby more accurately aligned along the annulus plane; however, the center of gravity is shifted into the valve. In our training data set, the mean Euclidean distance between the midpoint of the three hinge points and the midpoint deduced from this adjustment to the PCA input is 6.8 mm and the mean angle difference between the resulting normal vectors is . The midpoint and normal vector resulting from the masked segmentation of the annulus region allow for the approximation of the annulus plane.
Fig. 11

1. The segmentation of the annulus region is masked with the contours of the predicted aorta segmentation from step 2. 2. The resulting segmentation is used as input to the PCA for the calculation of the valve plane orientation

1. The segmentation of the annulus region is masked with the contours of the predicted aorta segmentation from step 2. 2. The resulting segmentation is used as input to the PCA for the calculation of the valve plane orientation Aortic Root Analysis The aortic valve segmentation from the previous step is combined with the segmentation of the annulus region and reduced to a height of 10 mm along the resulting plane to approximate the aortic root region including aortic valve leaflets and LVOT. The minimal diameter within this region is calculated using the slice-wise convex hull contours aligned along the deduced annulus plane and obtaining the area-derived diameter for each. We only consider minima above 17 mm to ensure that all three aortic leaflets are contained within the contour; an aortic annulus diameter below 17 mm is unlikely [14]. The reference diameter, used as ground truth, is obtained in the same manner from the annotated data: The aortic valve and LVOT segmentation masks are intersected parallel to the plane defined by the hinge points, and the reference diameter is calculated as minimum area-derived diameter in the resulting cross sections within a range of  mm along the plane normal. In addition to the annotated data set, we apply our method to 640 CT scans of patients who underwent a successful TAVI. We compare the size of the implanted device to our suggestion based on our area-derived diameter, inspired by the sizing strategy from Schuhbaeck et al. [14]: a 23-mm valve for annulus diameters of 19.5–22.5 mm, a 26-mm valve for 22.5–26.5 mm, a 29-mm valve for 26.5–29.5 mm; we further suggested a 20-mm valve for annulus diameters below 19.5 mm and a 34-mm valve for greater than 29.5 mm.

Results

The following subsections show the results per step.

Step 1: Detection of the region of interest

In the detection of the ROI, a bounding box with a fixed size around the aortic root and LVOT centered around the hinge points shall be found by segmentation. The detected bounding box is compared to the reference bounding box using the intersection over ground truth (IoG):The resulting bounding box around the aortic root and LVOT is used as input for the following steps. The IoG is not directly applied to the predicted segmentation but to the bounding box obtained after thresholding and reshaping, as explained in the “Methods” section. Step 1: Mean intersection over ground truth for one model trained with each loss function, the selected four highlighted in italics Table 2 shows the results for the individual loss functions reduced to the best parameters for clarity. For the final model, we selected the Tversky Loss with as well as the Focal Tversky Loss with , and , because they provide the highest IoG on the validation set (highlighted in italics). Table 3 shows the IoG for the selected loss functions evaluated on all 90 training samples and the 36 test samples.
Table 2

Step 1: Mean intersection over ground truth for one model trained with each loss function, the selected four highlighted in italics

Model (\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\beta $$\end{document}β)Training (75 patients)Validation (15 patients)
Binary cross-entropy0.9630.923
Focal0.9310.912
Tversky (0.75)0.9700.929
Tversky (0.80)0.9440.933
Tversky (0.85)0.9730.909
Focal Tversky (0.60)0.9540.925
Focal Tversky (0.65)0.9610.931
Focal Tversky (0.70)0.9610.918
Focal Tversky (0.80)0.9690.927
Focal Tversky (0.85)0.9520.932
Focal Tversky (0.90)0.9480.933
Focal Tversky (0.95)0.9580.914
Table 3

Step 1: Mean intersection over ground truth for each loss function in sixfold cross-validation and the final model as average of these models

Model (\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\beta $$\end{document}β)Training (90 patients)Test (36 patients)
Tversky (0.80)0.9510.936
Focal Tversky (0.65)0.9570.937
Focal Tversky (0.85)0.9540.938
Focal Tversky (0.90)0.9430.932
Final model0.9570.938
Step 1: Mean intersection over ground truth for each loss function in sixfold cross-validation and the final model as average of these models The final model resulting from the bagging of several models shows a higher IoG than any of the individual models in Table 2. In the second step, the aorta, including the aortic valve within the obtained bounding box, is segmented. The resulting mask is compared to the reference label with the F1 score (Dice coefficient), which considers precision and recall :Table 4 shows the F1 score for the four loss functions reduced to the best parameters.
Table 4

Step 2: Mean F1 score with the individual loss functions, the selected four highlighted in italics

Model (\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\beta $$\end{document}β)Training (75 patients)Validation (15 patients)
Binary cross-entropy0.9430.935
Focal0.9220.920
Tversky (0.45)0.9250.913
Tversky (0.50)0.9430.929
Tversky (0.55)0.9330.926
Focal Tversky (0.50)0.9280.917
Focal Tversky (0.55)0.9460.937
Focal Tversky (0.60)0.9420.927
Focal Tversky (0.65)0.9450.938
Focal Tversky (0.70)0.9460.938
Focal Tversky (0.75)0.9380.932
Step 2: Mean F1 score with the individual loss functions, the selected four highlighted in italics Table 5 shows the F1 score obtained from the selected loss functions, Tversky Loss with and Focal Tversky Loss with , and , as well as the final model, which is again the averaged output of the models with these four loss functions.
Table 5

Step 2: Mean F1 score for each loss function in sixfold cross-validation and the final model

Model (\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\beta $$\end{document}β)Training (90 patients)Test (36 patients)
Tversky (0.50)0.9420.939
Focal Tversky (0.55)0.9450.936
Focal Tversky (0.65)0.9440.937
Focal Tversky (0.70)0.9440.940
Final model0.9450.940
Step 2: Mean F1 score for each loss function in sixfold cross-validation and the final model The aortic root is found by considering the segmented aortic valve and LVOT in cross sections reformatted to the orientation of the detected valve plane. The minimal area-derived diameter within the aortic root is compared to the minimal area-derived diameter obtained from the annotated data set. Table 6 shows the mean error, which was used for the selection of the optimal loss functions, the Tversky Loss with , and and the Focal Tversky Loss with .
Table 6

Step 3: Mean error in mm with the individual loss functions, the selected four highlighted in italics

Model (\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\beta $$\end{document}β)Training (75 patients)Validation (15 patients)
Binary cross-entropy2.952.63
Focal3.303.48
Tversky (0.50)3.173.71
Tversky (0.55)1.962.49
Tversky (0.60)2.602.70
Tversky (0.80)2.692.76
Tversky (0.85)2.152.6
Tversky (0.90)2.062.52
Tversky (0.95)2.182.82
Focal Tversky (0.75)2.963.01
Focal Tversky (0.80)2.592.62
Focal Tversky (0.85)2.012.64
Step 3: Mean error in mm with the individual loss functions, the selected four highlighted in italics Table 7 shows the results for the automatically obtained diameters from the final model, the diameters deduced from the annotations and the respective error. Table 8 compares the test results of the different CT scanner manufacturers. No significant difference between the errors for individual manufacturers can be observed in our test data set (ANOVA, ).
Table 7

Step 3: Mean minimal diameter ± standard deviation [minimal value, maximal value] (median)

Training (90 patients)Test (36 patients)
Model\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$24.29 \pm 2.87$$\end{document}24.29±2.87 [17.88, 31.99]\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$24.11 \pm 2.57$$\end{document}24.11±2.57 [19.29, 29.87]
From annotation\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$22.84 \pm 3.61$$\end{document}22.84±3.61 [17.86, 31.06]\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$23.21 \pm 2.97$$\end{document}23.21±2.97 [17.97, 31.25]
Error\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$1.90 \pm 1.42$$\end{document}1.90±1.42 [0.03, 5.10] (1.64)\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$1.84 \pm 1.21$$\end{document}1.84±1.21 [0.04, 4.00] (1.89)

All values are given in mm

Table 8

Step 3: Mean minimal diameter ± standard deviation in mm grouped by CT scanner manufacturer

SiemensToshibaGEPhilips
Error\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$2.03 \pm 1.32$$\end{document}2.03±1.32\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$1.62 \pm 1.14$$\end{document}1.62±1.14\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$1.62 \pm 0.88$$\end{document}1.62±0.88\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$2.08 \pm 1.35$$\end{document}2.08±1.35
Step 3: Mean minimal diameter ± standard deviation [minimal value, maximal value] (median) All values are given in mm Step 3: Mean minimal diameter ± standard deviation in mm grouped by CT scanner manufacturer Step 3: Implant size suggestion versus actually implanted size in % Possible error sources: a difference between the annotations (green) and the model (red) in detected plane orientation (lines), aorta and valve segmentation (silhouettes) and segmentation around the annulus plane (solid); in this example, this leads to a difference in the diameter obtained from the model and the annotations of 5.91 mm Table 9 shows the results for implant size selection. We suggested the correct implant size in 81% of the training cases, 61% of the test cases and 64% of the device sizing cases.
Table 9

Step 3: Implant size suggestion versus actually implanted size in %

Training (90 cases)Test (36 cases)Sizing (640 cases)
> 2 sizes smaller103
2 sizes smaller176
1 size smaller142517
Correct size816164
1 size bigger165
2 sizes bigger1\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$<1$$\end{document}<13
\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$> 2$$\end{document}>2 sizes bigger102
On average, the processing time for one patient from the input of the original CT to the measurement of the minimal diameter amounts to 30 s, given the available hardware (see “Appendix”).

Discussion and conclusion

This paper aims to test the suitability of a neural network-based approach to support aortic root analysis for TAVI planning. Cascaded neural networks are applied for three processing steps: detection of the ROI around the aortic root and LVOT, segmentation of the aorta, including the aortic valve, and segmentation of the region around the aortic annulus. The inferred minimal area-derived diameter within the annulus region is compared to the diameter from expert annotations. The aortic root is measured in cross sections, whose orientation corresponds to the annulus plane. The annulus plane is approximated by applying a PCA to the segmentation of the annulus region, masked with the outer edge of the aortic valve segmentation. On average, our calculated minimal area-derived diameter within the annulus region deviates less than 2 mm from the minimal diameter from expert annotations. The calculated diameters are in a range comparable to similar studies [3, 8, 15]. The implant size could be inferred in 81% of the cases for the training set, 62% for the test set and 64% for the device sizing set. No significant difference between different CT scanners could be observed. The accuracy of the model’s predictions depends on the annotations of the data set. For the present study, the training set comprises a relatively small number of 90 cases and 36 cases are used for the evaluation of the model. Further improvement and evaluation with a larger data set are advisable. Future work is also required to optimize the detection of the aortic annulus plane. We currently only consider the plane orientation, while its exact position is estimated by the minimal area-derived diameter in the annulus region. The measured diameters are highly dependent on several factors, such as the orientation of the detected annulus plane. Kütting et. al report that plane tilting leads to a different choice in valve prosthesis size in 33% of cases for of tilt and 66% of cases for [7]. Figure 12 shows an example of possible error sources—a difference in detected plane orientation, aortic valve segmentation and segmentation around the annulus plane. In this example, all error sources are present.
Fig. 12

Possible error sources: a difference between the annotations (green) and the model (red) in detected plane orientation (lines), aorta and valve segmentation (silhouettes) and segmentation around the annulus plane (solid); in this example, this leads to a difference in the diameter obtained from the model and the annotations of 5.91 mm

The optimal valve size does not only depend on the annulus diameter but also other factors, such as the coronary distances, calcifications or aortic dilation. Although the strategy for prosthesis sizing in the clinical setting currently also concentrates on the annulus measurement, we suggest consideration of the more complex three-dimensional aortic root anatomy by, for example, regarding several planes throughout the aortic root along the centerline. This would allow for a thorough analysis of the aortic root contour and diminish the effect of measurement of a single tilted annulus plane. For such an extensive aortic root analysis, an automatic approach would be highly valuable for time efficiency and reproducibility of results. The current results suggest neural network-based aortic root analysis as a promising approach to support fully automatic, time-efficient and reproducible aortic root assessment for TAVI device sizing and selection, which can be improved through enhanced training data on the one hand and more sophisticated consideration of the aortic root anatomy on the other hand.
  8 in total

1.  Patient specific models for planning and guidance of minimally invasive aortic valve implantation.

Authors:  I Waechter; R Kneser; G Korosoglou; J Peters; N H Bakker; R van der Boomen; J Weese
Journal:  Med Image Comput Comput Assist Interv       Date:  2010

2.  Focal Loss for Dense Object Detection.

Authors:  Tsung-Yi Lin; Priya Goyal; Ross Girshick; Kaiming He; Piotr Dollar
Journal:  IEEE Trans Pattern Anal Mach Intell       Date:  2018-07-23       Impact factor: 6.226

3.  Reproducibility of aortic annulus measurements by computed tomography.

Authors:  Annika Schuhbaeck; Stephan Achenbach; Tobias Pflederer; Mohamed Marwan; Jasmin Schmid; Holger Nef; Johannes Rixe; Franziska Hecker; Christian Schneider; Michael Lell; Michael Uder; Martin Arnold
Journal:  Eur Radiol       Date:  2014-05-22       Impact factor: 5.315

4.  An application of cascaded 3D fully convolutional networks for medical image segmentation.

Authors:  Holger R Roth; Hirohisa Oda; Xiangrong Zhou; Natsuki Shimizu; Ying Yang; Yuichiro Hayashi; Masahiro Oda; Michitaka Fujiwara; Kazunari Misawa; Kensaku Mori
Journal:  Comput Med Imaging Graph       Date:  2018-03-16       Impact factor: 4.790

5.  Automatic aortic root segmentation and anatomical landmarks detection for TAVI procedure planning.

Authors:  Florent Lalys; Simon Esneault; Miguel Castro; Lucas Royer; Pascal Haigron; Vincent Auffret; Jacques Tomasi
Journal:  Minim Invasive Ther Allied Technol       Date:  2018-07-24       Impact factor: 2.442

6.  Reliability and Influence on Decision Making of fully-automated vs. semi-automated Software Packages for Procedural Planning in TAVI.

Authors:  Alexander Meyer; Markus Kofler; Matteo Montagner; Axel Unbehaun; Simon Sündermann; Semih Buz; Christoph Klein; Christof Stamm; Natalia Solowjowa; Maximilian Y Emmert; Volkmar Falk; Jörg Kempfert
Journal:  Sci Rep       Date:  2020-07-01       Impact factor: 4.379

7.  Enabling Automated Device Size Selection for Transcatheter Aortic Valve Implantation.

Authors:  Patricio Astudillo; Peter Mortier; Johan Bosmans; Ole De Backer; Peter de Jaegere; Matthieu De Beule; Joni Dambre
Journal:  J Interv Cardiol       Date:  2019-11-03       Impact factor: 2.279

8.  Automatic aortic root landmark detection in CTA images for preprocedural planning of transcatheter aortic valve implantation.

Authors:  Mustafa Elattar; Esther Wiegerinck; Floortje van Kesteren; Lucile Dubois; Nils Planken; Ed Vanbavel; Jan Baan; Henk Marquering
Journal:  Int J Cardiovasc Imaging       Date:  2015-10-23       Impact factor: 2.357

  8 in total
  1 in total

1.  Detection and Characterization of Gastric Cancer Using Cascade Deep Learning Model in Endoscopic Images.

Authors:  Atsushi Teramoto; Tomoyuki Shibata; Hyuga Yamada; Yoshiki Hirooka; Kuniaki Saito; Hiroshi Fujita
Journal:  Diagnostics (Basel)       Date:  2022-08-18
  1 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.