Literature DB >> 34397844

Added value of deep learning-based computer-aided diagnosis and shear wave elastography to b-mode ultrasound for evaluation of breast masses detected by screening ultrasound.

Min Young Kim1,2,3, Soo-Yeon Kim1,2,3, Yeon Soo Kim1,2,3, Eun Sil Kim1,2,3, Jung Min Chang1,2,3.   

Abstract

ABSTRACT: Low specificity and operator dependency are the main problems of breast ultrasound (US) screening. We investigated the added value of deep learning-based computer-aided diagnosis (S-Detect) and shear wave elastography (SWE) to B-mode US for evaluation of breast masses detected by screening US.Between February 2018 and June 2019, B-mode US, S-Detect, and SWE were prospectively obtained for 156 screening US-detected breast masses in 146 women before undergoing US-guided biopsy. S-Detect was applied for the representative B-mode US image, and quantitative elasticity was measured for SWE. Breast Imaging Reporting and Data System final assessment category was assigned for the datasets of B-mode US alone, B-mode US plus S-Detect, and B-mode US plus SWE by 3 radiologists with varied experience in breast imaging. Area under the receiver operator characteristics curve (AUC), sensitivity, and specificity for the 3 datasets were compared using Delong's method and McNemar test.Of 156 masses, 10 (6%) were malignant and 146 (94%) were benign. Compared to B-mode US alone, the addition of S-Detect increased the specificity from 8%-9% to 31%-71% and the AUC from 0.541-0.545 to 0.658-0.803 in all radiologists (All P < .001). The addition of SWE to B-mode US also increased the specificity from 8%-9% to 41%-75% and the AUC from 0.541-0.545 to 0.709-0.823 in all radiologists (All P < .001). There was no significant loss in sensitivity when either S-Detect or SWE were added to B-mode US.Adding S-Detect or SWE to B-mode US improved the specificity and AUC without loss of sensitivity.
Copyright © 2021 the Author(s). Published by Wolters Kluwer Health, Inc.

Entities:  

Mesh:

Year:  2021        PMID: 34397844      PMCID: PMC8341270          DOI: 10.1097/MD.0000000000026823

Source DB:  PubMed          Journal:  Medicine (Baltimore)        ISSN: 0025-7974            Impact factor:   1.817


Introduction

Breast ultrasound (US) can detect early stage breast cancers in asymptomatic women with dense breast.[ However, low specificity, low positive predictive value, and operator dependency are the main problems of breast US.[ To overcome the limitations of conventional B-mode US, additional US techniques measuring quantitative features of stiffness values or morphologic characteristics have been developed. For instance, US elastography, which measures and visualizes the intrinsic strain of a target mass, provides additional information for mass characterization, and increases the accuracy of breast US by providing tissue stiffness information.[ Among elastography techniques, shear wave elastography (SWE) evaluates the propagation speed of shear-wave through tissue and provides the quantitative measurements, and this is more reproducible than strain elastography.[ Prior studies have reported that addition of SWE features to B-mode US improved specificity without losing sensitivity.[ As another quantitative technique, computer-aided diagnosis (CAD) has been applied to breast US interpretation, providing assistance in the morphologic analysis of breast masses.[ S-Detect is a recently developed deep learning-based CAD software (S-Detect; Samsung Medison Co., Seongnam, Korea).[ It analyzes the morphological features of breast masses according to the breast imaging reporting and data systems (BI-RADS) lexicon and then provides a dichotomized final assessment (“possibly benign” or “possibly malignant”) on the possibility of malignancy of a breast mass.[ Prior studies have reported that use of S-Detect in assessment of breast masses has improved diagnostic accuracy and specificity.[ Screening US examinations have detected average 3 to 4 breast cancers per 1000 US examinations in women with dense breast.[ Efforts to detect more cancers using screening US have led to a lot of recalls and false-positive biopsies. As described above, the additional use of SWE or S-Detect has shown improved performances in assessing breast masses compared to using conventional B-mode US alone.[ However, prior studies using SWE or S-Detect have included patients with variable conditions regardless of patients’ symptoms or mammographic findings. To our knowledge, no study has evaluated the added value of SWE and S-Detect focusing on breast masses detected by screening US. Breast cancers detected by screening US tend to be small in size and lack of typical malignant features, compared to palpable breast cancers or screening mammography-detected breast cancers.[ Thus, the additional information obtained from SWE and S-Detect could be more useful for evaluating breast masses detected by screening US. Furthermore, using the complementary tools would be more helpful to less-experienced radiologists as it provides additional information to aid diagnosis.[ Therefore, the purpose of our study was to evaluate the added value of S-Detect and SWE to B-mode US for evaluating breast masses detected by screening US among radiologists with different level of experiences.

Materials and methods

Study participants

This single center prospective study was approved by an institutional review board and the recruited participants with written informed consent from February 2018 to June 2019 in a tertiary university hospital. The inclusion criteria were asymptomatic women scheduled for US-guided core needle biopsy for breast masses detected by screening US. The exclusion criteria were breast symptoms including lumps or nipple discharge, positive findings on mammography (BI-RADS final assessment category 0, 3, 4, or 5), a personal history of breast cancer, a recently diagnosed breast cancer, and refusal to participate in this study.

Ultrasound examination

All US examinations were performed before US-guided biopsy using 3 to 12 MHz linear probes and a real-time US system (RS85 Prestige; Samsung Medison Co., Seongnam, Korea) equipped with a deep learning-based CAD software (S-Detect). S-Detect employs a deep convolutional neural network that can process large-scale high-dimensional data and determine how to weight parameters through multiple layers of abstraction.[ Weights are used to compute the representation of the data at each layer, and the complex features of multiple levels of representation can be learned. In the final layer, the inputs from the previous layers are computed as probabilities and the outputs from the other networks are combined to make a final decision. B-mode US, S-Detect, and SWE images for each breast mass were obtained before undergoing biopsy by a dedicated breast radiologist (J.M.C. with 13 years of experience). The most representative images were selected on B-mode US, followed by application of S-Detect software. To obtain S-Detect images, when the center of mass was indicated by the radiologist, a region of interest (ROI) was automatically drawn along the margin of the mass by the S-Detect software. An analysis button was pressed after the ROI was drawn, and then ROI-based US features and the possibility of malignancy (the final assessment) were automatically evaluated and displayed on the US monitor. The automatic analysis took less than 5 seconds. The ROI-based US features included shape, orientation, margin, posterior features, and echo pattern characteristics according to the 5th edition of BI-RADS lexicon. The final assessment result was provided in the dichotomized form of “possibly benign” or “possibly malignant”. After B-mode US with S-Detect image acquisition, SWE images were generated by the same radiologists. On SWE, a color-coded image representing the elasticity (kilopascals, kPa) for each pixel was obtained with a default color scale ranging from dark blue, green, yellow, orange, to red. The closer it is to the red scale, the harder it is, and the closer it is to the blue scale, the softer it is. Quantitative elasticity values ranged from 0 to 180 kPa. Once the color-coded SWE image was displayed on the screen, 2 circular ROIs were placed on the mass and normal fat region, respectively for the quantitative assessment.[ The ROI for mass was placed on the stiffest part of the mass based on the color scale, and the ROI for fat was placed on the normal fat region showing a uniform dark blue color. The circular ROI with 0.9-mm diameter was a default mode recommended by the vendor. For each ROI, the elasticity parameters including the maximum, minimum, mean, and standard deviation were calculated and displayed on the US monitor as kPa. The lesion-to-fat elasticity ratio was defined as mean elasticity of the lesion ROI divided by mean elasticity of the fat ROI and displayed on the US monitor as percentages.

Image analysis

Prospective image analysis was performed by the radiologist during image acquisition. The radiologist assessed the BI-RADS final assessment category 3 times as follows. First, BI-RADS category was evaluated based on B-mode US features alone (B-mode US). Second, BI-RADS category was evaluated by combining S-Detect results to B-mode US (B-mode US plus S-Detect). Third, BI-RADS category was evaluated by combining SWE results to B-mode US (B-mode US plus SWE). All breast masses underwent biopsy regardless of the image review results. After completion of participants’ enrollment, additional retrospective image analysis was independently performed by 2 radiologists with different experiences in breast imaging (S.Y.K., a dedicated breast radiologist with 6 years of experience and M.Y.K., a 4th-year resident with 3 months of breast imaging training). The participant's clinical information and pathology were blinded during image analysis. There was a total of 3 review sessions with two-week intervals between each review. In the first review session (B-mode US), the reviewers analyzed only the B-mode US features and recorded the BI-RADS final assessment category. In the second review session (B-mode US plus S-Detect), the reviewers examined the B-mode US and S-Detect results together and recorded the BI-RADS final assessment category. SWE results were blinded in the second session. In the third review session (B-mode US plus SWE), SWE results were united with the B-mode US to evaluate the BI-RADS final assessment category. S-Detect results were blinded in this session. The change of category after combining S-Detect or SWE to B-mode US depended on the subjective judgment of the radiologists. It could be an upgrade, a downgrade, or maintain the original chosen category. For example, if a lesion was assigned as BI-RADS category 2 or 3 on B-mode US, but showed “possibly malignant” on S-Detect or hard elasticity (maximum stiffness color of lesion: orange to red, maximum elasticity of lesion greater than 135kPa) on SWE, the category could be upgraded to 4 or higher or kept at 3. Contrariwise, if a lesion was assigned as BI-RADS category 4 on B-mode US, but showed “possibly benign” on S-Detect or soft elasticity (maximum stiffness color of lesion: blue, maximum elasticity of lesion less than 30kPa) on SWE, the category could be downgraded to 2 or 3 or kept at 4.

Data and statistical analysis

Clinical data including age, menopausal status, family history of breast cancer, mammographic density, and US data including size at US, the dichotomized assessment of S-Detect, maximum elasticity, mean elasticity, and lesion-to-fat elasticity ratio of SWE and final pathologic data were collected from medical records. To differentiate benign and malignant breast lesions, area under the receiver operator characteristics (ROC) curve (AUC), sensitivity and specificity were calculated for S-Detect and SWE parameters. For quantitative SWE parameters, the optimal cut-off value was determined by maximizing the sum of sensitivity and specificity on the estimated ROC curve (the Youden index). SWE parameters were also compared between benign and malignant breast lesions by using the independent t-test. The final assessment categories of each mass after the radiologist's review were dichotomized for the statistical analysis. The cutoff for separating benign and malignant masses was set at category 4a, that is, category 2 and 3 were considered as benign, and categories 4a to 5 were considered as malignant. AUC, sensitivity and specificity of B-mode US, B-mode US plus S-Detect and B-mode US plus SWE were calculated for each reviewer data and compared using Delong's method for AUC and McNemar test for sensitivity and specificity. Fleiss kappa statistics were used to analyze the interobserver agreement on each review session. Kappa value <0 indicated poor agreement; 0 to 0.20, slight agreement; 0.21 to 0.40, fair agreement; 0.41 to 0.60, moderate agreement; 0.61 to 0.80, substantial agreement; and 0.81 to 1.00, almost perfect agreement.[ Statistical analyzes were performed using MedCalc Statistical Software version 19.1.3 (MedCalc Software bv, Ostend, Belgium; https://www.medcalc.org; 2019) and STATA software version 14.0 (StataCorp, College Station, TX). P value of less than .05 indicated statistical significance.

Results

Demographics

A total of 156 breast lesions in 146 women (mean age, 46 ± 10 years; ranges, 23–74) who met the inclusion and exclusion criteria were analyzed in this study (Table 1). From these participants, 10 (7%) had 2 breast lesions and the other 136 (93%) had one breast lesion. Of total 146 women, 130 (89%) had dense breast and 16 (11%) had fatty breast on mammography. All women had BI-RADS 1 or 2 on mammography. The mean size of breast lesions at US was 1.1 cm with ranges from 0.3 cm to 3.4 cm. The lesions consisted of 10 malignant lesions (8 invasive ductal carcinomas (IDC) and 2 ductal carcinomas in situ [DCIS]) and 146 benign lesions. The benign lesions were characterized as follows: 58 fibroadenomas, 21 fibrocystic changes, 14 intraductal papillomas, 13 fibroadenomatoid changes, 13 sclerosing adenoses, 5 stromal fibroses, 4 atypical ductal hyperplasias, 4 usual ductal hyperplasias, 4 duct ectasias, 3 benign phyllodes tumors, 2 atypical ductal hyperplasias involving intraductal papillomas, 2 fat necroses, 1 nodular adenosis, 1 cholesterol granuloma, and 1 adenomyoepithelioma.
Table 1

Patients characteristics.

CharacteristicsValue
Number of patients146
Number of breast lesions156
Age (yr)
 Mean ± standard deviation46 ± 10
 Ranges23–74
Menopause
 Pre-104 (71)
 Post-42 (29)
Family history
 No130 (89)
 Yes16 (11)
Mammography density
 Fatty16 (11)
 Dense130 (89)
Size on ultrasound (cm)
 Mean ± standard deviation1.1 ± 0.5
 Ranges0.3 - 3.4
Biopsy results
 Benign146 (94)
 Malignancy10 (6)
Patients characteristics.

S-Detect and shear wave elastography to predict malignancy

The individual performances of S-Detect and SWE parameters to predict malignancy are provided in Table 2. Of 10 malignancies, only 3 had a “possibly malignant” assessment on S-Detect, which yielded 30% sensitivity, 84.9% specificity and 0.575 of AUC. Orange or red maximum stiffness color on SWE had 50% sensitivity, 90.4% specificity, and 0.702 of AUC. Maximum elasticity (mean, 83.9 kPa vs 44.6 kPa, P < .001), mean elasticity (mean, 79.7 kPa vs 41.3 kPa, P < .001), and lesion-to-fat elasticity ratio (mean, 881.3% vs 481.5%, P = .029) of malignant breast lesions were significantly higher than those of benign breast lesions. Maximum elasticity with a cut-off value of 44.5kPa had 90% sensitivity, 61.6% specificity, and 0.784 of AUC. Mean elasticity with a cut-off value of 39.8kPa had 90% sensitivity, 61.6% specificity, and 0.783 of AUC. Lesion-to-fat elasticity ratio with a cut-off value of 304.5% had 90% sensitivity, 48.6% specificity, and 0.675 of AUC.
Table 2

S-Detect and SWE parameters to predict malignancy.

Benign (n = 146)Malignant (n = 10)AUCSensitivity (%)Specificity (%)
S-Detect final assessment, n (%)
 Possibly benign124 (95)7 (5)0.57530 (3/10)84.9 (124/146)
 Possibly malignant22 (88)3 (12)
SWE maximum stiffness color, n (%)
 Blue or Green132 (96)5 (3.6)0.70250 (5/10)90.4 (132/146)
 Orange or Red14 (74)5 (26)
SWE maximum elasticity (kPa), Mean ± SD44.6 ± 31.283.9 ± 42.50.78490 (9/10)61.6 (90/146)
SWE mean elasticity (kPa), Mean ± SD41.3 ± 30.179.7 ± 41.40.78390 (9/10)61.6 (90/146)
SWE lesion-to-fat elasticity ratio (%), Mean ± SD481.5 ± 533.7881.3 ± 833.30.67590 (9/10)48.6 (71/146)
S-Detect and SWE parameters to predict malignancy.

Added value of S-Detect or shear wave elastography to B-mode ultrasound

AUC, sensitivity, and specificity of B-mode US, B-mode US plus S-Detect, and B-mode US plus SWE are provided in Table 3. ROC curves are compared in Fig. 1. With B-mode US alone, all readers showed 100% (10 out of 10) sensitivity. However, specificity was 8.9% (13 out of 146) in reader 1 and reader 3 and 8.2% (12 out of 146) in reader 2. AUC was 0.545 in reader 1 and reader 3 and 0.541 in reader 2.
Table 3

Added value of S-Detect or SWE to B-mode US.

Reader 1Reader 2Reader 3
AUCSensitivity (%)Specificity (%)AUCSensitivity (%)Specificity (%)AUCSensitivity (%)Specificity (%)
B-mode US0.545100 (10/10)8.9 (13/146)0.541100 (10/10)8.2 (12/146)0.545100 (10/10)8.9 (13/146)
B-mode US
 plus S-Detect0.80390 (9/10)70.5 (103/146)0.658100 (10/10)31.5 (46/146)0.75890 (9/10)61.6 (90/146)
B-mode US
 plus SWE0.72490 (9/10)54.8 (80/146)0.709100 (10/10)41.8 (61/146)0.82390 (9/10)74.7 (109/146)
P value1<.001>.999<.001<.001NA<.001<.001>.999<.001
P value2<.001>.999<.001<.001NA<.001<.001>.999<.001
P value3.313>.999.001.004NA.008<.001NA<.001
Figure 1

The receiver operator characteristics (ROC) curves comparing B-mode US, B-mode US plus S-Detect, and B-mode US plus shear wave elastography (SWE) in reader 1 (A), reader 2 (B), and reader 3 (C), respectively.

Added value of S-Detect or SWE to B-mode US. The receiver operator characteristics (ROC) curves comparing B-mode US, B-mode US plus S-Detect, and B-mode US plus shear wave elastography (SWE) in reader 1 (A), reader 2 (B), and reader 3 (C), respectively. When adding S-Detect to B-mode US, the specificity significantly increased in all readers compared to B-mode US alone (8.9% [13 of 146] vs 70.5% [103 of 146], P < .001 in reader 1; 8.2% [12 of 146] vs 31.5% [46 of 146], P < .001 in reader 2; 8.9% [13 of 146] vs 61.6% [90 of 146], P < .001 in reader 3) (Fig. 2). Reader 2 did not miss cancer whereas reader 1 and reader 3 missed 1 malignancy, albeit without a statistically significant difference in sensitivity (100% vs 90%, P > .999). The AUC significantly increased in all readers (0.545 vs 0.803, P < .001 in reader 1, 0.541 vs 0.658, P < .001 in reader 2, 0.545 vs 0.758, P < .001 in reader 3).
Figure 2

A fibroadenoma correctly downgraded by adding S-Detect and shear wave elastography (SWE). (A) B-mode US in a 52-year-old woman shows a 1.1 cm breast mass with Breast Imaging Reporting and Data Systems (BI-RADS) final assessment category 4A by all 3 radiologists. (B) The mass is assessed as “possibly benign” on S-Detect. (C) The mass shows dark blue maximum stiffness color with maximum elasticity of 16.2kPa. All radiologists downgraded this mass to category 3 when S-Detect and SWE were added to B-mode US. The mass was confirmed as fibroadenoma on US-guided 14-gauge core needle biopsy and was stable on the 12-month follow-up ultrasound.

A fibroadenoma correctly downgraded by adding S-Detect and shear wave elastography (SWE). (A) B-mode US in a 52-year-old woman shows a 1.1 cm breast mass with Breast Imaging Reporting and Data Systems (BI-RADS) final assessment category 4A by all 3 radiologists. (B) The mass is assessed as “possibly benign” on S-Detect. (C) The mass shows dark blue maximum stiffness color with maximum elasticity of 16.2kPa. All radiologists downgraded this mass to category 3 when S-Detect and SWE were added to B-mode US. The mass was confirmed as fibroadenoma on US-guided 14-gauge core needle biopsy and was stable on the 12-month follow-up ultrasound. The addition of SWE to B-mode US, also increased specificity in all readers compared to B-mode US alone (8.9% [13 of 146] vs 54.8% [80 of 146], P < .001 in reader 1; 8.2% [12 of 146] vs 41.8% [61 of 146], P < .001 in reader 2; 8.9% [13 of 146] vs 74.7% [109 of 146], P < .001 in reader 3) (Fig. 2). Reader 2 did not miss cancer whereas reader 1 and reader 3 missed 1 malignancy, without a statistically significant loss in sensitivity (100% vs 90%, P > .999). Accordingly, the AUC significantly increased in all readers (0.545 vs 0.724, P < .001 in reader 1, 0.541 vs 0.709, P < .001 in reader 2, 0.545 vs 0.823, P < .001 in reader 3). When comparing B-mode US plus SWE and B-mode US plus S-Detect, the specificity (41.8% [61 of 146] vs 31.5% [46 of 146], P = .008 in reader 2; 74.7% [109 of 146] vs 61.6% [90 of 146], P < .001 in reader 3) and AUC (0.709 vs 0.658, P = .004 in reader 2; 0.823 vs 0.758, P < .001 in reader 3) of B-mode US plus SWE were significantly higher than those of B-mode US plus S-Detect in readers 2 and 3. However, in reader 1, the specificity of B-mode US plus S-Detect was significantly higher than that of B-mode US plus SWE (70.5% [103 of 146] vs 54.8% [80 of 146], P = .001) without significant difference in AUC (0.803 vs 0.724, P = .313).

Interobserver variability on each review session

Interobserver agreement among the 3 radiologists were as follows. In the B-mode US session, kappa value was 0.132 (95% confidence interval [CI]: 0.007, 0.214), indicating slight agreement. In the B-mode plus S-Detect session, kappa value was 0.324 (95% CI: 0.233–0.414), indicating fair agreement. In the B-mode plus SWE session, kappa value was 0.355 (95% CI: 0.265–0.446), indicating fair agreement.

Pathological and ultrasound characteristics of malignancy

There were 10 pathologically proven malignancies consisting of 8 IDC and 2 DCIS. All invasive cancers were node-negative, low or intermediate grade, and estrogen receptor-positive/human epidermal growth factor receptor type 2- negative subtype. The median size on B-mode US was 1.1 cm (ranges, 0.7–1.8 cm) and the median size on surgical pathology was 1.5 cm (ranges, 1–4 cm). There were 2 false negative cases when adding S-Detect or SWE to B-mode US. One malignancy (1 cm DCIS with low grade) was falsely downgraded to category 3 when SWE was added to B-mode US in reader 1, due to blue color of SWE (Fig. 3). The other (0.9 cm IDC with low grade) was downgraded to category 3 when S-detect was added to B-mode US in reader 1 and reader 3 due to “probably benign” assessment of S-Detect, and when SWE was added to B-mode US in reader 3 due to green color of SWE (Fig. 4).
Figure 3

A ductal carcinoma in situ with false-negative assessment by adding shear wave elastography (SWE). (A) B-mode US in a 59-year-old woman shows a 1 cm breast mass with Breast Imaging Reporting and Data Systems (BI-RADS) category 4A by all 3 radiologists. (B) S-Detect interprets this mass as “possibly benign,” but the category was maintained by all radiologists. (C) On SWE, majority of the mass shows dark blue color with a small part of light blue color. One radiologist (Reader 1) downgraded this mass to category 3 according to the SWE results.

Figure 4

An invasive ductal carcinoma with false-negative assessment when adding S-Detect and shear wave elastography (SWE). (A) B-mode US in a 55-year-old woman shows a 0.9 cm breast mass with partial microlobulations and Breast Imaging Reporting and Data Systems (BI-RADS) category 4A by all 3 radiologists. (B) S-Detect misinterprets this mass as “possibly benign”. Two radiologists (Reader 1 and Reader 3) downgraded this mass to category 3 according to the S-Detect results. (C) On SWE, the mass shows green color with maximum elasticity of 45.2kPa. One radiologist (Reader 3) downgraded the mass to category 3 according to the SWE results.

A ductal carcinoma in situ with false-negative assessment by adding shear wave elastography (SWE). (A) B-mode US in a 59-year-old woman shows a 1 cm breast mass with Breast Imaging Reporting and Data Systems (BI-RADS) category 4A by all 3 radiologists. (B) S-Detect interprets this mass as “possibly benign,” but the category was maintained by all radiologists. (C) On SWE, majority of the mass shows dark blue color with a small part of light blue color. One radiologist (Reader 1) downgraded this mass to category 3 according to the SWE results. An invasive ductal carcinoma with false-negative assessment when adding S-Detect and shear wave elastography (SWE). (A) B-mode US in a 55-year-old woman shows a 0.9 cm breast mass with partial microlobulations and Breast Imaging Reporting and Data Systems (BI-RADS) category 4A by all 3 radiologists. (B) S-Detect misinterprets this mass as “possibly benign”. Two radiologists (Reader 1 and Reader 3) downgraded this mass to category 3 according to the S-Detect results. (C) On SWE, the mass shows green color with maximum elasticity of 45.2kPa. One radiologist (Reader 3) downgraded the mass to category 3 according to the SWE results. When S-Detect was added to B-mode US, 3 malignancies had upgraded category within category 4 by all 3 readers due to the “possibly malignant” assessment of S-Detect (Figs. 4 and 5). When SWE was added to B-mode US, 3 malignancies had upgraded category within category 4 by all 3 readers due to orange to red color of SWE (Figs. 5 and 6).
Figure 5

An invasive ductal carcinoma with upgraded category when adding S-Detect and shear wave elastography (SWE). (A) B-mode US in a 44-year-old woman shows a 1.2 cm irregular and not-parallel mass with Breast Imaging Reporting and Data Systems (BI-RADS) category 4B by all 3 radiologists. (B) S-Detect correctly interprets this mass as “possibly malignant”. (C) On shear wave elastography (SWE), the mass shows red color with maximum elasticity of 148.2kPa. When S-Detect and SWE were added to B-mode US, all radiologists had more confidence in malignancy diagnosis, upgrading this mass to BI-RADS category 4C.

Figure 6

An invasive ductal carcinoma with upgraded category when adding S-Detect and shear wave elastography (SWE). (A) B-mode US in a 49-year-old woman shows a 1.5 cm mildly irregular and parallel mass with BI-RADS category 4A by 2 radiologists and 4B by 1 radiologist. (B) S-Detect correctly classifies this mass as “possibly malignant”. (C) The mass shows orange color with maximum elasticity of 91.1kPa on SWE. All radiologists upgraded BI-RADS category by 1 level when adding S-Detect and SWE.

An invasive ductal carcinoma with upgraded category when adding S-Detect and shear wave elastography (SWE). (A) B-mode US in a 44-year-old woman shows a 1.2 cm irregular and not-parallel mass with Breast Imaging Reporting and Data Systems (BI-RADS) category 4B by all 3 radiologists. (B) S-Detect correctly interprets this mass as “possibly malignant”. (C) On shear wave elastography (SWE), the mass shows red color with maximum elasticity of 148.2kPa. When S-Detect and SWE were added to B-mode US, all radiologists had more confidence in malignancy diagnosis, upgrading this mass to BI-RADS category 4C. An invasive ductal carcinoma with upgraded category when adding S-Detect and shear wave elastography (SWE). (A) B-mode US in a 49-year-old woman shows a 1.5 cm mildly irregular and parallel mass with BI-RADS category 4A by 2 radiologists and 4B by 1 radiologist. (B) S-Detect correctly classifies this mass as “possibly malignant”. (C) The mass shows orange color with maximum elasticity of 91.1kPa on SWE. All radiologists upgraded BI-RADS category by 1 level when adding S-Detect and SWE.

Discussion

Our study found that using S-Detect or SWE had added value in the differential diagnosis of breast masses detected by screening US. Compared to using conventional B-mode US alone, the additional use of S-Detect or SWE significantly improved specificity and AUC without losing the sensitivity of all radiologists. In addition, when adding S-Detect or SWE to B-mode US, interobserver agreement between 3 radiologists with different levels of experience improved from slight to fair agreement. These results were concordant with prior literature which applied S-Detect or SWE in the different study settings.[ In our study, the preferred method as a second opinion provider differed depending on the radiologists. Differences in experiences and image review settings may have affected these different opinions. Reader 1 with the highest experiences in breast US and SWE and in the prospective real-time analysis setting preferred S-Detect over SWE: the specificity and AUC of B-mode US plus S-Detect were higher than those of B-mode US plus SWE with statistical significance for specificity in reader 1. Whereas, reader 2 and 3 with relatively lower experience in breast US and SWE and in the retrospective analysis setting preferred SWE over S-Detect: the specificity and AUC of B-mode US plus SWE were significantly higher than those of B-mode US plus S-Detect in readers 2 and 3. With the recent advance of deep learning technology, the deep learning algorithms have been used in various field of US including image acquisition, processing, and interpretation. Elasticity-based state-space approach was accurate in measuring the two-dimentional motion of the carotid artery.[ A deep learning-based framework was effective for the strain reconstruction of elastography.[ S-Detect, a deep learning-based CAD software, has shown its ability as a useful diagnostic tool that can improve the accuracy and specificity in evaluating breast masses for both novice and experienced readers.[ Compared to previous studies using S-Detect, the different point of our study was that we compared the diagnostic performances of B-mode US alone, B-mode US plus SWE, and B-mode US plus S-Detect focusing on breast masses detected by screening US. Most breast cancers detected by screening US are small in size, without calcification, and lack of typical malignant US features.[ Because of these properties, differentiating screening US-detected breast masses as benign or malignant can be challenging and this may reduce the accuracy of screening US. Based on our results, the combined use of S-Detect or SWE to B-mode US could be helpful in reducing false-positive biopsy without missing cancers. Of the 10 malignancies in our study, 80% (8 of 10) were invasive and all were node-negative. All invasive cancers were low or intermediate grade and estrogen receptor-positive/human epidermal growth factor receptor type 2- negative subtype. The median size on surgical pathology was 1.5 cm. These favorable histologic findings are consistent with the reported pathologic features of breast cancer detected by screening US.[ When adding S-Detect or SWE to B-mode US, false-negative assessments occurred in 2 readers although there was no statistically significant loss in sensitivity. When S-Detect was added to B-mode US, 1 cancer was missed by 2 readers, because S-Detect misinterpreted the microlobulated margin that exists at a portion of the cancer as a circumscribed margin. It suggests the difficulty of accurate evaluation of margins in small breast masses, and the suspicious margin features identified on B-mode US should not be overlooked.[ When SWE was added to B-mode US, 2 cancers were missed, because the lesions showed blue or green as the maximum stiffness color. These results were concordant with the previous study in that small, low grade, and screening detected cancers tend to show soft elasticity.[ Among quantitative SWE parameters, maximum and mean elasticity showed high accuracy with AUC of 0.783 to 0.784 in differentiating benign and malignant breast lesions, concordant with the prior study.[ With regard to the dichotomized final assessment of S-Detect, S-Detect misinterpreted 7 cancers as “possibly benign”. The sensitivity reported in our study (30%) was lower than that reported in the previous studies (72%–91%).[ An explanation for this may be the difference in inclusion criteria of breast masses and the number of malignancies in the studies. Previous studies included symptomatic breast masses as well, while our study included only asymptomatic breast masses detected by screening US. This indicates that breast masses analyzed in this study were challenging cases with a small size and lack of suspicious US features. In addition, the small number of malignancies in our study may account for the low sensitivity of S-Detect. In order to safely use S-Detect without missing cancers in a screening setting, it is necessary to improve the diagnostic ability of S-Detect for small asymptomatic breast masses through deep learning training. Our study had limitations. First, as a single center study, all of B-mode US, SWE and S-Detect images were acquired by 1 radiologist, thus the reproducibility may be limited. Second, in terms of SWE application, the quantitative SWE parameters could differ according to the ROI location and size. The superiority of a small ROI approach used in our study has been demonstrated in previous studies,[ but a further clinical study including various radiologists as readers would be necessary to validate the reproducibility. Third, for reader 2 and reader 3, US images were retrospectively reviewed using the representative still images, not the real-time review. Fourth, the number of cancers included in this study were small (n = 10). However, it is known that the cancer detection rate of screening US in women with negative mammography is low as approximately 3 to 4 cancers per 1000 US examinations.[ In conclusion, deep learning-based CAD and SWE may be used as supplemental diagnostic tools to improve the specificity and AUC of screening breast US without a statistically significant loss of sensitivity in asymptomatic women with negative mammography, regardless of radiologists’ experience.

Author contributions

Conceptualization: Soo-Yeon Kim, Jung Min Chang. Funding acquisition: Jung Min Chang. Investigation: Min Young Kim, Soo-Yeon Kim. Methodology: Min Young Kim, Soo-Yeon Kim, Jung Min Chang. Supervision: Soo-Yeon Kim. Writing – original draft: Min Young Kim, Soo-Yeon Kim. Writing – review & editing: Soo-Yeon Kim, Yeon Soo Kim, Eun Sil Kim, Jung Min Chang.
  36 in total

1.  Distinguishing benign from malignant masses at breast US: combined US elastography and color doppler US--influence on radiologist accuracy.

Authors:  Nariya Cho; Mijung Jang; Chae Yeon Lyou; Jeong Seon Park; Hye Young Choi; Woo Kyung Moon
Journal:  Radiology       Date:  2011-11-14       Impact factor: 11.105

Review 2.  Screening ultrasound as an adjunct to mammography in women with mammographically dense breasts.

Authors:  John R Scheel; Janie M Lee; Brian L Sprague; Christoph I Lee; Constance D Lehman
Journal:  Am J Obstet Gynecol       Date:  2014-06-21       Impact factor: 8.661

Review 3.  Deep learning.

Authors:  Yann LeCun; Yoshua Bengio; Geoffrey Hinton
Journal:  Nature       Date:  2015-05-28       Impact factor: 49.962

4.  Diagnostic performances of shear wave elastography: which parameter to use in differential diagnosis of solid breast masses?

Authors:  Eun Jung Lee; Hae Kyoung Jung; Kyung Hee Ko; Jong Tae Lee; Jung Hyun Yoon
Journal:  Eur Radiol       Date:  2013-02-20       Impact factor: 5.315

5.  A deep learning framework for supporting the classification of breast lesions in ultrasound images.

Authors:  Seokmin Han; Ho-Kyung Kang; Ja-Yeon Jeong; Moon-Ho Park; Wonsik Kim; Won-Chul Bang; Yeong-Kyeong Seong
Journal:  Phys Med Biol       Date:  2017-09-15       Impact factor: 3.609

6.  Focal breast lesion characterization according to the BI-RADS US lexicon: role of a computer-aided decision-making support.

Authors:  Tommaso Vincenzo Bartolotta; Alessia Orlando; Vito Cantisani; Domenica Matranga; Raffele Ienzi; Alessandra Cirino; Francesco Amato; Maria Laura Di Vittorio; Massimo Midiri; Roberto Lagalla
Journal:  Radiol Med       Date:  2018-03-22       Impact factor: 3.469

7.  Automated classification of focal breast lesions according to S-detect: validation and role as a clinical and teaching tool.

Authors:  Mattia Di Segni; Valeria de Soccio; Vito Cantisani; Giacomo Bonito; Antonello Rubini; Gabriele Di Segni; Sveva Lamorte; Valentina Magri; Corrado De Vito; Giuseppe Migliara; Tommaso Vincenzo Bartolotta; Alessio Metere; Laura Giacomelli; Carlo de Felice; Ferdinando D'Ambrosio
Journal:  J Ultrasound       Date:  2018-04-21

Review 8.  Computed-aided diagnosis (CAD) in the detection of breast cancer.

Authors:  C Dromain; B Boyer; R Ferré; S Canale; S Delaloge; C Balleyguier
Journal:  Eur J Radiol       Date:  2012-08-30       Impact factor: 3.528

Review 9.  Value of shear wave elastography in discriminating malignant and benign breast lesions: A meta-analysis.

Authors:  Yan Xue; Shuxin Yao; Xiaodong Li; Huarong Zhang
Journal:  Medicine (Baltimore)       Date:  2017-10       Impact factor: 1.889

10.  Application of computer-aided diagnosis in breast ultrasound interpretation: improvements in diagnostic performance according to reader experience.

Authors:  Ji-Hye Choi; Bong Joo Kang; Ji Eun Baek; Hyun Sil Lee; Sung Hun Kim
Journal:  Ultrasonography       Date:  2017-08-14
View more
  1 in total

1.  Diagnostic accuracy of S-Detect to breast cancer on ultrasonography: A meta-analysis (PRISMA).

Authors:  Xiaolei Wang; Shuang Meng
Journal:  Medicine (Baltimore)       Date:  2022-08-26       Impact factor: 1.817

  1 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.