| Literature DB >> 35081148 |
Rock Christian Tomas1, Anthony Jay Sayat2, Andrea Nicole Atienza2, Jannah Lianne Danganan2, Ma Rollene Ramos2, Allan Fellizar3,4,5, Kin Israel Notarte6, Lara Mae Angeles6,7, Ruth Bangaoil3,4, Abegail Santillan3,4, Pia Marie Albano2,3,4.
Abstract
In this study, three (3) neural networks (NN) were designed to discriminate between malignant (n = 78) and benign (n = 88) breast tumors using their respective attenuated total reflection Fourier transform infrared (ATR-FTIR) spectral data. A proposed NN-based sensitivity analysis was performed to determine the most significant IR regions that distinguished benign from malignant samples. The result of the NN-based sensitivity analysis was compared to the obtained results from FTIR visual peak identification. In training each NN models, a 10-fold cross validation was performed and the performance metrics-area under the curve (AUC), accuracy, positive predictive value (PPV), specificity rate (SR), negative predictive value (NPV), and recall rate (RR)-were averaged for comparison. The NN models were compared to six (6) machine learning models-logistic regression (LR), Naïve Bayes (NB), decision trees (DT), random forest (RF), support vector machine (SVM) and linear discriminant analysis (LDA)-for benchmarking. The NN models were able to outperform the LR, NB, DT, RF, and LDA for all metrics; while only surpassing the SVM in accuracy, NPV and SR. The best performance metric among the NN models was 90.48% ± 10.30% for AUC, 96.06% ± 7.07% for ACC, 92.18 ± 11.88% for PPV, 94.19 ± 10.57% for NPV, 89.04% ± 16.75% for SR, and 94.34% ± 10.54% for RR. Results from the proposed sensitivity analysis were consistent with the visual peak identification. However, unlike the FTIR visual peak identification method, the NN-based method identified the IR region associated with C-OH C-OH group carbohydrates as significant. IR regions associated with amino acids and amide proteins were also determined as possible sources of variability. In conclusion, results show that ATR-FTIR via NN is a potential diagnostic tool. This study also suggests a possible more specific method in determining relevant regions within a sample's spectrum using NN.Entities:
Mesh:
Year: 2022 PMID: 35081148 PMCID: PMC8791515 DOI: 10.1371/journal.pone.0262489
Source DB: PubMed Journal: PLoS One ISSN: 1932-6203 Impact factor: 3.240
Fig 1Experimental design process flowchart.
The figure shows the experimental design implemented in the study, from the acquisition of breast tissue samples, to the acquisition, processing and analysis of spectral data.
Clinical data of the patients with breast lesions*.
| Diagnosis | Classification | Total no. of samples ( |
|---|---|---|
| Malignant | Invasive ductal carcinoma ( | 88 |
| Others ( | ||
| Benign | Fibroadenoma ( | 78 |
| Fibrocystic change ( | ||
| Other ( |
*Retrieved from hospital records and were based on microscopic evaluation of H&E-stained slides by resident pathologists of the hospital study sites.
Fig 2PCA biplot showing data points of malignant and benign samples.
The red points denote malignant samples while blue points denote benign samples plotted across the two most dominant components (F1 = 90.28% and F2 = 5.21%). The vectors show the wavenumbers associated with peak absorbance, where those highlighted in green were identified as significant wavenumbers in discriminating benign from malignant samples.
Feedforward neural network architecture.
| FNN2 | FNN4 | FNN8 | |
|---|---|---|---|
|
| input layer– 462 neurons | input layer– 462 neurons | input layer– 462 neurons |
| 2 hidden FC layers –350 neurons | 4 hidden FC layers– 400 neurons | 8 hidden FC layers –300 neurons | |
| output layer– 2 neurons | output layer– 2 neurons | output layer– 2 neurons | |
|
| 0.01 | 0.01 | 0.01 |
|
| Gaussian random: | ||
|
| Z-score normalization: | ||
|
| Input/Hidden layers–SELU | ||
| Output layer—softmax | |||
|
| Binary cross-entropy | ||
|
| 90% SELU dropout | ||
|
| AdaGrad stochastic gradient descent (SGD) | ||
|
| 1000 | ||
Fig 3A. Grid search surface plot of FNN2. The plot shows the grid search surface plot for optimizing the FNN2 model for learning rate and number of neurons per hidden layer. Validation accuracy peaked at a learning rate of 0.01 and 350 neurons per hidden layer. Low performance at high learning rates (blue region) may be due to divergence and high parameter oscillations, while stagnation of performance at low learning rates (green region) may be due to insufficient training time. B. Grid search surface plot of FNN4. The plot shows the grid search surface plot for optimizing the FNN4 model for learning rate and number of neurons per hidden layer. Validation accuracy peaked at a learning rate of 0.01 and 400 neurons per hidden layer. The same behavior in the low and high learning rate regions, observed in the FNN2 surface plot, is also evident here. C. Grid search surface plot of FNN8. The plot shows the grid search surface plot for optimizing the FNN8 model for learning rate and number of neurons per hidden layer. Validation accuracy peaked at a learning rate of 0.01 and 300 neurons per hidden layer. Among the FNN surface plots, the FNN8 constituted to the most unstable response in validation accuracy.
Diagnostic performance of the models.
| Model | AUC (%) | Accuracy (%) | PPV (%) | NPV (%) | SR (%) | RR (%) |
|---|---|---|---|---|---|---|
|
| 71.58±11.84 | 66.17±10.20 | 77.67±13.47 | 55.98±15.34 | 74.35±11.80 | 61.56±9.65 |
|
| 86.27±9.58 | 65.05±12.63 | 68.83±31.57 | 60.79±41.06 | 53.46±32.44 | 73.00±23.96 |
|
| 66.90±10.90 | 64.69±10.41 | 54.44±16.24 | 77.40±15.09 | 60.23±9.62 | 74.22±15.28 |
|
| 69.03±12.83 | 69.38±11.58 | 69.56±15.82 | 69.56±17.37 | 67.79±13.58 | 73.19±12.93 |
|
| 84.63±9.30 | 76.78±9.49 | 76.94±14.56 | 76.60±14.88 | 76.18±12.23 | 79.91±10.88 |
|
| 95.72±4.94 | 90.44±7.78 | 91.03±9.61 | 89.77±10.33 | 90.56±9.68 | 91.40±8.34 |
|
| 90.05±9.95 | 96.06±7.07 | 89.83±12.57 | 94.19±10.57 | 85.56±18.33 | 94.34±10.54 |
|
| 90.48±10.30 | 95.54±8.07 | 91.72±12.06 | 92.93±12.81 | 88.38±17.47 | 92.63±13.31 |
|
| 90.35±10.10 | 95.46±7.55 | 92.18±11.88 | 91.85±12.67 | 89.04±16.75 | 91.58±13.47 |
Abbreviations: LDA–linear discriminant analysis; SVM–support vector machines, FNN—feed forward neural network; AUC—area under the curve; PPV—positive predictive value, NPV- negative predictive value; SR—specificity rate; RR—recall rate.
Test of significance of neural network performance metrics relative to SVM.
| Model | Difference of average performance metric | |||||
|---|---|---|---|---|---|---|
| AUC (%) | ACC (%) | PPV (%) | NPV (%) | SR (%) | RR (%) | |
|
| -5.67 ( | 5.62 ( | -1.20 ( | 4.42 ( | -4.95 ( | 2.94 ( |
|
| -5.24 ( | 5.09 ( | 0.69 ( | 3.16 ( | -2.18 ( | 1.23 ( |
|
| -5.37 ( | 5.01 ( | 1.15 ( | 2.08 ( | -1.52 ( | 0.17 ( |
*The differences of performance metrics were computed by subtracting the FNN performance metric to that of the SVM.
** Mann-Whitney U test (two-tailed); significant when p<0.05.
Abbreviations: : LDA–linear discriminant analysis; SVM–support vector machines, FNN—feed forward neural network; AUC—area under the curve; ACC—accuracy ;PPV—positive predictive value, NPV- negative predictive value; SR—specificity rate; RR—recall rate.
Fig 4Median ATR-FTIR absorbance spectra of malignant (n = 88) and benign (n = 78) breast tissue samples.
The figure shows the median FTIR spectrum of malignant and benign breast tissue samples and their corresponding peaks identified via visual analysis. The plot shows almost similar absorbance among benign and malignant samples within wavenumbers associated with the amide proteins. Benign tissue samples, relative to malignant tissue samples, are shown to have increased absorbance within the region associated with lipids and nucleic acids while having decreased absorbance within the region associated with carbohydrates, glycogen, and phosphorylated proteins.
Comparison of the spectrum variables (peak positions and normalized absorbances) of malignant and benign breast samples in the fingerprint IR region (1800cm-1 to 850cm-1) via visual peak identification.
| Malignant samples ( | Benign samples ( | ||||||
|---|---|---|---|---|---|---|---|
| Peak position | Mean abs ±SD | Peak position | Mean abs ±SD | Functional Group | Vibrational Mode | Molecular Source[ | |
| P1632 | 2.8311 ±0.2347 | P1634 | 2.7934 ±0.1968 | O = C-N-H | ν(CO), ν(CN) | Amide I, protein | |
| P1539 | 2.1152 ±0.2475 | P1540 | 2.1533 ±0.1955 | O = C-N-H | γ(N-H), ν(C-C), ν(C-N) | Amide II, protein | |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |||
|
|
|
|
|
| |||
|
|
|
|
|
|
|
|
|
| P1160 | -0.8352 ±0.2566 | P1160 | -0.7759 ±0.2634 | C-O-H | ν(CO), γ(COH) | Carbohydrates | |
| P1032 | -0.1732 ±0.3355 | P1030 | -0.2386 ±0.2966 | C-O-H | def(CHO) | Glycogen | |
| P880 | 0.1482 ±1.0361 | P878 | -0.0945 ±0.9590 | C-O-P | ν(COP) | Phosphorylated protein | |
* Mann-Whitney U test (two-tailed); significant when p<0.05.
**values in bold refer to significantly higher peak absorbance (p<0.05).
Abbreviations: ν: stretching; δ: bending; γ: wagging, twisting and rocking; s: symmetric; as: asymmetric; def: deformation.
References:
[1] Wu M, Zhang W, Tian P, et al. Intraoperative diagnosis of thyroid diseases by fourier transform infrared spectroscopy based on support vector machine. Int J Clin Exp Med 2016; 9: 2351–2358.
[2] Dong L, Sun X, Chao Z, et al. Evaluation of FTIR spectroscopy as diagnostic tool for colorectal cancer using spectral analysis. Spectrochim Acta—Part A Mol Biomol Spectrosc 2014; 122: 288–294.
[3] Simonova D, Karamancheva I. Application of Fourier transform infrared spectroscopy for tumor diagnosis. Biotechnol Biotechnol Equip 2013; 27: 4200–4207.
[4] Lewis PD, Lewis KE, Ghosal R, et al. Evaluation of FTIR Spectroscopy as a diagnostic tool for lung cancer using sputum. BMC Cancer 2010; 10: 640.
[5] Zhang X, Xu Y, Zhang Y, et al. Intraoperative detection of thyroid carcinoma by fourier transform infrared spectrometry. J Surg Res 2011; 171: 650–656.
Fig 5Input response of neural networks from the designed NN-based sensitivity analysis.
The line plots show the input response of each neural network design per change of absorbance value per wavenumbers. A high per cent contribution magnitude implies a high response to a change for the particular wavenumber, hence may serve as a marker in identifying malignant samples from benign samples. As evident from the figure, the response of each network is nearly the same, which only varies slightly in the magnitude contribution.