| Literature DB >> 36209283 |
Shintaro Sukegawa1,2,3, Futa Tanaka4, Takeshi Hara4,5, Kazumasa Yoshii4, Katsusuke Yamashita6, Keisuke Nakano7, Kiyofumi Takabatake7, Hotaka Kawai7, Hitoshi Nagatsuka7, Yoshihiko Furuki8.
Abstract
In this study, the accuracy of the positional relationship of the contact between the inferior alveolar canal and mandibular third molar was evaluated using deep learning. In contact analysis, we investigated the diagnostic performance of the presence or absence of contact between the mandibular third molar and inferior alveolar canal. We also evaluated the diagnostic performance of bone continuity diagnosed based on computed tomography as a continuity analysis. A dataset of 1279 images of mandibular third molars from digital radiographs taken at the Department of Oral and Maxillofacial Surgery at a general hospital (2014-2021) was used for the validation. The deep learning models were ResNet50 and ResNet50v2, with stochastic gradient descent and sharpness-aware minimization (SAM) as optimizers. The performance metrics were accuracy, precision, recall, specificity, F1 score, and area under the receiver operating characteristic curve (AUC). The results indicated that ResNet50v2 using SAM performed excellently in the contact and continuity analyses. The accuracy and AUC were 0.860 and 0.890 for the contact analyses and 0.766 and 0.843 for the continuity analyses. In the contact analysis, SAM and the deep learning model performed effectively. However, in the continuity analysis, none of the deep learning models demonstrated significant classification performance.Entities:
Mesh:
Year: 2022 PMID: 36209283 PMCID: PMC9547920 DOI: 10.1038/s41598-022-21408-9
Source DB: PubMed Journal: Sci Rep ISSN: 2045-2322 Impact factor: 4.996
Figure 1Classification of the relationship between the mandibular third molar and inferior alveolar canal/nerve.
Figure 2Differences between the residual blocks of ResNet and ResNetv2: (a) ResNet Residual Unit; (b) ResNetv2 Residual Unit. BN: Batch Normalization and Conv2D: Two-dimensional convolution layer.
Performance metrics of ResNet50 and ResNet50v2 with the SAM and SGD optimizers in contact analysis.
| CNN | Optimizer | Accuracy | Precision | Recall | F1 score | AUC |
|---|---|---|---|---|---|---|
| SD | SD | SD | SD | SD | ||
| 95%CI | 95% CI | 95% CI | 95% CI | 95% CI | ||
| ResNet50 | SAM | 0.855 | 0.810 | 0.785 | 0.794 | 0.883 |
| 0.005 | 0.009 | 0.009 | 0.008 | 0.007 | ||
| 0.853–0.857 | 0.807–0.813 | 0.782–0.789 | 0.791–0.797 | 0.880–0.885 | ||
| ResNet50 | SGD | 0.850 | 0.804 | 0.781 | 0.789 | 0.875 |
| 0.009 | 0.010 | 0.010 | 0.009 | 0.008 | ||
| 0.847–0.853 | 0.800–0.807 | 0.785–0.778 | 0.786–0.793 | 0.872–0.878 | ||
| ResNet50v2 | SAM | 0.860 | 0.816 | 0.791 | 0.800 | 0.890 |
| 0.005 | 0.008 | 0.009 | 0.008 | 0.007 | ||
| 0.858–0.861 | 0.813–0.819 | 0.788–0.794 | 0.798–0.803 | 0.888–0.893 | ||
| ResNet50v2 | SGD | 0.853 | 0.809 | 0.782 | 0.792 | 0.884 |
| 0.005 | 0.008 | 0.009 | 0.007 | 0.006 | ||
| 0.851–0.855 | 0.806–0.812 | 0.779–0.785 | 0.790–0.795 | 0.882–0.886 |
SD, standard deviation; 95% CI, 95% confidence interval; AUC, area under the receiver operating characteristics curve.
Performance metrics of ResNet50 and ResNet50v2 with optimizers SAM and SGD continuity analysis.
| CNN | Optimizer | Accuracy | Precision | Recall | F1 score | AUC |
|---|---|---|---|---|---|---|
| SD | SD | SD | SD | SD | ||
| 95% CI | 95% CI | 95% CI | 95% CI | 95% CI | ||
| ResNet50 | SAM | 0.754 | 0.755 | 0.754 | 0.753 | 0.832 |
| 0.005 | 0.008 | 0.008 | 0.008 | 0.006 | ||
| 0.753–0.756 | 0.752–0.757 | 0.751–0.757 | 0.750–0.755 | 0.829–0.834 | ||
| ResNet50 | SGD | 0.754 | 0.754 | 0.754 | 0.752 | 0.830 |
| 0.007 | 0.008 | 0.008 | 0.008 | 0.006 | ||
| 0.752–0.757 | 0.752–0.757 | 0.751–0.757 | 0.750–0.755 | 0.827–0.832 | ||
| ResNet50v2 | SAM | 0.766 | 0.766 | 0.765 | 0.775 | 0.843 |
| 0.007 | 0.006 | 0.006 | 0.013 | 0.005 | ||
| 0.764–0.769 | 0.764–0.768 | 0.763–0.767 | 0.771–0.780 | 0.842–0.845 | ||
| ResNet50v2 | SGD | 0.765 | 0.765 | 0.765 | 0.767 | 0.842 |
| 0.006 | 0.006 | 0.006 | 0.013 | 0.005 | ||
| 0.763–0.768 | 0.763–0.767 | 0.762–0.767 | 0.762–0.772 | 0.840–0.844 |
SD, standard deviation; 95% CI, 95% confidence interval; AUC, area under the receiver operating characteristics curve.
Statistical evaluation of ResNet50 and ResNet50v2 with the SAM and SGD optimizers in contact analysis.
| Performance metrics | Model A | Model B | A-B | P value | Effect size |
|---|---|---|---|---|---|
| Accuracy | SAM | SGD | 0.006 | 0.003 | 0.761 |
| Precision | 0.006 | 0.006 | 0.677 | ||
| Recall | 0.004 | 0.046 | 0.440 | ||
| F1 score | 0.005 | 0.018 | 0.556 | ||
| AUC | 0.008 | < .0001 | 1.052 | ||
| Accuracy | SAM | SGD | 0.007 | < .0001 | 1.456 |
| Precision | 0.007 | < .0001 | 0.874 | ||
| Recall | 0.009 | < .0001 | 0.995 | ||
| F1 score | 0.008 | < .0001 | 1.103 | ||
| AUC | 0.006 | 0.001 | 0.899 | ||
| Accuracy | ResNet50v2 | ResNet50 | 0.004 | 0.004 | 0.835 |
| Precision | 0.006 | 0.004 | 0.742 | ||
| Recall | 0.005 | 0.013 | 0.560 | ||
| F1 score | 0.006 | 0.004 | 0.712 | ||
| AUC | 0.007 | < .0001 | 0.932 | ||
AUC, area under the receiver operating characteristics curve.
Statistical evaluation of ResNet50 and ResNet50v2 with the SAM and SGD optimizers in continuity analysis.
| Performance metrics | Model A | Model B | A-B | P value | Effect size |
|---|---|---|---|---|---|
| Accuracy | SAM | SGD | 0.0001 | 0.8442 | 0.0162 |
| Precision | 0.0001 | 0.8629 | 0.0109 | ||
| Recall | 0.0001 | 0.8485 | 0.0119 | ||
| F1 score | 0.0002 | 0.8176 | 0.0195 | ||
| AUC | 0.0022 | 0.0996 | 0.3512 | ||
| Accuracy | SAM | SGD | 0.0007 | 0.6328 | 0.1103 |
| Precision | 0.0010 | 0.5389 | 0.1576 | ||
| Recall | 0.0001 | 0.9123 | 0.0214 | ||
| F1 score | 0.0080 | 0.0523 | 0.6064 | ||
| AUC | 0.0014 | 0.2584 | 0.2737 | ||
| Accuracy | ResNet50v2 | ResNet50 | 0.0116 | < .0001 | 1.9765 |
| Precision | 0.0112 | < .0001 | 2.3677 | ||
| Recall | 0.0105 | < .0001 | 2.0622 | ||
| F1 score | 0.0225 | < .0001 | 4.6346 | ||
| AUC | 0.0113 | < .0001 | 2.1598 | ||
AUC, area under the receiver operating characteristic curve.
Figure 3Learning curves for each CNN model in contact and continuity analyses.
Figure 4Visualization of regions of interest for CNN classification in contact and continuity analyses.