| Literature DB >> 34063144 |
Posen Lee1, Tai-Been Chen2,3, Chi-Yuan Wang2,4, Shih-Yen Hsu2,5, Chin-Hsuan Liu1,6.
Abstract
Postural control decreases with aging. Thus, an efficient and accurate method of detecting postural control is needed. We enrolled 35 elderly adults (aged 82.06 ± 8.74 years) and 20 healthy young adults (aged 21.60 ± 0.60 years) who performed standing tasks for 40 s, performed six times. The coordinates of 15 joint nodes were captured using a Kinect device (30 Hz). We plotted joint positions into a single 2D figure (named a joint-node plot, JNP) once per second for up to 40 s. A total of 15 methods combining deep and machine learning for postural control classification were investigated. The accuracy, sensitivity, specificity, positive predicted value (PPV), negative predicted value (NPV), and kappa values of the selected methods were assessed. The highest PPV, NPV, accuracy, sensitivity, specificity, and kappa values were higher than 0.9 in validation testing. The presented method using JNPs demonstrated strong performance in detecting the postural control ability of young and elderly adults.Entities:
Keywords: deep learning; joint–node plot; machine learning; postural control
Mesh:
Year: 2021 PMID: 34063144 PMCID: PMC8124823 DOI: 10.3390/s21093212
Source DB: PubMed Journal: Sensors (Basel) ISSN: 1424-8220 Impact factor: 3.576
Demographic characteristics of the samples (N = 35 + 20 = 55).
| Index | Elderly (n = 35) | Young (n = 20) | ||
|---|---|---|---|---|
| Mean | SD | Mean | SD | |
|
| 80.17 | 8.56 | 20.00 | 1.97 |
|
| 24.91 | 3.40 | 30.00 | 0.00 |
|
| 86.57 | 4.16 | 100.00 | 0.00 |
|
| 47.09 | 6.47 | 56.00 | 0.00 |
Figure 1The Kinect device was placed 75 cm above the floor and 2 m in front of the participants. The participants stood still (with arms at their sides) in a comfortable stance for 40 s. The participants were defined as (a) elderly adults (experimental group) or (b) young adults (control group).
Figure 2Study flowchart.
Figure 3(a) The Kinect device recorded the positions of 15 joints; joint–node plots of (b) an elderly adults and (c) a young adult over a period of 40 s.
Pre-trained models used in this study [40].
| Pre-Trained Model | Input Image Size | Design Layers | Parametric Size (MB) | Layer of Features |
|---|---|---|---|---|
| AlexNet | 227 × 227 | 25 | 227 | 17th |
| DenseNet201 | 224 × 224 | 709 | 77 | 706th |
| ResNet50 | 224 × 224 | 177 | 96 | 175th |
| VGG16 | 224 × 224 | 41 | 27 | 33rd |
| VGG19 | 224 × 224 | 47 | 535 | 39th |
Figure 4Performance of 45 models using 60% of the data as the training set. Model details are listed in Appendix A.
Figure 5Performance of 45 models trained using 70% of the data. Model details are provided in Appendix A.
Models trained with 60% of the data had accuracy and kappa values of no less than 0.95 and 0.88, respectively.
| Model | Epoch | CNN | Learner | Accuracy | Sensitivity | Specificity | PPV | NPV | Kappa |
|---|---|---|---|---|---|---|---|---|---|
| M27 | 15 | DenseNet201 | SVM | 0.95 | 0.96 | 0.92 | 0.96 | 0.92 | 0.88 |
| M28 | 15 | ResNet50 | SVM | 0.95 | 0.96 | 0.93 | 0.97 | 0.91 | 0.88 |
| M12 | 10 | DenseNet201 | SVM | 0.96 | 0.99 | 0.88 | 0.95 | 0.97 | 0.90 |
| M43 | 20 | ResNet50 | SVM | 0.96 | 0.97 | 0.93 | 0.97 | 0.93 | 0.90 |
| M11 | 10 | AlexNet | SVM | 0.97 | 0.98 | 0.94 | 0.97 | 0.95 | 0.92 |
| M15 | 10 | VGG19 | SVM | 0.97 | 0.98 | 0.94 | 0.97 | 0.95 | 0.92 |
| M41 | 20 | AlexNet | SVM | 0.97 | 0.97 | 0.95 | 0.98 | 0.94 | 0.92 |
| M44 | 20 | VGG16 | SVM | 0.97 | 0.98 | 0.93 | 0.97 | 0.96 | 0.92 |
| M30 | 15 | VGG19 | SVM | 0.97 | 0.99 | 0.93 | 0.97 | 0.98 | 0.93 |
| M45 | 20 | VGG19 | SVM | 0.97 | 0.97 | 0.96 | 0.98 | 0.94 | 0.93 |
| M14 | 10 | VGG16 | SVM | 0.98 | 0.97 | 0.98 | 0.99 | 0.94 | 0.94 |
| M26 | 15 | AlexNet | SVM | 0.98 | 0.98 | 0.98 | 0.99 | 0.95 | 0.95 |
| M29 | 15 | VGG16 | SVM | 0.98 | 0.99 | 0.95 | 0.98 | 0.98 | 0.95 |
Models trained with 70% of the data achieved accuracy and kappa values of no less than 0.95 and 0.88, respectively.
| Model | Epoch | CNN | Learner | Accuracy | Sensitivity | Specificity | PPV | NPV | Kappa |
|---|---|---|---|---|---|---|---|---|---|
| M73 | 15 | ResNet50 | SVM | 0.95 | 0.97 | 0.91 | 0.96 | 0.93 | 0.89 |
| M57 | 10 | DenseNet201 | SVM | 0.96 | 0.98 | 0.91 | 0.96 | 0.95 | 0.90 |
| M88 | 20 | ResNet50 | SVM | 0.96 | 0.97 | 0.94 | 0.97 | 0.94 | 0.91 |
| M58 | 10 | ResNet50 | SVM | 0.97 | 0.97 | 0.97 | 0.99 | 0.92 | 0.92 |
| M87 | 20 | DenseNet201 | SVM | 0.97 | 0.97 | 0.95 | 0.98 | 0.94 | 0.92 |
| M60 | 10 | VGG19 | SVM | 0.97 | 0.97 | 0.97 | 0.99 | 0.94 | 0.93 |
| M56 | 10 | AlexNet | SVM | 0.98 | 0.99 | 0.94 | 0.97 | 0.98 | 0.94 |
| M71 | 15 | AlexNet | SVM | 0.98 | 0.99 | 0.95 | 0.98 | 0.97 | 0.94 |
| M75 | 15 | VGG19 | SVM | 0.98 | 0.99 | 0.95 | 0.98 | 0.97 | 0.94 |
| M59 | 10 | VGG16 | SVM | 0.98 | 0.99 | 0.97 | 0.99 | 0.97 | 0.96 |
| M74 | 15 | VGG16 | SVM | 0.98 | 1.00 | 0.94 | 0.97 | 1.00 | 0.96 |
| M86 | 20 | AlexNet | SVM | 0.98 | 0.98 | 0.98 | 0.99 | 0.95 | 0.96 |
| M89 | 20 | VGG16 | SVM | 0.98 | 0.98 | 0.98 | 0.99 | 0.95 | 0.96 |
| M90 | 20 | VGG19 | SVM | 0.99 | 0.99 | 0.97 | 0.99 | 0.98 | 0.97 |
Figure 6Abnormal patterns of postural control in several participants. (a) The forearm and knee joints exhibited slight tremors. (b) The forearm and hand joints exhibited obviously tremors. (c) The whole body shook horizontally and the left forearm shook more. (d) The whole body shook horizontally. (e) Symmetrical shaking of the wrists and lower limbs occurs on both sides. (f) Individual stands with whole-body asymmetrical shaking.
Summary of the results in Table 3 and Table 4.
| Deep Learning | Counts | Min. ACC | Max. ACC |
|---|---|---|---|
| AlexNet | 6 | 0.97 | 0.98 |
| DenseNet201 | 4 | 0.95 | 0.97 |
| ResNet50 | 5 | 0.95 | 0.97 |
| VGG16 | 6 | 0.97 | 0.98 |
| VGG19 | 6 | 0.97 | 0.99 |
| Total | 27 |
Note: Min. ACC and Max. ACC are the minimum and maximum accuracy.
Comparison of the proposed methods with methods developed in related studies.
| Author | Year | Methods | Task | Sample Size | Performance |
|---|---|---|---|---|---|
| Di Lazzaro G. et al. [ | 2020 | SVM | motor | 65 | ACC: 97% (SVM) |
| Yuhan Zhou et al. [ | 2020 | SVM | gait | 239 | ACC: 89% (SVM) |
| RF | ACC: 73% (RF) | ||||
| ANN | ACC: 90% (ANN) | ||||
| Tian Bao et al. [ | 2019 | SVM | balance | 16 | ACC: 82% (SVM) |
| Jianwei Niu et al. [ | 2019 | SVM | gait | 12 | ACC: 96.7% (SVM) |
| Narintip Roongbenjawan et al. [ | 2020 | Cohort Study | balance | 73 | SEN: 92% |
| SPE: 81% | |||||
| The Presented Methods | 2021 | DL + ML | balance | 55 | ACC: 98% (VGG16 + SVM) |
| ACC: 99% (VGG19 + SVM) |
Note: ACC is accuracy. SPE is specificity. RF is random forest. SVM is support vector machine. DL is deep learning. ML is machine learning.