| Literature DB >> 28972556 |
Congcong Ma1, Wenfeng Li2, Raffaele Gravina3, Jingjing Cao4, Qimeng Li5, Giancarlo Fortino6.
Abstract
As a sedentary lifestyle leads to numerous health problems, it is important to keep constant motivation for a more active lifestyle. A large majority of the worldwide population, such as office workers, long journey vehicle drivers and wheelchair users, spends several hours every day in sedentary activities. The postures that sedentary lifestyle users assume during daily activities hide valuable information that can reveal their wellness and general health condition. Aiming at mining such underlying information, we developed a cushion-based system to assess their activity levels and recognize the activity from the information hidden in sitting postures. By placing the smart cushion on the chair, we can monitor users' postures and body swings, using the sensors deployed in the cushion. Specifically, we construct a body posture analysis model to recognize sitting behaviors. In addition, we provided a smart cushion that effectively combine pressure and inertial sensors. Finally, we propose a method to assess the activity levels based on the evaluation of the activity assessment index (AAI) in time sliding windows. Activity level assessment can be used to provide statistical results in a defined period and deliver recommendation exercise to the users. For practical implications and actual significance of results, we selected wheelchair users among the participants to our experiments. Features in terms of standard deviation and approximate entropy were compared to recognize the activities and activity levels. The results showed that, using the novel designed smart cushion and the standard deviation features, we are able to achieve an accuracy of (>89%) for activity recognition and (>98%) for activity level recognition.Entities:
Keywords: activity assessment index; activity level assessment; activity recognition; body posture analysis model; smart cushion
Mesh:
Year: 2017 PMID: 28972556 PMCID: PMC5677409 DOI: 10.3390/s17102269
Source DB: PubMed Journal: Sensors (Basel) ISSN: 1424-8220 Impact factor: 3.576
Related works on cushion based systems.
| Author | Pressure Sensor | Accelerometer | Integrate | Features | Classification | Accuracy |
|---|---|---|---|---|---|---|
| Unit | Method | |||||
| Yu et al. [ | 2 on the seat and | Backrest | No | N/A | SVM | N/A |
| 4 on the backrest | ||||||
| Barba et al. [ | 8 on the seat and | No | - | N/A | N/A | N/A |
| 8 on the backrest | ||||||
| Zemp et al. [ | 16 pressure sensors | Backrest | No | N/A | SVM, MNR, | 90.9% |
| Boosting, | ||||||
| NNs, RF | ||||||
| Cheng et al. [ | 4 under the | No | - | Mean, RMS, | LDA | 88% |
| chair leg | Center of weight | |||||
| Fu et al. [ | 4 on the seat and | No | - | N/A | HMM | N/A |
| 4 on the backrest | ||||||
| Kumar et al. [ | 4 on the backrest | No | - | Mean and | ERT | 86% |
| variance, FFT etc. | ||||||
| Zhu [ | 4 pressure sensors | No | - | Approximate | N/A | N/A |
| Ma et al. [ | 2 on the seat and | Waist | No | Mean and standard | J48 | 96.85% |
| 1 on the backrest | deviation |
SVM: Support Vector Machine; MNR: Multinomial Regression; NNs: Neural Networks; RF: Random Forest; HMM: Hidden Markov Model; ERT: Extremely Randomized Trees.
Figure 1Body posture analyze model of sitting behavior.
Figure 2Sensors deployment of the smart cushion: (a) schematic diagram of the sensors deployment on the base board; (b) IMU sensor and the three axis representation
The coordinate of each pressure sensor.
| Sensor No. | Coordinate ( |
|---|---|
| −1, 2 | |
| 1, 2 | |
| −2, 0 | |
| 2, 0 | |
| −1, −2 | |
| 1, −2 |
Figure 3Deployment of the smart cushion circuit board on a real chair: (a) front of the circuit board; (b) back of the circuit board.
Figure 4Activity level assessment workflow.
Categorization of different activity levels of wheelchair users.
| Activity Level | Description | Activities |
|---|---|---|
| Light intensity | User performs common daily life activities in sitting condition. | Reading a book, Desk working, Conversation |
| Moderate intensity | User performs moderate activities to prevent pressure ulcer. | Swing left-right or front-back |
| Vigorous intensity | User is doing exercise to keep fit. | Doing exercise |
BMI distribution of the subjects participating to the experiments.
| Description | Underweight | Normal | Overweight and Obese |
|---|---|---|---|
| BMI | <18.5 | [18.5, 25) | ≥25 |
| Number of subjects | 2 | 4 | 2 |
Sampling frequency and time window chosen in literature.
| Research | Sampling Frequency (Hz) | Time Window (s) |
|---|---|---|
| Liu, K. et al. [ | 40 | 10, 270, 430 |
| Liu, C. et al. [ | 40 | 2 |
| Liu, S. et al. [ | 30 | 30 |
| Zhu, Y. et al. [ | 10 | 30 |
Figure 5Activity recognition results with different time slide window.
F-measure for each activity with different time window.
| 10 s | 20 s | 30 s | ||||
|---|---|---|---|---|---|---|
| Reading | 0.78 | 0.962 | 0.88 | 0.98 | 0.967 | 0.988 |
| Desk Working | 0.665 | 0.922 | 0.812 | 0.949 | 0.92 | 0.962 |
| Conversation | 0.776 | 0.953 | 0.902 | 0.967 | 0.95 | 0.972 |
| Swing | 0.985 | 0.997 | 0.995 | 0.997 | 0.997 | 0.997 |
| Doing Exercise | 0.828 | 0.995 | 0.992 | 0.995 | 0.995 | 0.995 |
| Mean F-measure | 0.828 | 0.966 | 0.916 | 0.978 | 0.966 | 0.983 |
Figure 6Feature distribution of each activity.
Figure 7Recognition results for different activities.
Figure 8Activity level recognition for different activities.
Activity recognition for using the pressure sensor cushion.
| Std Feature | ApEn Feature | Std & ApEn Feature | |||||||
|---|---|---|---|---|---|---|---|---|---|
| Accuracy | Precision | F-Measure | Accuracy | Precision | F-Measure | Accuracy | Precision | F-Measure | |
| Reading | 0.985 | 0.975 | 0.98 | 0.93 | 0.845 | 0.885 | 0.98 | 0.97 | 0.975 |
| Desk Working | 0.889 | 0.947 | 0.917 | 0.688 | 0.815 | 0.747 | 0.879 | 0.926 | 0.902 |
| Conversation | 0.96 | 0.918 | 0.939 | 0.824 | 0.808 | 0.816 | 0.945 | 0.913 | 0.928 |
| Swing | 1.0 | 0.995 | 0.997 | 0.995 | 1.0 | 0.997 | 1.0 | 0.995 | 0.997 |
| Doing Exercise | 0.995 | 0.995 | 0.995 | 0.995 | 0.957 | 0.975 | 1.0 | 1.0 | 1.0 |
| Total Results | 0.966 | 0.966 | 0.966 | 0.886 | 0.885 | 0.884 | 0.961 | 0.961 | 0.961 |
Activity level recognition for using the pressure sensor cushion.
| Std Feature | ApEn Feature | Std & ApEn Feature | |||||||
|---|---|---|---|---|---|---|---|---|---|
| Accuracy | Precision | F-Measure | Accuracy | Precision | F-Measure | Accuracy | Precision | F-Measure | |
| Light intensity | 0.998 | 1.0 | 0.999 | 0.983 | 0.998 | 0.991 | 0.998 | 1.0 | 0.999 |
| Moderate intensity | 1.0 | 0.995 | 0.997 | 0.995 | 0.995 | 0.995 | 1.0 | 0.995 | 0.997 |
| Vigorous intensity | 0.995 | 0.995 | 0.995 | 0.995 | 0.952 | 0.973 | 1.0 | 1.0 | 1.0 |
| Total Results | 0.998 | 0.998 | 0.998 | 0.988 | 0.988 | 0.988 | 0.999 | 0.999 | 0.999 |
Activity recognition for using the novel designed cushion.
| Std Feature | ApEn Feature | Std & ApEn Feature | |||||||
|---|---|---|---|---|---|---|---|---|---|
| Accuracy | Precision | F-Measure | Accuracy | Precision | F-Measure | Accuracy | Precision | F-Measure | |
| Reading | 0.995 | 0.98 | 0.988 | 0.96 | 0.974 | 0.967 | 0.995 | 0.98 | 0.988 |
| Desk Working | 0.955 | 0.969 | 0.962 | 0.925 | 0.915 | 0.92 | 0.95 | 0.974 | 0.962 |
| Conversation | 0.97 | 0.975 | 0.972 | 0.955 | 0.945 | 0.95 | 0.98 | 0.975 | 0.977 |
| Swing | 1.0 | 0.995 | 0.997 | 0.995 | 1.0 | 0.997 | 1.0 | 0.995 | 0.997 |
| Doing Exercise | 0.995 | 0.995 | 0.995 | 0.995 | 0.995 | 0.995 | 1.0 | 1.0 | 1.0 |
| Total Results | 0.983 | 0.983 | 0.983 | 0.966 | 0.966 | 0.966 | 0.985 | 0.985 | 0.985 |
Activity level recognition for using the novel designed cushion.
| Std Feature | ApEn Feature | Std & ApEn Feature | |||||||
|---|---|---|---|---|---|---|---|---|---|
| Accuracy | Precision | F-Measure | Accuracy | Precision | F-Measure | Accuracy | Precision | F-Measure | |
| Light intensity | 0.998 | 1.0 | 0.999 | 1.0 | 0.997 | 0.998 | 0.998 | 1.0 | 0.999 |
| Moderate intensity | 1.0 | 0.995 | 0.997 | 0.995 | 1.0 | 0.997 | 1.0 | 0.99 | 0.995 |
| Vigorous intensity | 0.995 | 0.995 | 0.995 | 0.995 | 1.0 | 0.997 | 0.995 | 1.0 | 0.997 |
| Total Results | 0.998 | 0.998 | 0.998 | 0.998 | 0.998 | 0.998 | 0.998 | 0.998 | 0.998 |
Figure 9Confusion matrix of predicted activities for each subject.
Figure 10Confusion matrix of predicted activity levels of subject S4 and S7.