| Literature DB >> 30781852 |
Hemant Ghayvat1, Muhammad Awais2, Sharnil Pandya3, Hao Ren4, Saeed Akbarzadeh5, Subhas Chandra Mukhopadhyay6, Chen Chen7, Prosanta Gope8, Arpita Chouhan9, Wei Chen10.
Abstract
BACKGROUND: Ambiguities and anomalies in the Activity of Daily Living (ADL) patterns indicate deviations from Wellness. The monitoring of lifestyles could facilitate remote physicians or caregivers to give insight into symptoms of the disease and provide health improvement advice to residents; Objective: This research work aims to apply lifestyle monitoring in an ambient assisted living (AAL) system by diagnosing conduct and distinguishing variation from the norm with the slightest conceivable fake alert. In pursuing this aim, the main objective is to fill the knowledge gap of two contextual observations (i.e., day and time) in the frequent behavior modeling for an individual in AAL. Each sensing category has its advantages and restrictions. Only a single type of sensing unit may not manage composite states in practice and lose the activity of daily living. To boost the efficiency of the system, we offer an exceptional sensor data fusion technique through different sensing modalities;Entities:
Keywords: activity of daily living; ambient assisted living; anomaly detection; elderly; smart home; wellness; wellness indices
Mesh:
Year: 2019 PMID: 30781852 PMCID: PMC6412512 DOI: 10.3390/s19040766
Source DB: PubMed Journal: Sensors (Basel) ISSN: 1424-8220 Impact factor: 3.576
Figure 1The bottom-up diagram to represent the Smart Home-based AAL system.
Figure 2A more than seven-decade-old house where the Smart Aging system was installed without any significant changes in the house.
Figure 3The layout of heterogeneous sensing units’ deployment in the AAL.
Figure 4(a) Outdoor temperature sensing unit. (b) Activity-based manual indication unit. (c) Movement sensor deployed at the entry. (d) Movement sensor deployed at the corner of the washbasin in kitchen. (e) Water cattle plugged into E & E Sensor. (f) Rice cooker plugged into E & E Sensor. (g) Microwave oven plugged into E & E Sensor. (h) Television plugged into E & E Sensor.
Figure 5(a) Contact sensing to know about the usage of the shower. (b) Force sensor deployed over the toilet seat. (c) Local Home Gateway Server.
Figure 6Activities of daily living.
Figure 7Modeling sub-activity for Activities of Daily Living.
Activity Annotation for 24 h.
| Unique Node ID | Household Stuff Connected | Sensor Applied | Timestamp | Usage | Activity Annotation |
|---|---|---|---|---|---|
| 00FR1 | Bedstead | Force | 21:07:33 2016-09-10 Start SL | 10 h 40 min 37 s | Sleeping |
| 00FR2 | Toilet seat | Force | 07:58:34 2016-09-11 Start TL | 8 min 38 s | Toilet |
| 00A1, 00A2, and 00A3 | Electric stove, Grill, and Rice Cooker | E & E monitoring unit | 08:17:23 2016-09-11 Start BF | 15 min 1 s | Breakfast |
| 00CN1 | Shower Door | Contact | 09:22:44 | 12 min | Shower |
| 00A1, 00A4, 00A5, and 00A6 | Electric stove, Grill, Rice Cooker, and Refrigerator | E & E monitoring unit | 10:24:17 2016-09-11 Start LN | 53 min | Lunch Cooking |
Number of sensor activation and activity detection for four different houses equipped with hydrogenous sensing units.
| Label | Household 1 | Household 2 | Household 3 | Household 4 |
|---|---|---|---|---|
| Sensing units (Nodes) | 37 | 32 | 37 | 29 |
| Weeks monitored | 43 | 43 | 43 | 43 |
| Sensory triggering | 693,705 | 605,758 | 725,671 | 650,521 |
| ADLs uncovering | 14,067 | 11,987 | 15,004 | 11,541 |
Figure 8(a) The (Basic) Ϣ1 for four different houses up to one week. (b) The (Basic) Ϣ2 for sleeping activity for four different houses up to one week.
Upgraded Wellness Function vs. Basic Wellness Function for recognizing ADLs.
| Sub | Sensor and Location | Activity | Ultimate- Active Interval (Sec) | Lowest-Active Interval (Sec) | Definite Real Interval (Sec) | Ϣ1, Basic | Ϣ2, Basic * | Activity Detection via Basic Functions | Ϣ1, upgraded | Ϣ2, upgraded * | Activity Detection via upgraded Functions |
|---|---|---|---|---|---|---|---|---|---|---|---|
| #1 | Force-Bed, Movement-Bedroom | Sleeping | 32,128 | 25,712 | 27,491 | 0.85 | RL | RL | 0.89 | RL | RL |
|
|
|
|
|
|
|
|
|
| |||
| Force -Toilet Seat, Movement-Toilet Door | Toilet/Latrine | 1835 | 1321 | 1521 | RL | RL | RL | RL | |||
| Force-Sofa | Calming | 2012 | 1092 | 1238 | RL | RL | |||||
| Contact/Force Sensor-Shower Door | Shower/Personal Hygiene | 1627 | 1170 | 1532 | RL | RL | |||||
| E & E Sensor-TV | TV | 3852 | 2438 | 2842 | RL | RL | |||||
| #2 |
|
|
|
|
|
|
|
|
|
|
|
| Force-Dinning Armchair, Movement -Dining Area | Taking Food | 4321 | 3213 | 3015 | RL | RL | NA | RL | |||
|
|
|
|
|
|
|
|
|
| |||
| Force-Sofa | Calming | 1823 | 1138 | 1426 | RL | RL | RL | RL | |||
| Contact/Force Sensor-Shower Door | Shower/Personal Hygiene | 1578 | 1262 | 1492 | RL | RL | |||||
| E & E Sensor-TV | TV | 3647 | 2745 | 2984 | RL | RL | |||||
| #3 | Force-Bed, Movement-Bedroom | Sleeping | 28,431 | 20,245 | 27,212 | 0.80 | RL | 0.89 | RL | ||
|
|
|
|
|
|
|
|
|
| |||
| Force -Toilet Seat, Movement-Toilet Door | Toilet/Latrine | 1838 | 1341 | 1530 | RL | RL | RL | RL | |||
| Force-Sofa | Calming | 1749 | 1369 | 1393 | RL | RL | |||||
| Contact/Force Sensor-Shower Door | Shower/Personal Hygiene | 1405 | 1136 | 1303 | RL | RL | |||||
| E & E Sensor-TV | TV | 3729 | 3021 | 3213 | RL | RL | |||||
| #4 | Force-Bed, Movement-Bedroom | Sleeping | 30,261 | 27,492 | 26,492 | 0.83 | RL | RL | 0.91 | RL | |
| Force-Dinning Armchair, Movement -Dining Area | Taking Food | 3620 | 2785 | 3329 | RL | RL | |||||
|
|
|
|
|
|
|
|
|
| |||
| Force-Sofa | Calming | 1640 | 1243 | 1620 | RL | RL | RL | RL | |||
| Contact/Force Sensor-Shower Door | Shower/Personal Hygiene | 1537 | 1138 | 1430 | RL | RL | |||||
| E & E Sensor-TV | TV | 3124 | 2481 | 2647 | RL | RL |
Well-being detection and anomaly forecasting on the basis of Wellness parameters.
| ADL | SID | Ϣ1 | Ϣ2 | Forecasting for an Upcoming Week | Actual-Duration (Sec) | Status | |||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| Max-Time (Sec) | Min-Time (Sec) | α | δ | Γ | |||||||
| #1 | Force-Bed, Movement-Bedroom | Sleeping | 0.83 | 0.842 | 27,483 | 24003 | 0.200 | 0.120 | 0.421 | 25,470 | RL |
| Force-Dinning Armchair, Movement -Dining Area | Taking Food | 0.932 | 4743 | 3216 | 0.140 | 0.058 | 0.490 | 3324 | RL | ||
|
|
|
|
|
|
|
|
|
|
| ||
| Force-Sofa, Movement-Living Room | Calming | 0.883 | 1487 | 1256 | 0.030 | 0.300 | 0.500 | 1409 | RL | ||
| Contact/Force Sensor-Shower Door | Shower/Personal Hygiene | 0.965 | 1765 | 1437 | 0.200 | 0.320 | 0.700 | 1432 | RL | ||
| E & E Sensor-TV | TV | 0.863 | 3689 | 2864 | 0.059 | 0.200 | 0.300 | 3257 | RL | ||
| #2 | Force-Bed, Movement-Bedroom | Sleeping | 0.795 | 0.810 | 27,492 | 21,394 | 0.030 | 0.120 | 0.600 | 26,408 | RL |
|
|
|
|
|
|
|
|
|
|
| ||
| Force -Toilet Seat, Movement-Toilet Door | Toilet/Latrine |
|
|
|
|
|
|
|
| ||
| Force-Sofa | Calming | 0.785 | 1420 | 1124 | 0.020 | 0.400 | 0.350 | 1294 | RL | ||
| Contact/Force Sensor-Shower Door | Shower/Personal Hygiene | 0.842 | 1530 | 1204 | 0.100 | 0.540 | 0.530 | 1420 | RL | ||
| E & E Sensor-TV | TV |
|
|
|
|
|
|
|
| ||
| #3 | Force-Bed, Movement-Bedroom | Sleeping | 0.846 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| ||
| Force -Toilet Seat, Movement-Toilet Door | Toilet/Latrine | 0.820 | 1509 | 1145 | 0.350 | 0.330 | 0.700 | 1329 | RL | ||
| Force-Sofa | Calming | 0.889 | 1530 | 1239 | 0.120 | 0.300 | 0.500 | 1430 | RL | ||
| Contact/Force Sensor-Shower Door Movement-Bathroom | Shower/Personal Hygiene | 0.943 | 1620 | 1307 | 0.100 | 0.459 | 0.300 | 1540 | RL | ||
| E & E Sensor-TV | TV | 0.920 | 3309 | 2845 | 0.400 | 0.340 | 0.600 | 2984 | RL | ||
| #4 | Force-Bed, Movement-Bedroom | Sleeping | 0.864 | 0.863 | 29,042 | 25,302 | 0.150 | 0.300 | 0.400 | 27,404 | RL |
|
|
|
|
|
|
|
|
|
|
| ||
| Force -Toilet Seat, Movement-Toilet Door | Toilet/Latrine | 0.824 | 2450 | 1750 | 0.250 | 0.300 | 0.740 | 1730 | RL | ||
| Force-Sofa Movement-Living Room | Calming | 0.842 | 1730 | 1284 | 0.300 | 0.350 | 0.600 | 1630 | RL | ||
| Contact/Force Sensor-Shower Door Movement-Bathroom | Shower/Personal Hygiene | 0.945 | 1430 | 1039 | 0.200 | 0.300 | 0.400 | 1240 | RL | ||
| E & E Sensor-TV | TV | 0.864 | 3102 | 2503 | 0.400 | 0.300 | 0.600 | 2830 | RL | ||
Annotation used.
| S.No. | Type of Activity |
|---|---|
| B1 | Bedtime |
| B2 | Entry |
| B3 | Exit |
| B4 | Water cattle |
| B5 | Television |
| B6 | Food preparation-cooking |
| B7 | Dining table-Eating chair |
| B8 | Microwave Oven |
| B9 | Fridge usage (by the door) |
| B10 | Wash basin/kitchen hygiene/dishwashing |
| B11 | Shower |
| B12 | Toilet usage |
| B13 | Computer use |
| B14 | Sofa-relax |
Figure 9(a) The activities during the course of the day. (b) The activities of taking medication and food during the course of the day.
Comparative overview of present work with existing ADLs monitoring and forecasting system.
| TITLE | CATEGORY OF AAL APPLICATION | DATA COLLECTION | SET OF ACTIVITIES | TYPE OF MACHINE LEARNING ALGORITHM | RELIABILITY AND PERFORMANCE PARAMETERS, MERITS OF ANNOTATION, ACTIVITY DETECTION, AND FORECASTING |
| PROJECT | |||||
| COBRA (CUMULATIVELY OVERLAPPING WINDOWING APPROACH FOR AMBIENT RECOGNITION OF ACTIVITIES) [ | BEHAVIORAL RECOGNITION | USES CASAS DATASET. MORE THAN 6500 ACTIVITIES RECOGNIZED FROM IT. | SLEEPING, MEAL PREPARATION, RELAX, HOUSEKEEPING, EATING, LEAVE HOME, ENTER HOME, WORK | SLIDING WINDOW TECHNIQUE | RECOGNITION ACCURACY (0.821) AND RECALL (0.89) |
| AUTOMATED FEATURE ENGINEERING [ | ACTIVITY DETECTION | OPEN SOURCE DATASETS OF DIFFERENT RESEARCH GROUPS WITH THE APPLICATION OF WEARABLE SENSORS | WALKING, STANDING, SITTING, VACUUMING, SWEEPING | SVM, NB, AND KNN | ACTIVITY DETECTION PRECISION (0.83) RECALL (0.80) |
| MINING HUMAN ACTIVITY PATTERNS FROM SMART HOME BIG DATA [ | ACTIVITY DETECTION AND FORECASTING | 400 MILLION SENSORS ACTIVATIONS | WATCHING TV, COOKING, USING COMPUTER, PREPARING FOOD AND CLEANING DISHES OR CLOTHES | BAYESIAN NETWORKS | PREDICTION ACCURACY (0.80) |
| LAPLACE [ | ACTIVITY DETECTION AND FORECASTING | OPEN SOURCE DATASETS OF DIFFERENT RESEARCH GROUPS | WAKE UP, SHOWER, EAT, GOING OUT, RELAX, COOK | FREQUENT SEQUENTIAL PATTERN MINING | DID NOT mention THE PARAMETER VALUE, THE PERFORMANCE WAS AVERAGE |
| AGACY MONITORING [ | ACTIVITY DETECTION | SENSING SYSTEM DEVELOPED | PREPARING FOOD, EAT, REST, DISHWASHING, WAKEUP | ONTOLOGICAL MODELING, SEMANTIC REASONING, AND DEMPSTER SHAFER THEORY | ACTIVITY DETECTION PRECISION (0.91) F1 SCORE (0.87) AND RECALL (0.83) |
| CONTEXTUALIZED BEHAVIOR PATTERNS [ | BEHAVIORAL RECOGNITION AND FORECASTING | CASAS DATASETS OF 193 DAYS USED | MEAL PREPARATION, SLEEPING, WASH DISHES, WORK, ENTER HOME, LEAVE HOME, TOILET, HOUSEKEEPING, RELAX, EATING | CONTEXTUALIZED PREFIX-TREE | DID NOT claim ANNOTATION AND ADL RECOGNITION MERIT VALUES. THE FORECASTING PRECISION VALUES (0.392) AND RECALL VALUE (0.41) |
| AGING IN PLACE BY CHRITIAN DEBES [ | BEHAVIORAL RECOGNITION | DATA WAS COLLECTED FROM TWO HOUSEHOLDS WITH MORE THAN 1000 ACTIVITY INSTANCES | PERSONAL HYGIENE, SLEEP WORK, MEAL PREPARATION, WATCH TV, SLEEP, SHOWERING | SVM, HMM AND FISHER KERNEL LEARNING (FKL) | THE ADL DETECTION CLASS AVERAGE ACCURACY FOR FKL (0.71), HMM (0.69) AND SVM (0.68) |
| ONLINE DAILY HABIT MODELING AND ANOMALY DETECTION (ODHMAD) MODEL [ | BEHAVIORAL AND ANOMALY DETECTION | OBTRUSIVE AND UNOBTRUSIVE SENSING SYSTEM | MOVEMENT, OPEN-CLOSE STATES OF DOOR/WINDOW, FLUSH TOILET, USE OF ELECTRICAL DEVICES, TAKE SHOWER, WASH HAND, FALLS, EATING | ONLINE ACTIVITY RECOGNITION (OAR) | ANOMALY PRECISION (0.78), FALSE ALARM RATE (0.21) AND MISS DETECTION RATE (0.11) |
| WELLNESS INDEX MODEL | Behavioral PATTERN GENERATION AND ANOMALY DETECTION | UN-OBTRUSIVE HETEROGENEOUS WIRELESS SENSORS NETWORK | SLEEPING | Novel Wellness Indices Modelling and Detection ALGORITHM | Sensitivity (0.9852), Specificity (0.9988), Precision (0.9887), Accuracy (0.9974), F1 score (0.9851), Correlation Coefficient (0.9144), False Negative Rate (0.0130) |