Literature DB >> 35795873

Deep CNN-LSTM With Self-Attention Model for Human Activity Recognition Using Wearable Sensor.

Mst Alema Khatun1, Mohammad Abu Yousuf1, Sabbir Ahmed1, Md Zia Uddin2, Salem A Alyami3, Samer Al-Ashhab3, Hanan F Akhdar4, Asaduzzaman Khan5, Akm Azad6,7, Mohammad Ali Moni5.   

Abstract

Human Activity Recognition (HAR) systems are devised for continuously observing human behavior - primarily in the fields of environmental compatibility, sports injury detection, senior care, rehabilitation, entertainment, and the surveillance in intelligent home settings. Inertial sensors, e.g., accelerometers, linear acceleration, and gyroscopes are frequently employed for this purpose, which are now compacted into smart devices, e.g., smartphones. Since the use of smartphones is so widespread now-a-days, activity data acquisition for the HAR systems is a pressing need. In this article, we have conducted the smartphone sensor-based raw data collection, namely H-Activity, using an Android-OS-based application for accelerometer, gyroscope, and linear acceleration. Furthermore, a hybrid deep learning model is proposed, coupling convolutional neural network and long-short term memory network (CNN-LSTM), empowered by the self-attention algorithm to enhance the predictive capabilities of the system. In addition to our collected dataset (H-Activity), the model has been evaluated with some benchmark datasets, e.g., MHEALTH, and UCI-HAR to demonstrate the comparative performance of our model. When compared to other models, the proposed model has an accuracy of 99.93% using our collected H-Activity data, and 98.76% and 93.11% using data from MHEALTH and UCI-HAR databases respectively, indicating its efficacy in recognizing human activity recognition. We hope that our developed model could be applicable in the clinical settings and collected data could be useful for further research.

Entities:  

Keywords:  LSTM; Sensors; accelerometers; attention; gyroscopes; smartphones

Mesh:

Year:  2022        PMID: 35795873      PMCID: PMC9252338          DOI: 10.1109/JTEHM.2022.3177710

Source DB:  PubMed          Journal:  IEEE J Transl Eng Health Med        ISSN: 2168-2372


  16 in total

1.  A comparison of public datasets for acceleration-based fall detection.

Authors:  Raul Igual; Carlos Medrano; Inmaculada Plaza
Journal:  Med Eng Phys       Date:  2015-07-29       Impact factor: 2.242

2.  Long short-term memory.

Authors:  S Hochreiter; J Schmidhuber
Journal:  Neural Comput       Date:  1997-11-15       Impact factor: 2.026

3.  The bit doesn't fit: Evaluation of a commercial activity-tracker at slower walking speeds.

Authors:  Christopher K Wong; Helena M Mentis; Ravi Kuber
Journal:  Gait Posture       Date:  2017-10-09       Impact factor: 2.840

Review 4.  A survey of online activity recognition using mobile phones.

Authors:  Muhammad Shoaib; Stephan Bosch; Ozlem Durmaz Incel; Hans Scholten; Paul J M Havinga
Journal:  Sensors (Basel)       Date:  2015-01-19       Impact factor: 3.576

5.  Comparison of Feature Learning Methods for Human Activity Recognition Using Wearable Sensors.

Authors:  Frédéric Li; Kimiaki Shirahama; Muhammad Adeel Nisar; Lukas Köping; Marcin Grzegorzek
Journal:  Sensors (Basel)       Date:  2018-02-24       Impact factor: 3.576

6.  Design, implementation and validation of a novel open framework for agile development of mobile health applications.

Authors:  Oresti Banos; Claudia Villalonga; Rafael Garcia; Alejandro Saez; Miguel Damas; Juan A Holgado-Terriza; Sungyong Lee; Hector Pomares; Ignacio Rojas
Journal:  Biomed Eng Online       Date:  2015-08-13       Impact factor: 2.819

7.  Detecting falls as novelties in acceleration patterns acquired with smartphones.

Authors:  Carlos Medrano; Raul Igual; Inmaculada Plaza; Manuel Castro
Journal:  PLoS One       Date:  2014-04-15       Impact factor: 3.240

8.  Gait characteristic analysis and identification based on the iPhone's accelerometer and gyrometer.

Authors:  Bing Sun; Yang Wang; Jacob Banda
Journal:  Sensors (Basel)       Date:  2014-09-12       Impact factor: 3.576

9.  Fusion of smartphone motion sensors for physical activity recognition.

Authors:  Muhammad Shoaib; Stephan Bosch; Ozlem Durmaz Incel; Hans Scholten; Paul J M Havinga
Journal:  Sensors (Basel)       Date:  2014-06-10       Impact factor: 3.576

10.  Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition.

Authors:  Francisco Javier Ordóñez; Daniel Roggen
Journal:  Sensors (Basel)       Date:  2016-01-18       Impact factor: 3.576

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.