| Literature DB >> 33139608 |
Israel Campero-Jurado1, Sergio Márquez-Sánchez2, Juan Quintanar-Gómez3, Sara Rodríguez2, Juan M Corchado2,4,5,6.
Abstract
Information and communication technologies (ICTs) have contributed to advances in Occupational Health and Safety, improving the security of workers. The use of Personal Protective Equipment (PPE) based on ICTs reduces the risk of accidents in the workplace, thanks to the capacity of the equipment to make decisions on the basis of environmental factors. Paradigms such as the Industrial Internet of Things (IIoT) and Artificial Intelligence (AI) make it possible to generate PPE models feasibly and create devices with more advanced characteristics such as monitoring, sensing the environment and risk detection between others. The working environment is monitored continuously by these models and they notify the employees and their supervisors of any anomalies and threats. This paper presents a smart helmet prototype that monitors the conditions in the workers' environment and performs a near real-time evaluation of risks. The data collected by sensors is sent to an AI-driven platform for analysis. The training dataset consisted of 11,755 samples and 12 different scenarios. As part of this research, a comparative study of the state-of-the-art models of supervised learning is carried out. Moreover, the use of a Deep Convolutional Neural Network (ConvNet/CNN) is proposed for the detection of possible occupational risks. The data are processed to make them suitable for the CNN and the results are compared against a Static Neural Network (NN), Naive Bayes Classifier (NB) and Support Vector Machine (SVM), where the CNN had an accuracy of 92.05% in cross-validation.Entities:
Keywords: OHS; PPE; convolutional neural network; deep learning; microcontroller; naive Bayes; risk detection; support vector machine
Mesh:
Year: 2020 PMID: 33139608 PMCID: PMC7663590 DOI: 10.3390/s20216241
Source DB: PubMed Journal: Sensors (Basel) ISSN: 1424-8220 Impact factor: 3.576
OSH-related proposals.
| Bibliography | Keywords | Novelty of the Proposal |
|---|---|---|
| Vaughn Jr, Rayford B. et al. (2002) | Security-engineering, Risk assessment | The state of security-engineering practices by three information security practitioners with different perspectives. |
| Choudhry, R. M., and Fang, D. (2008) | This work discusses empirical research aimed at why construction workers engage in unsafe behavior. | |
| Niu, Yuhan, et al. (2019) | This research seeks to develop a smart construction object enabled OHS management system. | |
| Champoux, D., and Brun, J. P. (2003) | Occupational health and safety (OHS), Construction safety, Artificial Inteligence (AI) | This exploratory study based on telephone interviews with the owner-managers of small manufacturing enterprises gives an overview of the most characteristic OHS representations and practices in small firms. |
| Podgorski, Daniel, et al. (2017) | A proposed framework based on a new paradigm of OSH risk management consisting of real-time risk assessment and risk level detection of every worker individually. | |
| Barata, Joao et al. (2019) | Viable System Model (VSM) to design smart products that adhere to the organization strategy in disruptive transformations | |
| Sun, Shengjing, et al. (2020) | A unified architecture to support the integration of different enabling technologies | |
| Hasle, P., and Limborg, H. J. (2006) | Occupational health and safety, Accident Prevention | The scientific literature regarding preventive occupational health and safety activities in small enterprise. |
| Hasle, P., et al. (2011) | Occupational health and safety, Accident prevention | The investigation applied qualitative methods and theoretical approaches to CSR, small and medium-sized enterprises (SMEs), and occupational health and safety. |
| Abdelhamid, T. S., Everett, J. G. (2000) | Occupational safety, Construction safety, Accidents prevention | Accident root causes tracing model (ARCTM) tailored to the needs of the construction industry. |
| Chi, S., Han, S. (2013) | This study incorporates the systems theory into Heinrich’s domino theory to explore the interrelationships of risks and break the chain of accident causation. | |
| Cambraia, F. B., et al. (2010) | Incident reporting systems, Safety management | Guidelines for identifying, analyzing and disseminating information on near misses in construction sites. |
| Chevalier, Yannick, et al. (2004) | Network security, Cryptographic protocols | High level protocol specification language for the modelling of security-sensitive cryptographic protocols. |
Proposals related to sensor networks.
| Bibliography | Keywords | Novelty of the Proposal |
|---|---|---|
| Zhou, Yinghui, et al. (2012) | Internet of Things, Wearable Computing, Robot sensing systems, Acceleration Feature analysis, Human-computer interaction | Wearable device based on a tri-axis accelerometer, which can detect acceleration change of human body based on the position of the device being set. |
| Zhu, C., and Sheng, W. (2009) | A human daily activity recognition method by fusing the data from two wearable inertial sensors attached on one foot and the waist of the subject. | |
| Lindeman, Robert W., et al. (2006) | A development history of a wearable, scalable vibrotactile stimulus delivery system. | |
| Kim, Sung Hun, et al. (2018) | Experiments were performed in which the sensing data were classified whether the safety helmet was being worn properly, not worn, or worn improperly during construction workers’ activities. | |
| Nithya, T., et al. (2018) | Head motion recognition, Hazardous gas, Temperature measurement, Sensor System, IMU, Electroencephealography (EEG) | Smart helmet able to detect hazardous events in the mining industry and design a mine safety system using wireless sensor networks. |
| Li, Ping, et al. (2014) | Smart Safety Helmet (SSH) in order to tack the head gestures and the brain activity of the worker to recognize anomalous behavior. | |
| Fang, Y., et al. (2016) | Crane safety, Human errorReal-time, Crane motion capturing | A prototype system was developed based on the framework and deployed on a mobile crane. |
| Cao, Teng, et al. (2014) | Steady-state visual evoked potential (SSCEP), Brain-computer interfaces (BCIs) | Propose a method for the real-time evaluation of fatigue in SSVEP-based BCIs. |
Proposals related to safety environment and motion recognition.
| Bibliography | Keywords | Novelty of the Proposal |
|---|---|---|
| Fernández-Muñiz, B., et al. (2012) | Safety climate, Employee perceptions, Safety performance | The current work aims to analyse the safety climate in diverse sectors, identify its dimensions, and propose to test a structural equation model that will help determine the antecedents and consequences of employees’ safety behaviour. |
| Glendon, A. I., Litherland, D. K. (2001) | A behavioral observation measure of safety performance and a road construction organization using a modified version of the safety climate questionnaire (SCQ). | |
| Han, Y., and Song, Y. H. (2003) | IMU, Magnetometers, Gyroscopes, Accelerometer, Human motion | After introducing the concepts and functions of CM, this paper describes the popular monitoring methods and research status of CM on transformer, generator, and induction motor, respectively. |
| Godfrey, A. C. R. M. D. O. G., et al. (2008) | The underlying biomechanical elements necessary to understand and study human movement. | |
| Ohtaki, Y., et al. (2001) | A new method is proposed to investigate kinematics and dynamics of locomotion without any limitation of laboratory conditions. | |
| Zampella, Francisco, et al. (2012) | The usage of the Unscented Kalman Filter (UKF) as the integration algorithm for the inertial measurements. | |
| Cheng, T., and Teizer, J. (2013) | Body sensor network (BSN), Vision Algorithms, Augmented reality (AR), Virtual Reality (VR), Location tracking | A novel framework is presented that explains the method of streaming data from real-time positioning sensors to a real-time data visualization platform. |
| Bleser, Gabriele, et al. (2015) | Assistance system based in the last advances in hardware, software and system level. | |
| Fitton, Daniel, et al. (2008) | Investigation into how physical objects augmented with sensing and communication technologies can measure use in order to enable new pay-per-use payment models for equipment hire. | |
| Yu, H., et al. (2007) | Measuring vigilance, Sensor network, Intelligent sensors | Signal transform method, Common Spatial Pattern, to process the EEG data. |
| Qiang, Cheng, et al. (2009) | A cost effective ZigBee-based wireless mine supervising system |
Proposals related to Smart manufacturing and Machine Learning.
| Bibliography | Keywords | Novelty of the Proposal |
|---|---|---|
| Lee, Jay, et al. (2018) | Artificial Inteligent, Smart manufacturing, Failt diagnosis | State of AI technologies and the eco-system required to harness the power of AI in industrial applications. |
| Henley, E. J., and Kumamoto, H. (1985) | Provides a quantitative treatment of the optimal design of safety systems focusing on information links (human and computer), sensors, and control systems. | |
| Li, Bo-hu, et al. (2017) | Based on research into the applications of artificial intelligence (AI) technology in the manufacturing industry in recent years. | |
| Xiaoli, X. et al. (2011) | A presentation of Intelligent internet of things for equipment maintenance (IITEM) which we can make intelligent processing of device information. | |
| Varian, Hal. (2018) | Summary of some of the forces at work and to describe some possible areas for future research. | |
| Wahab, L., and Jiang, H. (2019) | Machine Learning (ML), Decision Tree Classifier (DTC), Random Forest (RF), Multinomial logic model (MNLM), Support vector machine (SVMs), Receiver operating characteristic (ROS) | Traffic crash analysis using machine learning techniques. |
| Azar, A. T., et al. (2014) | A random forest classifier (RFC) approach is proposed to diagnose lymph diseases. | |
| Belgiu, M., and Drăguţ, L. (2016) | This review has revealed that RF classifier can successfully handle high data dimensionality and multicolinearity, being both fast and insensitive to overfitting. | |
| Khalilia, M., et al. | Method for predicting disease risk of individuals using random forest. | |
| Jedari, E., et al. (2015) | Machine learning approaches including k-nearest neighbor (k-NN), a rules-based classifier (JRip), and random forest have been investigated to estimate the indoor location of a user or an object using RSSI based fingerprinting method. | |
| Iranitalab, A., and Khattak, A. (2017) | This paper had three main objectives: comparison of the performance of four statistical and machine learning methods including Multinomial Logit (MNL), Nearest Neighbor Classification (NNC), Support Vector Machines (SVM) and Random Forests (RF), in predicting traffic crash severity. | |
| Pal, M. (2005) | To present the results obtained with the random forest classifier and to compare its performance with the support vector machines (SVMs) in terms of classification accuracy, training time and user defined parameters. | |
| Rodriguez-Galiano, V. F., et al. (2012) | The performance of the RF classifier for land cover classification of a complex area is explored. | |
| Yogameena, B., et al. (2019) | Complex software system, Mixture models, Convolutional neural networks | Intelligent video surveillance system for automatically detecting the motorcyclists with and without safety helmets. |
| Cockburn, D. (1996) | The benefit of taking a holistic perspective to developing complex software systems. |
Figure 1A block diagram of the devices.
Identification of common risk situations in the worker’s environment.
| Risk Factors | Associated Hazards |
|---|---|
| Lack of Adequate Lighting | - The inability of the worker to see their environment clearly leads to accidental hits, slips, trips and falls. |
| Temperature | - Extreme temperature changes leading to a heat stroke |
| Air Quality | - Harmful air in the environment |
| Operator Movement | - Slips, trips and falls |
Identification of electronic components for the prevention of risks in the worker’s environment.
| Risk Factors | Solution |
|---|---|
| Lack of Adequate Lighting | - Implementation of a brightness sensor in the helmet |
| Temperature | - Implementation of temperature sensors in the devices of the worker or environment |
| Air Quality | - Moisture and gas sensors. |
| Operator Movement | - The use of wearable devices with accelerometers capable of detecting falls. |
Figure 2A block diagram of the devices.
Figure 3The electronic system of the helmet.
Figure 4Setting up the ThingsBoard platform to operate according to the information received from ESP32, IoT module added to ThingsBoard and Multi-sensorial configuration.
Figure 5Alarm configuration on ThingsBoard, Block alarm creation method and Connecting alarms with sensors.
Figure 6Final configuration of ThingsBoard platform to be validated through an intelligent algorithm.
Parameters for which data are collected.
| 1. Brightness |
| 2. Variation in |
| 3. Force Sensitive Resistor |
| 4. Temperature, Humidity, Pressure |
| 5. Air quality |
Confusion matrix SVM.
| Predicted Class (Vertical)/True Class (Horizontal) | Class 0 | Class 1 | Class 2 | Class 3 | Class 4 | Class 5 | Class 6 | Class 7 | Class 8 | Class 9 | Class 10 | Class 11 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
| 153 | 10 | 31 | 0 | 0 | 0 | 0 | 0 | 0 | 1 | 1 | 6 |
|
| 0 | 122 | 0 | 0 | 1 | 6 | 0 | 12 | 0 | 2 | 1 | 5 |
|
| 20 | 0 | 192 | 0 | 0 | 0 | 0 | 0 | 0 | 120 | 0 | 0 |
|
| 20 | 0 | 0 | 158 | 3 | 0 | 13 | 25 | 2 | 101 | 0 | 7 |
|
| 1 | 0 | 0 | 0 | 12 | 0 | 0 | 0 | 3 | 5 | 9 | 0 |
|
| 0 | 25 | 23 | 0 | 0 | 135 | 0 | 0 | 0 | 2 | 8 | 7 |
|
| 0 | 0 | 0 | 0 | 0 | 0 | 110 | 30 | 0 | 1 | 0 | 0 |
|
| 15 | 5 | 30 | 0 | 0 | 57 | 0 | 159 | 0 | 5 | 0 | 0 |
|
| 1 | 9 | 0 | 30 | 0 | 0 | 20 | 0 | 11 | 1 | 0 | 9 |
|
| 13 | 0 | 5 | 40 | 0 | 0 | 10 | 0 | 0 | 432 | 0 | 0 |
|
| 0 | 8 | 0 | 4 | 0 | 0 | 0 | 6 | 0 | 3 | 53 | 0 |
|
| 0 | 0 | 0 | 0 | 0 | 0 | 8 | 0 | 0 | 2 | 5 | 72 |
Confusion matrix NB.
| Predicted Class (Vertical)/True Class (Horizontal) | Class 0 | Class 1 | Class 2 | Class 3 | Class 4 | Class 5 | Class 6 | Class 7 | Class 8 | Class 9 | Class 10 | Class 11 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
| 174 | 10 | 31 | 0 | 1 | 0 | 0 | 0 | 0 | 5 | 1 | 0 |
|
| 0 | 140 | 0 | 0 | 1 | 0 | 0 | 12 | 0 | 2 | 1 | 9 |
|
| 10 | 0 | 220 | 0 | 0 | 0 | 0 | 0 | 0 | 70 | 0 | 0 |
|
| 15 | 0 | 0 | 181 | 0 | 0 | 13 | 5 | 1 | 62 | 0 | 7 |
|
| 1 | 0 | 0 | 0 | 13 | 0 | 0 | 7 | 0 | 1 | 5 | 0 |
|
| 0 | 25 | 13 | 0 | 0 | 155 | 0 | 9 | 0 | 11 | 4 | 1 |
|
| 0 | 0 | 0 | 0 | 0 | 0 | 126 | 1 | 0 | 0 | 0 | 0 |
|
| 9 | 2 | 15 | 0 | 0 | 37 | 0 | 180 | 0 | 0 | 0 | 0 |
|
| 1 | 1 | 0 | 30 | 0 | 0 | 20 | 0 | 13 | 0 | 2 | 4 |
|
| 3 | 0 | 1 | 20 | 1 | 6 | 2 | 18 | 1 | 520 | 0 | 3 |
|
| 0 | 1 | 1 | 1 | 0 | 0 | 0 | 0 | 1 | 0 | 60 | 0 |
|
| 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 3 | 4 | 82 |
Figure 7Proposed architecture, static neural network.
Confusion matrix NN.
| Predicted Class (Vertical)/True Class (Horizontal) | Class 0 | Class 1 | Class 2 | Class 3 | Class 4 | Class 5 | Class 6 | Class 7 | Class 8 | Class 9 | Class 10 | Class 11 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
| 175 | 10 | 30 | 0 | 0 | 0 | 0 | 0 | 0 | 5 | 1 | 0 |
|
| 0 | 141 | 0 | 0 | 0 | 0 | 0 | 7 | 0 | 2 | 1 | 9 |
|
| 9 | 0 | 221 | 0 | 0 | 0 | 0 | 0 | 0 | 60 | 0 | 0 |
|
| 13 | 0 | 0 | 181 | 0 | 0 | 13 | 5 | 0 | 50 | 0 | 7 |
|
| 1 | 0 | 0 | 0 | 15 | 0 | 0 | 7 | 0 | 0 | 25 | 0 |
|
| 0 | 23 | 12 | 0 | 0 | 150 | 0 | 9 | 0 | 9 | 9 | 1 |
|
| 0 | 0 | 0 | 0 | 0 | 0 | 134 | 1 | 0 | 2 | 0 | 0 |
|
| 9 | 3 | 16 | 0 | 0 | 32 | 0 | 185 | 0 | 15 | 0 | 0 |
|
| 1 | 1 | 0 | 30 | 0 | 0 | 12 | 0 | 14 | 0 | 2 | 4 |
|
| 3 | 0 | 1 | 20 | 1 | 16 | 2 | 18 | 1 | 526 | 0 | 2 |
|
| 0 | 1 | 1 | 1 | 0 | 0 | 0 | 0 | 1 | 0 | 30 | 0 |
|
| 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 5 | 9 | 83 |
Figure 8Deep convolutional neural network operation.
Confusion matrix CNN.
| Predicted Class (Vertical)/True Class (Horizontal) | Class 0 | Class 1 | Class 2 | Class 3 | Class 4 | Class 5 | Class 6 | Class 7 | Class 8 | Class 9 | Class 10 | Class 11 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
| 190 | 0 | 8 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
|
| 8 | 169 | 0 | 0 | 0 | 12 | 0 | 3 | 0 | 0 | 0 | 0 |
|
| 18 | 0 | 267 | 0 | 0 | 3 | 0 | 2 | 0 | 3 | 1 | 0 |
|
| 4 | 0 | 0 | 209 | 0 | 1 | 0 | 0 | 0 | 30 | 0 | 0 |
|
| 1 | 0 | 1 | 0 | 15 | 0 | 0 | 0 | 0 | 0 | 1 | 0 |
|
| 1 | 8 | 0 | 0 | 0 | 179 | 0 | 4 | 0 | 0 | 0 | 0 |
|
| 0 | 2 | 0 | 4 | 0 | 0 | 150 | 0 | 4 | 29 | 0 | 0 |
|
| 1 | 0 | 0 | 0 | 0 | 0 | 0 | 115 | 0 | 0 | 0 | 0 |
|
| 0 | 0 | 0 | 3 | 0 | 0 | 0 | 0 | 67 | 1 | 0 | 0 |
|
| 0 | 0 | 4 | 16 | 0 | 2 | 11 | 1 | 6 | 612 | 0 | 0 |
|
| 0 | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0 | 1 | 73 | 0 |
|
| 0 | 0 | 0 | 0 | 0 | 1 | 0 | 0 | 0 | 0 | 2 | 106 |
Figure 9Cross-validation results with 20% for the SVM.
Figure 10Cross-validation results with 20% for the NB.
Figure 11Cross-validation results with 20% for the NN.
Figure 12Cross-validation results with 20% for the CNN.
Figure 13System of alarm rules established in ThingsBoard.
Ten-fold validation for CNN.
| Ten Fold Cross-Validation Test Sets | Accuracy (%) (Automated Risk Situations Develop in This Research) |
|---|---|
| 1 | 93.18 |
| 2 | 93.09 |
| 3 | 90.73 |
| 4 | 94.12 |
| 5 | 91.27 |
| 6 | 92.75 |
| 7 | 92.61 |
| 8 | 92.59 |
| 9 | 92.76 |
| 10 | 91.99 |
|
| 92.509 |