Yue Sun1, Jingjing Hu2, Wenjin Wang1, Min He2, Peter H N de With1. 1. Department of Electrical Engineering, Eindhoven University of Technology, Eindhoven, The Netherlands. 2. Department of Electrical Engineering, Hunan University, Changsha, China.
Abstract
BACKGROUND: Detecting discomfort in infants is an important topic for their well-being and development. In this paper, we present an automatic and continuous video-based system for monitoring and detecting discomfort in infants. METHODS: The proposed system employs a novel and efficient 3D convolutional neural network (CNN), which achieves an end-to-end solution without the conventional face detection and tracking steps. In the scheme of this study, we thoroughly investigate the video characteristics (e.g., intensity images and motion images) and CNN architectures (e.g., 2D and 3D) for infant discomfort detection. The realized improvements of the 3D-CNN are based on capturing both the motion and the facial expression information of the infants. RESULTS: The performance of the system is assessed using videos recorded from 24 hospitalized infants by visualizing receiver operating characteristic (ROC) curves and measuring the values of area under the ROC curve (AUC). Additional performance metrics (labeling accuracy) are also calculated. Experimental results show that the proposed system achieves an AUC of 0.99, while the overall labeling accuracy is 0.98. CONCLUSIONS: These results confirms the robustness by using the 3D-CNN for infant discomfort monitoring and capturing both motion and facial expressions simultaneously. 2021 Quantitative Imaging in Medicine and Surgery. All rights reserved.
BACKGROUND: Detecting discomfort in infants is an important topic for their well-being and development. In this paper, we present an automatic and continuous video-based system for monitoring and detecting discomfort in infants. METHODS: The proposed system employs a novel and efficient 3D convolutional neural network (CNN), which achieves an end-to-end solution without the conventional face detection and tracking steps. In the scheme of this study, we thoroughly investigate the video characteristics (e.g., intensity images and motion images) and CNN architectures (e.g., 2D and 3D) for infant discomfort detection. The realized improvements of the 3D-CNN are based on capturing both the motion and the facial expression information of the infants. RESULTS: The performance of the system is assessed using videos recorded from 24 hospitalized infants by visualizing receiver operating characteristic (ROC) curves and measuring the values of area under the ROC curve (AUC). Additional performance metrics (labeling accuracy) are also calculated. Experimental results show that the proposed system achieves an AUC of 0.99, while the overall labeling accuracy is 0.98. CONCLUSIONS: These results confirms the robustness by using the 3D-CNN for infant discomfort monitoring and capturing both motion and facial expressions simultaneously. 2021 Quantitative Imaging in Medicine and Surgery. All rights reserved.
Entities:
Keywords:
3D convolutional neural network (3D-CNN); Infant discomfort; discomfort detection; video health monitoring
Authors: Yue Sun; Caifeng Shan; Tao Tan; Tong Tong; Wenjin Wang; Arash Pourtaherian; Peter H N de With Journal: Physiol Meas Date: 2019-12-03 Impact factor: 2.833
Authors: Yue Sun; Peter H N de With; Deedee Kommers; Wenjin Wang; Rohan Joshi; Caifeng Shan; Tao Tan; Ronald M Aarts; Carola van Pul; Peter Andriessen Journal: Conf Proc IEEE Eng Med Biol Soc Date: 2019-07