Supun Nakandala1, Marta M Jankowska2, Fatima Tuz-Zahra3, John Bellettiere3, Jordan A Carlson4, Andrea Z LaCroix3, Sheri J Hartman3, Dori E Rosenberg5, Jingjing Zou3, Arun Kumar1, Loki Natarajan3. 1. Department of Computer Science and Engineering, University of California San Diego, La Jolla, CA, USA. 2. Qualcomm Institute/Calit2, University of California San Diego, La Jolla, CA, USA. 3. The Herbert Wertheim School of Public Health and Human Longevity Science, University of California San Diego, La Jolla, CA, USA. 4. Center for Children's Healthy Lifestyles and Nutrition, Children's Mercy Hospital, Kansas City, MO, USA, and the Department of Pediatrics, Children's Mercy Hospital and University of Missouri Kansas City, Kansas City, MO, USA. 5. Kaiser Permanente Washington Health Research Institute, Seattle, WA, USA.
Abstract
BACKGROUND: Machine learning has been used for classification of physical behavior bouts from hip-worn accelerometers; however, this research has been limited due to the challenges of directly observing and coding human behavior "in the wild." Deep learning algorithms, such as convolutional neural networks (CNNs), may offer better representation of data than other machine learning algorithms without the need for engineered features and may be better suited to dealing with free-living data. The purpose of this study was to develop a modeling pipeline for evaluation of a CNN model on a free-living data set and compare CNN inputs and results with the commonly used machine learning random forest and logistic regression algorithms. METHOD: Twenty-eight free-living women wore an ActiGraph GT3X+accelerometer on their right hip for 7 days. A concurrently worn thigh-mounted activPAL device captured ground truth activity labels. The authors evaluated logistic regression, random forest, and CNN models for classifying sitting, standing, and stepping bouts. The authors also assessed the benefit of performing feature engineering for this task. RESULTS: The CNN classifier performed best (average balanced accuracy for bout classification of sitting, standing, and stepping was 84%) compared with the other methods (56% for logistic regression and 76% for random forest), even without performing any feature engineering. CONCLUSION: Using the recent advancements in deep neural networks, the authors showed that a CNN model can outperform other methods even without feature engineering. This has important implications for both the model's ability to deal with the complexity of free-living data and its potential transferability to new populations.
BACKGROUND: Machine learning has been used for classification of physical behavior bouts from hip-worn accelerometers; however, this research has been limited due to the challenges of directly observing and coding human behavior "in the wild." Deep learning algorithms, such as convolutional neural networks (CNNs), may offer better representation of data than other machine learning algorithms without the need for engineered features and may be better suited to dealing with free-living data. The purpose of this study was to develop a modeling pipeline for evaluation of a CNN model on a free-living data set and compare CNN inputs and results with the commonly used machine learning random forest and logistic regression algorithms. METHOD: Twenty-eight free-living women wore an ActiGraph GT3X+accelerometer on their right hip for 7 days. A concurrently worn thigh-mounted activPAL device captured ground truth activity labels. The authors evaluated logistic regression, random forest, and CNN models for classifying sitting, standing, and stepping bouts. The authors also assessed the benefit of performing feature engineering for this task. RESULTS: The CNN classifier performed best (average balanced accuracy for bout classification of sitting, standing, and stepping was 84%) compared with the other methods (56% for logistic regression and 76% for random forest), even without performing any feature engineering. CONCLUSION: Using the recent advancements in deep neural networks, the authors showed that a CNN model can outperform other methods even without feature engineering. This has important implications for both the model's ability to deal with the complexity of free-living data and its potential transferability to new populations.
Entities:
Keywords:
ActiGraph; activPAL; activity classification; feature engineering; free living
Authors: Jordan A Carlson; John Bellettiere; Jacqueline Kerr; Jo Salmon; Anna Timperio; Simone J J M Verswijveren; Nicola D Ridgers Journal: J Sports Sci Date: 2019-04-19 Impact factor: 3.337
Authors: John Bellettiere; Genevieve N Healy; Michael J LaMonte; Jacqueline Kerr; Kelly R Evenson; Eileen Rillamas-Sun; Chongzhi Di; David M Buchner; Melbourne F Hovell; Andrea Z LaCroix Journal: J Gerontol A Biol Sci Med Sci Date: 2019-02-15 Impact factor: 6.053
Authors: Jeremy A Steeves; Heather R Bowles; James J McClain; Kevin W Dodd; Robert J Brychta; Juan Wang; Kong Y Chen Journal: Med Sci Sports Exerc Date: 2015-05 Impact factor: 5.411
Authors: Jeffer Eidi Sasaki; Amanda M Hickey; John W Staudenmayer; Dinesh John; Jane A Kent; Patty S Freedson Journal: Med Sci Sports Exerc Date: 2016-05 Impact factor: 5.411
Authors: Katherine Ellis; Suneeta Godbole; Simon Marshall; Gert Lanckriet; John Staudenmayer; Jacqueline Kerr Journal: Front Public Health Date: 2014-04-22
Authors: Sara Knaeps; Jan G Bourgois; Ruben Charlier; Evelien Mertens; Johan Lefevre; Katrien Wijndaele Journal: Br J Sports Med Date: 2016-08-04 Impact factor: 13.800
Authors: Andrew J Atkin; Trish Gorely; Stacy A Clemes; Thomas Yates; Charlotte Edwardson; Soren Brage; Jo Salmon; Simon J Marshall; Stuart J H Biddle Journal: Int J Epidemiol Date: 2012-10 Impact factor: 7.196
Authors: Mikael Anne Greenwood-Hickman; Supun Nakandala; Marta M Jankowska; Dori E Rosenberg; Fatima Tuz-Zahra; John Bellettiere; Jordan Carlson; Paul R Hibbing; Jingjing Zou; Andrea Z Lacroix; Arun Kumar; Loki Natarajan Journal: Med Sci Sports Exerc Date: 2021-11-01
Authors: Kelly R Evenson; John Bellettiere; Carmen C Cuthbertson; Chongzhi Di; Rimma Dushkes; Annie Green Howard; Humberto Parada; Benjamin T Schumacher; Eric J Shiroma; Guangxing Wang; I-Min Lee; Andrea Z LaCroix Journal: BMJ Open Date: 2021-11-29 Impact factor: 3.006
Authors: Paddy C Dempsey; Eivind Aadland; Tessa Strain; Olav M Kvalheim; Kate Westgate; Tim Lindsay; Kay-Tee Khaw; Nicholas J Wareham; Søren Brage; Katrien Wijndaele Journal: Prev Med Date: 2022-02-04 Impact factor: 4.018
Authors: Jordan A Carlson; Nicola D Ridgers; Supun Nakandala; Rong Zablocki; Fatima Tuz-Zahra; John Bellettiere; Paul R Hibbing; Chelsea Steel; Marta M Jankowska; Dori E Rosenberg; Mikael Anne Greenwood-Hickman; Jingjing Zou; Andrea Z LaCroix; Arun Kumar; Loki Natarajan Journal: Int J Behav Nutr Phys Act Date: 2022-08-26 Impact factor: 8.915