Lisa J Meltzer1, Laura S Hiruma2, Kristin Avis3, Hawley Montgomery-Downs4, Judith Valentin5. 1. National Jewish Health, Denver, CO. 2. University at Albany, State University of New York, Albany, NY. 3. University of Alabama at Birmingham, Birmingham, AL. 4. West Virginia University, Morgantown, WV. 5. Children's of Alabama, Birmingham, AL.
Abstract
STUDY OBJECTIVES: To evaluate the reliability and validity of the commercially available Fitbit Ultra (2012) accelerometer compared to polysomnography (PSG) and two different actigraphs in a pediatric sample. DESIGN AND SETTING: All subjects wore the Fitbit Ultra while undergoing overnight clinical polysomnography in a sleep laboratory; a randomly selected subset of participants also wore either the Ambulatory Monitoring Inc. Motionlogger Sleep Watch (AMI) or Phillips-Respironics Mini-Mitter Spectrum (PRMM). PARTICIPANTS: 63 youth (32 females, 31 males), ages 3-17 years (mean 9.7 years, SD 4.6 years). MEASUREMENTS: Both "Normal" and "Sensitive" sleep-recording Fitbit Ultra modes were examined. Outcome variables included total sleep time (TST), wake after sleep onset (WASO), and sleep efficiency (SE). Primary analyses examined the differences between Fitbit Ultra and PSG using repeated-measures ANCOVA, with epoch-by-epoch comparisons between Fitbit Ultra and PSG used to determine sensitivity, specificity, and accuracy. Intra-device reliability, differences between Fitbit Ultra and actigraphy, and differences by both developmental age group and sleep disordered breathing (SDB) status were also examined. RESULTS: Compared to PSG, the Normal Fitbit Ultra mode demonstrated good sensitivity (0.86) and accuracy (0.84), but poor specificity (0.52); conversely, the Sensitive Fitbit Ultra mode demonstrated adequate specificity (0.79), but inadequate sensitivity (0.70) and accuracy (0.71). Compared to PSG, the Fitbit Ultra significantly overestimated TST (41 min) and SE (8%) in Normal mode, and underestimated TST (105 min) and SE (21%) in Sensitive mode. Similar differences were found between Fitbit Ultra (both modes) and both brands of actigraphs. CONCLUSIONS: Despite its low cost and ease of use for consumers, neither sleep-recording mode of the Fitbit Ultra accelerometer provided clinically comparable results to PSG. Further, pediatric sleep researchers and clinicians should be cautious about substituting these devices for validated actigraphs, with a significant risk of either overestimating or underestimating outcome data including total sleep time and sleep efficiency.
STUDY OBJECTIVES: To evaluate the reliability and validity of the commercially available Fitbit Ultra (2012) accelerometer compared to polysomnography (PSG) and two different actigraphs in a pediatric sample. DESIGN AND SETTING: All subjects wore the Fitbit Ultra while undergoing overnight clinical polysomnography in a sleep laboratory; a randomly selected subset of participants also wore either the Ambulatory Monitoring Inc. Motionlogger Sleep Watch (AMI) or Phillips-Respironics Mini-Mitter Spectrum (PRMM). PARTICIPANTS: 63 youth (32 females, 31 males), ages 3-17 years (mean 9.7 years, SD 4.6 years). MEASUREMENTS: Both "Normal" and "Sensitive" sleep-recording Fitbit Ultra modes were examined. Outcome variables included total sleep time (TST), wake after sleep onset (WASO), and sleep efficiency (SE). Primary analyses examined the differences between Fitbit Ultra and PSG using repeated-measures ANCOVA, with epoch-by-epoch comparisons between Fitbit Ultra and PSG used to determine sensitivity, specificity, and accuracy. Intra-device reliability, differences between Fitbit Ultra and actigraphy, and differences by both developmental age group and sleep disordered breathing (SDB) status were also examined. RESULTS: Compared to PSG, the Normal Fitbit Ultra mode demonstrated good sensitivity (0.86) and accuracy (0.84), but poor specificity (0.52); conversely, the Sensitive Fitbit Ultra mode demonstrated adequate specificity (0.79), but inadequate sensitivity (0.70) and accuracy (0.71). Compared to PSG, the Fitbit Ultra significantly overestimated TST (41 min) and SE (8%) in Normal mode, and underestimated TST (105 min) and SE (21%) in Sensitive mode. Similar differences were found between Fitbit Ultra (both modes) and both brands of actigraphs. CONCLUSIONS: Despite its low cost and ease of use for consumers, neither sleep-recording mode of the Fitbit Ultra accelerometer provided clinically comparable results to PSG. Further, pediatric sleep researchers and clinicians should be cautious about substituting these devices for validated actigraphs, with a significant risk of either overestimating or underestimating outcome data including total sleep time and sleep efficiency.
Authors: Daniel Combs; James L Goodwin; Stuart F Quan; Wayne J Morgan; Chiu-Hsieh Hsu; Jamie O Edgin; Sairam Parthasarathy Journal: J Clin Sleep Med Date: 2019-01-15 Impact factor: 4.062