Literature DB >> 31777843

Validating Fitbit for Evaluation of Physical Activity in Patients with Knee Osteoarthritis: Do Thresholds Matter?

Genevieve S Silva1, Heidi Yang1, Jamie E Collins2, Elena Losina2.   

Abstract

OBJECTIVE: We sought to evaluate the performance of Fitbit in estimating ActiGraph-derived moderate-to-vigorous physical activity (MVPA) and sedentary time in the knee osteoarthritis (OA) population.
METHODS: We used data from two weeks of Fitbit and ActiGraph wear among knee OA subjects. In primary analyses, we used literature-based ActiGraph thresholds of 200 and 1924 counts/min (triaxial vector magnitude) for sedentary and MVPA time as the gold standard to which we compared three sets of Fitbit thresholds informed by literature and data (Youden index). We also considered personalized, stride length-based Fitbit thresholds. In sensitivity analyses, we used uniaxial, vertical axis-based as well as personalized, BMI-based ActiGraph thresholds. We calculated agreement, sensitivity, and specificity of Fitbit in classifying sedentary and MVPA time.
RESULTS: In the primary analysis (vector magnitude thresholds), maximum agreement for sedentary and MVPA time was 67.0% from the Youden index-based and 91.1% from the stride length-based Fitbit thresholds. For sedentary time, the 20 strides/min threshold had the highest sensitivity (97.6%), and Youden-derived 1 stride/min had the highest specificity (51.6%). For MVPA, Youden-derived 14 strides/min yielded 72.8% sensitivity, and using stride length yielded 98.6% specificity. MVPA time ranged from 49-323 min/d, depending on threshold used, with literature-based and personalized thresholds leading to more conservative estimates of MVPA than Youden-derived thresholds.
CONCLUSION: Using Fitbit for MVPA and sedentary time assessment may lead to inaccurate estimates of both. Fitbit MVPA estimates were generally more conservative than ActiGraph estimates. Incorporating individuals' characteristics did not meaningfully improve Fitbit performance. Caution should be exercised when measuring activity using Fitbit.
© 2019 The Authors. ACR Open Rheumatology published by Wiley Periodicals, Inc. on behalf of American College of Rheumatology.

Entities:  

Year:  2019        PMID: 31777843      PMCID: PMC6857976          DOI: 10.1002/acr2.11080

Source DB:  PubMed          Journal:  ACR Open Rheumatol        ISSN: 2578-5745


Introduction

Suboptimal physical activity (PA) is a health concern around the world 1, which has led public health organizations to release official PA guidelines 2, 3. In 2008, the US Department of Health and Human Services published suggested weekly PA guidelines for Americans 2, stratified by intensity of activity. These guidelines were updated in 2018 to include strategies for population‐level PA promotion, emphasize the risks of sedentary behavior, and eliminate the previous requirement that PA occur in bouts of at least 10 minutes 4. In conjunction with this emphasis on PA guidelines, studies have attempted to quantify PA levels currently achieved in different population groups 5, 6, 7. Patients with symptomatic knee osteoarthritis (OA) have suboptimal levels of PA 8, 9, 10, 11, 12. PA uptake among knee OA patients remains low despite growing evidence that PA and exercise are efficacious for pain relief 13. These observations highlight the importance of developing and implementing interventions to improve PA among knee OA patients. To evaluate the efficacy of such interventions, it is important to accurately measure PA levels. Triaxial, medical‐grade accelerometers like the ActiGraph GT3X+ (ActiGraph Corporation) are considered the gold standard for PA evaluation 14, yet guidelines for interpreting accelerometry data are not standardized in the literature 15. Studies have proposed multiple threshold cutoffs to relate ActiGraph counts to PA levels, and some have suggested that thresholds should be described as ranges to account for interperson variability 15, 16, 17, 18, 19. Furthermore, much accelerometry validation has involved young and healthy populations or uniaxial ActiGraphs 15, 20, 21, 22, the results of which are not applicable to the older OA population using triaxial accelerometers 23. Although ActiGraphs are the gold standard for objective PA assessment, commercially available accelerometers like the Fitbit have distinct advantages for use in PA‐focused investigations. Such devices have a significantly lower cost and greater ease of wear, factors that make them appealing for scalability in large trials conducted over extended periods of time, leading to their increased use in research 24, 25, 26, 27, 28. Although studies have begun to investigate agreement between medical‐ and commercial‐grade accelerometers 29, 30, 31, 32, standardized thresholds across devices have not been delineated, particularly those specific to at‐risk populations with unique gait patterns, such as older individuals with knee OA 33. As Fitbit use becomes more commonplace in large‐scale investigations of the OA population, it is essential to understand the meaning of the data in the context of validated ActiGraph accelerometry measures. We sought to examine a variety of thresholds—personalized, data‐driven, and published—to determine the accuracy of the Fitbit Charge 2 in approximating moderate‐to‐vigorous physical activity (MVPA) and sedentary time, compared with the gold standard ActiGraph GT3X+, under various classification paradigms. Our primary purpose in this analysis was to examine agreement between the two accelerometers in measuring activity level. Therefore, we only considered time during which both devices registered wear, per our definitions. Wherever possible, we focused on thresholds applicable to an older adult population representative of individuals most affected by knee OA.

Study sample

We analyzed data collected in a pilot study of 15 participants with symptomatic knee OA recruited from the patient population of four rheumatologists at Brigham and Women's Hospital 34. Participants were recruited between March and July of 2017. Participants were asked to simultaneously wear Fitbit (wrist) and ActiGraph GTX3 (hip) accelerometers over the course of 2 weeks for at least 10 waking hours per day, with which 14 of the 15 participants complied. In our previous report 34, we established that these sites (wrist for Fitbit and hip for ActiGraph) offered the best agreement across the accelerometers. Fitbit data were downloaded from the Fitbit server on a weekly basis using an in‐house application programming interface, and ActiGraph data were downloaded at the end of the study period using ActiLife software (ActiLife v.6.13.3, ActiGraph). Further details of this pilot study have been published elsewhere 34.

Wear time description and validation

To validate Fitbit wear time at the per‐minute level, we compared Fitbit stride counts to heart rate (HR) readings. We examined each minute of data for each of the 14 study participants included, classifying HR values as either missing or greater than zero and stride counts as equal to zero or greater than zero to define wear time and sedentary time without using stride counts alone. In all analyses, we defined nonwear time for the ActiGraph as any minute with zero vector magnitude counts. We defined a Fitbit nonwear minute as having a stride count of zero along with missing HR data. Fitbit minutes with zero strides and nonmissing HR data were considered as sedentary time. Any Fitbit minute with greater than zero strides was considered as wear time, even if HR data were missing. Our analysis included minutes during which both the ActiGraph and Fitbit were worn.

Defining Fitbit thresholds: main analysis

We compared Fitbit to ActiGraph data for each subject on a minute‐by‐minute level to examine agreement between the devices. Minutes from each device were classified to represent time in one of two activity categories: sedentary or MVPA. We determined these categories by defining stride or count (for Fitbit and ActiGraph, respectively) threshold cut point values for the upper bound of sedentary activity and the lower bound of MVPA. We considered four threshold sets for Fitbit‐derived PA data. We included two combinations of upper and lower strides/min cut points, which were informed by literature‐suggested speed and average stride length, and we used one data‐driven threshold set defined by a Youden index analysis 35. We also calculated a personalized threshold for MVPA by utilizing the stride length data for each individual 34. A walking speed of 2.5 km/h was considered consistent with MVPA for an older population 16, particularly one with elevated pain (mean Knee Injury and Osteoarthritis Outcome Score [KOOS] pain = 50) and limited function due to OA. We used an estimated stride length of 0.6 m (derived from a measured step length of 0.3 m) to conclude that at least 67 strides/min would be needed to achieve a speed of 2.5 km/h. We considered an alternate MVPA lower bound of 50 strides/min, which corresponded to the ~2 km/h pace suggested by another report for an elderly population 36. We considered two upper thresholds for sedentary time, 10 and 20 strides/min, which corresponded to speeds of about 0.4 and 0.7 km/h, respectively 37. We also defined a Fitbit threshold with a data‐driven approach. Using the ActiGraph as the gold standard, we used the receiver operating characteristic curve to evaluate possible cut points in Fitbit‐measured strides. We used the Youden index to select the cut points with the maximum combination of sensitivity and specificity 35. This yielded an upper bound for sedentary time of 1 stride/min and a lower bound for MVPA of 14 strides/min. To determine individualized Fitbit thresholds, we used coefficients for metabolic equivalents of task (METs) from Barnett et al and calculated METs for each participant based on their stride lengths recorded by the Fitbit 16. MVPA was defined as expending 3 METs of energy, which, for older adults, corresponds to walking at a 2.5 km/h pace 16. We calculated personalized MVPA thresholds from this by dividing that speed by half of each participant's stride length 34, 38. We used the published ActiGraph thresholds of 200 counts/min for the upper bound of sedentary time 18 and 1924 counts/min for the lower bound of MVPA, which were derived for an elderly population as the gold standard 16. We then compared the overall agreement, sensitivity, and specificity of the Fitbit compared with the ActiGraph in classifying minutes spent in sedentary and MVPA time. Agreement for each PA level was calculated by summing the overall percentage of minutes classified by both devices as the same PA level. Sensitivity represented the ability of the Fitbit to correctly identify sedentary and MVPA time, and specificity represented the ability of the Fitbit to correctly identify time not in sedentary time and not in MVPA, relative to the ActiGraph classifications.

Sensitivity analyses: varying ActiGraph threshold definitions

Uniaxial ActiGraph thresholds

As a sensitivity analysis, we repeated the above analyses using uniaxial ActiGraph thresholds as the gold standard against which the same set of Fitbit results were compared. For the uniaxial counts, the ActiGraph cutoffs were 100 counts/min as the upper bound of sedentary time 11 and 1013 counts/min as the lower bound of MVPA time 16. For the uniaxial ActiGraph data, we considered any minute with a vertical (uniaxial) count of zero as sedentary time if that same minute had a vector (triaxial) count greater than zero, indicating wear. Otherwise, uniaxial counts of zero were classified as nonwear.

Per‐person ActiGraph thresholds by body mass index adjustment

Additionally, some literature has suggested that the thresholds for determining MVPA may differ by body mass index (BMI) 16. To investigate this, we used the regression coefficients provided by Barnett et al to adjust our ActiGraph count thresholds by BMI for each subject 16. We compared Fitbit data, using the thresholds defined in our primary analysis, to ActiGraph hip minute‐by‐minute data with MVPA thresholds adjusted by BMI for each subject. We again examined agreement, sensitivity, and specificity between the devices, and we did this for both triaxial and uniaxial ActiGraph counts to evaluate MVPA versus non‐MVPA time.

Estimating PA

We also compared the average daily minutes classified as MVPA time across our Fitbit MVPA thresholds (50, 67, Youden‐derived [14 with triaxial and 15 with uniaxial], and stride length–derived strides/min) and our unadjusted (1924 triaxial and 1013 uniaxial counts/min) and BMI‐adjusted MVPA thresholds for triaxial and uniaxial ActiGraph counts.

Description of the study sample

Table 1 presents the cohort characteristics of the study participants, who had a mean(SD) stride length of 0.6(0.1) and a mean(SD) BMI of 28.9(5.4). Examining Fitbit wear time independently of ActiGraph wear time, subjects wore the Fitbit (defined as all minutes except those with both 0 strides and missing HR) for a total of 2217 hours (133 011 minutes) over the course of 2 weeks, or approximately 11 hours per subject per day. Seventy‐four percent of those minutes did not register any strides, whereas 26% (33 657 minutes) registered at least one stride. Less than 0.5% of the minute‐by‐minute Fitbit data represented instances in which stride count was greater than zero and HR was missing.
Table 1

Description of the study sample (n = 14)

CharacteristicValuea
Age (years)68.0 (8.3), 68.0
Female sex, n (%)9 (64.3)
BMI (kg/m2)28.9 (5.4), 27.7
Stride length (m)0.6 (0.1), 0.6
Medication for knee pain in past week, n (%)12 (85.7)
KOOS scoresb  
Pain49.6 (20.9), 56.7
Function55.3 (20.5), 60.7
Symptoms50.2 (18.1), 50.0
Quality of life38.2 (17.8), 42.5
Triaxial ActiGraph and Fitbit wear time (minutes)93 087

Abbreviation: BMI, body mass index; KOOS, Knee Injury and Osteoarthritis Outcome Score.

Values are mean(SD), median unless otherwise specified.

KOOS scores: 0‐100; 0 represents the worst outcome score 42.

Description of the study sample (n = 14) Abbreviation: BMI, body mass index; KOOS, Knee Injury and Osteoarthritis Outcome Score. Values are mean(SD), median unless otherwise specified. KOOS scores: 0‐100; 0 represents the worst outcome score 42. The total time that subjects wore both the Fitbit and triaxial ActiGraph was 93 087 minutes, and the mean per‐subject wear time classified by both Fitbit and ActiGraph was 6649 minutes (111 h/subject), or approximately 8 hours per subject per day.

Fitbit PA categorization versus triaxial ActiGraph gold standard, varying Fitbit thresholds

Results of all Fitbit cut point set scenarios (three sets for sedentary time and four sets for MVPA) compared with the triaxial ActiGraph hip are reported in Table 2. The Youden analysis resulted in an optimal Fitbit cutoff of 1 stride/min as the upper bound of sedentary and 14 stride/min for the lower bound of MVPA. The stride length–based MVPA Fitbit threshold ranged from 57‐87 strides/min, with a mean(SD) of 70(9) strides/min.
Table 2

Fitbit specificity, sensitivity, and agreement with ActiGraph in identifying minutes in sedentary and MVPA time based on various threshold definitions

Fitbit‐based threshold (strides/min)Sedentary Time MVPA Time
Sensitivity (%)Specificity (%)Agreement (%)Sensitivity (%)Specificity (%)Agreement (%)
  Triaxial ActiGraph; Non‐BMI (sedentary threshold: 200, MVPA threshold: 1924)
10 94.941.262.3 50 36.097.090.8
20 97.628.455.5 67 23.598.590.9
1 a 90.851.667.0 14 a 72.882.681.6
  Stride length b 24.498.691.1
  Uniaxial ActiGraph; Non‐BMI (sedentary threshold: 100, MVPA threshold: 1013)
10 92.547.970.9 50 40.296.592.1
20 96.734.166.4 67 27.498.292.7
1 a 86.858.273.0 15 a 71.982.081.3
  Stride length b 28.898.493.0
  Triaxial ActiGraph; BMI‐Based (mean MVPA threshold: 1807)
  50 30.596.889.2
67 19.698.389.3
9 a 74.677.577.2
Stride length b 20.698.589.5
  Uniaxial ActiGraph; BMI‐Based (mean MVPA threshold: 903)
  50 26.096.288.1
67 16.898.088.5
12 a 61.980.077.9
Stride length b 18.198.288.9

Abbreviation: BMI, body mass index; MVPA, moderate‐to‐vigorous physical activity.

Representation of a threshold derived using the Youden index analysis;

representation of thresholds derived using individualized stride length; The triaxial cutoffs used for sedentary and MVPA time for the ActiGraph were 200 and 1924 counts/minute, respectively. The uniaxial cutoffs were 100 and 1013 counts/minute for sedentary and MVPA time, respectively. BMI‐based analyses involved adjusting thresholds on a per‐subject basis by BMI calibration, for which data was only available for an MVPA, not sedentary, time threshold. Sensitivity represents the ability of the Fitbit to correctly identify time in MVPA, specificity represents ability of the Fitbit to correctly identify time not in MVPA, and agreement represents the total proportion of minutes categorized correctly by the Fitbit, all relative to the ActiGraph categorizations.

Fitbit specificity, sensitivity, and agreement with ActiGraph in identifying minutes in sedentary and MVPA time based on various threshold definitions Abbreviation: BMI, body mass index; MVPA, moderate‐to‐vigorous physical activity. Representation of a threshold derived using the Youden index analysis; representation of thresholds derived using individualized stride length; The triaxial cutoffs used for sedentary and MVPA time for the ActiGraph were 200 and 1924 counts/minute, respectively. The uniaxial cutoffs were 100 and 1013 counts/minute for sedentary and MVPA time, respectively. BMI‐based analyses involved adjusting thresholds on a per‐subject basis by BMI calibration, for which data was only available for an MVPA, not sedentary, time threshold. Sensitivity represents the ability of the Fitbit to correctly identify time in MVPA, specificity represents ability of the Fitbit to correctly identify time not in MVPA, and agreement represents the total proportion of minutes categorized correctly by the Fitbit, all relative to the ActiGraph categorizations. Among the scenarios evaluated in the primary analysis, the Fitbit threshold that yielded the greatest agreement with the ActiGraph for classifying sedentary time was the Youden‐derived threshold of 1 stride/min (67.0%), with the stride length–derived Fitbit threshold yielding greatest agreement (91.1%) for MVPA classification (Table 2). Overall agreement for sedentary and MVPA time ranged from 55.5% to 67.0% and from 81.6% to 90.8%, respectively. Among the Fitbit‐based thresholds for sedentary time, 20 strides/min had the highest sensitivity of 97.6%. In other words, 97.6% of all minutes designated as sedentary time by the ActiGraph had <20 strides/min measured by the Fitbit, thereby also being classified as sedentary time. Specificity for sedentary time was highest using the Youden‐defined 1 stride/min threshold, reaching 51.6%; that is, 51.6% of all minutes designated as nonsedentary time by the ActiGraph had >1 stride/min measured by the Fitbit also being classified as nonsedentary time. For MVPA classification, the Youden‐derived 14 strides/min threshold yielded the greatest sensitivity (72.8), and stride length yielded the greatest specificity (98.6). Figure 1 visualizes the distribution of Fitbit‐based strides/min versus ActiGraph‐based counts/min. Quadrants 2 (Q2) and 3 (Q3) of Figure 1 represent agreement between the two accelerometers when using 1924 counts/min and 67 strides/min as the lower bounds of MVPA. Although most of the data points are distributed across Q2 and Q3, a nontrivial number covers Q1 and Q4, pointing to the lack of perfect correspondence between MVPA thresholds defined by ActiGraph and Fitbit. The same discrepancy was present across all alternative Fitbit thresholds.
Figure 1

Distribution of Fitbit strides and triaxial ActiGraph counts per minute. The scatterplot describes triaxial ActiGraph counts/minute on the y‐axis and Fitbit strides/min on the x‐axis. We divide the plot into four quadrants using literature‐based MVPA thresholds for each device (67 strides/min and 1924 counts/min) to visualize the distribution of minutes based on these classifications of MVPA versus non‐MVPA. Quadrants 2 (Q2) and 3 (Q3) represent agreement between the two devices in classifying time in MVPA (Q2) and non‐MVPA (light physical activity and sedentary) (Q3).

Distribution of Fitbit strides and triaxial ActiGraph counts per minute. The scatterplot describes triaxial ActiGraph counts/minute on the y‐axis and Fitbit strides/min on the x‐axis. We divide the plot into four quadrants using literature‐based MVPA thresholds for each device (67 strides/min and 1924 counts/min) to visualize the distribution of minutes based on these classifications of MVPA versus non‐MVPA. Quadrants 2 (Q2) and 3 (Q3) represent agreement between the two devices in classifying time in MVPA (Q2) and non‐MVPA (light physical activity and sedentary) (Q3). The results of the sensitivity analyses using uniaxial ActiGraph thresholds and BMI‐adjusted thresholds for both triaxial and uniaxial ActiGraph data are also presented in Table 2. BMI‐derived MVPA thresholds for the triaxial ActiGraph ranged from 902 to 2456 counts/min, with a mean(SD) of 1807(441) compared with the singular, standardized threshold of 1924 counts/min. The same thresholds for the uniaxial ActiGraph ranged from 88 to 1488 counts/min, with a mean(SD) of 903(397), compared with the singular, standardized MVPA threshold of 1013 counts/min. The unadjusted uniaxial ActiGraph thresholds achieved maximum agreement (73.0%) in identifying sedentary time when paired with the Youden‐derived Fitbit threshold of 1 stride/min. Sedentary time sensitivity ranged from 86.8 to 96.7, and specificity ranged from 34.1 to 58.2. (Table 2) Maximum overall agreement in identifying MVPA time was achieved when using the stride length–based Fitbit threshold when compared with all variations of the ActiGraph thresholds: 93.0% with the unadjusted uniaxial thresholds, 89.5% with the BMI‐adjusted triaxial thresholds, and 88.9% with the BMI‐adjusted uniaxial thresholds. Correct classification of MVPA time was maximized when using the Youden‐derived Fitbit thresholds for all ActiGraph scenarios, yielding a sensitivity of 71.9, 74.6, and 61.9 for unadjusted uniaxial, BMI‐adjusted triaxial, and BMI‐adjusted uniaxial ActiGraph‐based standards, respectively. Correct classification of time not in MVPA was maximized when using stride length–derived Fitbit thresholds for all ActiGraph scenarios, although the 67 strides/min threshold yielded very similar values (Table 2). The specificity values were 98.4, 98.5, and 98.2, respectively. Figure 2 depicts the estimated average daily MVPA across the alternative MVPA thresholds and accelerometers. The mean daily MVPA time ranged from 49 to 323 minutes across all Fitbit and ActiGraph threshold scenarios. ActiGraph‐based thresholds led to greater daily MVPA time when compared with Fitbit‐based thresholds, with the exception of the Youden‐driven Fitbit thresholds of 14 and 15 strides/min, which led to the highest estimate of average daily MVPA for triaxial (323 min) and uniaxial (311 min) thresholds, respectively. The difference between MVPA estimates using appropriate uniaxial or triaxial thresholds was negligible.
Figure 2

Distribution of the average daily minutes in MVPA, by Fitbit and triaxial ActiGraph threshold scenario. The boxplot represents the distribution of the average minutes per day classified as time in MVPA under the Fitbit and triaxial ActiGraph threshold scenarios. The circle within each rectangle represents the mean of this distribution, and the midline of each rectangle represents the median of this distribution. The top and the bottom of each rectangle correspond to the 75th and 25th quartiles, respectively. Each rectangle of the boxplot represents a device and threshold for MVPA time used. We considered four Fitbit stride/min thresholds, along with a stride‐length based threshold, and two triaxial (vector magnitude) and uniaxial (vertical axis) ActiGraph count/min thresholds for the lower bound of MVPA. Fitbit‐based thresholds are represented by a purple color scheme, and ActiGraph‐based thresholds are represented by a blue color scheme.

Distribution of the average daily minutes in MVPA, by Fitbit and triaxial ActiGraph threshold scenario. The boxplot represents the distribution of the average minutes per day classified as time in MVPA under the Fitbit and triaxial ActiGraph threshold scenarios. The circle within each rectangle represents the mean of this distribution, and the midline of each rectangle represents the median of this distribution. The top and the bottom of each rectangle correspond to the 75th and 25th quartiles, respectively. Each rectangle of the boxplot represents a device and threshold for MVPA time used. We considered four Fitbit stride/min thresholds, along with a stride‐length based threshold, and two triaxial (vector magnitude) and uniaxial (vertical axis) ActiGraph count/min thresholds for the lower bound of MVPA. Fitbit‐based thresholds are represented by a purple color scheme, and ActiGraph‐based thresholds are represented by a blue color scheme.

Discussion

We conducted this validation study to determine the accuracy (agreement, sensitivity, and specificity) of alternative Fitbit‐based thresholds in identifying MVPA. The results of our analyses suggest that Fitbit‐based thresholds have high sensitivity and low specificity for classifying sedentary time and low sensitivity and high specificity for classifying MVPA time. We also found that Fitbit more conservatively estimated MVPA time compared with ActiGraph accelerometers. Fitbit tended to overestimate sedentary time and underestimate MVPA time. Using literature threshold values of 200 (sedentary) and 1924 (MVPA) counts/min for triaxial ActiGraph accelerometers, the maximum agreement we achieved between Fitbit and ActiGraph classifications of sedentary and MVPA time was 67.0% and 91.1%, respectively, corresponding to Fitbit thresholds derived by the Youden index and stride length. This rather poor agreement for sedentary time illustrates that Fitbit does not estimate sedentary time in alignment with the gold standard when using a single triaxial threshold. However, optimizing MVPA time classification by stride length yielded high agreement with the same gold standard. This participant‐adjusted agreement aligns with another study that compared outputs from ActiGraph and Fitbit and found an agreement of classifying time in vigorous PA of r = 0.80 39. In our primary analysis using unadjusted triaxial ActiGraph thresholds, we found that average sensitivity across all Fitbit thresholds was greater for sedentary time than for MVPA time. This corroborates a recent study that found that Fitbit Flex more accurately estimated sedentary time than MVPA time in comparison with the ActiGraph GT3X+ 32. The data‐driven Youden index produced the highest sensitivity and lowest specificity across all ActiGraph threshold scenarios in classifying MVPA. Across all subjects, many more minutes were spent not in MVPA versus in MVPA. The Youden index, which equally weights sensitivity and specificity, had lower overall agreement with the gold standard ActiGraph but was the only threshold to reach >50% sensitivity (identifying >50% of minutes deemed to be MVPA by the ActiGraph). Thus, selecting the cut point with the best performance depends on the ultimate goal of the classification exercise. Agreement, specificity, and sensitivity were higher for all Fitbit scenarios for the unadjusted, literature‐based triaxial ActiGraph thresholds than for the BMI‐adjusted triaxial ActiGraph thresholds; the same pattern held true for the unadjusted versus BMI‐adjusted uniaxial ActiGraph thresholds. Although this does not support previous proposals 16, 40 for adjusting accelerometer cut point thresholds based on individual characteristics, we also found that individualized stride length–derived Fitbit thresholds yielded the best MVPA time agreement in our sensitivity analyses. However, these stride length–derived agreement values did not differ greatly from the literature‐based agreement values within each ActiGraph threshold scenario. Another study found that ActiGraph underestimated mean steps more than Fitbit did 31. However, we found that the triaxial ActiGraph classified greater average daily minutes in MVPA under both the literature‐based and BMI‐adjusted threshold scenarios than all Fitbit threshold scenarios, aside from the Youden‐derived Fitbit threshold. We note several limitations and assumptions of the current study. The sample size from which we drew our accelerometry data was a pilot trial with 15 individuals, and only 14 trial participants wore both their Fitbit and ActiGraph during the study period. However, analysis on the minute‐by‐minute level across 14 days allowed us to analyze a substantial number of data points despite a relatively low number of participants. We defined MVPA using a walking speed (2.5 km/h) below the average speed of healthy adults in order to best represent our study population: older adults (mean age 68) with symptomatic knee OA (mean KOOS pain 50; 0‐100 scale with 100 being the worst). In addition, we used the lowest possible “normal” frequency of 30 Hz in our ActiGraph data collection protocol but did not use low‐frequency extension (LFE) filters. Although some data show that incorporating LFE increases the ActiGraph's ability to capture low activity readings, most comparisons used the standard ActiGraph setting of 60 Hz 41. Given that we used a lower frequency setting of 30 Hz, the impact of using an LFE filter would have been less significant in our context. Finally, as we did not have HR readings from the ActiGraph, we excluded all ActiGraph time with zero counts from this analysis. Therefore, it is likely that we underestimated overall sedentary time. We conclude that no Fitbit‐based thresholds yielded high enough specificity (the highest was 51.6%) to qualify Fitbit as a reasonable proxy for ActiGraph in estimating sedentary time. We found that optimizing Fitbit thresholds by stride length yielded high agreement of MVPA time classification with ActiGraph measures, which is comparable to agreement using literature‐based Fitbit thresholds. However, we also recommend against using Fitbit to determine minutes in MVPA in the older, heavier, knee OA population, as we only achieved sensitivity greater than 50 using the data‐driven Youden index to classify Fitbit thresholds. Adjusting ActiGraph MVPA thresholds by participant BMI also does not yield improved agreement, sensitivity, or specificity. Our results suggest that, although variation in per‐participant characteristics, such as BMI and stride length, influences the appropriate threshold to use for each individual, this variation does not seem to overtly influence the overall agreement, sensitivity, or specificity between Fitbit and ActiGraph categorizations of PA level. Additional studies are required to determine if these findings persist in a larger sample of a similar population and if these findings apply beyond our population of interest.

Author Contributions

All authors drafted the article and revised it critically for important intellectual content, and all authors gave final approval of the version of the article to be published.

Study conception and design

Collins, Losina.

Acquisition of data

Yang, Collins, Losina.

Analysis and interpretation of data

Silva, Yang, Collins, Losina.
  36 in total

1.  Stride rate recommendations for moderate-intensity walking.

Authors:  David A Rowe; Gregory J Welk; Dan P Heil; Matthew T Mahar; Charles D Kemble; M Andrés Calabró; Karin Camenisch
Journal:  Med Sci Sports Exerc       Date:  2011-02       Impact factor: 5.411

2.  Index for rating diagnostic tests.

Authors:  W J YOUDEN
Journal:  Cancer       Date:  1950-01       Impact factor: 6.860

3.  METs and accelerometry of walking in older adults: standard versus measured energy cost.

Authors:  Katherine S Hall; Cheryl A Howe; Sharon R Rana; Clara L Martin; Miriam C Morey
Journal:  Med Sci Sports Exerc       Date:  2013-03       Impact factor: 5.411

4.  Are Older Adults With Symptomatic Knee Osteoarthritis Less Active Than the General Population? Analysis From the Osteoarthritis Initiative and the National Health and Nutrition Examination Survey.

Authors:  Louise M Thoma; Dorothy Dunlop; Jing Song; Jungwha Lee; Catrine Tudor-Locke; Elroy J Aguiar; Hiral Master; Meredith B Christiansen; Daniel K White
Journal:  Arthritis Care Res (Hoboken)       Date:  2018-10       Impact factor: 4.794

5.  Physical Activity Minimum Threshold Predicting Improved Function in Adults With Lower-Extremity Symptoms.

Authors:  Dorothy D Dunlop; Jing Song; Jungwha Lee; Abigail L Gilbert; Pamela A Semanik; Linda Ehrlich-Jones; Christine A Pellegrini; Daniel Pinto; Barbara Ainsworth; Rowland W Chang
Journal:  Arthritis Care Res (Hoboken)       Date:  2017-02-28       Impact factor: 4.794

6.  Physical activity in the United States measured by accelerometer.

Authors:  Richard P Troiano; David Berrigan; Kevin W Dodd; Louise C Mâsse; Timothy Tilert; Margaret McDowell
Journal:  Med Sci Sports Exerc       Date:  2008-01       Impact factor: 5.411

Review 7.  Accelerometry analysis of physical activity and sedentary behavior in older adults: a systematic review and data analysis.

Authors:  E Gorman; H M Hanson; P H Yang; K M Khan; T Liu-Ambrose; M C Ashe
Journal:  Eur Rev Aging Phys Act       Date:  2013-09-17       Impact factor: 3.878

Review 8.  How fast is fast enough? Walking cadence (steps/min) as a practical estimate of intensity in adults: a narrative review.

Authors:  Catrine Tudor-Locke; Ho Han; Elroy J Aguiar; Tiago V Barreira; John M Schuna; Minsoo Kang; David A Rowe
Journal:  Br J Sports Med       Date:  2018-06       Impact factor: 13.800

9.  Comparison of older and newer generations of ActiGraph accelerometers with the normal filter and the low frequency extension.

Authors:  Kelli L Cain; Terry L Conway; Marc A Adams; Lisa E Husak; James F Sallis
Journal:  Int J Behav Nutr Phys Act       Date:  2013-04-25       Impact factor: 6.457

10.  Validity of Fitbit's active minutes as compared with a research-grade accelerometer and self-reported measures.

Authors:  Wayne Brewer; Brian T Swanson; Alexis Ortiz
Journal:  BMJ Open Sport Exerc Med       Date:  2017-09-13
View more
  1 in total

Review 1.  Quality Evaluation of Free-living Validation Studies for the Assessment of 24-Hour Physical Behavior in Adults via Wearables: Systematic Review.

Authors:  Marco Giurgiu; Irina Timm; Marlissa Becker; Steffen Schmidt; Kathrin Wunsch; Rebecca Nissen; Denis Davidovski; Johannes B J Bussmann; Claudio R Nigg; Markus Reichert; Ulrich W Ebner-Priemer; Alexander Woll; Birte von Haaren-Mack
Journal:  JMIR Mhealth Uhealth       Date:  2022-06-09       Impact factor: 4.947

  1 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.