skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Agreement of Step-Based Metrics From ActiGraph and ActivPAL Accelerometers Worn Concurrently Among Older Adults
Purpose : Our study evaluated the agreement of mean daily step counts, peak 1-min cadence, and peak 30-min cadence between the hip-worn ActiGraph GT3X+ accelerometer, using the normal filter (AG N ) and the low frequency extension (AG LFE ), and the thigh-worn activPAL3 micro (AP) accelerometer among older adults. Methods : Nine-hundred and fifty-three older adults (β‰₯65 years) were recruited to wear the ActiGraph device concurrently with the AP for 4–7 days beginning in 2016. Using the AP as the reference measure, device agreement for each step-based metric was assessed using mean differences (AG N β€‰βˆ’β€‰AP and AG LFE β€‰βˆ’β€‰AP), mean absolute percentage error (MAPE), and Pearson and concordance correlation coefficients. Results : For AG N β€‰βˆ’β€‰AP, the mean differences and MAPE were: daily steps βˆ’1,851 steps/day and 27.2%, peak 1-min cadence βˆ’16.2 steps/min and 16.3%, and peak 30-min cadence βˆ’17.7 steps/min and 24.0%. Pearson coefficients were .94, .85, and .91 and concordance coefficients were .81, .65, and .73, respectively. For AG LFE β€‰βˆ’β€‰AP, the mean differences and MAPE were: daily steps 4,968 steps/day and 72.7%, peak 1-min cadence βˆ’1.4 steps/min and 4.7%, and peak 30-min cadence 1.4 steps/min and 7.0%. Pearson coefficients were .91, .91, and .95 and concordance coefficients were .49, .91, and .94, respectively. Conclusions : Compared with estimates from the AP, the AG N underestimated daily step counts by approximately 1,800 steps/day, while the AG LFE overestimated by approximately 5,000 steps/day. However, peak step cadence estimates generated from the AG LFE and AP had high agreement (MAPE ≀ 7.0%). Additional convergent validation studies of step-based metrics from concurrently worn accelerometers are needed for improved understanding of between-device agreement.  more » « less
Award ID(s):
2100237
PAR ID:
10431827
Author(s) / Creator(s):
; ; ; ; ; ; ; ;
Date Published:
Journal Name:
Journal for the Measurement of Physical Behaviour
Volume:
5
Issue:
4
ISSN:
2575-6605
Page Range / eLocation ID:
242 to 251
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. null (Ed.)
    Little is known about how sedentary behavior (SB) metrics derived from hip- and thigh-worn accelerometers agree for older adults. Thigh-worn activPAL (AP) micro monitors were concurrently worn with hip-worn ActiGraph (AG) GT3X+ accelerometers (with SB measured using the 100 counts per minute [cpm] cut point; AG 100cpm ) by 953 older adults (age 77 ± 6.6, 54% women) for 4–7 days. Device agreement for sedentary time and five SB pattern metrics was assessed using mean error and correlations. Logistic regression tested associations with four health outcomes using standardized (i.e.,  z scores) and unstandardized SB metrics. Mean errors (AP βˆ’ AG 100cpm ) and 95% limits of agreement were: sedentary time βˆ’54.7 [βˆ’223.4, 113.9] min/day; time in 30+ min bouts 77.6 [βˆ’74.8, 230.1] min/day; mean bout duration 5.9 [0.5, 11.4] min; usual bout duration 15.2 [0.4, 30] min; breaks in sedentary time βˆ’35.4 [βˆ’63.1, βˆ’7.6] breaks/day; and alpha βˆ’.5 [βˆ’.6, βˆ’.4]. Respective Pearson correlations were: .66, .78, .73, .79, .51, and .40. Concordance correlations were: .57, .67, .40, .50, .14, and .02. The statistical significance and direction of associations were identical for AG 100cpm and AP metrics in 46 of 48 tests, though significant differences in the magnitude of odds ratios were observed among 13 of 24 tests for unstandardized and five of 24 for standardized SB metrics. Caution is needed when interpreting SB metrics and associations with health from AG 100cpm due to the tendency for it to overestimate breaks in sedentary time relative to AP. However, high correlations between AP and AG 100cpm measures and similar standardized associations with health outcomes suggest that studies using AG 100cpm are useful, though not ideal, for studying SB in older adults. 
    more » « less
  2. Abstract Background Hip-worn accelerometer cut-points have poor validity for assessing children’s sedentary time, which may partly explain the equivocal health associations shown in prior research. Improved processing/classification methods for these monitors would enrich the evidence base and inform the development of more effective public health guidelines. The present study aimed to develop and evaluate a novel computational method (CHAP-child) for classifying sedentary time from hip-worn accelerometer data. Methods Participants were 278, 8–11-year-olds recruited from nine primary schools in Melbourne, Australia with differing socioeconomic status. Participants concurrently wore a thigh-worn activPAL (ground truth) and hip-worn ActiGraph (test measure) during up to 4 seasonal assessment periods, each lasting up to 8 days. activPAL data were used to train and evaluate the CHAP-child deep learning model to classify each 10-s epoch of raw ActiGraph acceleration data as sitting or non-sitting, creating comparable information from the two monitors. CHAP-child was evaluated alongside the current practice 100 counts per minute (cpm) method for hip-worn ActiGraph monitors. Performance was tested for each 10-s epoch and for participant-season level sedentary time and bout variables (e.g., mean bout duration). Results Across participant-seasons, CHAP-child correctly classified each epoch as sitting or non-sitting relative to activPAL, with mean balanced accuracy of 87.6% (SD = 5.3%). Sit-to-stand transitions were correctly classified with mean sensitivity of 76.3% (SD = 8.3). For most participant-season level variables, CHAP-child estimates were within ± 11% (mean absolute percent error [MAPE]) of activPAL, and correlations between CHAP-child and activPAL were generally very large (> 0.80). For the current practice 100 cpm method, most MAPEs were greater than ± 30% and most correlations were small or moderate (≀ 0.60) relative to activPAL. Conclusions There was strong support for the concurrent validity of the CHAP-child classification method, which allows researchers to derive activPAL-equivalent measures of sedentary time, sit-to-stand transitions, and sedentary bout patterns from hip-worn triaxial ActiGraph data. Applying CHAP-child to existing datasets may provide greater insights into the potential impacts and influences of sedentary time in children. 
    more » « less
  3. Yamada, Yosuke (Ed.)
    The purpose of this study was to evaluate the reliability and validity of the raw accelerometry output from research-grade and consumer wearable devices compared to accelerations produced by a mechanical shaker table. Raw accelerometry data from a total of 40 devices (i.e., n = 10 ActiGraph wGT3X-BT, n = 10 Apple Watch Series 7, n = 10 Garmin Vivoactive 4S, and n = 10 Fitbit Sense) were compared to reference accelerations produced by an orbital shaker table at speeds ranging from 0.6 Hz (4.4 milligravity-mg) to 3.2 Hz (124.7mg). Two-way random effects absolute intraclass correlation coefficients (ICC) tested inter-device reliability. Pearson product moment, Lin’s concordance correlation coefficient (CCC), absolute error, mean bias, and equivalence testing were calculated to assess the validity between the raw estimates from the devices and the reference metric. Estimates from Apple, ActiGraph, Garmin, and Fitbit were reliable, with ICCs = 0.99, 0.97, 0.88, and 0.88, respectively. Estimates from ActiGraph, Apple, and Fitbit devices exhibited excellent concordance with the reference CCCs = 0.88, 0.83, and 0.85, respectively, while estimates from Garmin exhibited moderate concordance CCC = 0.59 based on the mean aggregation method. ActiGraph, Apple, and Fitbit produced similar absolute errors = 16.9mg, 21.6mg, and 22.0mg, respectively, while Garmin produced higher absolute error = 32.5mg compared to the reference. ActiGraph produced the lowest mean bias 0.0mg (95%CI = -40.0, 41.0). Equivalence testing revealed raw accelerometry data from all devices were not statistically significantly within the equivalence bounds of the shaker speed. Findings from this study provide evidence that raw accelerometry data from Apple, Garmin, and Fitbit devices can be used to reliably estimate movement; however, no estimates were statistically significantly equivalent to the reference. Future studies could explore device-agnostic and harmonization methods for estimating physical activity using the raw accelerometry signals from the consumer wearables studied herein. 
    more » « less
  4. Background : Hip-worn accelerometers are commonly used, but data processed using the 100 counts per minute cut point do not accurately measure sitting patterns. We developed and validated a model to accurately classify sitting and sitting patterns using hip-worn accelerometer data from a wide age range of older adults. Methods : Deep learning models were trained with 30-Hz triaxial hip-worn accelerometer data as inputs and activPAL sitting/nonsitting events as ground truth. Data from 981 adults aged 35–99 years from cohorts in two continents were used to train the model, which we call CHAP-Adult (Convolutional Neural Network Hip Accelerometer Posture-Adult). Validation was conducted among 419 randomly selected adults not included in model training. Results : Mean errors (activPAL βˆ’ CHAP-Adult) and 95% limits of agreement were: sedentary time βˆ’10.5 (βˆ’63.0, 42.0) min/day, breaks in sedentary time 1.9 (βˆ’9.2, 12.9) breaks/day, mean bout duration βˆ’0.6 (βˆ’4.0, 2.7) min, usual bout duration βˆ’1.4 (βˆ’8.3, 5.4) min, alpha .00 (βˆ’.04, .04), and time in β‰₯30-min bouts βˆ’15.1 (βˆ’84.3, 54.1) min/day. Respective mean (and absolute) percent errors were: βˆ’2.0% (4.0%), βˆ’4.7% (12.2%), 4.1% (11.6%), βˆ’4.4% (9.6%), 0.0% (1.4%), and 5.4% (9.6%). Pearson’s correlations were: .96, .92, .86, .92, .78, and .96. Error was generally consistent across age, gender, and body mass index groups with the largest deviations observed for those with body mass index β‰₯30 kg/m 2 . Conclusions : Overall, these strong validation results indicate CHAP-Adult represents a significant advancement in the ambulatory measurement of sitting and sitting patterns using hip-worn accelerometers. Pending external validation, it could be widely applied to data from around the world to extend understanding of the epidemiology and health consequences of sitting. 
    more » « less
  5. Hip-worn accelerometers are commonly used, but data processed using the 100 counts per minute cut point do not accurately measure sitting patterns. We developed and validated a model to accurately classify sitting and sitting patterns using hip-worn accelerometer data from a wide age range of older adults. Methods: Deep learning models were trained with 30-Hz triaxial hip-worn accelerometer data as inputs and activPAL sitting/nonsitting events as ground truth. Data from 981 adults aged 35–99 years from cohorts in two continents were used to train the model, which we call CHAP-Adult (Convolutional Neural Network Hip Accelerometer Posture-Adult). Validation was conducted among 419 randomly selected adults not included in model training. Results: Mean errors (activPAL βˆ’ CHAP-Adult) and 95% limits of agreement were: sedentary time βˆ’10.5 (βˆ’63.0, 42.0) min/day, breaks in sedentary time 1.9 (βˆ’9.2, 12.9) breaks/day, mean bout duration βˆ’0.6 (βˆ’4.0, 2.7) min, usual bout duration βˆ’1.4 (βˆ’8.3, 5.4) min, alpha .00 (βˆ’.04, .04), and time in β‰₯30-min bouts βˆ’15.1 (βˆ’84.3, 54.1) min/day. Respective mean (and absolute) percent errors were: βˆ’2.0% (4.0%), βˆ’4.7% (12.2%), 4.1% (11.6%), βˆ’4.4% (9.6%), 0.0% (1.4%), and 5.4% (9.6%). Pearson’s correlations were: .96, .92, .86, .92, .78, and .96. Error was generally consistent across age, gender, and body mass index groups with the largest deviations observed for those with body mass index β‰₯30 kg/m2. Conclusions: Overall, these strong validation results indicate CHAP-Adult represents a significant advancement in the ambulatory measurement of sitting and sitting patterns using hip-worn accelerometers. Pending external validation, it could be widely applied to data from around the world to extend understanding of the epidemiology and health consequences of sitting. 
    more » « less