skip to main content


Title: Predicting Participant Compliance With Fitness Tracker Wearing and Ecological Momentary Assessment Protocols in Information Workers: Observational Study
Background Studies that use ecological momentary assessments (EMAs) or wearable sensors to track numerous attributes, such as physical activity, sleep, and heart rate, can benefit from reductions in missing data. Maximizing compliance is one method of reducing missing data to increase the return on the heavy investment of time and money into large-scale studies. Objective This paper aims to identify the extent to which compliance can be prospectively predicted from individual attributes and initial compliance. Methods We instrumented 757 information workers with fitness trackers for 1 year and conducted EMAs in the first 56 days of study participation as part of an observational study. Their compliance with the EMA and fitness tracker wearing protocols was analyzed. Overall, 31 individual characteristics (eg, demographics and personalities) and behavioral variables (eg, early compliance and study portal use) were considered, and 14 variables were selected to create beta regression models for predicting compliance with EMAs 56 days out and wearable compliance 1 year out. We surveyed study participation and correlated the results with compliance. Results Our modeling indicates that 16% and 25% of the variance in EMA compliance and wearable compliance, respectively, could be explained through a survey of demographics and personality in a held-out sample. The likelihood of higher EMA and wearable compliance was associated with being older (EMA: odds ratio [OR] 1.02, 95% CI 1.00-1.03; wearable: OR 1.02, 95% CI 1.01-1.04), speaking English as a first language (EMA: OR 1.38, 95% CI 1.05-1.80; wearable: OR 1.39, 95% CI 1.05-1.85), having had a wearable before joining the study (EMA: OR 1.25, 95% CI 1.04-1.51; wearable: OR 1.50, 95% CI 1.23-1.83), and exhibiting conscientiousness (EMA: OR 1.25, 95% CI 1.04-1.51; wearable: OR 1.34, 95% CI 1.14-1.58). Compliance was negatively associated with exhibiting extraversion (EMA: OR 0.74, 95% CI 0.64-0.85; wearable: OR 0.67, 95% CI 0.57-0.78) and having a supervisory role (EMA: OR 0.65, 95% CI 0.54-0.79; wearable: OR 0.66, 95% CI 0.54-0.81). Furthermore, higher wearable compliance was negatively associated with agreeableness (OR 0.68, 95% CI 0.56-0.83) and neuroticism (OR 0.85, 95% CI 0.73-0.98). Compliance in the second week of the study could help explain more variance; 62% and 66% of the variance in EMA compliance and wearable compliance, respectively, was explained. Finally, compliance correlated with participants’ self-reflection on the ease of participation, usefulness of our compliance portal, timely resolution of issues, and compensation adequacy, suggesting that these are avenues for improving compliance. Conclusions We recommend conducting an initial 2-week pilot to measure trait-like compliance and identify participants at risk of long-term noncompliance, performing oversampling based on participants’ individual characteristics to avoid introducing bias in the sample when excluding data based on noncompliance, using an issue tracking portal, and providing special care in troubleshooting to help participants maintain compliance.  more » « less
Award ID(s):
1928612
NSF-PAR ID:
10357039
Author(s) / Creator(s):
; ; ; ; ; ; ; ; ; ;
Date Published:
Journal Name:
JMIR mHealth and uHealth
Volume:
9
Issue:
11
ISSN:
2291-5222
Page Range / eLocation ID:
e22218
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Importance

    The frequent occurrence of cognitive symptoms in post–COVID-19 condition has been described, but the nature of these symptoms and their demographic and functional factors are not well characterized in generalizable populations.

    Objective

    To investigate the prevalence of self-reported cognitive symptoms in post–COVID-19 condition, in comparison with individuals with prior acute SARS-CoV-2 infection who did not develop post–COVID-19 condition, and their association with other individual features, including depressive symptoms and functional status.

    Design, Setting, and Participants

    Two waves of a 50-state nonprobability population-based internet survey conducted between December 22, 2022, and May 5, 2023. Participants included survey respondents aged 18 years and older.

    Exposure

    Post–COVID-19 condition, defined as self-report of symptoms attributed to COVID-19 beyond 2 months after the initial month of illness.

    Main Outcomes and Measures

    Seven items from the Neuro-QoL cognition battery assessing the frequency of cognitive symptoms in the past week and patient Health Questionnaire-9.

    Results

    The 14 767 individuals reporting test-confirmed COVID-19 illness at least 2 months before the survey had a mean (SD) age of 44.6 (16.3) years; 568 (3.8%) were Asian, 1484 (10.0%) were Black, 1408 (9.5%) were Hispanic, and 10 811 (73.2%) were White. A total of 10 037 respondents (68.0%) were women and 4730 (32.0%) were men. Of the 1683 individuals reporting post–COVID-19 condition, 955 (56.7%) reported at least 1 cognitive symptom experienced daily, compared with 3552 of 13 084 (27.1%) of those who did not report post–COVID-19 condition. More daily cognitive symptoms were associated with a greater likelihood of reporting at least moderate interference with functioning (unadjusted odds ratio [OR], 1.31 [95% CI, 1.25-1.36]; adjusted [AOR], 1.30 [95% CI, 1.25-1.36]), lesser likelihood of full-time employment (unadjusted OR, 0.95 [95% CI, 0.91-0.99]; AOR, 0.92 [95% CI, 0.88-0.96]) and greater severity of depressive symptoms (unadjusted coefficient, 1.40 [95% CI, 1.29-1.51]; adjusted coefficient 1.27 [95% CI, 1.17-1.38). After including depressive symptoms in regression models, associations were also found between cognitive symptoms and at least moderate interference with everyday functioning (AOR, 1.27 [95% CI, 1.21-1.33]) and between cognitive symptoms and lower odds of full-time employment (AOR, 0.92 [95% CI, 0.88-0.97]).

    Conclusions and Relevance

    The findings of this survey study of US adults suggest that cognitive symptoms are common among individuals with post–COVID-19 condition and associated with greater self-reported functional impairment, lesser likelihood of full-time employment, and greater depressive symptom severity. Screening for and addressing cognitive symptoms is an important component of the public health response to post–COVID-19 condition.

     
    more » « less
  2. Background

    As mobile health (mHealth) studies become increasingly productive owing to the advancements in wearable and mobile sensor technology, our ability to monitor and model human behavior will be constrained by participant receptivity. Many health constructs are dependent on subjective responses, and without such responses, researchers are left with little to no ground truth to accompany our ever-growing biobehavioral data. This issue can significantly impact the quality of a study, particularly for populations known to exhibit lower compliance rates. To address this challenge, researchers have proposed innovative approaches that use machine learning (ML) and sensor data to modify the timing and delivery of surveys. However, an overarching concern is the potential introduction of biases or unintended influences on participants’ responses when implementing new survey delivery methods.

    Objective

    This study aims to demonstrate the potential impact of an ML-based ecological momentary assessment (EMA) delivery system (using receptivity as the predictor variable) on the participants’ reported emotional state. We examine the factors that affect participants’ receptivity to EMAs in a 10-day wearable and EMA–based emotional state–sensing mHealth study. We study the physiological relationships indicative of receptivity and affect while also analyzing the interaction between the 2 constructs.

    Methods

    We collected data from 45 healthy participants wearing 2 devices measuring electrodermal activity, accelerometer, electrocardiography, and skin temperature while answering 10 EMAs daily, containing questions about perceived mood. Owing to the nature of our constructs, we can only obtain ground truth measures for both affect and receptivity during responses. Therefore, we used unsupervised and supervised ML methods to infer affect when a participant did not respond. Our unsupervised method used k-means clustering to determine the relationship between physiology and receptivity and then inferred the emotional state during nonresponses. For the supervised learning method, we primarily used random forest and neural networks to predict the affect of unlabeled data points as well as receptivity.

    Results

    Our findings showed that using a receptivity model to trigger EMAs decreased the reported negative affect by >3 points or 0.29 SDs in our self-reported affect measure, scored between 13 and 91. The findings also showed a bimodal distribution of our predicted affect during nonresponses. This indicates that this system initiates EMAs more commonly during states of higher positive emotions.

    Conclusions

    Our results showed a clear relationship between affect and receptivity. This relationship can affect the efficacy of an mHealth study, particularly those that use an ML algorithm to trigger EMAs. Therefore, we propose that future work should focus on a smart trigger that promotes EMA receptivity without influencing affect during sampled time points.

     
    more » « less
  3. Abstract Study Objective

    We investigated sleep disparities and academic achievement in college.

    Methods

    Participants were 6,002 first-year college students attending a midsize private university in the southern United States [62.0% female, 18.8% first-generation, 37.4% Black, Indigenous, or People of Color (BIPOC) students]. During the first 3–5 weeks of college, students reported their typical weekday sleep duration, which we classified as short sleep (<7 hours), normal sleep (7–9 hours), or long sleep (>9 hours).

    Results

    The odds for short sleep were significantly greater in BIPOC students (95% CI: 1.34–1.66) and female students (95% CI: 1.09–1.35), and the odds for long sleep were greater in BIPOC students (95% CI: 1.38–3.08) and first-generation students (95% CI: 1.04–2.53). In adjusted models, financial burden, employment, stress, STEM academic major, student athlete status, and younger age explained unique variance in sleep duration, fully mediating disparities for females and first-generation students (but only partially mediating disparities for BIPOC students). Short and long sleep predicted worse GPA across students’ first year in college, even after controlling for high school academic index, demographics, and psychosocial variables.

    Conclusions

    Higher education should address sleep health early in college to help remove barriers to success and reduce disparities.

     
    more » « less
  4. Abstract Objectives

    This study compared the prevalence of concentrated urine (urine specific gravity ≥1.021), an indicator of hypohydration, across Tsimane' hunter‐forager‐horticulturalists living in hot‐humid lowland Bolivia and Daasanach agropastoralists living in hot‐arid Northern Kenya. It tested the hypotheses that household water and food insecurity would be associated with higher odds of hypohydration.

    Methods

    This study collected spot urine samples and corresponding weather data along with data on household water and food insecurity, demographics, and health characteristics among 266 Tsimane' households (N = 224 men, 235 women, 219 children) and 136 Daasanach households (N = 107 men, 120 women, 102 children).

    Results

    The prevalence of hypohydration among Tsimane' men (50.0%) and women (54.0%) was substantially higher (P < .001) than for Daasanach men (15.9%) and women (17.5%); the prevalence of hypohydration among Tsimane' (37.0%) and Daasanach (31.4%) children was not significantly different (P= .33). Multiple logistic regression models suggested positive but not statistically significant trends between household water insecurity and odds of hypohydration within populations, yet some significant joint effects of water and food insecurity were observed. Heat index (2°C) was associated with a 23% (95% confidence interval [CI]: 1.09‐1.40,P= .001), 34% (95% CI: 1.18‐1.53,P < .0005), and 23% (95% CI: 1.04‐1.44,P= .01) higher odds of hypohydration among Tsimane' men, women, and children, respectively, and a 48% (95% CI: 1.02‐2.15,P= .04) increase in the odds among Daasanach women. Lactation status was also associated with hypohydration among Tsimane' women (odds ratio = 3.35, 95% CI: 1.62‐6.95,P= .001).

    Conclusion

    These results suggest that heat stress and reproductive status may have a greater impact on hydration status than water insecurity across diverse ecological contexts.

     
    more » « less
  5. Abstract

    Alaskan wildfires have major ecological, social, and economic consequences, but associated health impacts remain unexplored. We estimated cardiorespiratory morbidity associated with wildfire smoke (WFS) fine particulate matter with a diameter less than 2.5 μm (PM2.5) in three major population centers (Anchorage, Fairbanks, and the Matanuska‐Susitna Valley) during the 2015–2019 wildfire seasons. To estimate WFS PM2.5, we utilized data from ground‐based monitors and satellite‐based smoke plume estimates. We implemented time‐stratified case‐crossover analyses with single and distributed lag models to estimate the effect of WFS PM2.5on cardiorespiratory emergency department (ED) visits. On the day of exposure to WFS PM2.5, there was an increased odds of asthma‐related ED visits among 15–65 year olds (OR = 1.12, 95% CI = 1.08, 1.16), people >65 years (OR = 1.15, 95% CI = 1.01, 1.31), among Alaska Native people (OR = 1.16, 95% CI = 1.09, 1.23), and in Anchorage (OR = 1.10, 95% CI = 1.05, 1.15) and Fairbanks (OR = 1.12, 95% CI = 1.07, 1.17). There was an increased risk of heart failure related ED visits for Alaska Native people (Lag Day 5 OR = 1.13, 95% CI = 1.02, 1.25). We found evidence that rural populations may delay seeking care. As the frequency and magnitude of Alaskan wildfires continue to increase due to climate change, understanding the health impacts will be imperative. A nuanced understanding of the effects of WFS on specific demographic and geographic groups facilitates data‐driven public health interventions and fire management protocols that address these adverse health effects.

     
    more » « less