Self-tracking using commodity wearables such as smartwatches can help older adults reduce sedentary behaviors and engage in physical activity. However, activity recognition applications that are typically deployed in these wearables tend to be trained on datasets that best represent younger adults. We explore how our activity recognition model, a hybrid of long short-term memory and convolutional layers, pre-trained on smartwatch data from younger adults, performs on older adult data. We report results on week-long data from two older adults collected in a preliminary study in the wild with ground-truth annotations based on activPAL, a thigh-worn sensor. We find that activity recognition for older adults remains challenging even when comparing our model’s performance to state of the art deployed models such as the Google Activity Recognition API. More so, we show that models trained on younger adults tend to perform worse on older adults.
more »
« less
MyMove: Facilitating Older Adults to Collect In-Situ Activity Labels on a Smartwatch with Speech
Current activity tracking technologies are largely trained on younger adults’ data, which can lead to solutions that are not well-suited for older adults. To build activity trackers for older adults, it is crucial to collect training data with them. To this end, we examine the feasibility and challenges with older adults in collecting activity labels by leveraging speech. Specifically, we built MyMove, a speech-based smartwatch app to facilitate the in-situ labeling with a low capture burden. We conducted a 7-day deployment study, where 13 older adults collected their activity labels and smartwatch sensor data, while wearing a thigh-worn activity monitor. Participants were highly engaged, capturing 1,224 verbal reports in total. We extracted 1,885 activities with corresponding effort level and timespan, and examined the usefulness of these reports as activity labels. We discuss the implications of our approach and the collected dataset in supporting older adults through personalized activity tracking technologies.
more »
« less
- NSF-PAR ID:
- 10356480
- Date Published:
- Journal Name:
- 2022 CHI Conference on Human Factors in Computing Systems
- Page Range / eLocation ID:
- 1 to 21
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
null (Ed.)Abstract Background Ecological momentary assessment (EMA) is a methodology involving repeated surveys to collect in situ data that describe respondents' current or recent experiences and related contexts in their natural environments. Audiology literature investigating the test-retest reliability of EMA is scarce. Purpose This article examines the test-retest reliability of EMA in measuring the characteristics of listening contexts and listening experiences. Research Design An observational study. Study Sample Fifty-one older adults with hearing loss. Data Collection and Analysis The study was part of a larger study that examined the effect of hearing aid technologies. The larger study had four trial conditions and outcome was measured using a smartphone-based EMA system. After completing the four trial conditions, participants repeated one of the conditions to examine the EMA test-retest reliability. The EMA surveys contained questions that assessed listening context characteristics including talker familiarity, talker location, and noise location, as well as listening experiences including speech understanding, listening effort, loudness satisfaction, and hearing aid satisfaction. The data from multiple EMA surveys collected by each participant were aggregated in each of the test and retest conditions. Test-retest correlation on the aggregated data was then calculated for each EMA survey question to determine the reliability of EMA. Results At the group level, listening context characteristics and listening experience did not change between the test and retest conditions. The test-retest correlation varied across the EMA questions, with the highest being the questions that assessed talker location (median r = 1.0), reverberation (r = 0.89), and speech understanding (r = 0.85), and the lowest being the items that quantified noise location (median r = 0.63), talker familiarity (r = 0.46), listening effort (r = 0.61), loudness satisfaction (r = 0.60), and hearing aid satisfaction (r = 0.61). Conclusion Several EMA questions yielded appropriate test-retest reliability results. The lower test-retest correlations for some EMA survey questions were likely due to fewer surveys completed by participants and poorly designed questions. Therefore, the present study stresses the importance of using validated questions in EMA. With sufficient numbers of surveys completed by respondents and with appropriately designed survey questions, EMA could have reasonable test-retest reliability in audiology research.more » « less
-
Abstract Background Ecological momentary assessment (EMA) is a methodology involving repeated surveys to collect in-situ self-reports that describe respondents' current or recent experiences. Audiology literature comparing in-situ and retrospective self-reports is scarce. Purpose To compare the sensitivity of in-situ and retrospective self-reports in detecting the outcome difference between hearing aid technologies, and to determine the association between in-situ and retrospective self-reports. Research Design An observational study. Study Sample Thirty-nine older adults with hearing loss. Data Collection and Analysis The study was part of a larger clinical trial that compared the outcomes of a prototype hearing aid (denoted as HA1) and a commercially available device (HA2). In each trial condition, participants wore hearing aids for 4 weeks. Outcomes were measured using EMA and retrospective questionnaires. To ensure that the outcome data could be directly compared, the Glasgow Hearing Aid Benefit Profile was administered as an in-situ self-report (denoted as EMA-GHABP) and as a retrospective questionnaire (retro-GHABP). Linear mixed models were used to determine if the EMA- and retro-GHABP could detect the outcome difference between HA1 and HA2. Correlation analyses were used to examine the association between EMA- and retro-GHABP. Results For the EMA-GHABP, HA2 had significantly higher (better) scores than HA1 in the GHABP subscales of benefit, residual disability, and satisfaction (p = 0.029–0.0015). In contrast, the difference in the retro-GHABP score between HA1 and HA2 was significant only in the satisfaction subscale (p = 0.0004). The correlations between the EMA- and retro-GHABP were significant in all subscales (p = 0.0004 to <0.0001). The strength of the association ranged from weak to moderate (r = 0.28–0.58). Finally, the exit interview indicated that 29 participants (74.4%) preferred HA2 over HA1. Conclusion The study suggests that in-situ self-reports collected using EMA could have a higher sensitivity than retrospective questionnaires. Therefore, EMA is worth considering in clinical trials that aim to compare the outcomes of different hearing aid technologies. The weak to moderate association between in-situ and retrospective self-reports suggests that these two types of measures assess different aspects of hearing aid outcomes.more » « less
-
Research on aging technologies typically has explored health condition management and physical activity, while other aspects of active aging (e.g., psychological and social well-being) receive less attention. To better support active aging, we focus on the context of tracking technologies because half of the U.S. aging population engaged in keeping records of health and non-health information using manual and digital mediums. We interviewed 18 older adults to investigate their holistic tracking practices. We found participants were motivated to manage their everyday life tasks, preserve sentimental values, generate knowledge for broader audiences, and support relationships and caregiving. These motivations can help older adults age actively by supporting multi-dimensions of well-being besides physical health. Reflecting on findings, we discuss design considerations for tracking technologies to support active aging by expanding the current focus on supporting physical health to broader psychological and social well-being.more » « less
-
null (Ed.)Background Older adults who experience pain are more likely to reduce their community and life-space mobility (ie, the usual range of places in an environment in which a person engages). However, there is significant day-to-day variability in pain experiences that offer unique insights into the consequences on life-space mobility, which are not well understood. This variability is complex and cannot be captured with traditional recall-based pain surveys. As a solution, ecological momentary assessments record repeated pain experiences throughout the day in the natural environment. Objective The aim of this study was to examine the temporal association between ecological momentary assessments of pain and GPS metrics in older adults with symptomatic knee osteoarthritis by using a smartwatch platform called Real-time Online Assessment and Mobility Monitor. Methods Participants (n=19, mean 73.1 years, SD 4.8; female: 13/19, 68%; male: 6/19, 32%) wore a smartwatch for a mean period of 13.16 days (SD 2.94). Participants were prompted in their natural environment about their pain intensity (range 0-10) at random time windows in the morning, afternoon, and evening. GPS coordinates were collected at 15-minute intervals and aggregated each day into excursion, ellipsoid, clustering, and trip frequency features. Pain intensity ratings were averaged across time windows for each day. A random effects model was used to investigate the within and between-person effects. Results The daily mean pain intensities reported by participants ranged between 0 and 8 with 40% reporting intensities ≥2. The within-person associations between pain intensity and GPS features were more likely to be statistically significant than those observed between persons. Within-person pain intensity was significantly associated with excursion size, and others (excursion span, total distance, and ellipse major axis) showed a statistical trend (excursion span: P=.08; total distance: P=.07; ellipse major axis: P=.07). Each point increase in the mean pain intensity was associated with a 3.06 km decrease in excursion size, 2.89 km decrease in excursion span, 5.71 km decrease total distance travelled per day, 31.4 km2 decrease in ellipse area, 0.47 km decrease ellipse minor axis, and 3.64 km decrease in ellipse major axis. While not statistically significant, the point estimates for number of clusters (P=.73), frequency of trips (P=.81), and homestay (P=.15) were positively associated with pain intensity, and entropy (P=.99) was negatively associated with pain intensity. Conclusions In this demonstration study, higher intensity knee pain in older adults was associated with lower life-space mobility. Results demonstrate that a custom-designed smartwatch platform is effective at simultaneously collecting rich information about ecological pain and life-space mobility. Such smart tools are expected to be important for remote health interventions that harness the variability in pain symptoms while understanding their impact on life-space mobility.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Conference Paper:
- https://doi.org/10.1145/3491102.3517457
