skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: MyMove: Facilitating Older Adults to Collect In-Situ Activity Labels on a Smartwatch with Speech
Current activity tracking technologies are largely trained on younger adults’ data, which can lead to solutions that are not well-suited for older adults. To build activity trackers for older adults, it is crucial to collect training data with them. To this end, we examine the feasibility and challenges with older adults in collecting activity labels by leveraging speech. Specifically, we built MyMove, a speech-based smartwatch app to facilitate the in-situ labeling with a low capture burden. We conducted a 7-day deployment study, where 13 older adults collected their activity labels and smartwatch sensor data, while wearing a thigh-worn activity monitor. Participants were highly engaged, capturing 1,224 verbal reports in total. We extracted 1,885 activities with corresponding effort level and timespan, and examined the usefulness of these reports as activity labels. We discuss the implications of our approach and the collected dataset in supporting older adults through personalized activity tracking technologies.  more » « less
Award ID(s):
1955568 1955590
PAR ID:
10356480
Author(s) / Creator(s):
; ; ; ; ; ; ;
Date Published:
Journal Name:
2022 CHI Conference on Human Factors in Computing Systems
Page Range / eLocation ID:
1 to 21
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Tracking activities holds great potential to improve the well-being of older adults, yet the accuracy of activity trackers for this demographic remains in question. Evaluating this accuracy requires ground-truth data directly from older adults, which has largely been gathered in controlled laboratory settings or labeled by researchers. Moreover, considering the diversity in older adults' activity engagement and tracking preferences, personalized activity tracking appears necessary. We demonstrate that older adults can benefit from personalized activity trackers by showing that cadence thresholds for stepping intensities vary within this group. However, collecting ground-truth data from older adults in real-world settings poses unique challenges. This paper examines two sources of ground-truth labels for the smartwatch Inertial Measurement Unit (IMU) data collected with older adults. Using verbal self-reports and a thigh-worn activity tracker, we assess their viability as ground-truth sources in natural settings. Additionally, we evaluate the costs and benefits of triangulating these sources as a ground-truth proxy. Our findings reveal two main costs: data shrinkage and notable effort from both contributors and data stewards. Simultaneously, we observe improved data quality and a greater ability to identify error sources when evaluating a trained model. 
    more » « less
  2. Self-tracking using commodity wearables such as smartwatches can help older adults reduce sedentary behaviors and engage in physical activity. However, activity recognition applications that are typically deployed in these wearables tend to be trained on datasets that best represent younger adults. We explore how our activity recognition model, a hybrid of long short-term memory and convolutional layers, pre-trained on smartwatch data from younger adults, performs on older adult data. We report results on week-long data from two older adults collected in a preliminary study in the wild with ground-truth annotations based on activPAL, a thigh-worn sensor. We find that activity recognition for older adults remains challenging even when comparing our model’s performance to state of the art deployed models such as the Google Activity Recognition API. More so, we show that models trained on younger adults tend to perform worse on older adults. 
    more » « less
  3. Activity tracking has the potential to promote active lifestyles among older adults. However, current activity tracking technologies may inadvertently perpetuate ageism by focusing on age-related health risks. Advocating for a personalized approach in activity tracking technology, we sought to understand what activities older adults find meaningful to track and the underlying values of those activities. We conducted a reflective interview study following a 7-day activity journaling with 13 participants. We identified various underlying values motivating participants to track activities they deemed meaningful. These values, whether competing or aligned, shape the desirability of activities. Older adults appreciate low-exertion activities, but they are difficult to track. We discuss how these activities can become central in designing activity tracking systems. Our research offers insights for creating value-driven, personalized activity trackers that resonate more fully with the meaningful activities of older adults. 
    more » « less
  4. Research on aging technologies typically has explored health condition management and physical activity, while other aspects of active aging (e.g., psychological and social well-being) receive less attention. To better support active aging, we focus on the context of tracking technologies because half of the U.S. aging population engaged in keeping records of health and non-health information using manual and digital mediums. We interviewed 18 older adults to investigate their holistic tracking practices. We found participants were motivated to manage their everyday life tasks, preserve sentimental values, generate knowledge for broader audiences, and support relationships and caregiving. These motivations can help older adults age actively by supporting multi-dimensions of well-being besides physical health. Reflecting on findings, we discuss design considerations for tracking technologies to support active aging by expanding the current focus on supporting physical health to broader psychological and social well-being. 
    more » « less
  5. Abstract Over 80% of older adults want to live independently in their own homes and communities, maintaining quality of life, autonomy, and dignity as they age. We are using community engaged research methods to aid in developing in-home cost-conscious remote sensing technologies to support older adults age in place. To understand their needs, we engaged older adults in discussions on home-based sensing technologies. We used visuals and demonstrations to facilitate discussions, showing participants our sensor prototypes and a vignette describing the challenges an older adult and the family face managing a chronic condition. Participants voiced their interest in monitoring for select health conditions and situations when either they or the person(s) they care for are home alone. Discussants raised concerns about personal security/privacy, loss of independence, ethics of data collection and sharing, and being overwhelmed by collected data. Discussions have provided valuable feedback to help us develop a sensor system that is flexible enough to accommodate individuals in different life stages and comfort levels, with different home environments, levels of expendable income, and support structures. As a result, we have developed a system that uses nonvisual, non-wearable sensing that measures respiration and heart rates, and indoor location tracking to monitor the health and wellbeing of users. During this session, we will provide detailed results from our community discussions, and discuss the continuing role for community engagement as we move forward with sensor development and testing. 
    more » « less