skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Investigating Best Practices for Remote Summative Usability Testing with People with Mild to Moderate Dementia
People with dementia may miss out on the benefits of using technology, because they often find it difficult to use. Usability testing is one method to identify barriers and areas for improvement in technology. Unfortunately, usability testing is often not conducted with people with dementia, independent of their caregivers. Difficulty recruiting local participants with dementia who regularly use technology further compounds the problem. Remote methods have been proposed as one approach to recruiting hard-to-reach populations. Currently, it is unclear how to effectively conduct remote summative usability testing with people with dementia. We recruited 15 participants. Five took part in the pilot study and 10 participated in the main study. We identify best practices and make suggestions for remote summative usability tests with people who have mild to moderate dementia, independent of caregivers. We discuss our findings in three sections: (1) logistics for planning remote summative usability testing, (2) approaches for conducting remote summative usability testing, including modifications of research methods, and (3) considerations when evaluating findings from remote summative usability sessions. We also present modified usability testing methods we developed to meet the unique needs of users with mild to moderate dementia, and summarize lessons learned and new directions for research on this topic.  more » « less
Award ID(s):
2045679
PAR ID:
10319803
Author(s) / Creator(s):
; ; ; ; ;
Date Published:
Journal Name:
ACM Transactions on Accessible Computing
Volume:
14
Issue:
3
ISSN:
1936-7228
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Background Prior research on health information behaviors of people with dementia has primarily focused on examining the types of information exchanged by people with dementia using various web-based platforms. A previous study investigated the information behaviors of people with dementia within a month of their diagnosis. There is an empirical gap in the literature regarding the evolution of health information needs and behaviors of people with dementia as their condition progresses. Objective Our work primarily investigated the information behaviors of people with dementia who have been living with the condition for several (4 to 26) years. We also aimed to identify their motivations for changing their information behaviors over time. Our primary research questions were as follows: how do people with dementia get informed about their condition, and why do people with dementia seek information about their condition? Methods We adopted an action research approach by including 2 people with dementia as members of our research team. Collaboratively, we conducted 16 remote 1-hour contextual inquiry sessions with people living with mild to moderate dementia. During the study sessions, the first 40 minutes included semistructured interviews with participants concerning their information behaviors, followed by a 20-minute demonstration of their information-seeking strategies. Data from these interviews were analyzed using a constructivist grounded theory approach. Results Participants described their information needs in terms of managing the disrupted physiological, emotional, and social aspects of their lives following a diagnosis of dementia. They used various information behaviors, including active search, ongoing search, monitoring, proxy search, information avoidance, and selective exposure. These information behaviors were not stagnant; however, they were adapted to accommodate the changing circumstances of their dementia and their lives as they worked to re-establish equilibrium to continue to engage in life while living with a degenerative neurological condition. Conclusions Our research revealed the motivations, changing abilities, and chosen strategies of people with dementia in their search for information as their condition evolves. This knowledge can be used to develop and improve person-centered information and support services for people with dementia so that they can more easily re-establish equilibrium and continue to engage in life. 
    more » « less
  2. Clinical researchers have identified sensory changes people with age-related cognitive changes, such as dementia and mild cognitive impairment, experience that are different from typical age-related sensory changes. Technology designers and researchers do not yet have an understanding of how these unique sensory changes affect technology use. This work begins to bridge the gap between the clinical knowledge of sensory changes and technology research and design through interviews with people with mild to moderate dementia, mild cognitive impairment, subjective cognitive decline, and healthcare professionals. This extended version of our ASSETS conference paper includes people with a range of age-related cognitive changes describing changes in vision, hearing, speech, dexterity, proprioception, and smell. We discuss each of these sensory changes and ways to leverage optimal modes of sensory interaction for accessible technology use with existing and emerging technologies. Finally, we discuss how accessible sensory stimulation may change across the spectrum of age-related cognitive changes. 
    more » « less
  3. null (Ed.)
    Dementia affects >50 million worldwide, causing progressive cognitive and physical disabilities. Its caregiving burden falls largely onto informal caregivers, who experience their own health problems, and face tremendous stress with little support–all exacerbated during COVID-19. In this paper, we present a new caregiver sup- port perspective, where the lenses of health equity and community health can shape future technology design. Through a 1.5 year long, in-depth research process with dementia community health workers, we learned how caregiving support technology can reflect key concepts in dementia community health practice. This paper makes two contributions: 1) We propose employing embodied cueing, such as imitation or action mimicry, as a communication modality that can align technology with community caregiving approaches, promote agency in people with dementia, and relieve caregiver burden, and 2) We suggest new avenues for HCI research to advance health equity in the context of dementia technology design. 
    more » « less
  4. BackgroundAlzheimer's disease affects 55 million people worldwide. As the disease progresses, these individuals require a devoted caregiver, often a family member, who provides evolving complex care. Caregivers can experience a variety of ongoing stressors, resulting in reductions in caregiver emotional well-being (and other quality-of-life indicators). Information and communication technologies provide an excellent opportunity to train caregivers remotely and help them to manage these stressors and related distress. ObjectiveThis protocol describes the theoretical rationale, study design, and methods of a new, technologically enhanced psychoeducational skill-building intervention for caregivers of people with dementia that includes a virtual reality component. MethodsThrough Alzheimer’s Eyes is a 4-week, single-arm, pre-post test pilot study consisting of 4 sessions of 90 minutes each that are delivered by videoconferencing. These sessions include a weekly virtual reality experience characterizing the journey of an older Latina with Alzheimer's disease from her perspective to help caregivers see through the eyes of a person with dementia. The 4 sessions cover the skill-training topics of communication, managing challenging behaviors and unhelpful thoughts, the importance of self-care, and mindfulness—all of which are key components designed to reduce stress and distress in family caregivers. Individual interviews conducted before and after the intervention gather participant insights into the intervention, evaluate its feasibility and acceptability, and assess its impact on key outcomes. ResultsData collection for the study started in January 2022, and the results are expected to be submitted for publication in the second half of 2023. Twenty caregivers from the United States have completed the workshop to date. Preliminary data gathered from these participants support the intervention’s feasibility and acceptability. ConclusionsThrough Alzheimer’s Eyes leverages existing technology combined with psychoeducational skill building to help caregivers manage their stress, regardless of their location. International Registered Report Identifier (IRRID)DERR1-10.2196/42655 
    more » « less
  5. BackgroundMonitoring technologies are used to collect a range of information, such as one’s location out of the home or movement within the home, and transmit that information to caregivers to support aging in place. Their surveilling nature, however, poses ethical dilemmas and can be experienced as intrusive to people living with Alzheimer disease (AD) and AD-related dementias. These challenges are compounded when older adults are not engaged in decision-making about how they are monitored. Dissemination of these technologies is outpacing our understanding of how to communicate their functions, risks, and benefits to families and older adults. To date, there are no tools to help families understand the functions of monitoring technologies or guide them in balancing their perceived need for ongoing surveillance and the older adult’s dignity and wishes. ObjectiveWe designed, developed, and piloted a communication and education tool in the form of a web application called Let’s Talk Tech to support family decision-making about diverse technologies used in dementia home care. The knowledge base about how to design online interventions for people living with mild dementia is still in development, and dyadic interventions used in dementia care remain rare. We describe the intervention’s motivation and development process, and the feasibility of using this self-administered web application intervention in a pilot sample of people living with mild AD and their family care partners. MethodsWe surveyed 29 mild AD dementia care dyads living together before and after they completed the web application intervention and interviewed each dyad about their experiences with it. We report postintervention measures of feasibility (recruitment, enrollment, and retention) and acceptability (satisfaction, quality, and usability). Descriptive statistics were calculated for survey items, and thematic analysis was used with interview transcripts to illuminate participants’ experiences and recommendations to improve the intervention. ResultsThe study enrolled 33 people living with AD and their care partners, and 29 (88%) dyads completed the study (all but one were spousal dyads). Participants were asked to complete 4 technology modules, and all completed them. The majority of participants rated the tool as having the right length (>90%), having the right amount of information (>84%), being very clearly worded (>74%), and presenting information in a balanced way (>90%). Most felt the tool was easy to use and helpful, and would likely recommend it to others. ConclusionsThis study demonstrated that our intervention to educate and facilitate conversation and documentation of preferences is preliminarily feasible and acceptable to mild AD care dyads. Effectively involving older adults in these decisions and informing care partners of their preferences could enable families to avoid conflicts or risks associated with uninformed or disempowered use and to personalize use so both members of the dyad can experience benefits. 
    more » « less