skip to main content

Explore Research Products in the NSF-PAR

Title: Investigating Best Practices for Remote Summative Usability Testing with People with Mild to Moderate Dementia
People with dementia may miss out on the benefits of using technology, because they often find it difficult to use. Usability testing is one method to identify barriers and areas for improvement in technology. Unfortunately, usability testing is often not conducted with people with dementia, independent of their caregivers. Difficulty recruiting local participants with dementia who regularly use technology further compounds the problem. Remote methods have been proposed as one approach to recruiting hard-to-reach populations. Currently, it is unclear how to effectively conduct remote summative usability testing with people with dementia. We recruited 15 participants. Five took part in the pilot study and 10 participated in the main study. We identify best practices and make suggestions for remote summative usability tests with people who have mild to moderate dementia, independent of caregivers. We discuss our findings in three sections: (1) logistics for planning remote summative usability testing, (2) approaches for conducting remote summative usability testing, including modifications of research methods, and (3) considerations when evaluating findings from remote summative usability sessions. We also present modified usability testing methods we developed to meet the unique needs of users with mild to moderate dementia, and summarize lessons learned and new directions for research on this topic.  more » « less
Award ID(s):
2045679
NSF-PAR ID:
10319803
Author(s) / Creator(s):
; ; ; ; ;
Date Published:
Journal Name:
ACM Transactions on Accessible Computing
Volume:
14
Issue:
3
ISSN:
1936-7228
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; ; ; ; ; ( , JMIR Aging)
    Background

    Monitoring technologies are used to collect a range of information, such as one’s location out of the home or movement within the home, and transmit that information to caregivers to support aging in place. Their surveilling nature, however, poses ethical dilemmas and can be experienced as intrusive to people living with Alzheimer disease (AD) and AD-related dementias. These challenges are compounded when older adults are not engaged in decision-making about how they are monitored. Dissemination of these technologies is outpacing our understanding of how to communicate their functions, risks, and benefits to families and older adults. To date, there are no tools to help families understand the functions of monitoring technologies or guide them in balancing their perceived need for ongoing surveillance and the older adult’s dignity and wishes.

     Objective

    We designed, developed, and piloted a communication and education tool in the form of a web application called Let’s Talk Tech to support family decision-making about diverse technologies used in dementia home care. The knowledge base about how to design online interventions for people living with mild dementia is still in development, and dyadic interventions used in dementia care remain rare. We describe the intervention’s motivation and development process, and the feasibility of using this self-administered web application intervention in a pilot sample of people living with mild AD and their family care partners.

     Methods

    We surveyed 29 mild AD dementia care dyads living together before and after they completed the web application intervention and interviewed each dyad about their experiences with it. We report postintervention measures of feasibility (recruitment, enrollment, and retention) and acceptability (satisfaction, quality, and usability). Descriptive statistics were calculated for survey items, and thematic analysis was used with interview transcripts to illuminate participants’ experiences and recommendations to improve the intervention.

     Results

    The study enrolled 33 people living with AD and their care partners, and 29 (88%) dyads completed the study (all but one were spousal dyads). Participants were asked to complete 4 technology modules, and all completed them. The majority of participants rated the tool as having the right length (>90%), having the right amount of information (>84%), being very clearly worded (>74%), and presenting information in a balanced way (>90%). Most felt the tool was easy to use and helpful, and would likely recommend it to others.

     Conclusions

    This study demonstrated that our intervention to educate and facilitate conversation and documentation of preferences is preliminarily feasible and acceptable to mild AD care dyads. Effectively involving older adults in these decisions and informing care partners of their preferences could enable families to avoid conflicts or risks associated with uninformed or disempowered use and to personalize use so both members of the dyad can experience benefits.

     
    more » « less
  2. ; ; ; ; ( , Journal of Medical Internet Research)
    Background Prior research on health information behaviors of people with dementia has primarily focused on examining the types of information exchanged by people with dementia using various web-based platforms. A previous study investigated the information behaviors of people with dementia within a month of their diagnosis. There is an empirical gap in the literature regarding the evolution of health information needs and behaviors of people with dementia as their condition progresses. Objective Our work primarily investigated the information behaviors of people with dementia who have been living with the condition for several (4 to 26) years. We also aimed to identify their motivations for changing their information behaviors over time. Our primary research questions were as follows: how do people with dementia get informed about their condition, and why do people with dementia seek information about their condition? Methods We adopted an action research approach by including 2 people with dementia as members of our research team. Collaboratively, we conducted 16 remote 1-hour contextual inquiry sessions with people living with mild to moderate dementia. During the study sessions, the first 40 minutes included semistructured interviews with participants concerning their information behaviors, followed by a 20-minute demonstration of their information-seeking strategies. Data from these interviews were analyzed using a constructivist grounded theory approach. Results Participants described their information needs in terms of managing the disrupted physiological, emotional, and social aspects of their lives following a diagnosis of dementia. They used various information behaviors, including active search, ongoing search, monitoring, proxy search, information avoidance, and selective exposure. These information behaviors were not stagnant; however, they were adapted to accommodate the changing circumstances of their dementia and their lives as they worked to re-establish equilibrium to continue to engage in life while living with a degenerative neurological condition. Conclusions Our research revealed the motivations, changing abilities, and chosen strategies of people with dementia in their search for information as their condition evolves. This knowledge can be used to develop and improve person-centered information and support services for people with dementia so that they can more easily re-establish equilibrium and continue to engage in life. 
    more » « less
  3. ( , JMIR Formative Research)
    null (Ed.)
    Background There are still many unanswered questions about the novel coronavirus; however, a largely underutilized source of knowledge is the millions of people who have recovered after contracting the virus. This includes a majority of undocumented cases of COVID-19, which were classified as mild or moderate and received little to no clinical care during the course of illness. Objective This study aims to document and glean insights from the experiences of individuals with a first-hand experience in dealing with COVID-19, especially the so-called mild-to-moderate cases that self-resolved while in isolation. Methods This web-based survey study called C19 Insider Scoop recruited adult participants aged 18 years or older who reside in the United States and had tested positive for COVID-19 or antibodies. Participants were recruited through various methods, including online support groups for COVID-19 survivors, advertisement in local news outlets, as well as through professional and other networks. The main outcomes measured in this study included knowledge of contraction or transmission of the virus, symptoms, and personal experiences on the road to recovery. Results A total of 72 participants (female, n=53; male, n=19; age range: 18-73 years; mean age: 41 [SD 14] years) from 22 US states were enrolled in this study. The top known source of how people contracted SARS-CoV-2, the virus known to cause COVID-19, was through a family or household member (26/72, 35%). This was followed by essential workers contracting the virus through the workplace (13/72, 18%). Participants reported up to 27 less-documented symptoms that they experienced during their illness, such as brain or memory fog, palpitations, ear pain or discomfort, and neurological problems. In addition, 47 of 72 (65%) participants reported that their symptoms lasted longer than the commonly cited 2-week period even for mild cases of COVID-19. The mean recovery time of the study participants was 4.5 weeks, and exactly one-half of participants (50%) still experienced lingering symptoms of COVID-19 after an average of 65 days following illness onset. Additionally, 37 (51%) participants reported that they experienced stigma associated with contracting COVID-19. Conclusions This study presents preliminary findings suggesting that emphasis on family or household spread of COVID-19 may be lacking and that there is a general underestimation of the recovery time even for mild cases of illness with the virus. Although a larger study is needed to validate these results, it is important to note that as more people experience COVID-19, insights from COVID-19 survivors can enable a more informed public, pave the way for others who may be affected by the virus, and guide further research. 
    more » « less
  4. ; ; ; ; ( , Alzheimer's Research & Therapy)
    Abstract Background Identification of reliable, affordable, and easy-to-use strategies for detection of dementia is sorely needed. Digital technologies, such as individual voice recordings, offer an attractive modality to assess cognition but methods that could automatically analyze such data are not readily available. Methods and findings We used 1264 voice recordings of neuropsychological examinations administered to participants from the Framingham Heart Study (FHS), a community-based longitudinal observational study. The recordings were 73 min in duration, on average, and contained at least two speakers (participant and examiner). Of the total voice recordings, 483 were of participants with normal cognition (NC), 451 recordings were of participants with mild cognitive impairment (MCI), and 330 were of participants with dementia (DE). We developed two deep learning models (a two-level long short-term memory (LSTM) network and a convolutional neural network (CNN)), which used the audio recordings to classify if the recording included a participant with only NC or only DE and to differentiate between recordings corresponding to those that had DE from those who did not have DE (i.e., NDE (NC+MCI)). Based on 5-fold cross-validation, the LSTM model achieved a mean (±std) area under the receiver operating characteristic curve (AUC) of 0.740 ± 0.017, mean balanced accuracy of 0.647 ± 0.027, and mean weighted F1 score of 0.596 ± 0.047 in classifying cases with DE from those with NC. The CNN model achieved a mean AUC of 0.805 ± 0.027, mean balanced accuracy of 0.743 ± 0.015, and mean weighted F1 score of 0.742 ± 0.033 in classifying cases with DE from those with NC. For the task related to the classification of participants with DE from NDE, the LSTM model achieved a mean AUC of 0.734 ± 0.014, mean balanced accuracy of 0.675 ± 0.013, and mean weighted F1 score of 0.671 ± 0.015. The CNN model achieved a mean AUC of 0.746 ± 0.021, mean balanced accuracy of 0.652 ± 0.020, and mean weighted F1 score of 0.635 ± 0.031 in classifying cases with DE from those who were NDE. Conclusion This proof-of-concept study demonstrates that automated deep learning-driven processing of audio recordings of neuropsychological testing performed on individuals recruited within a community cohort setting can facilitate dementia screening. 
    more » « less
  5. ; ; ; ; ; ( , Journal of Medical Internet Research)
    Background Social networks such as Twitter offer the clinical research community a novel opportunity for engaging potential study participants based on user activity data. However, the availability of public social media data has led to new ethical challenges about respecting user privacy and the appropriateness of monitoring social media for clinical trial recruitment. Researchers have voiced the need for involving users’ perspectives in the development of ethical norms and regulations. Objective This study examined the attitudes and level of concern among Twitter users and nonusers about using Twitter for monitoring social media users and their conversations to recruit potential clinical trial participants. Methods We used two online methods for recruiting study participants: the open survey was (1) advertised on Twitter between May 23 and June 8, 2017, and (2) deployed on TurkPrime, a crowdsourcing data acquisition platform, between May 23 and June 8, 2017. Eligible participants were adults, 18 years of age or older, who lived in the United States. People with and without Twitter accounts were included in the study. Results While nearly half the respondents—on Twitter (94/603, 15.6%) and on TurkPrime (509/603, 84.4%)—indicated agreement that social media monitoring constitutes a form of eavesdropping that invades their privacy, over one-third disagreed and nearly 1 in 5 had no opinion. A chi-square test revealed a positive relationship between respondents’ general privacy concern and their average concern about Internet research (P<.005). We found associations between respondents’ Twitter literacy and their concerns about the ability for researchers to monitor their Twitter activity for clinical trial recruitment (P=.001) and whether they consider Twitter monitoring for clinical trial recruitment as eavesdropping (P<.001) and an invasion of privacy (P=.003). As Twitter literacy increased, so did people’s concerns about researchers monitoring Twitter activity. Our data support the previously suggested use of the nonexceptionalist methodology for assessing social media in research, insofar as social media-based recruitment does not need to be considered exceptional and, for most, it is considered preferable to traditional in-person interventions at physical clinics. The expressed attitudes were highly contextual, depending on factors such as the type of disease or health topic (eg, HIV/AIDS vs obesity vs smoking), the entity or person monitoring users on Twitter, and the monitored information. Conclusions The data and findings from this study contribute to the critical dialogue with the public about the use of social media in clinical research. The findings suggest that most users do not think that monitoring Twitter for clinical trial recruitment constitutes inappropriate surveillance or a violation of privacy. However, researchers should remain mindful that some participants might find social media monitoring problematic when connected with certain conditions or health topics. Further research should isolate factors that influence the level of concern among social media users across platforms and populations and inform the development of more clear and consistent guidelines. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email