skip to main content

Explore Research Products in the NSF-PAR

Title: PERACTIV: Personalized Activity Monitoring - Ask My Hands
Medication adherence is a major problem in the healthcare industry: it has a major impact on an individual’s health and is a major expense on the healthcare system. We note that much of human activity involves using our hands, often in conjunction with objects. Camera-based wearables for tracking human activities have sparked a lot of attention in the past few years. These technologies have the potential to track human behavior anytime, any place. This paper proposes a paradigm for medication adherence employing innovative wrist-worn camera technology. We discuss how the device was built, various experiments to demonstrate feasibility and how the device could be deployed to detect the micro-activities involved in pill taking so as to ensure medication adherence.  more » « less
Award ID(s):
1828010
NSF-PAR ID:
10344382
Author(s) / Creator(s):
; ; ;
Date Published:
Journal Name:
International Conference on Human-Computer Interaction (HCII) 2022. Lecture Notes in Computer Science
Volume:
13326
Page Range / eLocation ID:
255–272
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; ( , IUI '21: 26th International Conference on Intelligent User Interfaces)
    null (Ed.)
    Nearly half of people prescribed medication to treat chronic or short-term conditions do not take their medicine as prescribed. This leads to worse treatment outcomes, higher hospital admission rates, increased healthcare costs, and increased morbidity and mortality rates. While some instances of medication non-adherence are a result of problems with the treatment plan or barriers caused by the health care provider, many are instances caused by patient-related factors such as forgetting, running out of medication, and not understanding the required dosages. This presents a clear need for patient-centered systems that can reliably increase medication adherence. To that end, in this work we describe an activity recognition system capable of recognizing when individuals take medication in an unconstrained, real-world environment. Our methodology uses a modified version of the Bagging ensemble method to suit unbalanced data and a classifier trained on the prediction probabilities of the Bagging classifier to identify when individuals took medication during a full-day study. Using this methodology we are able to recognize when individuals took medication with an F-measure of 0.77. Our system is a first step towards developing personal health interfaces that are capable of providing personalized medication adherence interventions. 
    more » « less
  2. ( , Journal of Marriage and Family)
    Abstract Objective

    This study investigates howhealthcare seekingfor oneself and “healthcare work” for family—constellations that include the continuation of health insurance, access to formal medical care, and medication adherence—change during a period of unemployment.

     Background

    “Intensive mothering” norms that promote selfless caregiving may discourage women's (but not men's) engagement in own healthcare seeking behavior. Breadwinning norms may oblige men (but not women) to provide income and other resources, including health insurance.

     Method

    This article relies on data from 100 in‐depth interviews with unemployed men and women conducted from 2013 to 2015. An iterative coding process guided data analysis; themes and patterns were evaluated to determine their importance across the data.

     Results

    After a job loss, many women (but few men) stopped seeking previously maintained healthcare for themselves. In contrast, some men rejected obligations to provide health insurance for their family. Moreover, the majority of women (but few men) discussed the prioritization of family in their healthcare decision‐making.

     Conclusion

    The intersection of financial inequalities and changing gender norms in healthcare seeking and family healthcare work placed a unique toll on women's health.

     Implications

    These findings expand current understanding of how gender functions as a primary frame and how these frames change, suggesting that gender beliefs about family responsibilities extend to healthcare seeking and family healthcare work and are constrained by social class, even as gender frames change to reshape men's obligations to provide health insurance.

     
    more » « less
  3. ; ; ; ( , Cobot)

    Background As the older adult population increases there is a great need of developing smart healthcare technologies to assist older adults. Robot-based homecare systems are a promising solution to achieving this goal. This study aims to summarize the recent research in homecare robots, understand user needs and identify the future research directions. Methods First, we present an overview of the state-of-the-art in homecare robots, including the design and functions of our previously developed ASCC Companion Robot (ASCCBot). Second, we conducted a user study to understand the stakeholders’ opinions and needs regarding homecare robots. Finally, we proposed the future research directions in this research area in response to the existing problems. Results Our user study shows that most of the interviewees emphasized the importance of medication reminder and fall detection functions. The stakeholders also emphasized the functions to enhance the connection between older adults and their families and friends, as well as the functions to improve the efficiency and productivity of the caregivers. We also identified three major future directions in this research area: human-machine interface, learning and adaptation, and privacy protection. Conclusions The user study discovered some new useful functions that the stakeholders want to have and also validated the developed functions of the ASCCBot. The three major future directions in the homecare robot research area were identified.

     
    more » « less
  4. ; ( , International Conference on Distributed Computing in Sensor Systems and workshops)
    Hand hygiene is crucial in preventing the spread of infections and diseases. Lack of hand hygiene is one of the major reasons for healthcare associated infections (HAIs) in hospitals. Adherence to hand hygiene compliance by the workers in the food business is very important for preventing food-borne illness. In addition to healthcare settings and food businesses, hand washing is also vital for personal well-being. Despite the importance of hand hygiene, people often do not wash hands when necessary. Automatic detection of hand washing activity can facilitate justin-time alerts when a person forgets to wash hands. Monitoring hand washing practices is also essential in ensuring accountability and providing personalized feedback, particularly in hospitals and food businesses. Inertial sensors available in smart wrist devices can capture hand movements, and so it is feasible to detect hand washing using these devices. However, it is challenging to detect hand washing using wrist wearable sensors since hand movements are associated with a wide range of activities. In this paper, we present HAWAD, a robust solution for hand washing detection using wrist wearable inertial sensors. We leverage the distribution of penultimate layer output of a neural network to detect hand washing from a wide range of activities. Our method reduces false positives by 77% and improves F1-score by 30% compared to the baseline method. 
    more » « less
  5. ; ; ; ; ; ( , JMIR Serious Games)
    Background Sustained engagement is essential for the success of telerehabilitation programs. However, patients’ lack of motivation and adherence could undermine these goals. To overcome this challenge, physical exercises have often been gamified. Building on the advantages of serious games, we propose a citizen science–based approach in which patients perform scientific tasks by using interactive interfaces and help advance scientific causes of their choice. This approach capitalizes on human intellect and benevolence while promoting learning. To further enhance engagement, we propose performing citizen science activities in immersive media, such as virtual reality (VR). Objective This study aims to present a novel methodology to facilitate the remote identification and classification of human movements for the automatic assessment of motor performance in telerehabilitation. The data-driven approach is presented in the context of a citizen science software dedicated to bimanual training in VR. Specifically, users interact with the interface and make contributions to an environmental citizen science project while moving both arms in concert. Methods In all, 9 healthy individuals interacted with the citizen science software by using a commercial VR gaming device. The software included a calibration phase to evaluate the users’ range of motion along the 3 anatomical planes of motion and to adapt the sensitivity of the software’s response to their movements. During calibration, the time series of the users’ movements were recorded by the sensors embedded in the device. We performed principal component analysis to identify salient features of movements and then applied a bagged trees ensemble classifier to classify the movements. Results The classification achieved high performance, reaching 99.9% accuracy. Among the movements, elbow flexion was the most accurately classified movement (99.2%), and horizontal shoulder abduction to the right side of the body was the most misclassified movement (98.8%). Conclusions Coordinated bimanual movements in VR can be classified with high accuracy. Our findings lay the foundation for the development of motion analysis algorithms in VR-mediated telerehabilitation. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email