skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Review of Existing Sensors for Tracking the Activities of Daily Living
Today, various sensor technologies have been introduced to help people keep track of their daily living activities. For example, a wide range of sensors were integrated in applications to develop a smart home, a mobile emergency response system and a fall detection system. Sensor technologies were also employed in clinical settings for monitoring an early sign or onset of Alzheimer’s diseases, dementia, abnormal sleep disorder, and heart rate problems. However, there has been a lack of attention paid to comprehensive reviews, valuable especially for young, early-career scholars who just developed research interests in this area. This paper reviewed the existing sensor technologies by considering various contexts such as sensor features, data of interests, locations of sensors, and the number of sensors. For instance, sensor technologies provided various features that enabled people to monitor biomechanics of human movement (e.g., walking speed), use of household goods (e.g., switch on/off of home appliances), sounds (e.g., sounds in a particular room), and surrounding environments (e.g., temperature and humidity). Sensor technologies were widely used to examine various data, such as biomarkers for health, dietary habits, leisure activities, and hygiene status. Sensors were installed in various locations to cover wide-open area (e.g., ceilings, wall, and hallway), specific area (e.g., a bedroom and a dining room), and specific objects (e.g., mattresses and windows). Different sets of sensors were employed to keep track of activities of daily living, which ranged from a single sensor to multiple sensors to cover throughout the home. This comprehensive reviews for sensor technology implementations are anticipated to help many researchers and professionals to design, develop, and use sensor technology applications adequately in the target user’s contexts by promoting safety, usability, and accessibility.  more » « less
Award ID(s):
1831969
PAR ID:
10356213
Author(s) / Creator(s):
Date Published:
Journal Name:
AHFE International
Volume:
52
ISSN:
2771-0718
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. null (Ed.)
    BACKGROUND: Although a number of research studies on sensor technology for smart home environments have been conducted, there is still lack of consideration of human factors in implementing sensor technology in the home of older adults with visual disabilities. OBJECTIVE: This paper aims to advance knowledge of how sensor technology (e.g., Microsoft Kinect) should be implemented in the home of those with visual disabilities. METHODS: A convenience sample of 20 older adults with visual disabilities allowed us to observe their home environments and interview about the activities of daily living, which were analyzed via the inductive content analysis. RESULTS: Sensor technology should be integrated in the living environments of those with visual disabilities by considering various contexts, including people, tasks, tools, and environments (i.e., level-1 categories), which were further broken down into 22 level-2 categories and 28 level-3 categories. Each sub-category included adequate guidelines, which were also sorted by sensor location, sensor type, and data analysis. CONCLUSIONS: The guidelines will be helpful for researchers and professionals in implementing sensor technology in the home of older adults with visual disabilities. 
    more » « less
  2. Not AvailablePeople with cognitive disabilities may experience challenges in consistently performing daily activities because they skip steps, struggle to track progress, or lack the motivation to complete them. These challenges are often along a range; people need assistive devices customized to their specific needs. However, existing assistive technologies, like prompting systems, lack the capabilities to customize support for diverse needs. With the advent of smart home devices, there are opportunities to design prompting systems that support diverse accessibility and motivational needs, thereby supporting the regular practice of daily activities. To understand design factors for such devices, we interviewed adults with cognitive disabilities, parents, and caregivers. Our participants described their needs for future prompting systems, including structuring tasks, supporting motivation, and introducing community support. This paper presents insights and design suggestions for context-aware assistive technologies that could help people with cognitive disabilities regularly perform everyday activities. 
    more » « less
  3. The ubiquitousness of smart and wearable devices with integrated acoustic sensors in modern human lives presents tremendous opportunities for recognizing human activities in our living spaces through ML-driven applications. However, their adoption is often hindered by the requirement of large amounts of labeled data during the model training phase. Integration of contextual metadata has the potential to alleviate this since the nature of these meta-data is often less dynamic (e.g. cleaning dishes, and cooking both can happen in the kitchen context) and can often be annotated in a less tedious manner (a sensor always placed in the kitchen). However, most models do not have good provisions for the integration of such meta-data information. Often, the additional metadata is leveraged in the form of multi-task learning with sub-optimal outcomes. On the other hand, reliably recognizing distinct in-home activities with similar acoustic patterns (e.g. chopping, hammering, knife sharpening) poses another set of challenges. To mitigate these challenges, we first show in our preliminary study that the room acoustics properties such as reverberation, room materials, and background noise leave a discernible fingerprint in the audio samples to recognize the room context and proposed AcouDL as a unified framework to exploit room context information to improve activity recognition performance. Our proposed self-supervision-based approach first learns the context features of the activities by leveraging a large amount of unlabeled data using a contrastive learning mechanism and then incorporates this feature induced with a novel attention mechanism into the activity classification pipeline to improve the activity recognition performance. Extensive evaluation of AcouDL on three datasets containing a wide range of activities shows that such an efficient feature fusion-mechanism enables the incorporation of metadata that helps to better recognition of the activities under challenging classification scenarios with 0.7-3.5% macro F1 score improvement over the baselines. 
    more » « less
  4. null (Ed.)
    Abstract Background Unified Parkinson Disease Rating Scale-part III (UPDRS III) is part of the standard clinical examination performed to track the severity of Parkinson’s disease (PD) motor complications. Wearable technologies could be used to reduce the need for on-site clinical examinations of people with Parkinson’s disease (PwP) and provide a reliable and continuous estimation of the severity of PD at home. The reported estimation can be used to successfully adjust the dose and interval of PD medications. Methods We developed a novel algorithm for unobtrusive and continuous UPDRS-III estimation at home using two wearable inertial sensors mounted on the wrist and ankle. We used the ensemble of three deep-learning models to detect UPDRS-III-related patterns from a combination of hand-crafted features, raw temporal signals, and their time–frequency representation. Specifically, we used a dual-channel, Long Short-Term Memory (LSTM) for hand-crafted features, 1D Convolutional Neural Network (CNN)-LSTM for raw signals, and 2D CNN-LSTM for time–frequency data. We utilized transfer learning from activity recognition data and proposed a two-stage training for the CNN-LSTM networks to cope with the limited amount of data. Results The algorithm was evaluated on gyroscope data from 24 PwP as they performed different daily living activities. The estimated UPDRS-III scores had a correlation of $$0.79\, (\textit{p}<0.0001)$$ 0.79 ( p < 0.0001 ) and a mean absolute error of 5.95 with the clinical examination scores without requiring the patients to perform any specific tasks. Conclusion Our analysis demonstrates the potential of our algorithm for estimating PD severity scores unobtrusively at home. Such an algorithm could provide the required motor-complication measurements without unnecessary clinical visits and help the treating physician provide effective management of the disease. 
    more » « less
  5. Over 1 billion people worldwide are estimated to experience significant disability, which impacts their ability to independently conduct activities of daily living (ADLs) such as eating, ambulating, and dressing. Physically assistive robots (PARs) have emerged as a promising technology to help people with disabilities conduct ADLs, thereby restoring independence and reducing caregiver burden. However, despite decades of research on PARs, deployments of them in end-users’ homes are still few and far between. This thesis focuses on robot-assisted feeding as a case study for how we can achieve in-home deployments of PARs. Our ultimate goal is to develop a robot-assisted feeding system that enables any user, in any environment, to feed themselves a meal of their choice in a way that aligns with their preferences. We collaborate closely with 2 community researchers with motor impairments to design, implement, and evaluate a robot-assisted feeding system that makes progress towards this ultimate goal. Specifically, this thesis presents the following work: 1. A systematic survey of research on PARs, identifying key themes and trends; 2. A formative study investigating the meal-related needs of people with motor impairments and their priorities regarding the design of robot-assisted feeding systems; 3. An action schema and unsupervised learning pipeline that uses human data to learn representative actions a robot can use acquire diverse bites of food; and 4. The key system design considerations, both software and hardware, that enabled us to develop a robot-assisted feeding system to deploy in users’ homes. We evaluate the system with two studies: (1) an out-of-lab study where 5 participants and 1 community researcher use the robot to feed themselves a meal of their choice in a cafeteria, conference room, or office; and (2) a 5-day, in-home deployment where 1 community researcher uses the robot to feed himself 10 meals across various spatial, social, and activity contexts. The studies reveal promising results in terms of the usability and functionality of the system, as well as key directions for future work that are necessary to achieve the aforementioned ultimate goal. We present key lessons learned regarding in-home deployments of PARs: (1) spatial contexts are numerous, customizability lets users adapt to them; (2) off-nominals will arise, variable autonomy lets users overcome them; (3) assistive robots’ benefits depend on context; and (4) work with end-users and stakeholders. 
    more » « less