skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Easy-Assist: An Intelligent Haptic-based Affective framework for Assisted Living
Unlike the younger population that uses wearables such as smartwatches for monitoring health on a daily basis, elderly people need assistance in the use of technology and interpreting the data obtained through these smart connected frameworks. The current monitoring systems are primarily designed to monitor the physiological signals on a daily basis. The aim of this proposed research, Easy-Assist, is to help older people to maintain their emotional well-being. This research is focused on developing a wearable affective framework, which can help in detecting the emotions of the user in addition to monitoring their physiological signals. The proposed framework can be used in an automated assisted living environment, where the user's emotional state can be balanced using a haptic-based emotional elicitation system after the user's emotion is recognized, detected and interpreted in real-time. The proposed framework is validated using a fall detection algorithm deployed in a custom-built watch wearable, built using off-the-shelf components and an emotion detection framework built using a single board computer. A dataset of 21700 samples acquired using the proposed framework yielded a maximum efficiency of 97.25%, 96 %, and 94 %, in classifying the state and emotion classes into Alert, Active and Normal classes respectively, using multi-class SVM model. The overall latency of the proposed research was in few orders of milli-seconds.  more » « less
Award ID(s):
1924117 1924112
PAR ID:
10157977
Author(s) / Creator(s):
; ; ;
Date Published:
Journal Name:
2020 IEEE International Conference on Consumer Electronics (ICCE)
Page Range / eLocation ID:
1 to 5
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Overindulgence of harmful substances such as drugs or alcohol, called substance abuse, can directly affect a person's health and their day-to-day activities. The younger population become more vulnerable to such use of psychoactive substances due to lack of awareness of the long-term hazardous effects these substances can have on their health. Additionally, these individuals tend to develop severe mental disorders as they grow older. With the boom of Internet of Things (IoT), the use of wearable sensors such as smartwatches and smartphones has tremendously increased. These wearables help in monitoring a person's physiological signal and keep them informed of one's health. In this research, we propose an edge-intelligent IoT-based wearable that can assist in substance-abuse detection by monitoring their physiological signals on daily basis. The proposed system helps in monitoring the substance abuse and craving of the individual and help the healthcare provider to start an early intervention as required. The proposed system is validated using a custom-built wearable, i-SAD, which was developed as a dedicated substance abuse wearable using commercially available off-the-shelf components. The proposed wearable design was validated using medical quality wearable and yielded a correlation of 0.89 for accelerometer values and 0.92 for average heart rate values. 
    more » « less
  2. We present a System for Processing In-situ Bio-signal Data for Emotion Recognition and Sensing (SPIDERS)- a low-cost, wireless, glasses-based platform for continuous in-situ monitoring of user's facial expressions (apparent emotions) and real emotions. We present algorithms to provide four core functions (eye shape and eyebrow movements, pupillometry, zygomaticus muscle movements, and head movements), using the bio-signals acquired from three non-contact sensors (IR camera, proximity sensor, IMU). SPIDERS distinguishes between different classes of apparent and real emotion states based on the aforementioned four bio-signals. We prototype advanced functionalities including facial expression detection and real emotion classification with a landmarks and optical flow based facial expression detector that leverages changes in a user's eyebrows and eye shapes to achieve up to 83.87% accuracy, as well as a pupillometry-based real emotion classifier with higher accuracy than other low-cost wearable platforms that use sensors requiring skin contact. SPIDERS costs less than $20 to assemble and can continuously run for up to 9 hours before recharging. We demonstrate that SPIDERS is a truly wireless and portable platform that has the capability to impact a wide range of applications, where knowledge of the user's emotional state is critical. 
    more » « less
  3. A person's emotional state can strongly influence their ability to achieve optimal task performance. Aiming to help individuals manage their feelings, different emotion regulation technologies have been proposed. However, despite the well-known influence that emotions have on task performance, no study to date has shown if an emotion regulation technology can also enhance user's cognitive performance in the moment. In this paper, we present BoostMeUp, a smartwatch intervention designed to improve user's cognitive performance by regulating their emotions unobtrusively. Based on studies that show that people tend to associate external signals that resemble heart rates as their own, the intervention provides personalized haptic feedback simulating a different heart rate. Users can focus on their tasks and the intervention acts upon them in parallel, without requiring any additional action. The intervention was evaluated in an experiment with 72 participants, in which they had to do math tests under high pressure. Participants who were exposed to slow haptic feedback during the tests decreased their anxiety, increased their heart rate variability and performed better in the math tests, while fast haptic feedback led to the opposite effects. These results indicate that the BoostMeUp intervention can lead to positive cognitive, physiological and behavioral changes. 
    more » « less
  4. Suicide is a negative outcome of combination of complex personal, social and mental health factors, which forces the individual to consider it as the only way out to their problems. Suicide has become one of the most significant causes of death in the United States. A major cause of this ominous event is due to mental illnesses such as major depression and bipolar depression. With an aim to increase the awareness of suicide and improve the quality of life of people who are vulnerable or prone to suicidal ideation, this research focuses on developing an IoT-based framework that can help in continuously monitoring physiological and behavioral signals of the individual. The proposed framework, M-SID, is designed based on a hypothesis to capture rapid variation of suicidal ideation using physiological signals. The proposed research is validated with the help of a custom-built hardware and the results are verified using a commercially available wrist band. 
    more » « less
  5. Emotion detection using machine learning and data gathered from an electroencephalogram (EEG) holds the potential for architecture and creating smart adaptive spaces which can respond to the user's current emotional state detected from the Neurophysiological data in real-time. This technology can help people with mental and physical disabilities to have a greater role in shaping their environment and live more independent lives. In this paper, two different machine learning approaches, the Long Short Term memory network, (LSTM) and Convolutional Neural Network (CNN) are compared in order to assess their potential to satisfy this goal of emotion detection. The LSTM network was trained on eight-channel time-series data which had undergone a Fast Fourier Transform, and the CNN was trained on the un-transformed data in the form of a unique plot-image based approach. 
    more » « less