skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


Title: Collaborative Fall Detection using a Wearable Device and a Companion Robot
Older adults who age in place face many health problems and need to be taken care of. Fall is a serious problem among elderly people. In this paper, we present the design and implementation of collaborative fall detection using a wearable device and a companion robot. First, we developed a wearable device by integrating a camera, an accelerometer and a microphone. Second, a companion robot communicates with the wearable device to conduct collaborative fall detection. The robot is also able to contact caregivers in case of emergency. The collaborative fall detection method consists of motion data based preliminary detection on the wearable device and video-based final detection on the companion robot. Both convolutional neural network (CNN) and long short-term memory (LSTM) are used for video-based fall detection. The experimental results show that the overall accuracy of video-based algorithm is 84%. We also investigated the relation between the accuracy and the number of image frames. Our method improves the accuracy of fall detection while maximizing the battery life of the wearable device. In addition, our method significantly increases the sensing range of the companion robot.  more » « less
Award ID(s):
1910993
PAR ID:
10297204
Author(s) / Creator(s):
; ; ; ; ;
Date Published:
Journal Name:
IEEE International Conference on Robotics and Automation
ISSN:
1049-3492
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; ; (, The 11th IEEE International Conference on CYBER Technology in Automation, Control, and Intelligent Systems)
    null (Ed.)
    In this paper, we aimed to study the energy consumption problem in a collaborative activity monitoring system (CAMS) that consists of a compan- ion robot and a wearable device. First, we tested the energy consumption in different operation modes of the system. Based on that, we analyzed the effect of band- width on the time cost and energy consumption which allowed us to combine WiFi and Bluetooth together for data transmission to improve the performance of the system. Second, we preprocessed the image data on the wearable device to reduce the size of images before sending them to the robot, and analyzed the time and energy consumption cost by local computing and data transmission. Third, based on the bandwidth of WiFi and Bluetooth, the requirement of time and energy consumption, we proposed an optimization problem on image sizes in which the wearable device decides how to send the data to the robot to reduce the energy and time cost. The results showed that the relations between the bandwidth, time cost, image resolutions and energy consumption could be used to improve the performance of CAMS. 
    more » « less
  2. ; ; ; ; ; ; (, International Journal of Neural Systems)
    The majority of current smart health applications are deployed on a smartphone paired with a smartwatch. The phone is used as the computation platform or the gateway for connecting to the cloud while the watch is used mainly as the data sensing device. In the case of fall detection applications for older adults, this kind of setup is not very practical since it requires users to always keep their phones in proximity while doing the daily chores. When a person falls, in a moment of panic, it might be difficult to locate the phone in order to interact with the Fall Detection App for the purpose of indicating whether they are fine or need help. This paper demonstrates the feasibility of running a real-time personalized deep-learning-based fall detection system on a smartwatch device using a collaborative edge-cloud framework. In particular, we present the software architecture we used for the collaborative framework, demonstrate how we automate the fall detection pipeline, design an appropriate UI on the small screen of the watch, and implement strategies for the continuous data collection and automation of the personalization process with the limited computational and storage resources of a smartwatch. We also present the usability of such a system with nine real-world older adult participants. 
    more » « less
  3. ; ; ; ; ; ; ; ; ; ; et al (, International Journal of Environmental Research and Public Health)
    Wearable sensors are beneficial for continuous health monitoring, movement analysis, rehabilitation, evaluation of human performance, and for fall detection. Wearable stretch sensors are increasingly being used for human movement monitoring. Additionally, falls are one of the leading causes of both fatal and nonfatal injuries in the workplace. The use of wearable technology in the workplace could be a successful solution for human movement monitoring and fall detection, especially for high fall-risk occupations. This paper provides an in-depth review of different wearable stretch sensors and summarizes the need for wearable technology in the field of ergonomics and the current wearable devices used for fall detection. Additionally, the paper proposes the use of soft-robotic-stretch (SRS) sensors for human movement monitoring and fall detection. This paper also recapitulates the findings of a series of five published manuscripts from ongoing research that are published as Parts I to V of “Closing the Wearable Gap” journal articles that discuss the design and development of a foot and ankle wearable device using SRS sensors that can be used for fall detection. The use of SRS sensors in fall detection, its current limitations, and challenges for adoption in human factors and ergonomics are also discussed. 
    more » « less
  4. ; ; (, ACM)
    Advancements in mobile hardware and streaming technologies enable high-quality video streaming for mobile users, but this comes at a cost: a boost in power consumption. Despite detailed studies on power consumption during acquisition, existing studies fall short of considering recent technologies and, hence, of accurately capturing video playback power consumption. This paper presents a novel method to model mobile video playback power consumption. First, we identify the major components contributing to power consumption during video playback on mobile devices. Then, we develop models for each component to estimate their power consumption. Our experimental results show that our combined model estimates power consumption with 91% mean accuracy. Furthermore, our model maintains its high accuracy on an unseen device, achieving 88% mean accuracy despite the hardware and screen heterogeneity. 
    more » « less
  5. ; ; ; (, Proceedings of the 2nd IFIP International Internet of Things (IoT) Conference (IFIP-IoT))
    It is imperative to find the most accurate way to detect falls in elders to help mitigate the disastrous effects of such unfortunate injuries. In order to mitigate fall related accidents, we propose the Good-Eye System, an Internet of Things (IoT) enabled Edge Level Device which works when there is an orientation change detected by camera, and monitors physiological signal parameters. If the observed change is greater than the set threshold, the user is notified with information regarding a prediction of fall or a detection of fall, using LED lights. The Good-Eye System has a remote wall attached camera to monitor continuously the subject as long as the person is in a room along with a camera attached to a wearable to increase the accuracy of the model. The observed accuracy of the Good-Eye System as a whole is approximately 95%. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email