skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Attention:

The NSF Public Access Repository (PAR) system and access will be unavailable from 10:00 PM to 12:00 PM ET on Tuesday, March 25 due to maintenance. We apologize for the inconvenience.


Title: Toward Real-Time, Robust Wearable Sensor Fall Detection Using Deep Learning Methods: A Feasibility Study
Real-time fall detection using a wearable sensor remains a challenging problem due to high gait variability. Furthermore, finding the type of sensor to use and the optimal location of the sensors are also essential factors for real-time fall-detection systems. This work presents real-time fall-detection methods using deep learning models. Early detection of falls, followed by pneumatic protection, is one of the most effective means of ensuring the safety of the elderly. First, we developed and compared different data-segmentation techniques for sliding windows. Next, we implemented various techniques to balance the datasets because collecting fall datasets in the real-time setting has an imbalanced nature. Moreover, we designed a deep learning model that combines a convolution-based feature extractor and deep neural network blocks, the LSTM block, and the transformer encoder block, followed by a position-wise feedforward layer. We found that combining the input sequence with the convolution-learned features of different kernels tends to increase the performance of the fall-detection model. Last, we analyzed that the sensor signals collected by both accelerometer and gyroscope sensors can be leveraged to develop an effective classifier that can accurately detect falls, especially differentiating falls from near-falls. Furthermore, we also used data from sixteen different body parts and compared them to determine the better sensor position for fall-detection methods. We found that the shank is the optimal position for placing our sensors, with an F1 score of 0.97, and this could help other researchers collect high-quality fall datasets.  more » « less
Award ID(s):
2019194
PAR ID:
10471856
Author(s) / Creator(s):
; ;
Publisher / Repository:
MDPI
Date Published:
Journal Name:
Applied Sciences
Volume:
13
Issue:
8
ISSN:
2076-3417
Page Range / eLocation ID:
4988
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Nitrate (NO3) pollution in groundwater, caused by various factors both natural and synthetic, contributes to the decline of human health and well-being. Current techniques used for nitrate detection include spectroscopic, electrochemical, chromatography, and capillary electrophoresis. It is highly desired to develop a simple cost-effective alternative to these complex methods for nitrate detection. Therefore, a real-time poly (3,4-ethylenedioxythiophene) (PEDOT)-based sensor for nitrate ion detection via electrical property change is introduced in this study. Vapor phase polymerization (VPP) is used to create a polymer thin film. Variations in specific parameters during the process are tested and compared to develop new insights into PEDOT sensitivity towards nitrate ions. Through this study, the optimal fabrication parameters that produce a sensor with the highest sensitivity toward nitrate ions are determined. With the optimized parameters, the electrical resistance response of the sensor to 1000 ppm nitrate solution is 41.79%. Furthermore, the sensors can detect nitrate ranging from 1 ppm to 1000 ppm. The proposed sensor demonstrates excellent potential to detect the overabundance of nitrate ions in aqueous solutions in real time. 
    more » « less
  2. Falls in the elderly are associated with significant morbidity and mortality. While numerous fall detection devices incorporating AI and machine learning algorithms have been developed, no known smartwatch-based system has been used successfully in real-time to detect falls for elderly persons. We have developed and deployed a SmartFall system on a commodity-based smartwatch which has been trialled by nine elderly participants. The system, while being usable and welcomed by the participants in our trials, has two serious limitations. The first limitation is the inability to collect a large amount of personalized data for training. When the fall detection model, which is trained with insufficient data, is used in the real world, it generates a large amount of false positives. The second limitation is the model drift problem. This means an accurate model trained using data collected with a specific device performs sub-par when used in another device. Therefore, building one model for each type of device/watch is not a scalable approach for developing smartwatch-based fall detection system. To tackle those issues, we first collected three datasets including accelerometer data for fall detection problem from different devices: the Microsoft watch (MSBAND), the Huawei watch, and the meta-sensor device. After that, a transfer learning strategy was applied to first explore the use of transfer learning to overcome the small dataset training problem for fall detection. We also demonstrated the use of transfer learning to generalize the model across the heterogeneous devices. Our preliminary experiments demonstrate the effectiveness of transfer learning for improving fall detection, achieving an F1 score higher by over 10% on average, an AUC higher by over 0.15 on average, and a smaller false positive prediction rate than the non-transfer learning approach across various datasets collected using different devices with different hardware specifications. 
    more » « less
  3. Abstract Falls are among the most common cause of decreased mobility and independence in older adults and rank as one of the most severe public health problems with frequent fatal consequences. In the present study, gait characteristics from 171 community-dwelling older adults were evaluated to determine their predictive ability for future falls using a wearable system. Participants wore a wearable sensor (inertial measurement unit, IMU) affixed to the sternum and performed a 10-m walking test. Measures of gait variability, complexity, and smoothness were extracted from each participant, and prospective fall incidence was evaluated over the following 6-months. Gait parameters were refined to better represent features for a random forest classifier for the fall-risk classification utilizing three experiments. The results show that the best-trained model for faller classification used both linear and nonlinear gait parameters and achieved an overall 81.6 ± 0.7% accuracy, 86.7 ± 0.5% sensitivity, 80.3 ± 0.2% specificity in the blind test. These findings augment the wearable sensor's potential as an ambulatory fall risk identification tool in community-dwelling settings. Furthermore, they highlight the importance of gait features that rely less on event detection methods, and more on time series analysis techniques. Fall prevention is a critical component in older individuals’ healthcare, and simple models based on gait-related tasks and a wearable IMU sensor can determine the risk of future falls. 
    more » « less
  4. A resilient positioning, navigation, and timing (PNT) system is a necessity for the robust navigation of autonomous vehicles (AVs). A global navigation satellite system (GNSS) provides satellite-based PNT services. However, a spoofer can tamper the authentic GNSS signal and could transmit wrong position information to an AV. Therefore, an AV must have the capability of real-time detection of spoofing attacks related to PNT receivers, whereby it will help the end-user (the AV in this case) to navigate safely even if the GNSS is compromised. This paper aims to develop a deep reinforcement learning (RL)-based turn-by-turn spoofing attack detection method using low-cost in-vehicle sensor data. We have utilized the Honda Research Institute Driving Dataset to create attack and non-attack datasets to develop a deep RL model and have evaluated the performance of the deep RL-based attack detection model. We find that the accuracy of the deep RL model ranges from 99.99% to 100%, and the recall value is 100%. Furthermore, the precision ranges from 93.44% to 100%, and the f1 score ranges from 96.61% to 100%. Overall, the analyses reveal that the RL model is effective in turn-by-turn spoofing attack detection. 
    more » « less
  5. Abstract We used smartphone technology to differentiate the gait characteristics of older adults with osteoporosis with falls from those without falls. We assessed gait mannerism and obtained activities of daily living (ADLs) with wearable sensor systems (smartphones and inertial measurement units [IMUs]) to identify fall-risk characteristics. We recruited 49 persons with osteoporosis: 14 who had a fall within a year before recruitment and 35 without falls. IMU sensor signals were sampled at 50 Hz using a customized smartphone app (Lockhart Monitor) attached at the pelvic region. Longitudinal data was collected using MoveMonitor+ (DynaPort) IMU over three consecutive days. Given the close association between serum calcium, albumin, PTH, Vitamin D, and musculoskeletal health, we compared these markers in individuals with history of falls as compared to nonfallers. For the biochemical parameters fall group had significantly lower calcium ( P  = 0.01*) and albumin ( P  = 0.05*) and higher parathyroid hormone levels ( P  = 0.002**) than nonfall group. In addition, persons with falls had higher sway area ( P  = 0.031*), lower dynamic stability ( P  < 0.001***), gait velocity ( P  = 0.012*), and were less able to perform ADLs ( P  = 0.002**). Thus, persons with osteoporosis with a history of falls can be differentiated by using dynamic real-time measurements that can be easily captured by a smartphone app, thus avoiding traditional postural sway and gait measures that require individuals to be tested in a laboratory setting. 
    more » « less