An official website of the United States government
Falls in the elderly are associated with significant morbidity and mortality. While numerous fall detection devices incorporating AI and machine learning algorithms have been developed, no known smartwatch-based system has been used successfully in real-time to detect falls for elderly persons. We have developed and deployed a SmartFall system on a commodity-based smartwatch which has been trialled by nine elderly participants. The system, while being usable and welcomed by the participants in our trials, has two serious limitations. The first limitation is the inability to collect a large amount of personalized data for training. When the fall detection model, which is trained with insufficient data, is used in the real world, it generates a large amount of false positives. The second limitation is the model drift problem. This means an accurate model trained using data collected with a specific device performs sub-par when used in another device. Therefore, building one model for each type of device/watch is not a scalable approach for developing smartwatch-based fall detection system. To tackle those issues, we first collected three datasets including accelerometer data for fall detection problem from different devices: the Microsoft watch (MSBAND), the Huawei watch, and the meta-sensor device. After that, a transfer learning strategy was applied to first explore the use of transfer learning to overcome the small dataset training problem for fall detection. We also demonstrated the use of transfer learning to generalize the model across the heterogeneous devices. Our preliminary experiments demonstrate the effectiveness of transfer learning for improving fall detection, achieving an F1 score higher by over 10% on average, an AUC higher by over 0.15 on average, and a smaller false positive prediction rate than the non-transfer learning approach across various datasets collected using different devices with different hardware specifications.
more »
« less
Toward Real-Time, Robust Wearable Sensor Fall Detection Using Deep Learning Methods: A Feasibility Study
Real-time fall detection using a wearable sensor remains a challenging problem due to high gait variability. Furthermore, finding the type of sensor to use and the optimal location of the sensors are also essential factors for real-time fall-detection systems. This work presents real-time fall-detection methods using deep learning models. Early detection of falls, followed by pneumatic protection, is one of the most effective means of ensuring the safety of the elderly. First, we developed and compared different data-segmentation techniques for sliding windows. Next, we implemented various techniques to balance the datasets because collecting fall datasets in the real-time setting has an imbalanced nature. Moreover, we designed a deep learning model that combines a convolution-based feature extractor and deep neural network blocks, the LSTM block, and the transformer encoder block, followed by a position-wise feedforward layer. We found that combining the input sequence with the convolution-learned features of different kernels tends to increase the performance of the fall-detection model. Last, we analyzed that the sensor signals collected by both accelerometer and gyroscope sensors can be leveraged to develop an effective classifier that can accurately detect falls, especially differentiating falls from near-falls. Furthermore, we also used data from sixteen different body parts and compared them to determine the better sensor position for fall-detection methods. We found that the shank is the optimal position for placing our sensors, with an F1 score of 0.97, and this could help other researchers collect high-quality fall datasets.
more »
« less
- Award ID(s):
- 2019194
- PAR ID:
- 10471856
- Publisher / Repository:
- MDPI
- Date Published:
- Journal Name:
- Applied Sciences
- Volume:
- 13
- Issue:
- 8
- ISSN:
- 2076-3417
- Page Range / eLocation ID:
- 4988
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Nitrate (NO3) pollution in groundwater, caused by various factors both natural and synthetic, contributes to the decline of human health and well-being. Current techniques used for nitrate detection include spectroscopic, electrochemical, chromatography, and capillary electrophoresis. It is highly desired to develop a simple cost-effective alternative to these complex methods for nitrate detection. Therefore, a real-time poly (3,4-ethylenedioxythiophene) (PEDOT)-based sensor for nitrate ion detection via electrical property change is introduced in this study. Vapor phase polymerization (VPP) is used to create a polymer thin film. Variations in specific parameters during the process are tested and compared to develop new insights into PEDOT sensitivity towards nitrate ions. Through this study, the optimal fabrication parameters that produce a sensor with the highest sensitivity toward nitrate ions are determined. With the optimized parameters, the electrical resistance response of the sensor to 1000 ppm nitrate solution is 41.79%. Furthermore, the sensors can detect nitrate ranging from 1 ppm to 1000 ppm. The proposed sensor demonstrates excellent potential to detect the overabundance of nitrate ions in aqueous solutions in real time.more » « less
-
Falls are the second leading cause of unintentional injury deaths worldwide. While numerous wearable fall detection devices incorporating AI models have been developed, none of them are used successfully in a fall detection application running on commodity-based smartwatches in real time. The system misses some falls, and generates an annoying amount of False Positives for practical use. We have investigated and experimented with an LSTM model for fall detection on a smartwatch. Even though the LSTM model has high accuracy during offline testing, the good performance of offline LSTM models cannot be translated to the equivalence of real-time performance. Transformers, on the other hand, can learn long-sequence data and patterns intrinsic to the data due to their self-attention mechanism. This paper compares three variants of LSTM and two variants of Transformer models for learning fall patterns. We trained all models using fall and activity data from three datasets, and the real-time testing of the model was performed using the SmartFall App. Our findings showed that in the offline training, the CNN-LSTM model was better than the Transformer model for all the datasets. However, the Transformer is a preferable choice for deployment in real-time fall detection applications.more » « less
-
It is often challenging to pick suitable data features for learning problems. Sometimes certain regions of the data are harder to learn because they are not well characterized by the selected data features. The challenge is amplified when resources for sensing and computation are limited and time-critical, yet reliable decisions must be made. For example, a robotic system for preventing falls of elderly people needs a real-time fall predictor, with low false positive and false negative rates, using a simple wearable sensor to activate a fall prevention mechanism. Here we present a methodology for assessing the learnability of data based on the Lipschitz quotient.We develop a procedure for determining which regions of the dataset contain adversarial data points, input data that look similar but belong to different target classes. Regardless of the learning model, it will be hard to learn such data. We then present a method for determining which additional feature(s) are most effective in improving the predictability of each of these regions. This is a model-independent data analysis that can be executed before constructing a prediction model through machine learning or other techniques. We demonstrate this method on two synthetic datasets and a dataset of human falls, which uses inertial measurement unit signals. For the fall dataset, we identified two groups of adversarial data points and improved the predictability of each group over the baseline dataset, as assessed by Lipschitz, by using 2 different sets of features. This work offers a valuable tool for assessing data learnability that can be applied to not only fall prediction problems, but also other robotics applications that learn from data.more » « less
-
Abstract Falls are among the most common cause of decreased mobility and independence in older adults and rank as one of the most severe public health problems with frequent fatal consequences. In the present study, gait characteristics from 171 community-dwelling older adults were evaluated to determine their predictive ability for future falls using a wearable system. Participants wore a wearable sensor (inertial measurement unit, IMU) affixed to the sternum and performed a 10-m walking test. Measures of gait variability, complexity, and smoothness were extracted from each participant, and prospective fall incidence was evaluated over the following 6-months. Gait parameters were refined to better represent features for a random forest classifier for the fall-risk classification utilizing three experiments. The results show that the best-trained model for faller classification used both linear and nonlinear gait parameters and achieved an overall 81.6 ± 0.7% accuracy, 86.7 ± 0.5% sensitivity, 80.3 ± 0.2% specificity in the blind test. These findings augment the wearable sensor's potential as an ambulatory fall risk identification tool in community-dwelling settings. Furthermore, they highlight the importance of gait features that rely less on event detection methods, and more on time series analysis techniques. Fall prevention is a critical component in older individuals’ healthcare, and simple models based on gait-related tasks and a wearable IMU sensor can determine the risk of future falls.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Journal Article:
- https://doi.org/10.3390/app13084988
