An official website of the United States government
Wearable IoT devices rely on batteries, which pose challenges for long-term sustainable health monitoring due to the need for recharging or replacement. Batteryless sensing approaches, which harvest energy from the environment, offer an appealing alternative. However, given the discontinuous supply of harvested energy, it is unclear how to leverage sparse, asynchronous data from batteryless sensors for machine learning (ML) tasks such as human activity recognition (HAR). To this end, we present and profile a prototype of a system to simulate data acquisition from a set of kinetic energy harvesting devices. Our results demonstrate that there is a need to jointly optimize (1) when sensors should spend energy to communicate data, and (2) the training of the ML model that will receive the data.
more »
« less
Packet Pruning: Finding Better Energy Spending Policies for Batteryless Human Activity Recognition
Batteryless sensing devices which rely on energy harvesting can enable more sustainable and long-lasting Internet of Things (IoT) based wearables. While it has become feasible to implement energy-harvesting based wearables for digital health applications, it remains challenging to integrate such devices and the data they collect into machine learning pipelines for tasks such as human activity recognition (HAR). A key obstacle is uncertainty in the data acquisition process. Given the discontinuous and uncertain availability of harvested energy, when should a sensor spend energy to sample and transmit data packets for processing? A common approach is to spend energy opportunistically by sending packets whenever sufficient energy is available. However, when considering a specific task, namely HAR with kinetic energy harvesting based sensors, this approach unfairly prioritizes data from activities where more energy can be harvested (e.g., running). In this work, we improve the opportunistic energy spending policy by pruning redundant packets to reallocate energy towards activities where less energy is harvested. Our approach results in an increase in the F1-score of ‘lower energy’ activities while having a minimal impact on the F1-score of ‘higher energy’ activities.
more »
« less
- Award ID(s):
- 2428656
- PAR ID:
- 10599914
- Publisher / Repository:
- IEEE
- Date Published:
- ISBN:
- 979-8-3315-3014-3
- Page Range / eLocation ID:
- 1 to 4
- Format(s):
- Medium: X
- Location:
- Chicago, IL, USA
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
null (Ed.)There is an increasing demand for performing machine learning tasks, such as human activity recognition (HAR) on emerging ultra-low-power internet of things (IoT) platforms. Recent works show substantial efficiency boosts from performing inference tasks directly on the IoT nodes rather than merely transmitting raw sensor data. However, the computation and power demands of deep neural network (DNN) based inference pose significant challenges when executed on the nodes of an energy-harvesting wireless sensor network (EH-WSN). Moreover, managing inferences requiring responses from multiple energy-harvesting nodes imposes challenges at the system level in addition to the constraints at each node. This paper presents a novel scheduling policy along with an adaptive ensemble learner to efficiently perform HAR on a distributed energy-harvesting body area network. Our proposed policy, Origin, strategically ensures efficient and accurate individual inference execution at each sensor node by using a novel activity-aware scheduling approach. It also leverages the continuous nature of human activity when coordinating and aggregating results from all the sensor nodes to improve final classification accuracy. Further, Origin proposes an adaptive ensemble learner to personalize the optimizations based on each individual user. Experimental results using two different HAR data-sets show Origin, while running on harvested energy, to be at least 2.5% more accurate than a classical battery-powered energy aware HAR classifier continuously operating at the same average power.more » « less
-
The potential of energy harvesting and batteryless sensing promises a future where IoT devices will become sustainable, long-lasting, and maintenance free. Given the significant challenges involved with building and programming such devices, it is reasonable to question whether energy harvesting based IoT can replace existing wearables (fitness trackers, smartwatches, or medical devices), while providing a reliable user experience. Hence, an important question arises: “What role can energy harvesting based sensing play in the age of AI and deep learning?” While energy harvesting based sensors can unlock new applications in wearables and personalized data analytics, the path towards integrating them into the modern deep learning landscape requires substantial intellectual innovation. This workshop aims to bridge multiple perspectives in wearable sensing and data analytics in the modern age of AI.more » « less
-
Human activity recognition (HAR) and, more broadly, activities of daily life recognition using wearable devices have the potential to transform a number of applications, including mobile healthcare, smart homes, and fitness monitoring. Recent approaches for HAR use multiple sensors on various locations on the body to achieve higher accuracy for complex activities. While multiple sensors increase the accuracy, they are also susceptible to reliability issues when one or more sensors are unable to provide data to the application due to sensor malfunction, user error, or energy limitations. Training multiple activity classifiers that use a subset of sensors is not desirable, since it may lead to reduced accuracy for applications. To handle these limitations, we propose a novel generative approach that recovers the missing data of sensors using data available from other sensors. The recovered data are then used to seamlessly classify activities. Experiments using three publicly available activity datasets show that with data missing from one sensor, the proposed approach achieves accuracy that is within 10% of the accuracy with no missing data. Moreover, implementation on a wearable device prototype shows that the proposed approach takes about 1.5 ms for recovering data in the w-HAR dataset, which results in an energy consumption of 606 μJ. The low-energy consumption ensures that SensorGAN is suitable for effectively recovering data in tinyML applications on energy-constrained devices.more » « less
-
In deep learning (DL) based human activity recognition (HAR), sensor selection seeks to balance prediction accuracy and sensor utilization (how often a sensor is used). With advances in on-device inference, sensors have become tightly integrated with DL, often restricting access to the underlying model used. Given only sensor predictions, how can we derive a selection policy which does efficient classification while maximizing accuracy? We propose a cascaded inference approach which, given the prediction of any one sensor, determines whether to query all other sensors. Typically, cascades use a sequence of classifiers which terminate once the confidence of a classifier exceeds a threshold. However, a threshold-based policy for sensor selection may be suboptimal; we define a more general class of policies which can surpass the threshold. We extend to settings where little or no labeled data is available for tuning the policy. Our analysis is validated on three HAR datasets by improving upon the F1-score of a threshold policy across several utilization budgets. Overall, our work enables practical analytics for HAR by relaxing the requirement of labeled data for sensor selection and reducing sensor utilization to directly extend a sensor system’s lifetime.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Conference Paper:
- https://doi.org/10.1109/BSN63547.2024.10780463
