skip to main content

Explore Research Products in the NSF-PAR

Title: Oblivious Sensor Fusion via Secure Multi-Party Combinatorial Filter Evaluation
Given sensor units distributed throughout an environment, we consider the problem of consolidating readings into a single coherent view when sensors wish to limit knowledge of their specific readings. Standard fusion methods make no guarantees about what curious participants may learn. For applications where privacy guarantees are required, we introduce a fusion approach that limits what can be inferred. First, it forms an aggregate stream, oblivious to the underlying sensor data, and then evaluates that stream on a combinatorial filter. This is achieved via secure multi-party computation techniques built on cryptographic primitives, which we extend and apply to the problem of fusing discrete sensor signals. We prove that the extensions preserve security under the model of semi-honest adversaries. Also, for a simple target tracking case study, we examine a proof-of-concept implementation: analyzing the (empirical) running times for components in the architecture and suggesting directions for future improvement.  more » « less
Award ID(s):
2034123 2024733 2034097
NSF-PAR ID:
10344689
Author(s) / Creator(s):
; ; ;
Date Published:
Journal Name:
2021 60th IEEE Conference on Decision and Control (CDC)
Page Range / eLocation ID:
5620 to 5627
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ( , Springer)
    Avidan, S. (Ed.)
    In this paper, we tackle the problem of RGB-D Semantic Segmentation. The key challenges in solving this problem lie in 1) how to extract features from depth sensor data and 2) how to effectively fuse the features extracted from the two modalities. For the first challenge, we found that the depth information obtained from the sensor is not always reliable (e.g. objects with reflective or dark surfaces typically have inaccurate or void sensor readings), and existing methods that extract depth features using ConvNets did not explicitly consider the reliability of depth value at different pixel locations. To tackle this challenge, we propose a novel mechanism, namely Uncertainty-Aware Self-Attention that explicitly controls the information flow from unreliable depth pixels to confident depth pixels during feature extraction. For the second challenge, we propose an effective and scalable fusion module based on Cross-Attention that can adaptively fuse and exchange information between the RGB encoder and depth encoder. Our proposed framework, namely UCTNet, is an encoder-decoder network that naturally incorporates these two key designs for robust and accurate RGB-D Segmentation. Experimental results show that UCTNet outperforms existing works and achieves state-of-the-art performances on two RGB-D Semantic Segmentation benchmarks. 
    more » « less
  2. ; ( , American Society of Mechanical Engineers)
    Significant progress into the development and use of stretchable sensors for structural health monitoring (SHM) has been made in the last several years. The fusion of stretchable, adaptable sensing materials with highly specialized additive manufacturing techniques allows for the development of highly adaptive, customizable, and easily accessible sensing solutions. However, a significant portion of these works explore SHM topics at a macro level, and with a reduced focus on implementation. As such, little application or experimentation into practical sensing elements, especially those at the micro scale, have followed the advances in sensing technology. In this work, we demonstrate the application of recent developments in stretchable electronics, alongside multiple advanced additive manufacturing processes, to develop a novel flexible microscale sensor. A complex sensor is designed and printed utilizing Digital Light Processing (DLP) to directly fabricate the structure. The printed sensor is then filled with a piezoresistive sensing element of either PEDOT:PSS or carbon-based PDMS (cPDMS), which provided strain readings via resistance change. After being filled with a sensing mixture, the sensor is shown to operate as desired under large deformations. Additionally, the sensor is shown to work effectively when embedded into a separate additively manufactured part. A flexible test coupon is manufactured using the DLP AM process, and a microsensor is embedded inside the coupon structure. This sensing systems is tested in both tension and bending. These results show the feasibility of implementing both modern day AM processes and into current structural health monitoring developments into practical applications. 
    more » « less
  3. ; ; ; ; ; ( , IEEE Conference on Computer Communications (INFOCOM))
    Smart mobile devices have become an integral part of people's life and users often input sensitive information on these devices. However, various side channel attacks against mobile devices pose a plethora of serious threats against user security and privacy. To mitigate these attacks, we present a novel secure Back-of-Device (BoD) input system, SecTap, for mobile devices. To use SecTap, a user tilts her mobile device to move a cursor on the keyboard and tap the back of the device to secretly input data. We design a tap detection method by processing the stream of accelerometer readings to identify the user's taps in real time. The orientation sensor of the mobile device is used to control the direction and the speed of cursor movement. We also propose an obfuscation technique to randomly and effectively accelerate the cursor movement. This technique not only preserves the input performance but also keeps the adversary from inferring the tapped keys. Extensive empirical experiments were conducted on different smart phones to demonstrate the usability and security on both Android and iOS platforms. 
    more » « less
  4. ; ( , IEEE Transactions on Emerging Topics in Computing)
    Activity recognizers are challenging to design for continuous, in-home settings. However, they are notoriously difficult to create when there is more than one resident in the home. Despite recent efforts, there remains a need for an algorithm that can estimate the number of residents in the house, split a time series stream into separate substreams, and accurately identify each resident's activities. To address this challenge, we introduce Gamut . This novel unsupervised method jointly estimates the number of residents and associates sensor readings with those residents, based on a multi-target Gaussian mixture probability hypothesis density filter. We hypothesize that the proposed method will offer robust recognition for homes with two or more residents. In experiments with labeled data collected from 50 single-resident and 11 multi-resident homes, we observe that Gamut outperforms previous unsupervised and supervised methods, offering a robust strategy to track behavioral routines in complex settings. 
    more » « less
  5. ; ; ; ; ( , Proceedings of the 6th International Conference on Sensor Networks (SENSORNETS 2017), Porto, Portugal, February 19-21, 2017)
    We address the problem of in-network processing of k-Maximizing Range Sum (k-MaxRS) queries inWireless Sensor Networks (WSN). The traditional, Computational Geometry version of the MaxRS problem considers the setting in which, given a set of (possibly weighted) 2D points, the goal is to determine the optimal location for a given (axes-parallel) rectangle R to be placed so that the sum of the weights (or, a simple count) of the input points in R’s interior is maximized. In WSN, this corresponds to finding the location of region R such that the sum of the sensors’ readings inside R is maximized. The k-MaxRS problem deals with maximizing the overall sum over k such rectangular regions. Since centralized processing – i.e., transmitting the raw readings and subsequently determining the k-MaxRS in a dedicated sink – incur communication overheads, we devised an efficient distributed algorithm for in-network computation of k-MaxRS. Our experimental observations show that the novel algorithm provides significant energy/communication savings when compared to the centralized approach. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email