skip to main content

Explore Research Products in the NSF-PAR

Title: Programmable Triangulation Light Curtains
A vehicle on a road or a robot in the field does not need a full-featured 3D depth sensor to detect potential collisions or monitor its blind spot. Instead, it needs to only monitor if any object comes within its near proximity which is an easier task than full depth scanning. We introduce a novel device that monitors the presence of objects on a virtual shell near the device, which we refer to as a light curtain. Light curtains offer a light-weight, resource-efficient and programmable approach to proximity awareness for obstacle avoidance and navigation. They also have additional benefits in terms of improving visibility in fog as well as flexibility in handling light fall-off. Our prototype for generating light curtains works by rapidly rotating a line sensor and a line laser, in synchrony. The device is capable of generating light curtains of various shapes with a range of 20–30 m in sunlight (40 m under cloudy skies and 50 m indoors) and adapts dynamically to the demands of the task. We analyze properties of light curtains and various approaches to optimize their thickness as well as power requirements. We showcase the potential of light curtains using a range of real-world scenarios.  more » « less
Award ID(s):
1652569
NSF-PAR ID:
10080874
Author(s) / Creator(s):
; ; ; ;
Date Published:
Journal Name:
European Conference on Computer Vision
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; ; ( , Robotics: Science and Systems)
    null (Ed.)
    To safely navigate unknown environments; robots must accurately perceive dynamic obstacles. Instead of directly measuring the scene depth with a LiDAR sensor; we explore the use of a much cheaper and higher resolution sensor: programmable light curtains. Light curtains are controllable depth sensors that sense only along a surface that a user selects. We use light curtains to estimate the safety envelope of a scene: a hypothetical surface that separates the robot from all obstacles. We show that generating light curtains that sense random locations (from a particular distribution) can quickly discover the safety envelope for scenes with unknown objects. Importantly; we produce theoretical safety guarantees on the probability of detecting an obstacle using random curtains. We combine random curtains with a machine learning based model that forecasts and tracks the motion of the safety envelope efficiently. Our method accurately estimates safety envelopes while providing probabilistic safety guarantees that can be used to certify the efficacy of a robot perception system to detect and avoid dynamic obstacles. We evaluate our approach in a simulated urban driving environment and a real-world environment with moving pedestrians using a light curtain device and show that we can estimate safety envelopes efficiently and effectively. 
    more » « less
  2. ; ; ; ; ( , IEEE Conference on Computer Vision and Pattern Recognition)
    Active sensing through the use of Adaptive Depth Sensors is a nascent field, with potential in areas such as Advanced driver-assistance systems (ADAS). They do however require dynamically driving a laser / light-source to a specific location to capture information, with one such class of sensor being the Triangulation Light Curtains (LC). In this work, we introduce a novel approach that exploits prior depth distributions from RGB cameras to drive a Light Curtain’s laser line to regions of uncertainty to get new measurements. These measurements are utilized such that depth uncertainty is reduced and errors get corrected recursively. We show real-world experiments that validate our approach in outdoor and driving settings, and demonstrate qualitative and quantitative improvements in depth RMSE when RGB cameras are used in tandem with a Light Curtain. 
    more » « less
  3. ; ; ; ; ( , European Conference on Computer Vision)
    null (Ed.)
    Most real-world 3D sensors such as LiDARs perform fixed scans of the entire environment, while being decoupled from the recognition system that processes the sensor data. In this work, we propose a method for 3D object recognition using light curtains, a resource-efficient controllable sensor that measures depth at user-specified locations in the environment. Crucially, we propose using prediction uncertainty of a deep learning based 3D point cloud detector to guide active perception. Given a neural network's uncertainty, we derive an optimization objective to place light curtains using the principle of maximizing information gain. Then, we develop a novel and efficient optimization algorithm to maximize this objective by encoding the physical constraints of the device into a constraint graph and optimizing with dynamic programming. We show how a 3D detector can be trained to detect objects in a scene by sequentially placing uncertainty-guided light curtains to successively improve detection accuracy. 
    more » « less
  4. ; ; ; ; ; ( , Small)
    Abstract

    Next‐generation electronics and energy technologies can now be developed as a result of the design, discovery, and development of novel, environmental friendly lead (Pb)‐free ferroelectric materials with improved characteristics and performance. However, there have only been a few reports of such complex materials’ design with multi‐phase interfacial chemistry, which can facilitate enhanced properties and performance. In this context, herein, novel lead‐free piezoelectric materials (1‐x)Ba0.95Ca0.05Ti0.95Zr0.05O3‐(x)Ba0.95Ca0.05Ti0.95Sn0.05O3, are reported, which are represented as (1‐x)BCZT‐(x)BCST, with demonstrated excellent properties and energy harvesting performance. The (1‐x)BCZT‐(x)BCST materials are synthesized by high‐temperature solid‐state ceramic reaction method by varyingxin the full range (x= 0.00–1.00). In‐depth exploration research is performed on the structural, dielectric, ferroelectric, and electro‐mechanical properties of (1‐x)BCZT‐(x)BCST ceramics. The formation of perovskite structure for all ceramics without the presence of any impurity phases is confirmed by X‐ray diffraction (XRD) analyses, which also reveals that the Ca2+, Zr4+, and Sn4+are well dispersed within the BaTiO3lattice. For all (1‐x)BCZT‐(x)BCST ceramics, thorough investigation of phase formation and phase‐stability using XRD, Rietveld refinement, Raman spectroscopy, high‐resolution transmission electron microscopy (HRTEM), and temperature‐dependent dielectric measurements provide conclusive evidence for the coexistence of orthorhombic + tetragonal (Amm2+P4mm) phases at room temperature. The steady transition ofAmm2crystal symmetry toP4mmcrystal symmetry with increasingxcontent is also demonstrated by Rietveld refinement data and related analyses. The phase transition temperatures, rhombohedral‐orthorhombic (TR‐O), orthorhombic‐ tetragonal (TO‐T), and tetragonal‐cubic (TC), gradually shift toward lower temperature with increasingxcontent. For (1‐x)BCZT‐(x)BCST ceramics, significantly improved dielectric and ferroelectric properties are observed, including relatively high dielectric constantεr≈ 1900–3300 (near room temperature),εr≈ 8800–12 900 (near Curie temperature), dielectric loss, tanδ≈ 0.01–0.02, remanent polarizationPr≈ 9.4–14 µC cm−2, coercive electric fieldEc≈ 2.5–3.6 kV cm−1. Further, high electric field‐induced strainS≈ 0.12–0.175%, piezoelectric charge coefficientd33≈ 296–360 pC N−1, converse piezoelectric coefficient ≈ 240–340 pm V−1, planar electromechanical coupling coefficientkp≈ 0.34–0.45, and electrostrictive coefficient (Q33)avg≈ 0.026–0.038 m4C−2are attained. Output performance with respect to mechanical energy demonstrates that the (0.6)BCZT‐(0.4)BCST composition (x= 0.4) displays better efficiency for generating electrical energy and, thus, the synthesized lead‐free piezoelectric (1‐x)BCZT‐(x)BCST samples are suitable for energy harvesting applications. The results and analyses point to the outcome that the (1‐x)BCZT‐(x)BCST ceramics as a potentially strong contender within the family of Pb‐free piezoelectric materials for future electronics and energy harvesting device technologies.

     
    more » « less
  5. ; ( , Journal of Atmospheric and Oceanic Technology)
    Abstract To overcome challenges with observing ocean heat content (OHC) over the entire ocean, we propose a novel approach that exploits the abundance of satellite data, including data from modern satellite geomagnetic surveys such as Swarm. The method considers a novel combination of conventional in situ (temperature and pressure) as well as satellite (altimetry and gravimetry) data with estimates of ocean electrical conductance (depth-integrated conductivity), which can potentially be obtained from magnetic observations (by satellite, land, seafloor, ocean, and airborne magnetometers). To demonstrate the potential benefit of the proposed method, we sample model output of an ocean state estimate to reflect existing observations and train a machine learning algorithm [Generalized Additive Model (GAM)] on these samples. We then calculate OHC everywhere using information potentially derivable from various global satellite coverage—including magnetic observations—to gauge the GAM’s goodness of fit on a global scale. Inclusion of in situ observations of OHC in the upper 2000 m from Argo-like floats and conductance data each reduce the root-mean-square error by an order of magnitude. Retraining the GAM with recent ship-based hydrographic data attains a smaller RMSE in polar oceans than training the GAM only once on all available historical ship-based hydrographic data; the opposite is true elsewhere. The GAM more accurately calculates OHC anomalies throughout the water column than below 2000 m and can detect global OHC anomalies over multiyear time scales, even when considering hypothetical measurement errors. Our method could complement existing methods and its accuracy could be improved through careful ship-based campaign planning. Significance Statement The purpose of this manuscript is to demonstrate the potential for practical implementation of a remote monitoring method for ocean heat content (OHC) anomalies. To do this, we sample data from a reanalysis product primarily because of the dearth of observations below 2000 m depth that can be used for validation and the fact that full-depth-integrated electrical seawater conductivity data products derived from satellite magnetometry are not yet available. We evaluate multiple factors related to the accuracy of OHC anomaly estimation and find that, even with hypothetical measurement errors, our method can be used to monitor OHC anomalies on multiyear time scales. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email