skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Deformation Capture via Soft and Stretchable Sensor Arrays
We propose a hardware and software pipeline to fabricate flexible wearable sensors and use them to capture deformations without line-of-sight. Our first contribution is a low-cost fabrication pipeline to embed multiple aligned conductive layers with complex geometries into silicone compounds. Overlapping conductive areas from separate layers form local capacitors that measure dense area changes. Contrary to existing fabrication methods, the proposed technique only requires hardware that is readily available in modern fablabs. While area measurements alone are not enough to reconstruct the full 3D deformation of a surface, they become sufficient when paired with a data-driven prior. A novel semi-automatic tracking algorithm, based on an elastic surface geometry deformation, allows us to capture ground-truth data with an optical mocap system, even under heavy occlusions or partially unobservable markers. The resulting dataset is used to train a regressor based on deep neural networks, directly mapping the area readings to global positions of surface vertices. We demonstrate the flexibility and accuracy of the proposed hardware and software in a series of controlled experiments and design a prototype of wearable wrist, elbow, and biceps sensors, which do not require line-of-sight and can be worn below regular clothing.  more » « less
Award ID(s):
1835712 1652515
PAR ID:
10602279
Author(s) / Creator(s):
 ;  ;  ;  
Publisher / Repository:
Association for Computing Machinery (ACM)
Date Published:
Journal Name:
ACM Transactions on Graphics
Volume:
38
Issue:
2
ISSN:
0730-0301
Format(s):
Medium: X Size: p. 1-16
Size(s):
p. 1-16
Sponsoring Org:
National Science Foundation
More Like this
  1. null (Ed.)
    Standards for the fatigue testing of wearable sensing technologies are lacking. The majority of published fatigue tests for wearable sensors are performed on proof-of-concept stretch sensors fabricated from a variety of materials. Due to their flexibility and stretchability, polymers are often used in the fabrication of wearable sensors. Other materials, including textiles, carbon nanotubes, graphene, and conductive metals or inks, may be used in conjunction with polymers to fabricate wearable sensors. Depending on the combination of the materials used, the fatigue behaviors of wearable sensors can vary. Additionally, fatigue testing methodologies for the sensors also vary, with most tests focusing only on the low-cycle fatigue (LCF) regime, and few sensors are cycled until failure or runout are achieved. Fatigue life predictions of wearable sensors are also lacking. These issues make direct comparisons of wearable sensors difficult. To facilitate direct comparisons of wearable sensors and to move proof-of-concept sensors from “bench to bedside”, fatigue testing standards should be established. Further, both high-cycle fatigue (HCF) and failure data are needed to determine the appropriateness in the use, modification, development, and validation of fatigue life prediction models and to further the understanding of how cracks initiate and propagate in wearable sensing technologies. 
    more » « less
  2. There has been an increasing need of technologies to manufacturing chemical and biological sensors for various applications ranging from environmental monitoring to human health monitoring. Currently, manufacturing of most chemical and biological sensors relies on a variety of standard microfabrication techniques, such as physical vapor deposition and photolithography, and materials such as metals and semiconductors. Though functional, they are hampered by high cost materials, rigid substrates, and limited surface area. Paper based sensors offer an intriguing alternative that is low cost, mechanically flexible, has the inherent ability to filter and separate analytes, and offers a high surface area, permeable framework advantageous to liquid and vapor sensing. However, a major drawback is that standard microfabrication techniques cannot be used in paper sensor fabrication. To fabricate sensors on paper, low temperature additive techniques must be used, which will require new manufacturing processes and advanced functional materials. In this work, we focus on using aerosol jet printing as a highresolution additive process for the deposition of ink materials to be used in paper-based sensors. This technique can use a wide variety of materials with different viscosities, including materials with high porosity and particles inherent to paper. One area of our efforts involves creating interdigitated microelectrodes on paper in a one-step process using commercially available silver nanoparticle and carbon black based conductive inks. Another area involves use of specialized filter papers as substrates, such as multi-layered fibrous membrane paper consisting of a poly(acrylonitrile) nanofibrous layer and a nonwoven poly(ethylene terephthalate) layer. The poly(acrylonitrile) nanofibrous layer are dense and smooth enough to allow for high resolution aerosol jet printing. With additively fabricated electrodes on the paper, molecularly-functionalized metal nanoparticles are deposited by molecularly-mediated assembling, drop casting, and printing (sensing and electrode materials), allowing full functionalization of the paper, and producing sensor devices with high surface area. These sensors, depending on the electrode configuration, are used for detection of chemical and biological species in vapor phase, such as water vapor and volatile organic compounds, making them applicable to human performance monitoring. These paper based sensors are shown to display an enhancement in sensitivity, as compared to control devices fabricated on non-porous polyimide substrates. These results have demonstrated the feasibility of paper-based printed devices towards manufacturing of a fully wearable, highly-sensitive, and wireless human performance monitor coupled to flexible electronics with the capability to communicate wirelessly to a smartphone or other electronics for data logging and analysis. 
    more » « less
  3. The study of non-line-of-sight (NLOS) imaging is growing due to its many potential applications, including rescue operations and pedestrian detection by self-driving cars. However, implementing NLOS imaging on a moving camera remains an open area of research. Existing NLOS imaging methods rely on time-resolved detectors and laser configurations that require precise optical alignment, making it difficult to deploy them in dynamic environments. This work proposes a data-driven approach to NLOS imaging, PathFinder, that can be used with a standard RGB camera mounted on a small, power-constrained mobile robot, such as an aerial drone. Our experimental pipeline is designed to accurately estimate the 2D trajectory of a person who moves in a Manhattan-world environment while remaining hidden from the camera’s fieldof- view. We introduce a novel approach to process a sequence of dynamic successive frames in a line-of-sight (LOS) video using an attention-based neural network that performs inference in real-time. The method also includes a preprocessing selection metric that analyzes images from a moving camera which contain multiple vertical planar surfaces, such as walls and building facades, and extracts planes that return maximum NLOS information. We validate the approach on in-the-wild scenes using a drone for video capture, thus demonstrating low-cost NLOS imaging in dynamic capture environments. 
    more » « less
  4. Piezoresistive structures inspired by serpentines, auxetic, and kirigami arrangements have demonstrated good flexibility and sensitivity under tension. Piezoresistive structures display optimal performance when the characteristics entail reliable stretchability and repeatability. These structures can be implemented as wearable sensors by compressing and elongating the conductive nanocomposites to vary the flow of electrons and to provide resistance change. To guarantee the reliability of these structures for strain sensing, it is important that the resistance change in these structures remains constant under repeated loads. In this study, the performance of different piezoresistive structures under cyclic tensile load is investigated and compared. Based on the performance of different types of structures, novel hybrid structures have been also proposed to design for both high stretchability and sensitivity of piezoresistive sensors. All the structures were tested with position limits rather than a fixed force to avoid permanent deformation. First, small position limits were used to determine Young’s Modulus, then a 10-cycle tensile test with larger position limits was used to further study the electromechanical behavior of different piezoresistive structures under larger deformation and repetition. Finally, the gage factor was derived for all the studied structures, and they were re-categorized based on properties’ similarities. 
    more » « less
  5. Abstract In the past years, piezo-conductive sensors have drawn great attention in both academic and industrial sectors. The piezo-conductive sensors made by inorganic semiconductors exhibited poor mechanical flexibility, restricting their further practical applications. In this study, we report the piezo-conductive sensors by a semiconducting polymer, poly(3,4-ethylenedioxythiophene) doped with tosylate ions (PEDOT:Tos) thin films. Systemically studies indicate that the piezo-conductive response of the PEDOT:Tos thin films is originated from the deformation of the PEDOT crystal cells and the stretched π–π distances induced by Tos. Moreover, the negative piezo-conductive effect, for the first time, is observed from PEDOT:Tos thin film under the pressure. A working mechanism is further proposed to interpret the transient from a positive to a negative piezo-conductive response within the PEDOT:Tos thin films. Our studies offer a facile route to approach effective piezo-conductive sensors based on conjugated polymers. 
    more » « less