skip to main content

Title: Multimodal Sensors with Decoupled Sensing Mechanisms

Highly sensitive and multimodal sensors have recently emerged for a wide range of applications, including epidermal electronics, robotics, health‐monitoring devices and human–machine interfaces. However, cross‐sensitivity prevents accurate measurements of the target input signals when a multiple of them are simultaneously present. Therefore, the selection of the multifunctional materials and the design of the sensor structures play a significant role in multimodal sensors with decoupled sensing mechanisms. Hence, this review article introduces varying methods to decouple different input signals for realizing truly multimodal sensors. Early efforts explore different outputs to distinguish the corresponding input signals applied to the sensor in sequence. Next, this study discusses the methods for the suppression of the interference, signal correction, and various decoupling strategies based on different outputs to simultaneously detect multiple inputs. The recent insights into the materials' properties, structure effects, and sensing mechanisms in recognition of different input signals are highlighted. The presence of the various decoupling methods also helps avoid the use of complicated signal processing steps and allows multimodal sensors with high accuracy for applications in bioelectronics, robotics, and human–machine interfaces. Finally, current challenges and potential opportunities are discussed in order to motivate future technological breakthroughs.

more » « less
Award ID(s):
Author(s) / Creator(s):
 ;  ;  ;  ;  ;  
Publisher / Repository:
Wiley Blackwell (John Wiley & Sons)
Date Published:
Journal Name:
Advanced Science
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract

    Highly stretchable fiber sensors have attracted significant interest recently due to their applications in wearable electronics, human–machine interfaces, and biomedical implantable devices. Here, a scalable approach for fabricating stretchable multifunctional electrical and optical fiber sensors using a thermal drawing process is reported. The fiber sensors can sustain at least 580% strain and up to 750% strain with a helix structure. The electrical fiber sensor simultaneously exhibits ultrahigh stretchability (400%), high gauge factors (≈1960), and excellent durability during 1000 stretching and bending cycles. It is also shown that the stretchable step‐index optical fibers facilitate detection of bending and stretching deformation through changes in the light transmission. By combining both electrical and optical detection schemes, multifunctional fibers can be used for quantifying and distinguishing multimodal deformations such as bending and stretching. The fibers’ utility and functionality in sensing and control applications are demonstrated in a smart glove for controlling a virtual hand model, a wrist brace for wrist motion tracking, fiber meshes for strain mapping, and real‐time monitoring of multiaxial expansion and shrinkage of porcine bladders. These results demonstrate that the fiber sensors can be promising candidates for smart textiles, robotics, prosthetics, and biomedical implantable devices.

    more » « less
  2. The recent prevalence of machine learning-based techniques and smart device embedded sensors has enabled widespread human-centric sensing applications. However, these applications are vulnerable to false data injection attacks (FDIA) that alter a portion of the victim's sensory signal with forged data comprising a targeted trait. Such a mixture of forged and valid signals successfully deceives the continuous authentication system (CAS) to accept it as an authentic signal. Simultaneously, introducing a targeted trait in the signal misleads human-centric applications to generate specific targeted inference; that may cause adverse outcomes. This paper evaluates the FDIA's deception efficacy on sensor-based authentication and human-centric sensing applications simultaneously using two modalities - accelerometer, blood volume pulse signals. We identify variations of the FDIA such as different forged signal ratios, smoothed and non-smoothed attack samples. Notably, we present a novel attack detection framework named Siamese-MIL that leverages the Siamese neural networks' generalizable discriminative capability and multiple instance learning paradigms through a unique sensor data representation. Our exhaustive evaluation demonstrates Siamese-MIL's real-time execution capability and high efficacy in different attack variations, sensors, and applications. 
    more » « less
  3. Abstract

    Liquid metal (LM) exhibits a distinct combination of high electrical conductivity comparable to that of metals and exceptional deformability derived from its liquid state, thus it is considered a promising material for high-performance soft electronics. However, rapid patterning LM to achieve a sensory system with high sensitivity remains a challenge, mainly attributed to the poor rheological property and wettability. Here, we report a rheological modification strategy of LM and strain redistribution mechanics to simultaneously simplify the scalable manufacturing process and significantly enhance the sensitivity of LM sensors. By incorporating SiO2particles into LM, the modulus, yield stress, and viscosity of the LM-SiO2composite are drastically enhanced, enabling 3D printability on soft materials for stretchable electronics. The sensors based on printed LM-SiO2composite show excellent mechanical flexibility, robustness, strain, and pressure sensing performances. Such sensors are integrated onto different locations of the human body for wearable applications. Furthermore, by integrating onto a tactile glove, the synergistic effect of strain and pressure sensing can decode the clenching posture and hitting strength in boxing training. When assisted by a deep-learning algorithm, this tactile glove can achieve recognition of the technical execution of boxing punches, such as jab, swing, uppercut, and combination punches, with 90.5% accuracy. This integrated multifunctional sensory system can find wide applications in smart sport-training, intelligent soft robotics, and human-machine interfaces.

    more » « less
  4. null (Ed.)
    Stimuli-responsive hydrogel strain sensors that synergize the advantages of both soft-wet hydrogels and smart functional materials have attracted rapidly increasing interest for exploring the opportunities from material design principles to emerging applications in electronic skins, health monitors, and human–machine interfaces. Stimuli-responsive hydrogel strain sensors possess smart and on-demand ability to specifically recognize various external stimuli and convert them into strain-induced mechanical, thermal, optical, and electrical signals. This review presents an up-to-date summary over the past five years on hydrogel strain sensors from different aspects, including material designs, gelation/fabrication methods, stimuli-responsive principles, and sensing performance. Hydrogel strain sensors are classified into five major categories based on the nature of the stimuli, and representative examples from each category are carefully selected and discussed in terms of structures, response mechanisms, and potential medical applications. Finally, current challenges and future perspectives of hydrogel strain sensors are tentatively proposed to stimulate more and better research in this emerging field. 
    more » « less
  5. Abstract

    Recent advances in soft sensors and flexible electronics offer various applications in detecting physical, electrical, and chemical signals. However, there are still technical barriers in current mechanical, electrical, and material properties for enhanced signal sensing. When measuring signals from the human skin, minimizing the skin‐sensor contact impedance is still challenging while maximizing sensitivity through optimized materials and soft electronics. Here, this review summarizes recent advances in materials, manufacturing, and integration technologies to develop ultrathin soft sensors for monitoring various human physiological signals. The enhancements in soft and compliant structures and mechanical properties are critical to making reliable wearable electronic systems. This article shares the details of soft sensors, integration processes, manufacturing methods, and their applications to target physical, electrical, and chemical signals. In addition, the limitations and current trends in developing multifunctional sensors, self‐powered devices, and integration with external stimuli systems are discussed.

    more » « less