skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Decoding of Facial Strains via Conformable Piezoelectric Interfaces
Devices that facilitate nonverbal communication typically require high computational loads or have rigid and bulky form factors that are unsuitable for use on the face or on other curvilinear body surfaces. Here, we report the design and pilot testing of an integrated system for decoding facial strains and for predicting facial kinematics. The system consists of mass-manufacturable, conformable piezoelectric thin films for strain mapping; multiphysics modelling for analysing the nonlinear mechanical interactions between the conformable device and the epidermis; and three-dimensional digital image correlation for reconstructing soft-tissue surfaces under dynamic deformations as well as for informing device design and placement. In healthy individuals and in patients with amyotrophic lateral sclerosis, we show that the piezoelectric thin films, coupled with algorithms for the real-time detection and classification of distinct skin-deformation signatures, enable the reliable decoding of facial movements. The integrated system could be adapted for use in clinical settings as a nonverbal communication technology or for use in the monitoring of neuromuscular conditions.  more » « less
Award ID(s):
2026344
PAR ID:
10287639
Author(s) / Creator(s):
; ; ; ; ; ; ; ; ; ;
Date Published:
Journal Name:
Nature biomedical engineering
Volume:
4
ISSN:
2157-846X
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. This paper presents development of a three dimensional finite element model for simulations of a conformable piezoelectric sensor utilizing COMSOL Multiphysics. The sensor has a multi-layer structure composed of four circular piezoelectric elements arranged in an array structure laminated on a soft substrate and is capable of providing a strain mapping of soft tissue surfaces for spatiotemporal biokinematic assessment of the facial skin. Here, we provide the finite element method (FEM) for the sensor to predict its electromechanical behavior. This paper studies the effect of the design parameters such as dimensions of the piezoelectric sensor and the substrate on voltage sensitivity and sensor compliance. The FEM model is established to understand the underlying physics and guide the mechanical characterization of the system. The developed model is experimentally verified through two series of tests. The first set of tests involve comprehensive in vitro mechanical testing to provide accurate measurements of strain during compression, stretching, and bending. The second set of tests present in vivo experiments on healthy and amyotrophic lateral sclerosis subjects. The experimentally verified FEM model provides a detailed insight into analyzing the response of the sensor which establishes new design rules for next generations of conformable piezoelectric sensors. 
    more » « less
  2. Abstract Conformable electronics are regarded as the next generation of personal healthcare monitoring and remote diagnosis devices. In recent years, piezoelectric‐based conformable ultrasound electronics (cUSE) have been intensively studied due to their unique capabilities, including nonradiative monitoring, soft tissue imaging, deep signal decoding, wireless power transfer, portability, and compatibility. This review provides a comprehensive understanding of cUSE for use in biomedical and healthcare monitoring systems and a summary of their recent advancements. Following an introduction to the fundamentals of piezoelectrics and ultrasound transducers, the critical parameters for transducer design are discussed. Next, five types of cUSE with their advantages and limitations are highlighted, and the fabrication of cUSE using advanced technologies is discussed. In addition, the working function, acoustic performance, and accomplishments in various applications are thoroughly summarized. It is noted that application considerations must be given to the tradeoffs between material selection, manufacturing processes, acoustic performance, mechanical integrity, and the entire integrated system. Finally, current challenges and directions for the development of cUSE are highlighted, and research flow is provided as the roadmap for future research. In conclusion, these advances in the fields of piezoelectric materials, ultrasound transducers, and conformable electronics spark an emerging era of biomedicine and personal healthcare. 
    more » « less
  3. Recent advancements in wearable technology have improved lifestyle and medical practices, enabling personalized care ranging from fitness tracking, to real-time health monitoring, to predictive sensing. Wearable devices serve as an interface between humans and technology; however, this integration is far from seamless. These devices face various limitations such as size, biocompatibility, and battery constraints wherein batteries are bulky, are expensive, and require regular replacement. On-body energy harvesting presents a promising alternative to battery power by utilizing the human body’s continuous generation of energy. This review paper begins with an investigation of contemporary energy harvesting methods, with a deep focus on piezoelectricity. We then highlight the materials, configurations, and structures of such methods for self-powered devices. Here, we propose a novel combination of thin-film composites, kirigami patterns, and auxetic structures to lay the groundwork for an integrated piezoelectric system to monitor and sense. This approach has the potential to maximize energy output by amplifying the piezoelectric effect and manipulating the strain distribution. As a departure from bulky, rigid device design, we explore compositions and microfabrication processes for conformable energy harvesters. We conclude by discussing the limitations of these harvesters and future directions that expand upon current applications for wearable technology. Further exploration of materials, configurations, and structures introduce interdisciplinary applications for such integrated systems. Considering these factors can revolutionize the production and consumption of energy as wearable technology becomes increasingly prevalent in everyday life. 
    more » « less
  4. Nonverbal communication, such as body language, facial expressions, and hand gestures, is crucial to human communication as it conveys more information about emotions and attitudes than spoken words. However, individuals who are blind or have low-vision (BLV) may not have access to this method of communication, leading to asymmetry in conversations. Developing systems to recognize nonverbal communication cues (NVCs) for the BLV community would enhance communication and understanding for both parties. This paper focuses on developing a multimodal computer vision system to recognize and detect NVCs. To accomplish our objective, we are collecting a dataset focused on nonverbal communication cues. Here, we propose a baseline model for recognizing NVCs and present initial results on the Aff-Wild2 dataset. Our baseline model achieved an accuracy of 68% and a F1-Score of 64% on the Aff-Wild2 validation set, making it comparable with previous state of the art results. Furthermore, we discuss the various challenges associated with NVC recognition as well as the limitations of our current work. 
    more » « less
  5. Further miniaturization of electronic devices necessitates the introduction of new materials, including piezoelectric thin films, that exhibit electromechanical functionalities without significant degradation in response due to substrate-induced clamping. To identify material systems with superior piezoelectric properties as thin films, simplified and quantitative electromechanical characterization techniques are required. Here, single-beam, laser Doppler vibrometry is used to detect ac electric-field-induced surface displacement in the frequency range 1–100 kHz with low error (around 6% at 10 kHz) and resolution of 0.0003 nm. The technique is used to quantify both electrostriction and piezoelectric responses (surface displacement values <0.05 nm) of various thin films. Requirements for sample geometry and device structures are established and measurement accuracy and resolution are validated against measurements from the literature via synchrotron-based diffraction measurements. A general methodology to measure and extract the piezoelectric coefficients for thin-film samples using finite-element modeling is presented and applied to determine the d33 coefficient and visualize the response in substrate-clamped 50–400-nm-thick PbZr0.52Ti0.48O3 films, especially as compared to bulk versions with the same sample geometry. 
    more » « less