skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


Title: Neuromechanical Autoencoders: Learning to Couple Elastic and Neural Network Nonlinearity
Intelligent biological systems are characterized by their embodiment in a complex environment and the intimate interplay between their nervous systems and the nonlinear mechanical properties of their bodies. This coordination, in which the dynamics of the motor system co-evolved to reduce the computational burden on the brain, is referred to as "mechanical intelligence" or "morphological computation". In this work, we seek to develop machine learning analogs of this process, in which we jointly learn the morphology of complex nonlinear elastic solids along with a deep neural network to control it. By using a specialized differentiable simulator of elastic mechanics coupled to conventional deep learning architectures---which we refer to as neuromechanical autoencoders---we are able to learn to perform morphological computation via gradient descent. Key to our approach is the use of mechanical metamaterials---cellular solids, in particular---as the morphological substrate. Just as deep neural networks provide flexible and massively-parametric function approximators for perceptual and control tasks, cellular solid metamaterials are promising as a rich and learnable space for approximating a variety of actuation tasks. In this work we take advantage of these complementary computational concepts to co-design materials and neural network controls to achieve nonintuitive mechanical behavior. We demonstrate in simulation how it is possible to achieve translation, rotation, and shape matching, as well as a "digital MNIST" task. We additionally manufacture and evaluate one of the designs to verify its real-world behavior.  more » « less
Award ID(s):
2007278
PAR ID:
10470418
Author(s) / Creator(s):
; ; ;
Publisher / Repository:
International Conference on Learning Representations (ICLR)
Date Published:
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; (, Proc. SPIE 11589, Behavior and Mechanics of Multifunctional Materials XV)
    null (Ed.)
    In the field of soft robotics, harnessing the nonlinear dynamics of soft and compliant bodies as a computational resource to enable embodied intelligence and control is known as morphological computation. Physical reservoir computing (PRC) is a true instance of morphological computation wherein; a physical nonlinear dynamic system is used as a fixed reservoir to perform complex computational tasks. These dynamic reservoirs can be used to approximate nonlinear dynamical systems and even perform machine learning tasks. By numerical simulation, this study illustrates that an origami meta-material can also be used as a dynamic reservoir for pattern generation, output modulation, and input sensing. These results could pave the way for intelligently designed origami-based robots that interact with the environment through a distributed network of sensors and actuators. This embodied intelligence will enable the next generations of soft robots to autonomously coordinate and modulate their activities, such as locomotion gait generation and limb manipulation while resisting external disturbances. 
    more » « less
  2. ; (, Journal of Computational Physics)
    We develop data-driven methods incorporating geometric and topological information to learn parsimonious representations of nonlinear dynamics from observations. The approaches learn nonlinear state-space models of the dynamics for general manifold latent spaces using training strategies related to Variational Autoencoders (VAEs). Our methods are referred to as Geometric Dynamic (GD) Variational Autoencoders (GD-VAEs). We learn encoders and decoders for the system states and evolution based on deep neural network architectures that include general Multilayer Perceptrons (MLPs), Convolutional Neural Networks (CNNs), and other architectures. Motivated by problems arising in parameterized PDEs and physics, we investigate the performance of our methods on tasks for learning reduced dimensional representations of the nonlinear Burgers Equations, Constrained Mechanical Systems, and spatial fields of Reaction-Diffusion Systems. GD-VAEs provide methods that can be used to obtain representations in manifold latent spaces for diverse learning tasks involving dynamics. 
    more » « less
  3. ; ; ; (, AIChE Journal)
    Abstract Data‐enabled predictive control (DeePC) is a data‐driven control algorithm that utilizes data matrices to form a non‐parametric representation of the underlying system, predicting future behaviors and generating optimal control actions. DeePC typically requires solving an online optimization problem, the complexity of which is heavily influenced by the amount of data used, potentially leading to expensive online computation. In this article, we leverage deep learning to propose a highly computationally efficient DeePC approach for general nonlinear processes, referred to as Deep DeePC. Specifically, a deep neural network is employed to learn the DeePC vector operator, which is an essential component of the non‐parametric representation of DeePC. This neural network is trained offline using historical open‐loop input and output data of the nonlinear process. With the trained neural network, the Deep DeePC framework is formed for online control implementation. At each sampling instant, this neural network directly outputs the DeePC operator, eliminating the need for online optimization as conventional DeePC. The optimal control action is obtained based on the DeePC operator updated by the trained neural network. To address constrained scenarios, a constraint handling scheme is further proposed and integrated with the Deep DeePC to handle hard constraints during online implementation. The efficacy and superiority of the proposed Deep DeePC approach are demonstrated using two benchmark process examples. 
    more » « less
  4. ; ; ; ; (, Nature Communications)
    Abstract In recent years, mechanical metamaterials have been developed that support the propagation of an intriguing variety of nonlinear waves, including transition waves and vector solitons (solitons with coupling between multiple degrees of freedom). Here we report observations of phase transitions in 2D multistable mechanical metamaterials that are initiated by collisions of soliton-like pulses in the metamaterial. Analogous to first-order phase transitions in crystalline solids, we observe that the multistable metamaterials support phase transitions if the new phase meets or exceeds a critical nucleus size. If this criterion is met, the new phase subsequently propagates in the form of transition waves, converting the rest of the metamaterial to the new phase. More interestingly, we numerically show, using an experimentally validated model, that the critical nucleus can be formed via collisions of soliton-like pulses. Moreover, the rich direction-dependent behavior of the nonlinear pulses enables control of the location of nucleation and the spatio-temporal shape of the growing phase. 
    more » « less
  5. ; ; ; ; (, Advanced Functional Materials)
    Abstract Active metamaterials are a type of metamaterial with tunable properties enabled by structural reconfigurations. Existing active metamaterials often achieve only a limited number of structural reconfigurations upon the application of an external load across the entire structure. Here, a selective actuation strategy is proposed for inhomogeneous deformations of magneto‐mechanical metamaterials, which allows for the integration of multiple elastic wave‐tuning functionalities into a single metamaterial design. Central to this actuation strategy is that a magnetic field is applied to specific unit cells instead of the entire metamaterial, and the unit cell can transform between two geometrically distinct shapes, which exhibit very different mechanical responses to elastic wave excitations. The numerical simulations and experiments demonstrate that the tunable response of the unit cell, coupled with inhomogeneous deformation achieved through selective actuation, unlocks multifunctional capabilities of magneto‐mechanical metamaterials such as tunable elastic wave transmittance, elastic waveguide, and vibration isolation. The proposed selective actuation strategy offers a simple but effective way to control the tunable properties and thus enhances the programmability of magneto‐mechanical metamaterials, which also expands the application space of magneto‐mechanical metamaterials in elastic wave manipulation. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email