skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Accelerating LSTM-based High-Rate Dynamic System Models
In this paper, we evaluate the use of a trained Long Short-Term Memory (LSTM) network as a surrogate for a Euler–Bernoulli beam model, and then we describe and characterize an FPGA-based deployment of the model for use in real-time structural health monitoring applications. The focus of our efforts is the DROPBEAR (Dynamic Reproduction of Projectiles in Ballistic Environments for Advanced Research) dataset, which was generated as a benchmark for the study of real-time structural modeling applications. The purpose of DROPBEAR is to evaluate models that take vibration data as input and give the initial conditions of the cantilever beam on which the measurements were taken as output. DROPBEAR is meant to serve an exemplar for emerging high-rate “active structures” that can be actively controlled with feedback latencies of less than one microsecond. Although the Euler–Bernoulli beam model is a well-known solution to this modeling problem, its computational cost is prohibitive for the time scales of interest. It has been previously shown that a properly structured LSTM network can achieve comparable accuracy with less workload, but achieving sub-microsecond model latency remains a challenge. Our approach is to deploy the LSTM optimized specifically for latency on FPGA. We designed the model using both high-level synthesis (HLS) and hardware description language (HDL). The lowest latency of 1.42 µS and the highest throughput of 7.87 Gops/s were achieved on Alveo U55C platform for HDL design.  more » « less
Award ID(s):
1956071
PAR ID:
10435536
Author(s) / Creator(s):
Date Published:
Journal Name:
Proc. 33rd International Conference on Field Programmable Logic and Applications (FPL 2023)
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. We present FireSim, an open-source simulation platform that enables cycle-exact microarchitectural simulation of large scale-out clusters by combining FPGA-accelerated simulation of silicon-proven RTL designs with a scalable, distributed network simulation. Unlike prior FPGA-accelerated simulation tools, FireSim runs on Amazon EC2 F1, a public cloud FPGA platform, which greatly improves usability, provides elasticity, and lowers the cost of large-scale FPGA-based experiments. We describe the design and implementation of FireSim and show how it can provide sufficient performance to run modern applications at scale, to enable true hardware-software co-design. As an example, we demonstrate automatically generating and deploying a target cluster of 1,024 3.2 GHz quad-core server nodes, each with 16 GB of DRAM, interconnected by a 200 Gbit/s network with 2 microsecond latency, which simulates at a 3.4 MHz processor clock rate (less than 1,000x slowdown over real-time). In aggregate, this FireSim instantiation simulates 4,096 cores and 16 TB of memory, runs ~ 14 billion instructions per second, and harnesses 12.8 million dollars worth of FPGAs-at a total cost of only ~ $100 per simulation hour to the user. We present several examples to show how FireSim can be used to explore various research directions in warehouse-scale machine design, including modeling networks with high-bandwidth and low-latency, integrating arbitrary RTL designs for a variety of commodity and specialized datacenter nodes, and modeling a variety of datacenter organizations, as well as reusing the scale-out FireSim infrastructure to enable fast, massively parallel cycle-exact single-node microarchitectural experimentation. 
    more » « less
  2. null (Ed.)
    A reliable, accurate, and yet simple dynamic model is important to analyzing, designing, and controlling hybrid rigid–continuum robots. Such models should be fast, as simple as possible, and user-friendly to be widely accepted by the ever-growing robotics research community. In this study, we introduce two new modeling methods for continuum manipulators: a general reduced-order model (ROM) and a discretized model with absolute states and Euler–Bernoulli beam segments (EBA). In addition, a new formulation is presented for a recently introduced discretized model based on Euler–Bernoulli beam segments and relative states (EBR). We implement these models in a Matlab software package, named TMTDyn, to develop a modeling tool for hybrid rigid–continuum systems. The package features a new high-level language (HLL) text-based interface, a CAD-file import module, automatic formation of the system equation of motion (EOM) for different modeling and control tasks, implementing Matlab C-mex functionality for improved performance, and modules for static and linear modal analysis of a hybrid system. The underlying theory and software package are validated for modeling experimental results for (i) dynamics of a continuum appendage, and (ii) general deformation of a fabric sleeve worn by a rigid link pendulum. A comparison shows higher simulation accuracy (8–14% normalized error) and numerical robustness of the ROM model for a system with a small number of states, and computational efficiency of the EBA model with near real-time performances that makes it suitable for large systems. The challenges and necessary modules to further automate the design and analysis of hybrid systems with a large number of states are briefly discussed. 
    more » « less
  3. Ionic polymer metal composites (IPMCs) are a class of soft electroactive polymers. IPMCs comprise a soft ionic polymer core, on which two stiff metal electrodes are plated. These active materials exhibit large bend- ing upon the application of a small driving voltage across their electrodes, in air or in aqueous environments. In a recent work, we presented compelling theoretical and numerical evidence suggesting that ionic polymer membranes exhibit complex multiaxial deformations neglected by reduced-order structural models. Where most beam theories (including Euler-Bernoulli, Timoshenko, and most higher-order shear deformation models) would suggest vanishing through-the-thickness deformation, we discover the onset of localized deformation that rever- berates into axial stretching. Building upon this effort, here we investigate the role of the electrodes and shear on multiaxial deformations of IPMCs. We establish a novel structural theory for IPMCs, based on the Euler- Bernoulli kinematics enriched with the through-the-thickness deformation in the ionic polymer, computed from a Saint-Venant-like problem for uniform bending. While considering boundary conditions that elicit non-uniform bending, we compare the results of this model against classical Euler-Bernoulli beam theory without enrichment and finite element simulations, encapsulating the nonlinear response of the material. We demonstrate that our theory can predict the macroscopic displacement of the IPMC, along with the localized deformation in the ionic polymer at the interface with the electrodes, which are not captured by the classical Euler-Bernoulli beam theory. This work paves the way to the development of more sophisticated structural theories for IPMCs and analogous active materials, affording an accurate description of deformations at a limited computational cost. 
    more » « less
  4. Abstract In this work, a new theoretical model for contact resonance atomic force microscopy, which incorporates the elastic dynamics of a long sensing tip is presented. The model is based on the Euler–Bernoulli beam theory and includes coupling effects from the two-beam structure, also known as an ‘L-shaped’ beam in the literature. Here, high-accuracy prediction of the sample stiffness, using several vibration modes with a relative error smaller than 10% for practical working ranges, is demonstrated. A discussion on the model’s capability to predict the dynamic phenomena of eigenmode veering and crossing, as the force applied to the sample increases, is presented. The L-shaped beam model presented here is also applicable for structural applications such as: micro-electro-mechanical systems, energy harvesting, and unmanned aerial vehicle landing gear. 
    more » « less
  5. Structures operating in high-rate dynamic environments, such as hypersonic vehicles, orbital space infrastructure, and blast mitigation systems, require microsecond (µs) decisionmaking. Advances in real-time sensing, edge-computing, and high-bandwidth computer memory are enabling emerging technologies such as High-rate structural health monitoring (HRSHM) to become more feasible. Due to the time restrictions such systems operate under, a target of 1 millisecond (ms) from event detection to decision-making is set at the goal to enable HRSHM. With minimizing latency in mind, a data-driven method that relies on time-series measurements processed in real-time to infer the state of the structure is investigated in this preliminary work. A methodology for deploying LSTM-based state estimators for structures using subsampled time-series vibration data is presented. The proposed estimator is deployed to an embedded real-time device and the achieved accuracy along with system timing are discussed. The proposed approach has shown potential for high-rate state estimation as it provides sufficient accuracy for the considered structure while a time-step of 2.5 ms is achieved. The Contributions of this work are twofold: 1) a framework for deploying LSTM models in real-time for high-rate state estimation, 2) an experimental validation of LSTMs running on a real-time computing system. 
    more » « less