skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Attention:

The NSF Public Access Repository (PAR) system and access will be unavailable from 10:00 PM ET on Friday, February 6 until 10:00 AM ET on Saturday, February 7 due to maintenance. We apologize for the inconvenience.

Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


Title: Deep reinforcement learning of airfoil pitch control in a highly disturbed environment using partial observations
This study explores the application of deep reinforcement learning (RL) to design an airfoil pitch controller capable of minimizing lift variations in randomly disturbed flows. The controller, treated as an agent in a partially observable Markov decision process, receives non-Markovian observations from the environment, simulating practical constraints where flow information is limited to force and pressure sensors. Deep RL, particularly the TD3 algorithm, is used to approximate an optimal control policy under such conditions. Testing is conducted for a flat plate airfoil in two environments: a classical unsteady environment with vertical acceleration disturbances (i.e., a Wagner setup) and a viscous flow model with pulsed point force disturbances. In both cases, augmenting observations of the lift, pitch angle, and angular velocity with extra wake information (e.g., from pressure sensors) and retaining memory of past observations enhances RL control performance. Results demonstrate the capability of RL control to match or exceed standard linear controllers in minimizing lift variations. Special attention is given to the choice of training data and the generalization to unseen disturbances.  more » « less
Award ID(s):
2247005
PAR ID:
10571098
Author(s) / Creator(s):
;
Publisher / Repository:
American Physical Society
Date Published:
Journal Name:
Physical Review Fluids
Volume:
9
Issue:
9
ISSN:
2469-990X
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; (, Smart Materials, Adaptive Structures and Intelligent Systems)
    null (Ed.)
    Tall and slender buildings often endure disturbances resulting from winds composed of various mean and fluctuating velocities. These disturbances result in discomfort for the occupants as well as accelerated fatigue life cycles and premature fatigue failures in the building. This work presents the development of a smart morphing façade (Smorphaçade) system that dynamically alters a buildings’ external shape or texture to minimize the effect of wind-induced vibrations on the building. The Smorphacade system is represented in this work by a series of plates that vary their orientation by means of a central controller module. To validate the simulation, a simple NACA0012 airfoil is simulated in a stream of air at a Reynolds number (RE) of 2 million. The pressure and viscous force profiles are captured to plot the variation of the lift force for different angles of attack that are then validated using published experimental airfoil data. After validation, the airfoil is attached to a linear spring-damper combination and is allowed to translate vertically without rotation according to the force profile captured from the surrounding air stream. A PID controller is developed to equilibrate the vertical position of the airfoil by altering its angle of attack. The model and its utility functions are implemented as an OpenFOAM® module (MSLSolid). Thereafter, the model is expanded to handle a planar case of a building floor carrying 4 controllable plates. The forces on the building profile are summed at the centroid of the building and the windward rigid body motion of the floor is estimated by reflecting the horizontal force component on a Finite Element (FE) model of the building. The time series information of the force acting on the building and the resulting oscillations are captured for exhaustive combinations of the plate angles. This data is used to build a lookup table that gives the best plate configuration for a given wind condition. A controller operates in real-time by searching the lookup table using readings of the wind condition. Preliminary results show a 94% reduction in the amplitudes of wind-induced vibrations. 
    more » « less
  2. ; ; (, Fluids)
    null (Ed.)
    A closed-loop control algorithm for the reduction of turbulent flow separation over NACA 0015 airfoil equipped with leading-edge synthetic jet actuators (SJAs) is presented. A system identification approach based on Nonlinear Auto-Regressive Moving Average with eXogenous inputs (NARMAX) technique was used to predict nonlinear dynamics of the fluid flow and for the design of the controller system. Numerical simulations based on URANS equations are performed at Reynolds number of 106 for various airfoil incidences with and without closed-loop control. The NARMAX model for flow over an airfoil is based on the static pressure data, and the synthetic jet actuator is developed using an incompressible flow model. The corresponding NARMAX identification model developed for the pressure data is nonlinear; therefore, the describing function technique is used to linearize the system within its frequency range. Low-pass filtering is used to obtain quasi-linear state values, which assist in the application of linear control techniques. The reference signal signifies the condition of a fully re-attached flow, and it is determined based on the linearization of the original signal during open-loop control. The controller design follows the standard proportional-integral (PI) technique for the single-input single-output system. The resulting closed-loop response tracks the reference value and leads to significant improvements in the transient response over the open-loop system. The NARMAX controller enhances the lift coefficient from 0.787 for the uncontrolled case to 1.315 for the controlled case with an increase of 67.1%. 
    more » « less
  3. ; (, Journal of Fluid Mechanics)
    A bio-inspired, passively deployable flap attached to an airfoil by a torsional spring of fixed stiffness can provide significant lift improvements at post-stall angles of attack. In this work, we describe a hybrid active–passive variant to this purely passive flow control paradigm, where the stiffness of the hinge is actively varied in time to yield passive fluid–structure interaction of greater aerodynamic benefit than the fixed-stiffness case. This hybrid active–passive flow control strategy could potentially be implemented using variable-stiffness actuators with less expense compared with actively prescribing the flap motion. The hinge stiffness is varied via a reinforcement-learning-trained closed-loop feedback controller. A physics-based penalty and a long–short-term training strategy for enabling fast training of the hybrid controller are introduced. The hybrid controller is shown to provide lift improvements as high as 136 % and 85 % with respect to the flapless airfoil and the best fixed-stiffness case, respectively. These lift improvements are achieved due to large-amplitude flap oscillations as the stiffness varies over four orders of magnitude, whose interplay with the flow is analysed in detail. 
    more » « less
  4. ; ; ; ; (, Journal of Fluid Mechanics)
    This paper experimentally investigates the flow field development and unsteady loading of three force-mitigating pitch manoeuvres during a transverse gust encounter. The manoeuvres are constructed using varying levels of theoretical and simulation fidelity and implemented as open-loop kinematics in a water towing tank. It is found that pitch actuation during a gust encounter results in two important changes in flow topology: (i) early detachment of the leading-edge vortex (LEV) and (ii) formation of an LEV on the pressure side of the wing upon gust exit. Each of the pitch manoeuvres is found to mitigate a significant portion of the circulatory contribution of the lift force while only manoeuvres with accurate modelling of the added-mass force are found to adequately mitigate the total lift force. The penalty of aerodynamic lift mitigation using pitch manoeuvres was a twofold increase in the pitching moment transients experienced by the wing for all cases. By quantifying changes in the vertical gust momentum before and after the encounter, lift-mitigating manoeuvres were found to reduce the disturbance to the gust's flow field, thereby reducing the momentum exchange between the gust and the wing. 
    more » « less
  5. ; ; ; ; (, In Advanced Wind Tunnel Boundary Simulation II)
    This study presents the first 3D two-way coupled fluid structure interaction (FSI) simulation of a hybrid anechoic wind tunnel (HAWT) test section with modeling all important effects, such as turbulence, Kevlar wall porosity and deflection, and reveals for the first time the complete 3D flow structure associated with a lifting model placed into a HAWT. The Kevlar deflections are captured using finite element analysis (FEA) with shell elements operated under a membrane condition. Three-dimensional RANS CFD simulations are used to resolve the flow field. Aerodynamic experimental results are available and are compared against the FSI results. Quantitatively, the pressure coefficients on the airfoil are in good agreement with experimental results. The lift coefficient was slightly underpredicted while the drag was overpredicted by the CFD simulations. The flow structure downstream of the airfoil showed good agreement with the experiments, particularly over the wind tunnel walls where the Kevlar windows interact with the flow field. A discrepancy between previous experimental observations and juncture flow-induced vortices at the ends of the airfoil is found to stem from the limited ability of turbulence models. The qualitative behavior of the flow, including airfoil pressures and cross-sectional flow structure is well captured in the CFD. From the structural side, the behavior of the Kevlar windows and the flow developing over them is closely related to the aerodynamic pressure field induced by the airfoil. The Kevlar displacement and the transpiration velocity across the material is dominated by flow blockage effects, generated aerodynamic lift, and the wake of the airfoil. The airfoil wake increases the Kevlar window displacement, which was previously not resolved by two-dimensional panel-method simulations. The static pressure distribution over the Kevlar windows is symmetrical about the tunnel mid-height, confirming a dominantly two-dimensional flow field. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Text Encoded Conversion
  • XML
  • Save / Share this Record
  • Send to Email