skip to main content


Title: Stochastic Drift Counteraction Optimal Control of a Fuel Cell-Powered Small Unmanned Aerial Vehicle
This paper investigates optimal power management of a fuel cell hybrid small unmanned aerial vehicle (sUAV) from the perspective of endurance (time of flight) maximization in a stochastic environment. Stochastic drift counteraction optimal control is exploited to obtain an optimal policy for power management that coordinates the operation of the fuel cell and battery to maximize the expected flight time while accounting for the limits on the rate of change of fuel cell power output and the orientation dependence of fuel cell efficiency. The proposed power management strategy accounts for known statistics in transitions of propeller power and climb angle during the mission, but does not require the exact preview of their time histories. The optimal control policy is generated offline using value iterations implemented in Cython, demonstrating an order of magnitude speedup as compared to MATLAB. It is also shown that the value iterations can be further sped up using a discount factor, but at the cost of decreased performance. Simulation results for a 1.5 kg sUAV are reported that illustrate the optimal coordination between the fuel cell and the battery during aircraft maneuvers, including a turnpike in the battery state of charge (SOC) trajectory. As the fuel cell is not able to support fast changes in power output, the optimal policy is shown to charge the battery to the turnpike value if starting from a low initial SOC value. If starting from a high SOC value, the battery energy is used till a turnpike value of the SOC is reached with further discharge delayed to later in the flight. For the specific scenarios and simulated sUAV parameters considered, the results indicate the capability of up to 2.7 h of flight time.  more » « less
Award ID(s):
1931738
NSF-PAR ID:
10274635
Author(s) / Creator(s):
; ;
Date Published:
Journal Name:
Energies
Volume:
14
Issue:
5
ISSN:
1996-1073
Page Range / eLocation ID:
1304
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. The rising global trend to reduce dependence on fossil fuels has provided significant motivation toward the development of alternative energy conversion methods and new technologies to improve their efficiency. Recently, oscillating energy harvesters have shown promise as highly efficient and scalable turbines, which can be implemented in areas where traditional energy extraction and conversion are either unfeasible or cost prohibitive. Although such devices are quickly gaining popularity, there remain a number of hurdles in the understanding of their underlying fluid dynamics phenomena. The ability to achieve high efficiency power output from oscillating airfoil energy harvesters requires exploitation of the complexities of the event of dynamic stall. During dynamic stall, the oncoming flow separates at the leading edge of the airfoil to form leading ledge vortex (LEV) structures. While it is well known that LEVs play a significant role in aerodynamic force generation in unsteady animal flight (e.g. insects and birds), there is still a need to further understand their spatiotemporal evolution in order to design more effective energy harvesting enhancement mechanisms. In this work, we conduct extensive experimental investigations to shed-light on the flow physics of a heaving and pitching airfoil energy harvester operating at reduced frequencies of k = fc=U1 = 0.06-0.18, pitching amplitude of 0 = 75 and heaving amplitude of h0 = 0:6c. The experimental work involves the use of two-component particle image velocimetry (PIV) measurements conducted in a wind tunnel facility at Oregon State University. Velocity fields obtained from the PIV measurements are analyzed qualitatively and quantitatively to provide a description of the dynamics of LEVs and other flow structures that may be present during dynamic stall. Due to the difficulties of accurately measuring aerodynamic forces in highly unsteady flows in wind tunnels, a reduced-order model based on the vortex-impulse theory is proposed for estimating the aerodynamic loadings and power output using flow field data. The reduced-order model is shown to be dominated by two terms that have a clear physical interpretation: (i) the time rate of change of the impulse of vortical structures and (ii) the Kutta-Joukowski force which indirectly represents the history effect of vortex shedding in the far wake. Furthermore, the effects of a bio-inspired flow control mechanism based on deforming airfoil surfaces on the flow dynamics and energy harvesting performance are investigated. The results show that the aerodynamic loadings, and hence power output, are highly dependent on the formation, growth rate, trajectory and detachment of the LEV. It is shown that the energy harvesting efficiency increases with increasing reduced frequency, peaking at 25% when k = 0.14, agreeing very well with published numerical results. At this optimal reduced frequency, the time scales of the LEV evolution and airfoil kinematics are matched, resulting in highly correlated aerodynamic load generation and airfoil motion. When operating at k > 0:14, it is shown that the aerodynamic moment and airfoil pitching motion become negatively correlated and as a result, the energy harvesting performance is deteriorated. Furthermore, by using a deforming airfoil surface at the leading and trailing edges, the peak energy harvesting efficiency is shown to increase by approximately 17% and 25% relative to the rigid airfoil, respectively. The performance enhancement is associated with enhanced aerodynamic forces for both the deforming leading and trailing edges. In addition, The deforming trailing edge airfoil is shown to enhance the correlation between the aerodynamic moment and pitching motion at higher reduced frequencies, resulting in a peak efficiency at k = 0:18 as opposed to k = 0:14 for the rigid airfoil. 
    more » « less
  2. null (Ed.)
    Electrification of vehicles is becoming one of the main avenues for decarbonization of the transportation market. To reduce stress on the energy grid, large-scale charging will require optimal scheduling of when electricity is delivered to vehicles. Coordinated electric-vehicle charging can produce optimal, flattened loads that would improve reliability of the power system as well as reduce system costs and emissions. However, a challenge for successful introduction of coordinated deadline-scheduling of residential charging comes from the demand side: customers would need to be willing both to defer charging their vehicles and to accept less than a 100% target for battery charge. Within a coordinated electric-vehicle charging pilot run by the local utility in upstate New York, this study analyzes the necessary incentives for customers to accept giving up control of when charging of their vehicles takes place. Using data from a choice experiment implemented in an online survey of electric-vehicle owners and lessees in upstate New York (N=462), we make inference on the willingness to pay for features of hypothetical coordinated electric-vehicle charging programs. To address unobserved preference heterogeneity, we apply Variational Bayes (VB) inference to a mixed logit model. Stochastic variational inference has recently emerged as a fast and computationally-efficient alternative to Markov chain Monte Carlo (MCMC) methods for scalable Bayesian estimation of discrete choice models. Our results show that individuals negatively perceive the duration of the timeframe in which the energy provider would be allowed to defer charging, even though both the desired target for battery charge and deadline would be respected. This negative monetary valuation is evidenced by an expected average reduction in the annual fee of joining the charging program of $2.64 per hour of control yielded to the energy provider. Our results also provide evidence of substantial heterogeneity in preferences. For example, the 25% quantile of the posterior distribution of the mean of the willingness to accept an additional hour of control yielded to the utility is $5.16. However, the negative valuation of the timeframe for deferring charging is compensated by positive valuation of emission savings coming from switching charging to periods of the day with a higher proportion of generation from renewable sources. Customers also positively valued discounts in the price of energy delivery. 
    more » « less
  3. Hybrid electric vehicles can achieve better fuel economy than conventional vehicles by utilizing multiple power sources. While these power sources have been controlled by rule-based or optimization-based control algorithms, recent studies have shown that machine learning-based control algorithms such as online Deep Reinforcement Learning (DRL) can effectively control the power sources as well. However, the optimization and training processes for the online DRL-based powertrain control strategy can be very time and resource intensive. In this paper, a new offline–online hybrid DRL strategy is presented where offline vehicle data are exploited to build an initial model and an online learning algorithm explores a new control policy to further improve the fuel economy. In this manner, it is expected that the agent can learn an environment consisting of the vehicle dynamics in a given driving condition more quickly compared to the online algorithms, which learn the optimal control policy by interacting with the vehicle model from zero initial knowledge. By incorporating a priori offline knowledge, the simulation results show that the proposed approach not only accelerates the learning process and makes the learning process more stable, but also leads to a better fuel economy compared to online only learning algorithms. 
    more » « less
  4. Tracking the change in electronic structure of target elements is crucial to investigate the nature of redox reactions occurring in battery electrodes. X-ray emission spectroscopy (XES) and x-ray absorption fine structure (XAFS) perform this role well with high sensitivity and throughput, but the requisite of synchrotron facilities often limits those availability for material characterization. Using a lab-scale x-ray emission/absorption spectrometer, we investigated the changes in the local structure and chemistry around the 3d transition metal elements of LiMO 2 cathodes for Li-ion batteries as a function of the battery state of charge (SoC). Ex situ measurement was prepared from the electrode samples with discrete difference in SoC. Coupled with ex situ measurement, operando measurement was performed using pouch cells with LiMO 2 cathode, which enabled a real-time monitoring of chemical shift in an element-specific manner resulted from changing electrode potential. Through the XES mode of the bench-top spectrometer, fluorescence emissions from the LiMO 2 cathode, or the cell containing it, was monochromatized by a spherically bent crystal analyzer (SBCA). The Kβ emissions of 3d transition metal elements such as cobalt display position/shape difference of spectrum with varying SoC. The trend of chemical shift and change in spectral features provided the information on the electronic structure variation, such as oxidation state change of 3d transition metals in LiMO 2 during charge and discharge (i.e., delithiation and lithiation). Furthermore, valence-to-core (VtC) emission signals helped enable in-depth analysis such as spin structure characterization. In addition to the XES analysis, we could measure K-edge XAFS for the same 3d transition metals in LiMO 2 as well. In the XAFS mode of the spectrometer, SBCA monochromatized bremsstrahlung x-ray generated from a high-power x-ray tube is used to make an incident source energy-dispersive. While Kβ XES probed occupied levels, K-edge XAFS examined unoccupied levels providing comprehensive understanding on the change in electronic structure of 3d transition metals in LiMO 2 . Figure 1 
    more » « less
  5. Rooftop photovoltaics (PV) and electrical vehicles (EV) have become more economically viable to residential customers. Most existing home energy management systems (HEMS) only focus on the residential occupants’ thermal comfort in terms of indoor temperature and humidity while neglecting their other behaviors or concerns. This paper aims to integrate residential PV and EVs into the HEMS in an occupant-centric manner while taking into account the occupants’ thermal comfort, clothing behaviors, and concerns on the state-of-charge (SOC) of EVs. A stochastic adaptive dynamic programming (ADP) model was proposed to optimally determine the setpoints of heating, ventilation, air conditioning (HVAC), occupant’s clothing decisions, and the EV’s charge/discharge schedule while considering uncertainties in the outside temperature, PV generation, and EV’s arrival SOC. The nonlinear and nonconvex thermal comfort model, EV SOC concern model, and clothing behavior model were holistically embedded in the ADP-HEMS model. A model predictive control framework was further proposed to simulate a residential house under the time of use tariff, such that it continually updates with optimal appliance schedules decisions passed to the house model. Cosimulations were carried out to compare the proposed HEMS with a baseline model that represents the current operational practice. The result shows that the proposed HEMS can reduce the energy cost by 68.5% while retaining the most comfortable thermal level and negligible EV SOC concerns considering the occupant’s behaviors. 
    more » « less