skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Risk-Aware Stochastic Control of a Sailboat
Not AvailableSailboat path-planning is a natural hybrid control problem (due to continuous steering and occasional “tack-switching” maneuvers), with the actual path-to-target greatly affected by stochastically evolving wind conditions. Previous studies have focused on finding risk-neutral policies that minimize the expected time of arrival. In contrast, we present a robust control approach, which maximizes the probability of arriving before a specified deadline/threshold. Our numerical method recovers the optimal risk-aware (and threshold-specific) policies for all initial sailboat positions and a broad range of thresholds simultaneously. This is accomplished by solving two quasi-variational inequalities based on second-order Hamilton-Jacobi-Bellman (HJB) PDEs with degenerate parabolicity. Monte-Carlo simulations show that risk-awareness in sailing is particularly useful when a carefully calculated bet on the evolving wind direction might yield a reduction in the number of tack-switches.  more » « less
Award ID(s):
2111522 1645643
PAR ID:
10655925
Author(s) / Creator(s):
 ;  ;  ;  ;  
Publisher / Repository:
IEEE, 2024 American Control Conference (ACC), Toronto, ON, Canada, 2024
Date Published:
Page Range / eLocation ID:
5460 to 5465
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. null (Ed.)
    The shared nature of the wireless medium induces contention between data transport and backward signaling, such as acknowledgment. The current way of TCP acknowledgment induces control overhead which is counter-productive for TCP performance especially in wireless local area network (WLAN) scenarios. In this paper, we present a new acknowledgment called TACK (“Tame ACK”), as well as its TCP implementation TCP-TACK. TACK seeks to minimize ACK frequency, which is exactly what is required by transport. TCP-TACK works on top of commodity WLAN, delivering high wireless transport goodput with minimal control overhead in the form of ACKs, without any hardware modification. Evaluation results show that TCP-TACK achieves significant advantages over legacy TCP in WLAN scenarios due to less contention between data packets and ACKs. Specifically, TCP-TACK reduces over 90% of ACKs and also obtains an improvement of up to 28% on goodput. A TACK-based protocol is a good replacement of the legacy TCP to compensate for scenarios where the acknowledgment overhead is non-negligible. 
    more » « less
  2. The shared nature of the wireless medium induces contention between data transport and backward signaling, such as acknowledgement. The current way of TCP acknowledgment induces control overhead which is counter-productive for TCP performance especially in wireless local area network (WLAN) scenarios.In this paper, we present a new acknowledgement called TACK ("Tame ACK"), as well as its TCP implementation TCP-TACK. TCP-TACK works on top of commodity WLAN, delivering high wireless transport goodput with minimal control overhead in the form of ACKs, without any hardware modification. To minimize ACK frequency, TACK abandons the legacy received-packet-driven ACK. Instead, it balances byte-counting ACK and periodic ACK so as to achieve a controlled ACK frequency. Evaluation results show that TCP-TACK achieves significant advantages over legacy TCP in WLAN scenarios due to less contention between data packets and ACKs. Specifically, TCP-TACK reduces over 90% of ACKs and also obtains an improvement of ~ 28% on good-put. We further find it performs equally well as high-speed TCP variants in wide area network (WAN) scenarios, this is attributed to the advancements of the TACK-based protocol design in loss recovery, round-trip timing, and send rate control. 
    more » « less
  3. Although adaptive cancer therapy shows promise in integrating evolutionary dynamics into treatment scheduling, the stochastic nature of cancer evolution has seldom been taken into account. Various sources of random perturbations can impact the evolution of heterogeneous tumors, making performance metrics of any treatment policy random as well. In this paper, we propose an efficient method for selecting optimal adaptive treatment policies under randomly evolving tumor dynamics. The goal is to improve the cumulative “cost” of treatment, a combination of the total amount of drugs used and the total treatment time. As this cost also becomes random in any stochastic setting, we maximize the probability of reaching the treatment goals (tumor stabilization or eradication) without exceeding a pre-specified cost threshold (or a “budget”). We use a novel Stochastic Optimal Control formulation and Dynamic Programming to find such “threshold-aware” optimal treatment policies. Our approach enables an efficient algorithm to compute these policies for a range of threshold values simultaneously. Compared to treatment plans shown to be optimal in a deterministic setting, the new “threshold-aware” policies significantly improve the chances of the therapy succeeding under the budget, which is correlated with a lower general drug usage. We illustrate this method using two specific examples, but our approach is far more general and provides a new tool for optimizing adaptive therapies based on a broad range of stochastic cancer models. 
    more » « less
  4. Abstract Wind erosion and dust emissions affect regions of the world with sparse vegetation cover or affected by agricultural practices that expose the soil surface to wind action. Although several studies have investigated the impact of soil moisture, land use and land cover on soil susceptibility to wind erosion and dust emissions, the effect of surface soil salinity and sodicity on dust emissions, remains poorly understood. Salt accumulation in agricultural soils is a major concern in agroecosystems with high evaporative demand, shallow water tables or irrigated with water rich in dissolved solids. Recent studies have focused on the effect of soil salinity on soil erodibility in dry atmospheric conditions, while the effect of soil salinity and sodicity in more humid conditions still needs to be investigated. Here we use wind tunnel tests to study the effect of high atmospheric humidity on wind erodibility and particulate matter emissions under saline and sodic conditions. We find that the threshold velocity for wind erosion significantly increases with increasing soil salinity and sodicity, provided that the soil crust formed by soil salts is not disturbed. Indeed, with increasing soil salinity, the formation of a soil crust of increasing strength is observed, leading to an increase in the threshold wind velocity and a consequent decrease in particulate emissions. Interestingly, after the threshold velocity was exceeded, soil crusts were readily ruptured by saltating sand grains resulting in comparable or sometimes even higher particulate matter emissions in saline and sodic soils compared to their untreated (‘control’) counterparts which can be explained by salinity‐induced aggregation and sodicity‐driven clay dispersion effects. Lastly, understanding the role of atmospheric humidity under changing climate scenarios will help to modulate the wind erosion processes in saline‐sodic soils and will help mitigate better dust emissions and soil management policies in arid and semi‐arid climate zones. 
    more » « less
  5. Wind erosion and dust emissions affect regions of the world with sparse vegetation cover or affected by agricultural practices that expose the soil surface to wind action. Research in this field has investigated the impact of soil moisture, land use, and land cover on soil susceptibility to wind erosion and dust emissions. The effect of soil salinity and sodicity, however, remains poorly appreciated. Salt accumulation in agricultural soils is a major concern in agroecosystems with high evaporative demand, shallow water tables or irrigated with water rich in dissolved solids. The understanding of how salts can affect aeolian processes in arid and hyper-arid landscapes remains incomplete. Recent studies focused on the effect of soil salinity on soil erodibility in dry atmospheric conditions, while the effect of soil sodicity and more humid conditions still needs to be investigated. Here we use wind tunnel tests to detect the effect of varying atmospheric humidity on wind erodibility and particulate matter emissions under saline and sodic conditions.Through a series of controlled wind tunnel experiments of soils treated with different concentrations of saline and sodic water, we find that the threshold velocity for wind erosion significantly increases with increasing soil salinity and sodicity, provided that the soil crust formed by soil salts is not disturbed. Indeed, with increasing soil salinity, the formation of a soil crust of increasing strength is observed, leading to an increase in the threshold wind velocity and a consequent decrease in particulate emissions. However, if the crust is destroyed by trampling, no significant changes in threshold velocity for wind erosion are found with increasing salinity and sodicity levels. Interestingly, after the threshold velocity was exceeded, soil crusts were readily ruptured by saltating sand grains resulting in comparable or sometimes even higher particulate matter emissions in saline and sodic soils compared to their untreated ('control') counterparts. Finally, understanding the role of atmospheric humidity under changing climate scenarios will help to modulate the wind erosion processes in saline-sodic soils and will help mitigate better dust emissions and soil management policies in arid and semi-arid climate zones. 
    more » « less