skip to main content


Title: Uniform polynomial rates of convergence for a class of Lévy-driven controlled SDEs arising in multiclass many-server queues
We study the ergodic properties of a class of controlled stochastic differential equations (SDEs) driven by a-stable processes which arise as the limiting equations of multiclass queueing models in the Halfin–Whitt regime that have heavy–tailed arrival processes. When the safety staffing parameter is positive, we show that the SDEs are uniformly ergodic and enjoy a polynomial rate of convergence to the invariant probability measure in total variation, which is uniform over all stationary Markov controls resulting in a locally Lipschitz continuous drift. We also derive a matching lower bound on the rate of convergence (under no abandonment). On the other hand, when all abandonment rates are positive, we show that the SDEs are exponentially ergodic uniformly over the above-mentioned class of controls. Analogous results are obtained for Lévy–driven SDEs arising from multiclass many-server queues under asymptotically negligible service interruptions. For these equations, we show that the aforementioned ergodic properties are uniform over all stationary Markov controls. We also extend a key functional central limit theorem concerning diffusion approximations so as to make it applicable to the models studied here.  more » « less
Award ID(s):
1715210
NSF-PAR ID:
10131768
Author(s) / Creator(s):
; ; ;
Date Published:
Journal Name:
Stochastic Control, Optimization, and Applications, Yin G., Zhang Q. (eds). The IMA Volumes in Mathematics and its Applications
Volume:
164
Page Range / eLocation ID:
1-20
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. null (Ed.)
    We study ergodic properties of Markovian multiclass many-server queues that are uniform over scheduling policies and the size of the system. The system is heavily loaded in the Halfin–Whitt regime, and the scheduling policies are work conserving and preemptive. We provide a unified approach via a Lyapunov function method that establishes Foster–Lyapunov equations for both the limiting diffusion and the prelimit diffusion-scaled queuing processes simultaneously. We first study the limiting controlled diffusion and show that if the spare capacity (safety staffing) parameter is positive, the diffusion is exponentially ergodic uniformly over all stationary Markov controls, and the invariant probability measures have uniform exponential tails. This result is sharp because when there is no abandonment and the spare capacity parameter is negative, the controlled diffusion is transient under any Markov control. In addition, we show that if all the abandonment rates are positive, the invariant probability measures have sub-Gaussian tails regardless whether the spare capacity parameter is positive or negative. Using these results, we proceed to establish the corresponding ergodic properties for the diffusion-scaled queuing processes. In addition to providing a simpler proof of previous results in Gamarnik and Stolyar [Gamarnik D, Stolyar AL (2012) Multiclass multiserver queueing system in the Halfin-Whitt heavy traffic regime: asymptotics of the stationary distribution. Queueing Systems 71(1–2):25–51], we extend these results to multiclass models with renewal arrival processes, albeit under the assumption that the mean residual life functions are bounded. For the Markovian model with Poisson arrivals, we obtain stronger results and show that the convergence to the stationary distribution is at an exponential rate uniformly over all work-conserving stationary Markov scheduling policies. 
    more » « less
  2. null (Ed.)
    Abstract We study ergodic properties of a class of Markov-modulated general birth–death processes under fast regime switching. The first set of results concerns the ergodic properties of the properly scaled joint Markov process with a parameter that is taken to be large. Under very weak hypotheses, we show that if the averaged process is exponentially ergodic for large values of the parameter, then the same applies to the original joint Markov process. The second set of results concerns steady-state diffusion approximations, under the assumption that the ‘averaged’ fluid limit exists. Here, we establish convergence rates for the moments of the approximating diffusion process to those of the Markov-modulated birth–death process. This is accomplished by comparing the generator of the approximating diffusion and that of the joint Markov process. We also provide several examples which demonstrate how the theory can be applied. 
    more » « less
  3. The past few decades have seen robust research on questions regarding the existence, form, and properties of stationary distributions of stochastically modeled reaction networks. When a stochastic model admits a stationary distribution an important practical question is: what is the rate of convergence of the distribution of the process to the stationary distribution? With the exception of [1] pertaining to models whose state space is restricted to the non-negative integers, there has been a notable lack of results related to this rate of convergence in the reaction network literature. This paper begins the process of filling that hole in our understanding. In this paper, we characterize this rate of convergence, via the mixing times of the processes, for two classes of stochastically modeled reaction networks. Specifically, by applying a Foster-Lyapunov criteria we establish exponential ergodicity for two classes of reaction networks introduced in [2]. Moreover, we show that for one of the classes the convergence is uniform over the initial state.

     
    more » « less
  4. Abstract Tropical areas with mean upward motion—and as such the zonal-mean intertropical convergence zone (ITCZ)—are projected to contract under global warming. To understand this process, a simple model based on dry static energy and moisture equations is introduced for zonally symmetric overturning driven by sea surface temperature (SST). Processes governing ascent area fraction and zonal mean precipitation are examined for insight into Atmospheric Model Intercomparison Project (AMIP) simulations. Bulk parameters governing radiative feedbacks and moist static energy transport in the simple model are estimated from the AMIP ensemble. Uniform warming in the simple model produces ascent area contraction and precipitation intensification—similar to observations and climate models. Contributing effects include stronger water vapor radiative feedbacks, weaker cloud-radiative feedbacks, stronger convection-circulation feedbacks, and greater poleward moisture export. The simple model identifies parameters consequential for the inter-AMIP-model spread; an ensemble generated by perturbing parameters governing shortwave water vapor feedbacks and gross moist stability changes under warming tracks inter-AMIP-model variations with a correlation coefficient ∼0.46. The simple model also predicts the multimodel mean changes in tropical ascent area and precipitation with reasonable accuracy. Furthermore, the simple model reproduces relationships among ascent area precipitation, ascent strength, and ascent area fraction observed in AMIP models. A substantial portion of the inter-AMIP-model spread is traced to the spread in how moist static energy and vertical velocity profiles change under warming, which in turn impact the gross moist stability in deep convective regions—highlighting the need for observational constraints on these quantities. Significance Statement A large rainband straddles Earth’s tropics. Most, but not all, climate models predict that this rainband will shrink under global warming; a few models predict an expansion of the rainband. To mitigate some of this uncertainty among climate models, we build a simpler model that only contains the essential physics of rainband narrowing. We find several interconnected processes that are important. For climate models, the most important process is the efficiency with which clouds move heat and humidity out of rainy regions. This efficiency varies among climate models and appears to be a primary reason for why climate models do not agree on the rate of rainband narrowing. 
    more » « less
  5. Abstract

    To understand the mechanisms underlying species coexistence, ecologists often study invasion growth rates of theoretical and data-driven models. These growth rates correspond to average per-capita growth rates of one species with respect to an ergodic measure supporting other species. In the ecological literature, coexistence often is equated with the invasion growth rates being positive. Intuitively, positive invasion growth rates ensure that species recover from being rare. To provide a mathematically rigorous framework for this approach, we prove theorems that answer two questions: (i) When do the signs of the invasion growth rates determine coexistence? (ii) When signs are sufficient, which invasion growth rates need to be positive? We focus on deterministic models and equate coexistence with permanence, i.e., a global attractor bounded away from extinction. For models satisfying certain technical assumptions, we introduce invasion graphs where vertices correspond to proper subsets of species (communities) supporting an ergodic measure and directed edges correspond to potential transitions between communities due to invasions by missing species. These directed edges are determined by the signs of invasion growth rates. When the invasion graph is acyclic (i.e. there is no sequence of invasions starting and ending at the same community), we show that permanence is determined by the signs of the invasion growth rates. In this case, permanence is characterized by the invasibility of all$$-i$$-icommunities, i.e., communities without speciesiwhere all other missing species have negative invasion growth rates. To illustrate the applicability of the results, we show that dissipative Lotka-Volterra models generically satisfy our technical assumptions and computing their invasion graphs reduces to solving systems of linear equations. We also apply our results to models of competing species with pulsed resources or sharing a predator that exhibits switching behavior. Open problems for both deterministic and stochastic models are discussed. Our results highlight the importance of using concepts about community assembly to study coexistence.

     
    more » « less