skip to main content

Title: A Reinforcement Learning-Based Admission Control Strategy for Elastic Network Slices
This paper addresses the problem of admission control for elastic network slices that may dynamically adjust provisioned bandwidth levels over time. When admitting new slice requests, sufficient spare capacity must be reserved to allow existing elastic slices to dynamically increase their bandwidth allocation when needed. We demonstrate a lightweight deep Reinforcement Learning (RL) model to intelligently make ad-mission control decisions for elastic slice requests and inelastic slice requests. This model achieves higher revenue and higher acceptance rates compared to traditional heuristic methods. Due to the lightness of this model, it can be deployed without GPUs. We can also use a relatively small amount of data to train the model and to achieve stable performance. Also, we introduce a Recurrent Neural Network to encode the variable-size environment and train the encoder with the RL model together.
; ; ;
Award ID(s):
Publication Date:
Journal Name:
2021 IEEE Global Communications Conference (GLOBECOM)
Page Range or eLocation-ID:
01 to 06
Sponsoring Org:
National Science Foundation
More Like this
  1. This paper addresses a routing selection strategy for elastic network slices that dynamically adjust required resources over time. When admitting elastic initial slice requests, sufficient spare resources on the same path should be reserved to allow existing elastic slices to increase their bandwidth dynamically. We demonstrate a deep Reinforcement Learning (RL) model to intelligently make routing choice decisions for elastic slice requests and inelastic slice requests. This model achieves higher revenue and higher acceptance rates compared to traditional heuristic methods. Due to the lightness of this model, it can be deployed in an embedded system. We can also use a relatively small amount of data to train the model and achieve stable performance. Also, we introduce a Recurrent Neural Network to auto-encode the variable-size environment and train the encoder together with the RL model.
  2. A key dimension of reproducibility in testbeds is stable performance that scales in regular and predictable ways in accordance with declarative specifications for virtual resources. We contend that reproducibility is crucial for elastic performance control in live experiments, in which testbed tenants (slices) provide services for real user traffic that varies over time. This paper gives an overview of ExoPlex, a framework for deploying network service providers (NSPs) as a basis for live inter-domain networking experiments on the ExoGENI testbed. As a motivating example, we show how to use ExoPlex to implement a virtual software-defined exchange (vSDX) as a tenant NSP. The vSDX implements security-managed interconnection of customer IP networks that peer with it via direct L2 links stitched dynamically into its slice. An elastic controller outside of the vSDX slice provisions network links and computing capacity for a scalable monitoring fabric within the tenant vSDX slice. The vSDX checks compliance of traffic flows with customer-specified interconnection policies, and blocks traffic from senders that trigger configured rules for intrusion detection in Bro security monitors. We present initial results showing the effect of resource provisioning on Bro performance within the vSDX.
  3. In order to meet the performance/privacy require- ments of future data-intensive mobile applications, e.g., self- driving cars, mobile data analytics, and AR/VR, service providers are expected to draw on shared storage/computation/connectivity resources at the network “edge”. To be cost-effective, a key functional requirement for such infrastructure is enabling the shar- ing of heterogeneous resources amongst tenants/service providers supporting spatially varying and dynamic user demands. This paper proposes a resource allocation criterion, namely, Share Constrained Slicing (SCS), for slices allocated predefined shares of the network’s resources, which extends traditional α−fairness criterion, by striking a balance among inter- and intra-slice fairness vs. overall efficiency. We show that SCS has several desirable properties including slice-level protection, envyfreeness, and load- driven elasticity. In practice, mobile users’ dynamics could make the cost of implementing SCS high, so we discuss the feasibility of using a simpler (dynamically) weighted max-min as a surrogate resource allocation scheme. For a setting with stochastic loads and elastic user requirements, we establish a sufficient condition for the stability of the associated coupled network system. Finally, and perhaps surprisingly, we show via extensive simulations that while SCS (and/or the surrogate weighted max-min allocation) provides inter-slice protection, they can achieve improved job delaymore »and/or perceived throughput, as compared to other weighted max- min based allocation schemes whose intra-slice weight allocation is not share-constrained, e.g., traditional max-min or discriminatory processor sharing.« less
  4. Abstract Background The brain extracellular environment is involved in many critical processes associated with neurodevelopment, neural function, and repair following injury. Organization of the extracellular matrix and properties of the extracellular space vary throughout development and across different brain regions, motivating the need for platforms that provide access to multiple brain regions at different stages of development. We demonstrate the utility of organotypic whole hemisphere brain slices as a platform to probe regional and developmental changes in the brain extracellular environment. We also leverage whole hemisphere brain slices to characterize the impact of cerebral ischemia on different regions of brain tissue. Results Whole hemisphere brain slices taken from postnatal (P) day 10 and P17 rats retained viable, metabolically active cells through 14 days in vitro (DIV). Oxygen-glucose-deprivation (OGD), used to model a cerebral ischemic event in vivo, resulted in reduced slice metabolic activity and elevated cell death, regardless of slice age. Slices from P10 and P17 brains showed an oligodendrocyte and microglia-driven proliferative response after OGD exposure, higher than the proliferative response seen in DIV-matched normal control slices. Multiple particle tracking in oxygen-glucose-deprived brain slices revealed that oxygen-glucose-deprivation impacts the extracellular environment of brain tissue differently depending on brain age andmore »brain region. In most instances, the extracellular space was most difficult to navigate immediately following insult, then gradually provided less hindrance to extracellular nanoparticle diffusion as time progressed. However, changes in diffusion were not universal across all brain regions and ages. Conclusions We demonstrate whole hemisphere brain slices from P10 and P17 rats can be cultured up to two weeks in vitro. These brain slices provide a viable platform for studying both normal physiological processes and injury associated mechanisms with control over brain age and region. Ex vivo OGD impacted cortical and striatal brain tissue differently, aligning with preexisting data generated in in vivo models. These data motivate the need to account for both brain region and age when investigating mechanisms of injury and designing potential therapies for cerebral ischemia.« less
  5. Multi-user oblivious storage allows users to access their shared data on the cloud while retaining access pattern obliviousness and data confidentiality simultaneously. Most secure and efficient oblivious storage systems focus on the utilization of the maximum network bandwidth in serving concurrent accesses via a trusted proxy. How- ever, since the proxy executes a standard ORAM protocol over the network, the performance is capped by the network bandwidth and latency. Moreover, some important features such as access control and security against active adversaries have not been thoroughly explored in such proxy settings. In this paper, we propose MOSE, a multi-user oblivious storage system that is efficient and enjoys from some desirable security properties. Our main idea is to harness a secure enclave, namely Intel SGX, residing on the untrusted storage server to execute proxy logic, thereby, minimizing the network bottleneck of proxy-based designs. In this regard, we address various technical design challenges such as memory constraints, side-channel attacks and scalability issues when enabling proxy logic in the secure enclave. We present a formal security model and analysis for secure enclave multi-user ORAM with access control. We optimize MOSE to boost its throughput in serving concurrent requests. We implemented MOSE and evaluatedmore »its performance on commodity hardware. Our evaluation confirmed the efficiency of MOSE, where it achieves approximately two orders of magnitudes higher throughput than the state-of-the-art proxy-based design, and also, its performance is scalable proportional to the available system resources.« less