skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Total-delay-based Max Pressure: A Max Pressure Algorithm Considering Delay Equity
This paper proposes a novel decentralized signal control algorithm that seeks to improve traffic delay equity, measured as the variation of delay experienced by individual vehicles. The proposed method extends the recently developed delay-based max pressure (MP) algorithm by using the sum of cumulative delay experienced by all vehicles that joined a given link as the metric for weight calculation. Doing so ensures the movements with lower traffic loads have a higher chance of being served as their delay increases. Three existing MP models are used as baseline models with which to compare the proposed algorithm in microscopic simulations of both a single intersection and a grid network. The results indicate that the proposed algorithm can improve the delay equity for various traffic conditions, especially for highly unbalanced traffic flows. Moreover, this improvement in delay equity does not come with a significant increase to average delay experienced by all vehicles. In fact, the average delay from the proposed algorithm is close to—and sometimes even lower than—the baseline models. Therefore, the proposed algorithm can maintain both objectives at the same time. In addition, the performance of the proposed control strategy was tested in a connected vehicle environment. The results show that the proposed algorithm outperforms the other baseline models in both reducing traffic delay and increasing delay equity when the penetration rate is less or equal to 60%, which would not be exceeded in reality in the near future.  more » « less
Award ID(s):
1749200
PAR ID:
10403492
Author(s) / Creator(s):
;
Date Published:
Journal Name:
Transportation Research Record: Journal of the Transportation Research Board
ISSN:
0361-1981
Page Range / eLocation ID:
036119812211470
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Max-pressure (MP) signal timing is an actuated decentralized signal control policy. Rigorous mathematical studies have proven the stability properties and established the benefits of different MP policies. However, theoretical studies make assumptions about traffic properties that may not represent reality and whose effects are not explored much in the literature under realistic traffic conditions. This study focuses on examining how different variations of MP perform in realistic scenarios and on finding the most practical policy among those for implementation in real roads. Microsimulation models of seven intersections from two corridors, County Road (CR) 30 and CR 109 from Hennepin County, Minnesota were created. Real-life demand and current signal timing data provided by Hennepin County were used to make the simulations as close to reality as possible. In this paper, we compare the performance of current actuated-coordinated signal control with an acyclic MP and two variations of cyclic MP policies. We present the performance of different control policies as delay, throughput, worst lane delay, and number of phase changes. We also present how different parameters affect the performance of the MP policies. We found that better performance can be achieved with a cyclic MP policy by allowing phase skipping when no vehicles are waiting. Our findings also suggest that most of the claimed performance benefits can still be achieved in real-life traffic conditions even with the simplified assumptions made in the theoretical models. In most cases, MP control policies outperformed current signal control. 
    more » « less
  2. Hybrid traffic which involves both autonomous and human-driven vehicles would be the norm of the autonomous vehicles’ practice for a while. On the one hand, unlike autonomous vehicles, human-driven vehicles could exhibit sudden abnormal behaviors such as unpredictably switching to dangerous driving modes – putting its neighboring vehicles under risks; such undesired mode switching could arise from numbers of human driver factors, including fatigue, drunkenness, distraction, aggressiveness, etc. On the other hand, modern vehicle-to-vehicle (V2V) communication technologies enable the autonomous vehicles to efficiently and reliably share the scarce run-time information with each other [1]. In this paper, we propose, to the best of our knowledge, the first efficient algorithm that can (1) significantly improve trajectory prediction by effectively fusing the run-time information shared by surrounding autonomous vehicles, and can (2) accurately and quickly detect abnormal human driving mode switches or abnormal driving behavior with formal assurance without hurting human drivers’ privacy. To validate our proposed algorithm, we first evaluate our proposed trajectory predictor on NGSIM and Argoverse datasets and show that our proposed predictor outperforms the baseline methods. Then through extensive experiments on SUMO simulator, we show that our proposed algorithm has great detection performance in both highway and urban traffic. The best performance achieves detection rate of\(97.3\% \), average detection delay of 1.2s, and 0 false alarm. 
    more » « less
  3. This paper studies the learning-based optimal control for a class of infinite-dimensional linear time-delay systems. The aim is to fill the gap of adaptive dynamic programming (ADP) where adaptive optimal control of infinite-dimensional systems is not addressed. A key strategy is to combine the classical model-based linear quadratic (LQ) optimal control of time-delay systems with the state-of-art reinforcement learning (RL) technique. Both the model-based and data-driven policy iteration (PI) approaches are proposed to solve the corresponding algebraic Riccati equation (ARE) with guaranteed convergence. The proposed PI algorithm can be considered as a generalization of ADP to infinite-dimensional time-delay systems. The efficiency of the proposed algorithm is demonstrated by the practical application arising from autonomous driving in mixed traffic environments, where human drivers’ reaction delay is considered. 
    more » « less
  4. null (Ed.)
    We consider an LTE downlink scheduling system where a base station allocates resource blocks (RBs) to users running delay-sensitive applications. We aim to find a scheduling policy that minimizes the queuing delay experienced by the users. We formulate this problem as a Markov Decision Process (MDP) that integrates the channel quality indicator (CQI) of each user in each RB, and queue status of each user. To solve this complex problem involving high dimensional state and action spaces, we propose a Deep Reinforcement Learning based scheduling framework that utilizes the Deep Deterministic Policy Gradient (DDPG) algorithm to minimize the queuing delay experienced by the users. Our extensive experiments demonstrate that our approach outperforms state-of-the-art benchmarks in terms of average throughput, queuing delay, and fairness, achieving up to 55% lower queuing delay than the best benchmark. 
    more » « less
  5. Recently, switched Ethernet has become increasingly popular in networked cyber-physical systems (NCPS). In an Ethernet-based NCPS, network-connected devices (e.g., sensors and actuators) realize time-critical tasks by exchanging miscellaneous information, such as sensor readings and control commands. To ensure reliable control and operation, network-induced delays for time-critical NCPS applications must be carefully examined. In this work, we propose a framework combining network delay measurements and network-calculus-based delay performance analysis to obtain accurate, deterministic worst-case delay bounds for NCPS. By modeling traffic sources and networking devices (e.g., Ethernet switches) through measurements, we establish accurate traffic and device models for network-calculus-based analysis. To obtain worst-case delay bounds, different network-calculus-based analytical methods can be leveraged, allowing CPS architects to customize the proposed delay analysis framework to suit application-specific needs. Our evaluation results show that the proposed approach derives accurate delay bounds, making it a valuable tool for architects designing NCPSs supporting time-critical applications. 
    more » « less