Search for: All records

The main objective of this paper is to establish a framework to study the co-adaptation between humans and automation systems in a haptic shared control framework. We specifically used this framework to design control transfer strategies between humans and automation systems to resolve a conflict when co-steering a semi-automated ground vehicle. The proposed framework contains three main parts. First, we defined a modular structure to separate partner-specific strategies from task-dependent representations and use this structure to learn different co-adaption strategies. In this structure, we assume the human and automation steering commands can be determined by optimizing cost functions. For each agent, the costs are defined as a combination of a set of hand-coded features and vectors of weights. The hand-coded features can be selected to describe task-dependent representations. On the other hand, the weight distributions over these features can be used as a proxy to determine the partner-specific conventions. Second, to leverage the learned co-adaptation strategies, we developed a map connecting different strategies to the outputs of human-automation interactions by employing a collaborative-competitive game concept. Finally, using the map, we designed an adaptable automation system capable of co-adapting to human driver’s strategies. Specifically, we designed an episode-based policy search using the deep deterministic policy gradients technique to determine the optimal weights vector distribution of automation’s cost function. The simulation results demonstrate that the handover strategies designed based on co-adaption between human and automation systems can successfully resolve a conflict and improve the performance of the human automation teaming. 

Abstract The primary aim of this research paper is to enhance the effectiveness of a two-level infrastructure-based control framework utilized for traffic management in expansive networks. The lower-level controller adjusts vehicle velocities to achieve the desired density determined by the upper-level controller. The upper-level controller employs a novel Lyapunov-based switched Newton extremum seeking control approach to ascertain the optimal vehicle density in congested cells where downstream bottlenecks are unknown, even in the presence of disturbances in the model. Unlike gradient-based approaches, the Newton algorithm eliminates the need for the unknown Hessian matrix, allowing for user-assignable convergence rates. The Lyapunov-based switched approach also ensures asymptotic convergence to the optimal set point. Simulation results demonstrate that the proposed approach, combining Newton’s method with user-assignable convergence rates and a Lyapunov-based switch, outperforms gradient-based extremum seeking in the hierarchical control framework.