skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Stable heteroclinic channels as a decision-making model: overcoming low signal-to-noise ratio with mutual inhibition
Abstract Bio-inspired robot controllers are becoming more complex as we strive to make them more robust to, and flexible in, noisy, real-world environments. A stable heteroclinic network (SHN) is a dynamical system that produces cyclical state transitions using noisy input. SHN-based robot controllers enable sensory input to be integrated at the phase-space level of the controller, thus simplifying sensor-integrated, robot control methods. In this work, we investigate the mechanism that drives branching state trajectories in SHNs. We liken the branching state trajectories to decision-splits imposed into the system, which opens the door for more sophisticated controls -- all driven by sensory input. This work provides guidelines to systematically define an SHN topology, and increase the rate at which desired decision states in the topology are chosen. Ultimately, we are able to control the rate at which desired decision states activate for input signal-to-noise ratios across six orders of magnitude.  more » « less
Award ID(s):
2047330
PAR ID:
10577297
Author(s) / Creator(s):
; ; ;
Publisher / Repository:
IOP Publishing
Date Published:
Journal Name:
Bioinspiration & Biomimetics
ISSN:
1748-3182
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Stable Heteroclinic Channels (SHCs) are dynamical systems composed of connected saddle equilibria. This work demonstrates a control system that combines SHCs with movement primitives to enable swimming in a simulated six segment snake robot. We identify control system parameters for lateral undulation, where all joints oscillate with the same amplitude, and anguilliform swimming, where joint amplitudes increase linearly from the head to the tail. Swimming speed is improved by learning SHC movement primitive parameters. We also propose a method for adapting the gait amplitude and frequency with tactile sensor input to accommodate obstacles. Then, we evaluate the relationship between SHC movement primitive parameters and the resulting trajectories. The swimming speed and efficiency of SHC controllers for each gait are compared against a conventional serpenoid controller, which derives joint trajectories from sinusoids. Controllers are evaluated first in an unobstructed environment, then in straight passages of various widths, and finally in 65 randomly generated uneven channels. We find that the amplitudes of joint oscillations scale proportionally with the SHC controller parameters. Due to gait optimization, as well as adaptive amplitude and frequency in response to tactile input, the learned SHC control system exhibits an average 28.8% greater speed than a serpenoid controller that only adapts amplitude during contact. This research demonstrates that SHCs benefit from intuitive tuning like serpenoid control, while also effectively incorporating sensory information to generate smooth kinematic trajectories. 
    more » « less
  2. null (Ed.)
    The performance of hierarchical Model Predictive Control (MPC) is highly dependent on the mechanisms used to coordinate the decisions made by controllers at different levels of the hierarchy. Conventionally, reference tracking serves as the primary coordination mechanism, where optimal state and input trajectories determined by upper-level controllers are communicated down the hierarchy to be tracked by lower-level controllers. As such, significant tuning is required for each controller in the hierarchy to achieve the desired closed-loop system performance. This paper presents a novel terminal cost coordination mechanism using constrained zonotopes, designed to improve system performance under hierarchical control. These terminal costs allow lower-level controllers to balance both short- and long-term control performance without the need for controller tuning. Unlike terminal costs widely used to guarantee MPC stability, the proposed terminal costs are time-varying and computed on-line based on the optimal state trajectory of the upper-level controllers. A numerical example demonstrates the provable performance benefits achieved using the proposed terminal cost coordination mechanism. 
    more » « less
  3. null (Ed.)
    We consider the decentralized control of a discretetime, linear system subject to exogenous disturbances and polyhedral constraints on the state and input trajectories. The underlying system is composed of a finite collection of dynamically coupled subsystems, where each subsystem is assumed to have a dedicated local controller. The decentralization of information is expressed according to sparsity constraints on the state measurements that each local controller has access to. In this context, we investigate the design of decentralized controllers that are affinely parameterized in their measurement history. For problems with partially nested information structures, the optimization over such policy spaces is known to be convex. Convexity is not, however, guaranteed under more general (nonclassical) information structures in which the information available to one local controller can be affected by control actions that it cannot access or reconstruct. With the aim of alleviating the nonconvexity that arises in such problems, we propose an approach to decentralized control design where the information-coupling states are effectively treated as disturbances whose trajectories are constrained to take values in ellipsoidal contract sets whose location, scale, and orientation are jointly optimized with the underlying affine decentralized control policy. We establish a natural structural condition on the space of allowable contracts that facilitates the joint optimization over the control policy and the contract set via semidefinite programming. 
    more » « less
  4. In the quest to model neuronal function amid gaps in physiological data, a promising strategy is to develop a normative theory that interprets neuronal physiology as optimizing a computational objective. This study extends current normative models, which primarily optimize prediction, by conceptualizing neurons as optimal feedback controllers. We posit that neurons, especially those beyond early sensory areas, steer their environment toward a specific desired state through their output. This environment comprises both synaptically interlinked neurons and external motor sensory feedback loops, enabling neurons to evaluate the effectiveness of their control via synaptic feedback. To model neurons as biologically feasible controllers which implicitly identify loop dynamics, infer latent states, and optimize control we utilize the contemporary direct data-driven control (DD-DC) framework. Our DD-DC neuron model explains various neurophysiological phenomena: the shift from potentiation to depression in spike-timing-dependent plasticity with its asymmetry, the duration and adaptive nature of feedforward and feedback neuronal filters, the imprecision in spike generation under constant stimulation, and the characteristic operational variability and noise in the brain. Our model presents a significant departure from the traditional, feedforward, instant-response McCulloch–Pitts–Rosenblatt neuron, offering a modern, biologically informed fundamental unit for constructing neural networks. 
    more » « less
  5. Human teams are able to easily perform collaborative manipulation tasks. However, simultaneously manipulating a large extended object for a robot and human is a difficult task due to the inherent ambiguity in the desired motion. Our approach in this paper is to leverage data from human-human dyad experiments to determine motion intent for a physical human-robot co-manipulation task. We do this by showing that the human-human dyad data exhibits distinct torque triggers for a lateral movement. As an alternative intent estimation method, we also develop a deep neural network based on motion data from human-human trials to predict future trajectories based on past object motion. We then show how force and motion data can be used to determine robot control in a human-robot dyad. Finally, we compare human-human dyad performance to the performance of two controllers that we developed for human-robot co-manipulation. We evaluate these controllers in three-degree-of-freedom planar motion where determining if the task involves rotation or translation is ambiguous. 
    more » « less