skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Stable heteroclinic channels as a decision-making model: overcoming low signal-to-noise ratio with mutual inhibition
Abstract Bio-inspired robot controllers are becoming more complex as we strive to make them more robust to, and flexible in, noisy, real-world environments. A stable heteroclinic network (SHN) is a dynamical system that produces cyclical state transitions using noisy input. SHN-based robot controllers enable sensory input to be integrated at the phase-space level of the controller, thus simplifying sensor-integrated, robot control methods. In this work, we investigate the mechanism that drives branching state trajectories in SHNs. We liken the branching state trajectories to decision-splits imposed into the system, which opens the door for more sophisticated controls -- all driven by sensory input. This work provides guidelines to systematically define an SHN topology, and increase the rate at which desired decision states in the topology are chosen. Ultimately, we are able to control the rate at which desired decision states activate for input signal-to-noise ratios across six orders of magnitude.  more » « less
Award ID(s):
2047330
PAR ID:
10577297
Author(s) / Creator(s):
; ; ;
Publisher / Repository:
IOP Publishing
Date Published:
Journal Name:
Bioinspiration & Biomimetics
ISSN:
1748-3182
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Stable Heteroclinic Channels (SHCs) are dynamical systems composed of connected saddle equilibria. This work demonstrates a control system that combines SHCs with movement primitives to enable swimming in a simulated six segment snake robot. We identify control system parameters for lateral undulation, where all joints oscillate with the same amplitude, and anguilliform swimming, where joint amplitudes increase linearly from the head to the tail. Swimming speed is improved by learning SHC movement primitive parameters. We also propose a method for adapting the gait amplitude and frequency with tactile sensor input to accommodate obstacles. Then, we evaluate the relationship between SHC movement primitive parameters and the resulting trajectories. The swimming speed and efficiency of SHC controllers for each gait are compared against a conventional serpenoid controller, which derives joint trajectories from sinusoids. Controllers are evaluated first in an unobstructed environment, then in straight passages of various widths, and finally in 65 randomly generated uneven channels. We find that the amplitudes of joint oscillations scale proportionally with the SHC controller parameters. Due to gait optimization, as well as adaptive amplitude and frequency in response to tactile input, the learned SHC control system exhibits an average 28.8% greater speed than a serpenoid controller that only adapts amplitude during contact. This research demonstrates that SHCs benefit from intuitive tuning like serpenoid control, while also effectively incorporating sensory information to generate smooth kinematic trajectories. 
    more » « less
  2. Abstract Proprioceptive sensory feedback is crucial for the control of movement. In many ways, sensorimotor control loops in the neuromuscular system act as state feedback controllers. These controllers combine input commands and sensory feedback regarding the mechanical state of the muscle, joint or limb to modulate the mechanical output of the muscles. To understand how these control circuits function, it is necessary to understand fully the mechanical state variables that are signalled by proprioceptive sensory (propriosensory) afferents. Using new computational approaches, we demonstrate how combinations of group Ia and II muscle spindle afferent feedback can allow for tuned responses to force and the rate of force (or length and velocity) and how combinations of muscle spindle and Golgi tendon organ feedback can parse external and internal (self‐generated) force. These models suggest that muscle spindle feedback might be used to monitor and control muscle forces in addition to length and velocity and, when combined with tendon organ feedback, can distinguish self‐generated from externally imposed forces. Given that these models combine feedback from different sensory afferent types, they emphasize the utility of analysing muscle propriosensors as an integrated population, rather than independently, to gain a better understanding of propriosensory–motor control. Furthermore, these models propose a framework that links neural connectivity in the spinal cord with neuromechanical control. Although considerable work has been done on propriosensory–motor pathways in the CNS, our aim is to build upon this work by emphasizing the mechanical context. 
    more » « less
  3. null (Ed.)
    The performance of hierarchical Model Predictive Control (MPC) is highly dependent on the mechanisms used to coordinate the decisions made by controllers at different levels of the hierarchy. Conventionally, reference tracking serves as the primary coordination mechanism, where optimal state and input trajectories determined by upper-level controllers are communicated down the hierarchy to be tracked by lower-level controllers. As such, significant tuning is required for each controller in the hierarchy to achieve the desired closed-loop system performance. This paper presents a novel terminal cost coordination mechanism using constrained zonotopes, designed to improve system performance under hierarchical control. These terminal costs allow lower-level controllers to balance both short- and long-term control performance without the need for controller tuning. Unlike terminal costs widely used to guarantee MPC stability, the proposed terminal costs are time-varying and computed on-line based on the optimal state trajectory of the upper-level controllers. A numerical example demonstrates the provable performance benefits achieved using the proposed terminal cost coordination mechanism. 
    more » « less
  4. null (Ed.)
    We consider the decentralized control of a discretetime, linear system subject to exogenous disturbances and polyhedral constraints on the state and input trajectories. The underlying system is composed of a finite collection of dynamically coupled subsystems, where each subsystem is assumed to have a dedicated local controller. The decentralization of information is expressed according to sparsity constraints on the state measurements that each local controller has access to. In this context, we investigate the design of decentralized controllers that are affinely parameterized in their measurement history. For problems with partially nested information structures, the optimization over such policy spaces is known to be convex. Convexity is not, however, guaranteed under more general (nonclassical) information structures in which the information available to one local controller can be affected by control actions that it cannot access or reconstruct. With the aim of alleviating the nonconvexity that arises in such problems, we propose an approach to decentralized control design where the information-coupling states are effectively treated as disturbances whose trajectories are constrained to take values in ellipsoidal contract sets whose location, scale, and orientation are jointly optimized with the underlying affine decentralized control policy. We establish a natural structural condition on the space of allowable contracts that facilitates the joint optimization over the control policy and the contract set via semidefinite programming. 
    more » « less
  5. Everyday locomotion is a complex sensorimotor process that can unfold over multiple timescales, from long-term path planning to rapid, reactive adjustments. However, we lack an understanding of how factors such as environmental demands, or the available sensory information simultaneously influence these control timescales. To address this, we present a unified data-driven framework to quantify the control timescales by identifying how early we can predict future actions from past inputs. We apply this framework across tasks including walking and running, environmental contexts including treadmill, overground, and varied terrains, and sensory input modalities including gaze fixations and body states. We find that deep neural network architectures that effectively handle long-range dependencies, specifically Gated Recurrent Units and Transformers, outperform other architectures and widely used linear models when predicting future actions. Our framework reveals the factors that influence locomotor foot placement control timescales. Across environmental contexts, we discover that humans rely more on fast timescale control in more complex terrain. Across input modalities, we find a hierarchy of control timescales where gaze predicts foot placement before full-body states, which predict before center-of-mass states. Our model also identifies mid-swing as a critical phase when the swing foot's state predicts its future placement, with this timescale adapting across environments. Overall, this work offers data-driven insights into locomotor control in everyday settings, offering models that can be integrated with rehabilitation technologies and movement simulations to improve their applicability in everyday settings. 
    more » « less