Significance Nervous systems use highly effective layered architectures in the sensorimotor control system to minimize the harmful effects of delay and inaccuracy in biological components. To study what makes effective architectures, we develop a theoretical framework that connects the component speed–accuracy trade-offs (SATs) with system SATs and characterizes the system performance of a layered control system. We show that diversity in layers (e.g., planning and reflex) allows fast and accurate sensorimotor control, even when each layer uses slow or inaccurate components. We term such phenomena “diversity-enabled sweet spots (DESSs).” DESSs explain and link the extreme heterogeneities in axon sizes and numbers and the resulting robust performance in sensorimotor control.
more »
« less
Theoretical foundations for layered architectures and speed-accuracy tradeoffs in sensorimotor control
Nervous systems sense, communicate, compute, and actuate movement, using distributed hardware with tradeoffs in speed and accuracy. The resulting sensorimotor control is nevertheless remarkably fast and accurate due to highly effective layered architectures. However, such architectures have received little attention in neuroscience due to the lack of theory that connects the system and hardware level speed-accuracy tradeoffs. In this paper, we present a theoretical framework that connects the speed-accuracy tradeoffs of sensorimotor control and neurophysiology. We characterize how the component SATs in spiking neuron communication and their sensory and muscle endpoints constrain the system SATs in both stochastic and deterministic models. The results show that appropriate speed -accuracy diversity at the neurons/muscles levels allow nervous systems to improve the speed and accuracy in control performance despite using slow or inaccurate hardware. Then, we characterize the fundamental limits of layered control systems and show that appropriate diversity in planning and reaction layers leads to both fast and accurate system despite being composed of slow or inaccurate layers. We term these phenomena “Diversity Sweet Spots.” The theory presented here is illustrated in a companion paper, which introduces simple demos and a new inexpensive and easy-to-use experimental platform.
more »
« less
- Award ID(s):
- 1735003
- PAR ID:
- 10155678
- Date Published:
- Journal Name:
- 2019 American Control Conference
- Page Range / eLocation ID:
- 809 to 814
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
This paper describes several surprisingly rich but simple demos and a new experimental platform for human sensorimotor control research and also controls education. The platform safely simulates a canonical sensorimotor task of riding a mountain bike down a steep, twisting, bumpy trail using a standard display and inexpensive off-the-shelf gaming steering wheel with a force feedback motor. We use the platform to verify our theory, presented in a companion paper. The theory tells how component hardware speed-accuracy tradeoffs (SATs) in control loops impose corresponding SATs at the system level and how effective architectures mitigate the deleterious impact of hardware SATs through layering and “diversity sweet spots” (DSSs). Specifically, we measure the impacts on system performance of delays, quantization, and uncertainties in sensorimotor control loops, both within the subject's nervous system and added externally via software in the platform. This provides a remarkably rich test of the theory, which is consistent with all preliminary data. Moreover, as the theory predicted, subjects effectively multiplex specific higher layer planning/tracking of the trail using vision with lower layer rejection of unseen bump disturbances using reflexes. In contrast, humans multitask badly on tasks that do not naturally distribute across layers (e.g. texting and driving). The platform is cheap to build and easy to program for both research and education purposes, yet verifies our theory, which is aimed at closing a crucial gap between neurophysiology and sensorimotor control. The platform can be downloaded at https://github.com/Doyle-Lab/WheelCon.more » « less
-
Noises are ubiquitous in sensorimotor interactions and contaminate the information provided to the central nervous system (CNS) for motor learning. An interesting question is how the CNS manages motor learning with imprecise information. Integrating ideas from reinforcement learning and adaptive optimal control, this paper develops a novel computational mechanism to explain the robustness of human motor learning to the imprecise information, caused by control-dependent noise that exists inherently in the sensorimotor systems. Starting from an initial admissible control policy, in each learning trial the mechanism collects and uses the noisy sensory data (caused by the control-dependent noise) to form an imprecise evaluation of the performance of the current policy and then constructs an updated policy based on the imprecise evaluation. As the number of learning trials increases, the generated policies mathematically provably converge to a (potentially small) neighborhood of the optimal policy under mild conditions, despite the imprecise information in the learning process. The mechanism directly synthesizes the policies from the sensory data, without identifying an internal forward model. Our preliminary computational results on two classic arm reaching tasks are in line with experimental observations reported in the literature. The model-free control principle proposed in the paper sheds more lights into the inherent robustness of human sensorimotor systems to the imprecise information, especially control-dependent noise, in the CNS.more » « less
-
The challenge of failure management emerges in decentralized architectures due to the distributed nature of the layered control process. Failures in microgrid system may occur at the microgrid level or any of the control layers. A failure detection and response mechanism is required to attain a reliable, fault-tolerant microgrid operation. This paper introduces a Failure Management Unit as an essential function in a microgrid Energy Management System. The proposed unit comprises failure detection mechanisms and a recovery algorithm. The proposed system is applied to a microgrid case study and shows a robust detection and recovery outcome during a system failure. The real-time experimental results were achieved using Hardware-In-the-Loop platform. Coordination between controllers during the recovery period requires low-bandwidth communications, which has no significant overhead on the communication infrastructure.more » « less
-
Synopsis Across the animal kingdom, the ability to produce communication signals appropriate to social encounters is essential, but how these behaviors are selected and adjusted in a context-dependent manner are poorly understood. This question can be addressed on many levels, including sensory processing by peripheral organs and the central nervous system, sensorimotor integration in decision-making brain regions, and motor circuit activation and modulation. Because neuromodulator systems act at each of these levels, they are a useful lens through which to explore the mechanisms underlying complex patterns of communication. It has been clear for decades that understanding the logic of input–output decision making by the nervous system requires far more than simply identifying the connections linking sensory organs to motor circuits; this is due in part to the fact that neuromodulators can promote distinct and temporally dynamic responses to similar signals. We focus on the vocal circuit dynamics of Xenopus frogs, and describe complementary examples from diverse vertebrate communication systems. While much remains to be discovered about how neuromodulators direct flexibility in communication behaviors, these examples illustrate that several neuromodulators can act upon the same circuit at multiple levels of control, and that the functional consequence of neuromodulation can depend on species-specific factors as well as dynamic organismal characteristics like internal state.more » « less
An official website of the United States government

