This paper describes several surprisingly rich but simple demos and a new experimental platform for human sensorimotor control research and also controls education. The platform safely simulates a canonical sensorimotor task of riding a mountain bike down a steep, twisting, bumpy trail using a standard display and inexpensive off-the-shelf gaming steering wheel with a force feedback motor. We use the platform to verify our theory, presented in a companion paper. The theory tells how component hardware speed-accuracy tradeoffs (SATs) in control loops impose corresponding SATs at the system level and how effective architectures mitigate the deleterious impact of hardware SATs through layering and “diversity sweet spots” (DSSs). Specifically, we measure the impacts on system performance of delays, quantization, and uncertainties in sensorimotor control loops, both within the subject's nervous system and added externally via software in the platform. This provides a remarkably rich test of the theory, which is consistent with all preliminary data. Moreover, as the theory predicted, subjects effectively multiplex specific higher layer planning/tracking of the trail using vision with lower layer rejection of unseen bump disturbances using reflexes. In contrast, humans multitask badly on tasks that do not naturally distribute across layers (e.g. texting and driving). The platform is cheap to build and easy to program for both research and education purposes, yet verifies our theory, which is aimed at closing a crucial gap between neurophysiology and sensorimotor control. The platform can be downloaded at https://github.com/Doyle-Lab/WheelCon.
more »
« less
Theoretical foundations for layered architectures and speed-accuracy tradeoffs in sensorimotor control
Nervous systems sense, communicate, compute, and actuate movement, using distributed hardware with tradeoffs in speed and accuracy. The resulting sensorimotor control is nevertheless remarkably fast and accurate due to highly effective layered architectures. However, such architectures have received little attention in neuroscience due to the lack of theory that connects the system and hardware level speed-accuracy tradeoffs. In this paper, we present a theoretical framework that connects the speed-accuracy tradeoffs of sensorimotor control and neurophysiology. We characterize how the component SATs in spiking neuron communication and their sensory and muscle endpoints constrain the system SATs in both stochastic and deterministic models. The results show that appropriate speed -accuracy diversity at the neurons/muscles levels allow nervous systems to improve the speed and accuracy in control performance despite using slow or inaccurate hardware. Then, we characterize the fundamental limits of layered control systems and show that appropriate diversity in planning and reaction layers leads to both fast and accurate system despite being composed of slow or inaccurate layers. We term these phenomena “Diversity Sweet Spots.” The theory presented here is illustrated in a companion paper, which introduces simple demos and a new inexpensive and easy-to-use experimental platform.
more »
« less
- Award ID(s):
- 1735003
- NSF-PAR ID:
- 10155678
- Date Published:
- Journal Name:
- 2019 American Control Conference
- Page Range / eLocation ID:
- 809 to 814
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
more » « less
Nervous systems sense, communicate, compute, and actuate movement using distributed components with severe trade-offs in speed, accuracy, sparsity, noise, and saturation. Nevertheless, brains achieve remarkably fast, accurate, and robust control performance due to a highly effective layered control architecture. Here, we introduce a driving task to study how a mountain biker mitigates the immediate disturbance of trail bumps and responds to changes in trail direction. We manipulated the time delays and accuracy of the control input from the wheel as a surrogate for manipulating the characteristics of neurons in the control loop. The observed speed–accuracy trade-offs motivated a theoretical framework consisting of two layers of control loops—a fast, but inaccurate, reflexive layer that corrects for bumps and a slow, but accurate, planning layer that computes the trajectory to follow—each with components having diverse speeds and accuracies within each physical level, such as nerve bundles containing axons with a wide range of sizes. Our model explains why the errors from two control loops are additive and shows how the errors in each control loop can be decomposed into the errors caused by the limited speeds and accuracies of the components. These results demonstrate that an appropriate diversity in the properties of neurons across layers helps to create “diversity-enabled sweet spots,” so that both fast and accurate control is achieved using slow or inaccurate components.
-
Sensorimotor tasks that humans perform are often affected by different sources of uncertainty. Nevertheless, the central nervous system (CNS) can gracefully coordinate our movements. Most learning frameworks rely on the internal model principle, which requires a precise internal representation in the CNS to predict the outcomes of our motor commands. However, learning a perfect internal model in a complex environment over a short period of time is a nontrivial problem. Indeed, achieving proficient motor skills may require years of training for some difficult tasks. Internal models alone may not be adequate to explain the motor adaptation behavior during the early phase of learning. Recent studies investigating the active regulation of motor variability, the presence of suboptimal inference, and model-free learning have challenged some of the traditional viewpoints on the sensorimotor learning mechanism. As a result, it may be necessary to develop a computational framework that can account for these new phenomena. Here, we develop a novel theory of motor learning, based on model-free adaptive optimal control, which can bypass some of the difficulties in existing theories. This new theory is based on our recently developed adaptive dynamic programming (ADP) and robust ADP (RADP) methods and is especially useful for accounting for motor learning behavior when an internal model is inaccurate or unavailable. Our preliminary computational results are in line with experimental observations reported in the literature and can account for some phenomena that are inexplicable using existing models.more » « less
-
Synopsis Across the animal kingdom, the ability to produce communication signals appropriate to social encounters is essential, but how these behaviors are selected and adjusted in a context-dependent manner are poorly understood. This question can be addressed on many levels, including sensory processing by peripheral organs and the central nervous system, sensorimotor integration in decision-making brain regions, and motor circuit activation and modulation. Because neuromodulator systems act at each of these levels, they are a useful lens through which to explore the mechanisms underlying complex patterns of communication. It has been clear for decades that understanding the logic of input–output decision making by the nervous system requires far more than simply identifying the connections linking sensory organs to motor circuits; this is due in part to the fact that neuromodulators can promote distinct and temporally dynamic responses to similar signals. We focus on the vocal circuit dynamics of Xenopus frogs, and describe complementary examples from diverse vertebrate communication systems. While much remains to be discovered about how neuromodulators direct flexibility in communication behaviors, these examples illustrate that several neuromodulators can act upon the same circuit at multiple levels of control, and that the functional consequence of neuromodulation can depend on species-specific factors as well as dynamic organismal characteristics like internal state.more » « less
-
more » « less
Abstract A common goal of Intelligent Tutoring Systems (ITS) is to provide learning environments that adapt to the varying abilities and characteristics of users. This type of adaptivity is possible only if the ITS has information that characterizes the learning behaviors of its users and can adjust its pedagogy accordingly. This study investigated an intelligent tutoring system with computer agents (
AutoTutor ) designed to improve comprehension skills in adults with low reading literacy. One goal of this study was to classify adults into different clusters based on their behavioral patterns (accuracy and response time to answer questions) while they interacted with AutoTutor to help them improve their reading comprehension skills. A second goal was to investigate whether adults’ behaviors were associated with different reading components. A third goal was to assess improvements in reading comprehension skills, based on psychometric tests, of different clusters of readers. Performance on AutoTutor was collected in a targeted 100-hour hybrid intervention for adult readers (n = 252) that included both human teachers and the AutoTutor system. The adults’ average accuracy and response time in AutoTutor were used to cluster the adults into four categories: higher performers (comparatively fast and accurate), conscientious readers (slow but accurate), under-engaged readers (fast at the expense of somewhat lower accuracy) and struggling readers (slow and inaccurate). Two psychometric tests of comprehension were used to assess comprehension. Gains in comprehension scores were highest for conscientious readers, lowest for struggling readers, with higher performing readers and under-engaged readers in between. The results provide guidance to enhance the adaptivity of AutoTutor.
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Conference Paper:
- https://doi.org/10.23919/ACC.2019.8814897
