Abstract Existing models of human walking use low-level reflexes or neural oscillators to generate movement. While appropriate to generate the stable, rhythmic movement patterns of steady-state walking, these models lack the ability to change their movement patterns or spontaneously generate new movements in the specific, goal-directed way characteristic of voluntary movements. Here we present a neuromuscular model of human locomotion that bridges this gap and combines the ability to execute goal directed movements with the generation of stable, rhythmic movement patterns that are required for robust locomotion. The model represents goals for voluntary movements of the swing leg on the task level of swing leg joint kinematics. Smooth movements plans towards the goal configuration are generated on the task level and transformed into descending motor commands that execute the planned movements, using internal models. The movement goals and plans are updated in real time based on sensory feedback and task constraints. On the spinal level, the descending commands during the swing phase are integrated with a generic stretch reflex for each muscle. Stance leg control solely relies on dedicated spinal reflex pathways. Spinal reflexes stimulate Hill-type muscles that actuate a biomechanical model with eight internal joints and six free-body degrees of freedom. The model is able to generate voluntary, goal-directed reaching movements with the swing leg and combine multiple movements in a rhythmic sequence. During walking, the swing leg is moved in a goal-directed manner to a target that is updated in real-time based on sensory feedback to maintain upright balance, while the stance leg is stabilized by low-level reflexes and a behavioral organization switching between swing and stance control for each leg. With this combination of reflex-based stance leg and voluntary, goal-directed control of the swing leg, the model controller generates rhythmic, stable walking patterns in which the swing leg movement can be flexibly updated in real-time to step over or around obstacles.
more »
« less
Mode switching in organisms for solving explore-versus-exploit problems
Abstract Trade-offs between producing costly movements for gathering information (‘explore’) and using previously acquired information to achieve a goal (‘exploit’) arise in a wide variety of problems, including foraging, reinforcement learning and sensorimotor control. Determining the optimal balance between exploration and exploitation is computationally intractable, necessitating heuristic solutions. Here we show that the electric fishEigenmannia virescensuses a salience-dependent mode-switching strategy to solve the explore–exploit conflict during a refuge-tracking task in which the same category of movement (fore-aft swimming) is used for both gathering information and achieving task goals. The fish produced distinctive non-Gaussian distributions of movement velocities characterized by sharp peaks for slower, task-oriented ‘exploit’ movements and broad shoulders for faster ‘explore’ movements. The measures of non-normality increased with increased sensory salience, corresponding to a decrease in the prevalence of fast explore movements. We found the same sensory salience-dependent mode-switching behaviour across ten phylogenetically diverse organisms, from amoebae to humans, performing tasks such as postural balance and target tracking. We propose a state-uncertainty-based mode-switching heuristic that reproduces the distinctive velocity distribution, rationalizes modulation by sensory salience and outperforms the classic persistent excitation approach while using less energy. This mode-switching heuristic provides insights into purposeful exploratory behaviours in organisms, as well as a framework for more efficient state estimation and control of robots.
more »
« less
- Award ID(s):
- 2011619
- PAR ID:
- 10513355
- Publisher / Repository:
- Nature Portfolio
- Date Published:
- Journal Name:
- Nature Machine Intelligence
- Volume:
- 5
- Issue:
- 11
- ISSN:
- 2522-5839
- Page Range / eLocation ID:
- 1285 to 1296
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Motor systems in animals are highly dependent on sensory information for optimal control and precision, with mechanosensory feedback from the somatosensory system playing a critical role. These mechanosensory pathways are woven into the descending feedforward pathways and local central pattern generator circuits that control and generate movement, respectively. Somatosensory feedback in mammals and insects, the two animal classes this review touches upon, is complex due to the increased demands that limbed locomotion, weight-bearing, and corrective movements place on sensorimotor control. In this review, we outline the salient features of the proprioceptive and exteroceptive sensory feedback pathways animals rely on for controlling movement and highlight some of the key principles of sensory feedback that are shared across the animal kingdom.more » « less
-
null (Ed.)While animals track or search for targets, sensory organs make small unexplained movements on top of the primary task-related motions. While multiple theories for these movements exist—in that they support infotaxis, gain adaptation, spectral whitening, and high-pass filtering—predicted trajectories show poor fit to measured trajectories. We propose a new theory for these movements called energy-constrained proportional betting, where the probability of moving to a location is proportional to an expectation of how informative it will be balanced against the movement’s predicted energetic cost. Trajectories generated in this way show good agreement with measured trajectories of fish tracking an object using electrosense, a mammal and an insect localizing an odor source, and a moth tracking a flower using vision. Our theory unifies the metabolic cost of motion with information theory. It predicts sense organ movements in animals and can prescribe sensor motion for robots to enhance performance.more » « less
-
BackgroundUpper limb proprioceptive impairments are common after stroke and affect daily function. Recent work has shown that stroke survivors have difficulty using visual information to improve proprioception. It is unclear how eye movements are impacted to guide action of the arm after stroke. Here, we aimed to understand how upper limb proprioceptive impairments impact eye movements in individuals with stroke. MethodsControl (N = 20) and stroke participants (N = 20) performed a proprioceptive matching task with upper limb and eye movements. A KINARM exoskeleton with eye tracking was used to assess limb and eye kinematics. The upper limb was passively moved by the robot and participants matched the location with either an arm or eye movement. Accuracy was measured as the difference between passive robot movement location and active limb matching (Hand-End Point Error) or active eye movement matching (Eye-End Point Error). ResultsWe found that individuals with stroke had significantly larger Hand (2.1×) and Eye-End Point (1.5×) Errors compared to controls. Further, we found that proprioceptive errors of the hand and eye were highly correlated in stroke participants ( r = .67, P = .001), a relationship not observed for controls. ConclusionsEye movement accuracy declined as a function of proprioceptive impairment of the more-affected limb, which was used as a proprioceptive reference. The inability to use proprioceptive information of the arm to coordinate eye movements suggests that disordered proprioception impacts integration of sensory information across different modalities. These results have important implications for how vision is used to actively guide limb movement during rehabilitation.more » « less
-
null (Ed.)Abstract Swimming in schools has long been hypothesized to allow fish to save energy. Fish must exploit the energy from the wakes of their neighbors for maximum energy savings, a feat that requires them to both synchronize their tail movements and stay in certain positions relative to their neighbors. To maintain position in a school, we know that fish use multiple sensory systems, mainly their visual and flow sensing lateral line system. However, how fish synchronize their swimming movements in a school is still not well understood. Here we test the hypothesis that this synchronization may depend on functional differences in the two branches of the lateral line sensory system that detects water movements close to the fish’s body. The anterior branch, located on the head, encounters largely undisturbed free-stream flow, while the posterior branch, located on the trunk and tail, encounters flow that has been affected strongly by the tail movement. Thus, we hypothesize that the anterior branch may be more important for regulating position within the school, while the posterior branch may be more important for synchronizing tail movements. Our study examines functional differences in the anterior and posterior lateral line in the structure and tail synchronization of fish schools. We used a widely available aquarium fish that schools, the giant danio, Devario equipinnatus. Fish swam in a large circular tank where stereoscopic videos recordings were used to reconstruct the 3 D position of each individual within the school and to track tail kinematics to quantify synchronization. For one fish in each school, we ablated using cobalt chloride either the anterior region only, the posterior region only, or the entire lateral line system. We observed that ablating any region of the lateral line system causes fish to swim in a “box” or parallel swimming formation, which was different from the diamond formation observed in normal fish. Ablating only the anterior region did not substantially reduce tail beat synchronization but ablating only the posterior region caused fish to stop synchronizing their tail beats, largely because the tail beat frequency increased dramatically. Thus, the anterior and posterior lateral line system appear to have different behavioral functions in fish. Most importantly, we showed that the posterior lateral line system played a major role in determining tail beat synchrony in schooling fish. Without synchronization, swimming efficiency decreases, which can have an impact on the fitness of the individual fish and group.more » « less
An official website of the United States government

