skip to main content


Title: Sources of predictive information in dynamical neural networks
Abstract Behavior involves the ongoing interaction between an organism and its environment. One of the prevailing theories of adaptive behavior is that organisms are constantly making predictions about their future environmental stimuli. However, how they acquire that predictive information is still poorly understood. Two complementary mechanisms have been proposed: predictions are generated from an agent’s internal model of the world or predictions are extracted directly from the environmental stimulus. In this work, we demonstrate that predictive information, measured using bivariate mutual information, cannot distinguish between these two kinds of systems. Furthermore, we show that predictive information cannot distinguish between organisms that are adapted to their environments and random dynamical systems exposed to the same environment. To understand the role of predictive information in adaptive behavior, we need to be able to identify where it is generated. To do this, we decompose information transfer across the different components of the organism-environment system and track the flow of information in the system over time. To validate the proposed framework, we examined it on a set of computational models of idealized agent-environment systems. Analysis of the systems revealed three key insights. First, predictive information, when sourced from the environment, can be reflected in any agent irrespective of its ability to perform a task. Second, predictive information, when sourced from the nervous system, requires special dynamics acquired during the process of adapting to the environment. Third, the magnitude of predictive information in a system can be different for the same task if the environmental structure changes.  more » « less
Award ID(s):
1845322 1735095
NSF-PAR ID:
10286540
Author(s) / Creator(s):
;
Date Published:
Journal Name:
Scientific Reports
Volume:
10
Issue:
1
ISSN:
2045-2322
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract

    An organism’s ability to control the timing and direction of energy flow both within its body and out to the surrounding environment is vital to maintaining proper function. When physically interacting with an external target, the mechanical energy applied by the organism can be transferred to the target as several types of output energy, such as target deformation, target fracture, or as a transfer of momentum. The particular function being performed will dictate which of these results is most adaptive to the organism. Chewing food favors fracture, whereas running favors the transfer of momentum from the appendages to the ground. Here, we explore the relationship between deformation, fracture, and momentum transfer in biological puncture systems. Puncture is a widespread behavior in biology requiring energy transfer into a target to allow fracture and subsequent insertion of the tool. Existing correlations between both tool shape and tool dynamics with puncture success do not account for what energy may be lost due to deformation and momentum transfer in biological systems. Using a combination of pendulum tests and particle tracking velocimetry (PTV), we explored the contributions of fracture, deformation and momentum to puncture events using a gaboon viper fang. Results on unrestrained targets illustrate that momentum transfer between tool and target, controlled by the relative masses of the two, can influence the extent of fracture achieved during high-speed puncture. PTV allowed us to quantify deformation throughout the target during puncture and tease apart how input energy is partitioned between deformation and fracture. The relationship between input energy, target deformation and target fracture is non-linear; increasing impact speed from 2.0 to 2.5 m/s created no further fracture, but did increase deformation while increasing speed to 3.0 m/s allowed an equivalent amount of fracture to be achieved for less overall deformation. These results point to a new framework for examining puncture systems, where the relative resistances to deformation, fracture and target movement dictate where energy flows during impact. Further developing these methods will allow researchers to quantify the energetics of puncture systems in a way that is comparable across a broad range of organisms and connect energy flow within an organism to how that energy is eventually transferred to the environment.

     
    more » « less
  2. Abstract Americium is a highly radioactive actinide element found in used nuclear fuel. Its adsorption on aluminum (hydr)oxide minerals is important to study for at least two reasons: (i) aluminum (hydr)oxide minerals are ubiquitous in the subsurface environment and (ii) bentonite clays, which are proposed engineered barriers for the geologic disposal of used nuclear fuel, have the same ≡AlOH sites as aluminum (hydr)oxide minerals. Surface complexation modeling is widely used to interpret the adsorption behavior of heavy metals on mineral surfaces. While americium sorption is understudied, multiple adsorption studies for europium, a chemical analog, are available. In this study we compiled data describing Eu(III) adsorption on three aluminum (hydr)oxide minerals—corundum (α-Al 2 O 3 ), γ-alumina (γ-Al 2 O 3 ) and gibbsite (γ-Al(OH) 3 )—and developed surface complexation models for Eu(III) adsorption on these minerals by employing diffuse double layer (DDL) and charge distribution multisite complexation (CD-MUSIC) electrostatic frameworks. We also developed surface complexation models for Am(III) adsorption on corundum (α-Al 2 O 3 ) and γ-alumina (γ-Al 2 O 3 ) by employing a limited number of Am(III) adsorption data sourced from literature. For corundum and γ-alumina, two different adsorbed Eu(III) species, one each for strong and weak sites, were found to be important regardless of which electrostatic framework was used. The formation constant of the weak site species was almost 10,000 times weaker than the formation constant for the corresponding strong site species. For gibbsite, two different adsorbed Eu(III) species formed on the single available site type and were important for the DDL model, whereas the best-fit CD-MUSIC model for Eu(III)-gibbsite system required only one Eu(III) surface species. The Am(III)-corundum model based on the CD-MUSIC framework had the same set of surface species as the Eu(III)-corundum model. However, the log K values of the surface reactions were different. The best-fit Am(III)-corundum model based on the DDL framework had only one site type. Both the CD-MUSIC and the DDL model developed for Am(III)-γ-alumina system only comprised of one site type and the formation constant of the corresponding surface species was ~ 500 times stronger and ~ 700 times weaker than the corresponding Eu(III) species on the weak and the strong sites, respectively. The CD-MUSIC model for corundum and both the DDL and the CD-MUSIC models for γ-alumina predicted the Am(III) adsorption data very well, whereas the DDL model for corundum overpredicted the Am(III) adsorption data. The root mean square of errors of the DDL and CD-MUSIC models developed in this study were smaller than those of two previously-published models describing Am(III)-γ-alumina system, indicating the better predictive capacity of our models. Overall, our results suggest that using Eu(III) as an analog for Am(III) is practical approach for predicting Am(III) adsorption onto well-characterized minerals. Graphical Abstract 
    more » « less
  3. null (Ed.)
    Animals generate many different motor programs (such as moving, feeding and grooming) that they can alter in response to internal needs and environmental cues. These motor programs are controlled by dedicated brain circuits that act on specific muscle groups. However, little is known about how organisms coordinate these different motor programs to ensure that their resulting behavior is coherent and appropriate to the situation. This is difficult to investigate in large organisms with complex nervous systems, but with 302 brain cells that control 143 muscle cells, the small worm Caenorhabditis elegans provides a good system to examine this question. Here, Cermak, Yu, Clark et al. devised imaging methods to record each type of motor program in C. elegans worms over long time periods, while also dissecting the underlying neural mechanisms that coordinate these motor programs. This constitutes one of the first efforts to capture and quantify all the behavioral outputs of an entire organism at once. The experiments also showed that dopamine – a messenger molecule in the brain – links the neural circuits that control two motor programs: movement and egg-laying. A specific type of high-speed movement activates brain cells that release dopamine, which then transmits this information to the egg-laying circuit. This means that worms lay most of their eggs whilst traveling at high speed through a food source, so that their progeny can be distributed across a nutritive environment. This work opens up the possibility to study how behaviors are coordinated at the level of the whole organism – a departure from the traditional way of focusing on how specific neural circuits generate specific behaviors. Ultimately, it will also be interesting to look at the role of dopamine in behavior coordination in a wide range of animals. 
    more » « less
  4. Organisms perceive their environment and respond. The origin of perception–response traits presents a puzzle. Perception provides no value without response. Response requires perception. Recent advances in machine learning may provide a solution. A randomly connected network creates a reservoir of perceptive information about the recent history of environmental states. In each time step, a relatively small number of inputs drives the dynamics of the relatively large network. Over time, the internal network states retain a memory of past inputs. To achieve a functional response to past states or to predict future states, a system must learn only how to match states of the reservoir to the target response. In the same way, a random biochemical or neural network of an organism can provide an initial perceptive basis. With a solution for one side of the two-step perception–response challenge, evolving an adaptive response may not be so difficult. Two broader themes emerge. First, organisms may often achieve precise traits from sloppy components. Second, evolutionary puzzles often follow the same outlines as the challenges of machine learning. In each case, the basic problem is how to learn, either by artificial computational methods or by natural selection.

     
    more » « less
  5. null (Ed.)
    An important problem in designing human-robot systems is the integration of human intent and performance in the robotic control loop, especially in complex tasks. Bimanual coordination is a complex human behavior that is critical in many fine motor tasks, including robot-assisted surgery. To fully leverage the capabilities of the robot as an intelligent and assistive agent, online recognition of bimanual coordination could be important. Robotic assistance for a suturing task, for example, will be fundamentally different during phases when the suture is wrapped around the instrument (i.e., making a c- loop), than when the ends of the suture are pulled apart. In this study, we develop an online recognition method of bimanual coordination modes (i.e., the directions and symmetries of right and left hand movements) using geometric descriptors of hand motion. We (1) develop this framework based on ideal trajectories obtained during virtual 2D bimanual path following tasks performed by human subjects operating Geomagic Touch haptic devices, (2) test the offline recognition accuracy of bi- manual direction and symmetry from human subject movement trials, and (3) evalaute how the framework can be used to characterize 3D trajectories of the da Vinci Surgical System’s surgeon-side manipulators during bimanual surgical training tasks. In the human subject trials, our geometric bimanual movement classification accuracy was 92.3% for movement direction (i.e., hands moving together, parallel, or away) and 86.0% for symmetry (e.g., mirror or point symmetry). We also show that this approach can be used for online classification of different bimanual coordination modes during needle transfer, making a C loop, and suture pulling gestures on the da Vinci system, with results matching the expected modes. Finally, we discuss how these online estimates are sensitive to task environment factors and surgeon expertise, and thus inspire future work that could leverage adaptive control strategies to enhance user skill during robot-assisted surgery. 
    more » « less