skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: The role of long-term power-law memory in controlling large-scale dynamical networks
Abstract Controlling large-scale dynamical networks is crucial to understand and, ultimately, craft the evolution of complex behavior. While broadly speaking we understand how to control Markov dynamical networks, where the current state is only a function of its previous state, we lack a general understanding of how to control dynamical networks whose current state depends on states in the distant past (i.e. long-term memory). Therefore, we require a different way to analyze and control the more prevalent long-term memory dynamical networks. Herein, we propose a new approach to control dynamical networks exhibiting long-term power-law memory dependencies. Our newly proposed method enables us to find the minimum number of driven nodes (i.e. the state vertices in the network that are connected to one and only one input) and their placement to control a long-term power-law memory dynamical network given a specific time-horizon, which we define as the ‘time-to-control’. Remarkably, we provide evidence that long-term power-law memory dynamical networks require considerably fewer driven nodes to steer the network’s state to a desired goal for any given time-to-control as compared with Markov dynamical networks. Finally, our method can be used as a tool to determine the existence of long-term memory dynamics in networks.  more » « less
Award ID(s):
1932620
PAR ID:
10473437
Author(s) / Creator(s):
; ; ;
Publisher / Repository:
Nature Publishing Group
Date Published:
Journal Name:
Scientific Reports
Volume:
13
Issue:
1
ISSN:
2045-2322
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. null (Ed.)
    Abstract Recent advances in network science, control theory, and fractional calculus provide us with mathematical tools necessary for modeling and controlling complex dynamical networks (CDNs) that exhibit long-term memory. Selecting the minimum number of driven nodes such that the network is steered to a prescribed state is a key problem to guarantee that complex networks have a desirable behavior. Therefore, in this paper, we study the effects of long-term memory and of the topological properties on the minimum number of driven nodes and the required control energy. To this end, we introduce Gramian-based methods for optimal driven node selection for complex dynamical networks with long-term memory and by leveraging the structure of the cost function, we design a greedy algorithm to obtain near-optimal approximations in a computationally efficiently manner. We investigate how the memory and topological properties influence the control effort by considering Erdős–Rényi, Barabási–Albert and Watts–Strogatz networks whose temporal dynamics follow a fractional order state equation. We provide evidence that scale-free and small-world networks are easier to control in terms of both the number of required actuators and the average control energy. Additionally, we show how our method could be applied to control complex networks originating from the human brain and we discover that certain brain cortex regions have a stronger impact on the controllability of network than others. 
    more » « less
  2. null (Ed.)
    The ability to steer the state of a dynamical network towards a desired state within a time horizon is intrinsically dependent on the number of driven nodes considered, as well as the network’s topology. The trade-off between time-to-control and the minimum number of driven nodes is captured by the notion of the actuation spectrum (AS). We study the actuation spectra of a variety of artificial and real-world networked systems, modeled by fractional-order dynamics that are capable of capturing non-Markovian time properties with power-law dependencies. We find evidence that, in both types of networks, the actuation spectra are similar when the time-to-control is less or equal to about 1/5 of the size of the network. Nonetheless, for a time-to-control larger than the network size, the minimum number of driven nodes required to attain controllability in networks with fractional-order dynamics may still decrease in comparison with other networks with Markovian properties. These differences suggest that the minimum number of driven nodes can be used to determine the true dynamical nature of the network. Furthermore, such differences also suggest that new generative models are required to reproduce the actuation spectra of real fractional-order dynamical networks. 
    more » « less
  3. Lee, Jonghyun; Darve, Eric F.; Kitanidis, Peter K.; Mahoney, Michael W.; Karpatne, Anuj; Farthing, Matthew W.; Hesser, Tyler (Ed.)
    Modern design, control, and optimization often require multiple expensive simulations of highly nonlinear stiff models. These costs can be amortized by training a cheap surrogate of the full model, which can then be used repeatedly. Here we present a general data-driven method, the continuous time echo state network (CTESN), for generating surrogates of nonlinear ordinary differential equations with dynamics at widely separated timescales. We empirically demonstrate the ability to accelerate a physically motivated scalable model of a heating system by 98x while maintaining relative error of within 0.2 %. We showcase the ability for this surrogate to accurately handle highly stiff systems which have been shown to cause training failures with common surrogate methods such as Physics-Informed Neural Networks (PINNs), Long Short Term Memory (LSTM) networks, and discrete echo state networks (ESN). We show that our model captures fast transients as well as slow dynamics, while demonstrating that fixed time step machine learning techniques are unable to adequately capture the multi-rate behavior. Together this provides compelling evidence for the ability of CTESN surrogates to predict and accelerate highly stiff dynamical systems which are unable to be directly handled by previous scientific machine learning techniques. 
    more » « less
  4. null (Ed.)
    Recursive neural networks can be trained to serve as a memory for robots to perform intelligent behaviors when localization is not available. This paper develops an approach to convert a spatial map, represented as a scalar field, into a trained memory represented by the long short-term memory (LSTM) neural network. The trained memory can be retrieved through sensor measurements collected by robots to achieve intelligent behaviors, such as tracking level curves in the map. Memory retrieval does not require robot locations. The retrieved information is combined with sensor measurements through a Kalman filter enabled by the LSTM (LSTM-KF). Furthermore, a level curve tracking control law is designed. Simulation results show that the LSTM-KF and the control law are effective to generate level curve tracking behaviors for single-robot and multi-robot teams. 
    more » « less
  5. The spatiotemporal organization of networks of dynamical units can break down resulting in diseases (e.g., in the brain) or large-scale malfunctions (e.g., power grid blackouts). Re-establishment of function then requires identification of the optimal intervention site from which the network behavior is most efficiently re-stabilized. Here, we consider one such scenario with a network of units with oscillatory dynamics, which can be suppressed by sufficiently strong coupling and stabilizing a single unit, i.e., pinning control. We analyze the stability of the network with hyperbolas in the control gain vs coupling strength state space and identify the most influential node (MIN) as the node that requires the weakest coupling to stabilize the network in the limit of very strong control gain. A computationally efficient method, based on the Moore–Penrose pseudoinverse of the network Laplacian matrix, was found to be efficient in identifying the MIN. In addition, we have found that in some networks, the MIN relocates when the control gain is changed, and thus, different nodes are the most influential ones for weakly and strongly coupled networks. A control theoretic measure is proposed to identify networks with unique or relocating MINs. We have identified real-world networks with relocating MINs, such as social and power grid networks. The results were confirmed in experiments with networks of chemical reactions, where oscillations in the networks were effectively suppressed through the pinning of a single reaction site determined by the computational method. 
    more » « less