Title: Synaptic balancing: A biologically plausible local learning rule that provably increases neural network noise robustness without sacrificing task performance
We introduce a novel, biologically plausible local learning rule that provably increases the robustness of neural dynamics to noise in nonlinear recurrent neural networks with homogeneous nonlinearities. Our learning rule achieves higher noise robustness without sacrificing performance on the task and without requiring any knowledge of the particular task. The plasticity dynamics—an integrable dynamical system operating on the weights of the network—maintains a multiplicity of conserved quantities, most notably the network’s entire temporal map of input to output trajectories. The outcome of our learning rule is a synaptic balancing between the incoming and outgoing synapses of every neuron. This synaptic balancing rule is consistent with many known aspects of experimentally observed heterosynaptic plasticity, and moreover makes new experimentally testable predictions relating plasticity at the incoming and outgoing synapses of individual neurons. Overall, this work provides a novel, practical local learning rule that exactly preserves overall network function and, in doing so, provides new conceptual bridges between the disparate worlds of the neurobiology of heterosynaptic plasticity, the engineering of regularized noise-robust networks, and the mathematics of integrable Lax dynamical systems.  more » « less
Award ID(s):
1845166
PAR ID:
10513477
Author(s) / Creator(s):
; ; ;
Editor(s):
Richards, Blake A
Publisher / Repository:
PLOS
Date Published:
Journal Name:
PLOS Computational Biology
Volume:
18
Issue:
9
ISSN:
1553-7358
Page Range / eLocation ID:
e1010418
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. The Liquid State Machine (LSM) is a promising model of recurrent spiking neural networks. It consists of a fixed recurrent network, or the reservoir, which projects to a readout layer through plastic readout synapses. The classification performance is highly dependent on the training of readout synapses which tend to be very dense and contribute significantly to the overall network complexity. We present a unifying biologically inspired calcium-modulated supervised spike-timing dependent plasticity (STDP) approach to training and sparsification of readout synapses, where supervised temporal learning is modulated by the post-synaptic firing level characterized by the post-synaptic calcium concentration. The proposed approach prevents synaptic weight saturation, boosts learning performance, and sparsifies the connectivity between the reservoir and readout layer. Using the recognition rate of spoken English letters adopted from the TI46 speech corpus as a measure of performance, we demonstrate that the proposed approach outperforms a baseline supervised STDP mechanism by up to 25%, and a competitive non-STDP spike-dependent training algorithm by up to 2.7%. Furthermore, it can prune out up to 30% of readout synapses without causing significant performance degradation. 
    more » « less
  2. Synaptic plasticity refers to activity-dependent synaptic strengthening or weakening between neurons. It is usually associated with homosynaptic plasticity, which refers to a synaptic junction controlled by interactions between specific neurons. Heterosynaptic plasticity, on the other hand, lacks this specificity. It involves much larger populations of synapses and neurons and can be associated with changes in synaptic strength due to nonlocal alterations in the ambient electrochemical environment. This paper presents specific examples demonstrating how variations in the ambient electrochemical environment of lipid membranes can impact the nonlinear dynamical behaviors of memristive and memcapacitive systems in droplet interface bilayers (DIBs). Examples include the use of pH as a modulatory factor that alters the voltage-dependent memristive behavior of alamethicin ion channels in DIB lipid bilayers, and the discovery of long-term potentiation (LTP) in a lipid bilayer-only system after application of electrical stimulation protocols. 
    more » « less
  3. An approach combining signal detection theory and precise 3D reconstructions from serial section electron microscopy (3DEM) was used to investigate synaptic plasticity and information storage capacity at medial perforant path synapses in adult hippocampal dentate gyrus in vivo. Induction of long-term potentiation (LTP) markedly increased the frequencies of both small and large spines measured 30 minutes later. This bidirectional expansion resulted in heterosynaptic counterbalancing of total synaptic area per unit length of granule cell dendrite. Control hemispheres exhibited 6.5 distinct spine sizes for 2.7 bits of storage capacity while LTP resulted in 12.9 distinct spine sizes (3.7 bits). In contrast, control hippocampal CA1 synapses exhibited 4.7 bits with much greater synaptic precision than either control or potentiated dentate gyrus synapses. Thus, synaptic plasticity altered total capacity, yet hippocampal subregions differed dramatically in their synaptic information storage capacity, reflecting their diverse functions and activation histories. 
    more » « less
  4. Memories are believed to be stored in synapses and retrieved by reactivating neural ensembles. Learning alters synaptic weights, which can interfere with previously stored memories that share the same synapses, creating a trade-off between plasticity and stability. Interestingly, neural representations change even in stable environments, without apparent learning or forgetting—a phenomenon known as representational drift. Theoretical studies have suggested that multiple neural representations can correspond to a memory, with postlearning exploration of these representation solutions driving drift. However, it remains unclear whether representations explored through drift differ from those learned or offer unique advantages. Here, we show that representational drift uncovers noise-robust representations that are otherwise difficult to learn. We first define the nonlinear solution space manifold of synaptic weights for fixed input–output mappings, which allows us to disentangle drift from learning and forgetting and simulate drift as diffusion within this manifold. Solutions explored by drift have many inactive and saturated neurons, making them robust to weight perturbations due to noise or continual learning. Such solutions are prevalent and entropically favored by drift, but their lack of gradients makes them difficult to learn and nonconducive to future learning. To overcome this, we introduce an allocation procedure that selectively shifts representations for new stimuli into a learning-conducive regime. By combining allocation with drift, we resolve the trade-off between learnability and robustness. 
    more » « less
  5. Abstract Neuromorphic systems that employ advanced synaptic learning rules, such as the three-factor learning rule, require synaptic devices of increased complexity. Herein, a novel neoHebbian artificial synapse utilizing ReRAM devices has been proposed and experimentally validated to meet this demand. This synapse features two distinct state variables: a neuron coupling weight and an “eligibility trace” that dictates synaptic weight updates. The coupling weight is encoded in the ReRAM conductance, while the “eligibility trace” is encoded in the local temperature of the ReRAM and is modulated by applying voltage pulses to a physically co-located resistive heating element. The utility of the proposed synapse has been investigated using two representative tasks: first, temporal signal classification using Recurrent Spiking Neural Networks (RSNNs) employing the e-prop algorithm, and second, Reinforcement Learning (RL) for path planning tasks in feedforward networks using a modified version of the same learning rule. System-level simulations, accounting for various device and system-level non-idealities, confirm that these synapses offer a robust solution for the fast, compact, and energy-efficient implementation of advanced learning rules in neuromorphic hardware. 
    more » « less