Network features found in the brain may help implement more efficient and robust neural networks. Spiking neural networks (SNNs) process spikes in the spatiotemporal domain and can offer better energy efficiency than deep neural networks. However, most SNN implementations rely on simple point neurons that neglect the rich neuronal and dendritic dynamics. Herein, a bio‐inspired columnar learning network (CLN) structure that employs feedforward, lateral, and feedback connections to make robust classification with sparse data is proposed. CLN is inspired by the mammalian neocortex, comprising cortical columns each containing multiple minicolumns formed by interacting pyramidal neurons. A column continuously processes spatiotemporal signals from its sensor, while learning spatial and temporal correlations between features in different regions of an object along with the sensor's movement through sensorimotor interaction. CLN can be implemented using memristor crossbars with a local learning rule, spiking timing‐dependent plasticity (STDP), which can be natively obtained in second‐order memristors. CLN allows inputs from multiple sensors to be simultaneously processed by different columns, resulting in higher classification accuracy and better noise tolerance. Analysis of networks implemented on memristor crossbars shows that the system can operate at very low power and high throughput, with high accuracy and robustness to noise.
This content will become publicly available on February 14, 2025
Understanding the neural code has been one of the central aims of neuroscience research for decades. Spikes are commonly referred to as the units of information transfer, but multi-unit activity (MUA) recordings are routinely analyzed in aggregate forms such as binned spike counts, peri-stimulus time histograms, firing rates, or population codes. Various forms of averaging also occur in the brain, from the spatial averaging of spikes within dendritic trees to their temporal averaging through synaptic dynamics. However, how these forms of averaging are related to each other or to the spatial and temporal units of information representation within the neural code has remained poorly understood.
In this work we developed NeuroPixelHD, a symbolic hyperdimensional model of MUA, and used it to decode the spatial location and identity of static images shown to
For almost all subjects, we found 125ms temporal resolution to maximize decoding accuracy for both the spatial location of Gabor patches (81 classes for patches presented over a 9×9 grid) as well as the identity of natural images (118 classes corresponding to 118 images) across the whole brain. This optimal temporal resolution nevertheless varied greatly between different regions, followed a sensory-associate hierarchy, and was significantly modulated by the central frequency of theta-band oscillations across different regions. Spatially, the optimal resolution was at either of two mesoscale levels for almost all mice: the area level, where the spiking activity of all neurons within each brain area are combined, and the population level, where neuronal spikes within each area are combined across fast spiking (putatively inhibitory) and regular spiking (putatively excitatory) neurons, respectively. We also observed an expected interplay between optimal spatial and temporal resolutions, whereby increasing the amount of averaging across one dimension (space or time) decreases the amount of averaging that is optimal across the other dimension, and vice versa.
Our findings corroborate existing empirical practices of spatiotemporal binning and averaging in MUA data analysis, and provide a rigorous computational framework for optimizing the level of such aggregations. Our findings can also synthesize these empirical practices with existing knowledge of the various sources of biological averaging in the brain into a new theory of neural information processing in which the
- Award ID(s):
- 2239654
- NSF-PAR ID:
- 10495331
- Editor(s):
- Jonathan R. Whitlock
- Publisher / Repository:
- Frontiers Media SA
- Date Published:
- Journal Name:
- Frontiers in Cellular Neuroscience
- Volume:
- 18
- ISSN:
- 1662-5102
- Subject(s) / Keyword(s):
- ["neural code, multi-unit activity, averaging, spatial resolution, temporal resolution,\nhyper-dimensional computing, computational modeling, neural dynamics"]
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
more » « less
-
Superresolution of GOES-16 ABI Bands to a Common High Resolution with a Convolutional Neural Networkmore » « less
Abstract Superresolution is the general task of artificially increasing the spatial resolution of an image. The recent surge in machine learning (ML) research has yielded many promising ML-based approaches for performing single-image superresolution including applications to satellite remote sensing. We develop a convolutional neural network (CNN) to superresolve the 1- and 2-km bands on the GOES-R series Advanced Baseline Imager (ABI) to a common high resolution of 0.5 km. Access to 0.5-km imagery from ABI band 2 enables the CNN to realistically sharpen lower-resolution bands without significant blurring. We first train the CNN on a proxy task, which allows us to only use ABI imagery, namely, degrading the resolution of ABI bands and training the CNN to restore the original imagery. Comparisons at reduced resolution and at full resolution with
Landsat-8/Landsat-9 observations illustrate that the CNN produces images with realistic high-frequency detail that is not present in a bicubic interpolation baseline. Estimating all ABI bands at 0.5-km resolution allows for more easily combining information across bands without reconciling differences in spatial resolution. However, more analysis is needed to determine impacts on derived products or multispectral imagery that use superresolved bands. This approach is extensible to other remote sensing instruments that have bands with different spatial resolutions and requires only a small amount of data and knowledge of each channel’s modulation transfer function.Significance Statement Satellite remote sensing instruments often have bands with different spatial resolutions. This work shows that we can artificially increase the resolution of some lower-resolution bands by taking advantage of the texture of higher-resolution bands on the
GOES-16 ABI instrument using a convolutional neural network. This may help reconcile differences in spatial resolution when combining information across bands, but future analysis is needed to precisely determine impacts on derived products that might use superresolved bands. -
more » « less
One of the major challenges in large scale optical imaging of neuronal activity is to simultaneously achieve sufficient temporal and spatial resolution across a large volume. Here, we introduce sparse decomposition light-field microscopy (SDLFM), a computational imaging technique based on light-field microscopy (LFM) that takes algorithmic advantage of the high temporal resolution of LFM and the inherent temporal sparsity of spikes to improve effective spatial resolution and signal-to-noise ratios (SNRs). With increased effective spatial resolution and SNRs, neuronal activity at the single-cell level can be recovered over a large volume. We demonstrate the single-cell imaging capability of SDLFM with
in vivo imaging of neuronal activity of whole brains of larval zebrafish with estimated lateral and axial resolutions ofand , respectively, acquired at volumetric imaging rates up to 50 Hz. We also show that SDLFM increases the quality of neural imaging in adult fruit flies. -
It is widely assumed that distributed neuronal networks are fundamental to the functioning of the brain. Consistent spike timing between neurons is thought to be one of the key principles for the formation of these networks. This can involve synchronous spiking or spiking with time delays, forming spike sequences when the order of spiking is consistent. Finding networks defined by their sequence of time-shifted spikes, denoted here as spike timing networks, is a tremendous challenge. As neurons can participate in multiple spike sequences at multiple between-spike time delays, the possible complexity of networks is prohibitively large. We present a novel approach that is capable of (1) extracting spike timing networks regardless of their sequence complexity, and (2) that describes their spiking sequences with high temporal precision. We achieve this by decomposing frequency-transformed neuronal spiking into separate networks, characterizing each network’s spike sequence by a time delay per neuron, forming a spike sequence timeline. These networks provide a detailed template for an investigation of the experimental relevance of their spike sequences. Using simulated spike timing networks, we show network extraction is robust to spiking noise, spike timing jitter, and partial occurrences of the involved spike sequences. Using rat multi-neuron recordings, we demonstrate the approach is capable of revealing real spike timing networks with sub-millisecond temporal precision. By uncovering spike timing networks, the prevalence, structure, and function of complex spike sequences can be investigated in greater detail, allowing us to gain a better understanding of their role in neuronal functioning.more » « less
-
more » « less
Abstract Objective Temporal coordination between oscillations enables intercortical communication and is implicated in cognition. Focal epileptic activity can affect distributed neural networks and interfere with these interactions. Refractory pediatric epilepsies are often accompanied by substantial cognitive comorbidity, but mechanisms and predictors remain mostly unknown. Here, we investigate oscillatory coupling across large‐scale networks in the developing brain.
Methods We analyzed large‐scale intracranial electroencephalographic recordings in children with medically refractory epilepsy undergoing presurgical workup (
n = 25, aged 3–21 years). Interictal epileptiform discharges (IEDs), pathologic high‐frequency oscillations (HFOs), and sleep spindles were detected. Spatiotemporal metrics of oscillatory coupling were determined and correlated with age, cognitive function, and postsurgical outcome.Results Children with epilepsy demonstrated significant temporal coupling of both IEDs and HFOs to sleep spindles in discrete brain regions. HFOs were associated with stronger coupling patterns than IEDs. These interactions involved tissue beyond the clinically identified epileptogenic zone and were ubiquitous across cortical regions. Increased spatial extent of coupling was most prominent in older children. Poor neurocognitive function was significantly correlated with high IED–spindle coupling strength and spatial extent; children with strong pathologic interactions additionally had decreased likelihood of postoperative seizure freedom.
Significance Our findings identify pathologic large‐scale oscillatory coupling patterns in the immature brain. These results suggest that such intercortical interactions could predict risk for adverse neurocognitive and surgical outcomes, with the potential to serve as novel therapeutic targets to restore physiologic development.
