skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Reinforcement Learning-Guided Optogenetic Stimulation Policies for Robust Functional Network Discovery
Optogenetic stimulation has opened up a new avenue to probe neuronal circuitry at high spatiotemporal resolutions. A key challenge in optogenetic stimulation is deciding which subset out of thousands of neurons should be stimulated to elicit a desired network activation or affect behavior. In this work, we introduce a reinforcement learning approach to adaptively narrow down the multitude of stimulation possibilities and robustly identify Granger causal networks that underlie neuronal activity. We use realistic simulations with different underlying circuitry to show the effectiveness of reinforcement learning in identifying an optimal policy for selecting stimulation targets.  more » « less
Award ID(s):
2032649 2020624
PAR ID:
10546497
Author(s) / Creator(s):
; ; ;
Publisher / Repository:
IEEE
Date Published:
ISBN:
979-8-3503-4485-1
Page Range / eLocation ID:
13271 to 13275
Format(s):
Medium: X
Location:
2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Seoul, Korea
Sponsoring Org:
National Science Foundation
More Like this
  1. Miniaturization of the neuromodulation system is important for non-invasive or sub-invasive optogenetic application. This work presents an optimized wireless power transfer (WPT) system integrated with an on-chip rectification circuitry and an off-chip stimulation circuitry for optogenetic stimulation of freely moving rodents. The proposed WPT system is built using parallel transmitter (TX) coils on printed circuit board (PCB) and wire-wound based receiver (RX) coil followed by a seven-stage voltage doubler and a low dropout regulator (LDO) circuit designed in 180 nm standard Complementary Metal Oxide Semiconductor (CMOS) process. A pulse stimulation is used to stimulate the neurons which is generated using a commercially available off-the-shelf (COTS) components based oscillator circuit. The intensity of the stimulation is controlled by using a COTS based LED driver circuit which controls the current through the μ LED. The total dimension of the RX coil is 8 mm × 3.4 mm. The maximum power transfer efficiency (PTE) of the proposed WPT system is ∼ 35% and the power conversion efficiency (PCE) of the rectifier is 52%. The proposed system with reconfigurable stimulation frequency is suitable for exciting different brain areas for long-term health monitoring. 
    more » « less
  2. Abstract The use of optogenetic stimulation to evoke neuronal activity in targeted neural populations—enabled by opsins with fast kinetics, high sensitivity and cell-type and subcellular specificity—is a powerful tool in neuroscience. However, to interface with the opsins, deep-brain light delivery systems are required that match the scale of the spatial and temporal control offered by the molecular actuators. Here we show that organic light-emitting diodes can be combined with complementary metal–oxide–semiconductor technology to create bright, actively multiplexed emissive elements. We create implantable shanks in which 1,024 individually addressable organic light-emitting diode pixels with a 24.5 µm pitch are integrated with active complementary metal–oxide–semiconductor drive and control circuitry. This integration is enabled by controlled electrode conditioning, monolithic deposition of the organic light-emitting diodes and optimized thin-film encapsulation. The resulting probes can be used to access brain regions as deep as 5 mm and selectively activate individual neurons with millisecond-level precision in mice. 
    more » « less
  3. Perceptual experiences may arise from neuronal activity patterns in mammalian neocortex. We probed mouse neocortex during visual discrimination using a red-shifted channelrhodopsin (ChRmine, discovered through structure-guided genome mining) alongside multiplexed multiphoton-holography (MultiSLM), achieving control of individually specified neurons spanning large cortical volumes with millisecond precision. Stimulating a critical number of stimulus-orientation-selective neurons drove widespread recruitment of functionally related neurons, a process enhanced by (but not requiring) orientation-discrimination task learning. Optogenetic targeting of orientation-selective ensembles elicited correct behavioral discrimination. Cortical layer–specific dynamics were apparent, as emergent neuronal activity asymmetrically propagated from layer 2/3 to layer 5, and smaller layer 5 ensembles were as effective as larger layer 2/3 ensembles in eliciting orientation discrimination behavior. Population dynamics emerging after optogenetic stimulation both correctly predicted behavior and resembled natural internal representations of visual stimuli at cellular resolution over volumes of cortex. 
    more » « less
  4. We describe and analyze a computational model of neural circuits in the mammalian spinal cord responsible for generating and shaping locomotor-like oscillations. The model represents interacting populations of spinal neurons, including the neurons that were genetically identified and characterized in a series of previous experimental studies. Here, we specifically focus on the ipsilaterally projecting V1 interneurons, their possible role in the spinal locomotor circuitry, and their involvement in the generation of locomotor oscillations. The proposed connections of these neurons and their involvement in different neuronal pathways in the spinal cord allow the model to reproduce the results of optogenetic manipulations of these neurons under different experimental conditions. We suggest the existence of two distinct populations of V1 interneurons mediating different ipsilateral and contralateral interactions within the spinal cord. The model proposes explanations for multiple experimental data concerning the effects of optogenetic silencing and activation of V1 interneurons on the frequency of locomotor oscillations in the intact cord and hemicord under different experimental conditions. Our simulations provide an important insight into the organization of locomotor circuitry in the mammalian spinal cord. 
    more » « less
  5. The ability to manipulate specific neuronal populations of the spinal cord following spinal cord injury (SCI) could prove highly beneficial for rehabilitation in patients through maintaining and strengthening still existing neuronal connections and/or facilitating the formation of new connections. A non-invasive and highly specific approach to neuronal stimulation is bioluminescent-optogenetics (BL-OG), where genetically expressed light emitting luciferases are tethered to light sensitive channelrhodopsins (luminopsins, LMO); neurons are activated by the addition of the luciferase substrate coelenterazine (CTZ). This approach utilizes ion channels for current conduction while activating the channels through the application of a small chemical compound, thus allowing non-invasive stimulation and recruitment of all targeted neurons. Rats were transduced in the lumbar spinal cord with AAV2/9 to express the excitatory LMO3 under control of a pan-neuronal or motor neuron-specific promoter. A day after contusion injury of the thoracic spine, rats received either CTZ or vehicle every other day for 2 weeks. Activation of either neuron population below the level of injury significantly improved locomotor recovery lasting beyond the treatment window. Utilizing histological and gene expression methods we identified neuronal plasticity as a likely mechanism underlying the functional recovery. These findings provide a foundation for a rational approach to spinal cord injury rehabilitation, thereby advancing approaches for functional recovery after SCI. Summary Bioluminescent optogenetic activation of spinal neurons results in accelerated and enhanced locomotor recovery after spinal cord injury in rats. 
    more » « less