skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: An Optogenetic Brain System (OBServ) to Restore Visual Perception in the Blind
Ultra-large mesoscopic imaging advances in the cortex open new pathways to develop neuroprosthetics to restore foveal vision in blind patients. Using targeted optogenetic activation, an optical prosthetic can focally stimulate spatially localized lateral geniculate nucleus (LGN) synaptic boutons within the primary visual cortex (V1). If we localize a cluster within a specific hypercolumn’s input layer, we will find that activation of a subset of these boutons is perceptually fungible with the activation of a different subset of boutons from the same hypercolumn input module. By transducing these LGN neurons with light-sensitive proteins, they are now sensitive to light and we can optogenetically stimulate them in a pattern mimicking naturalistic visual input. Optogenetic targeting of these purely glutamatergic inputs is free from unwanted co-activation of inhibitory neurons (a common problem in electrode-based prosthetic devices, which result in diminished contrast perception). We must prosthetically account for rapidly changing cortical activity and gain control, so our system integrates a real-time cortical read-out mechanism to continually assess and provide feedback to modify stimulation levels, just as the natural visual system does. We accomplish this by readingout a multi-colored array of genetically-encoded and transduced bioluminescent calcium responses in V1 neurons. This hyperspectral array of colors can achieve single-cell resolution. By tracking eye movements in the blind patients, we will account for oculomotor effects by adjusting the contemporaneous stimulation of the LGN boutons to mimic the effects of natural vision, including those from eye movements. This system, called the Optogenetic Brain System (OBServ), is designed to function by optimally activating visual responses in V1 from a fully-implantable coplanar emitter array coupled with a video camera and a bioluminescent read-out system. It follows that if we stimulate the LGN input modules in the same pattern as natural vision, the recipient should perceive naturalistic prosthetic vision. As such, the system holds the promise of restoring vision in the blind at the highest attainable acuity, with maximal contrast sensitivity, using an integrated nanophotonic implantable device that receives eye-tracked video input from a head-mounted video camera, using relatively non-invasive prosthetic technology that does not cross the pia mater of the brain.  more » « less
Award ID(s):
1734887
PAR ID:
10431040
Author(s) / Creator(s):
Date Published:
Journal Name:
Society for Neuroscience (SfN) 2022 Conference
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. This paper offers a theory for the origin of direction selectivity (DS) in the macaque primary visual cortex, V1. DS is essential for the perception of motion and control of pursuit eye movements. In the macaque visual pathway, neurons with DS first appear in V1, in the Simple cell population of the Magnocellular input layer 4Cα. The lateral geniculate nucleus (LGN) cells that project to these cortical neurons, however, are not direction selective. We hypothesize that DS is initiated in feed-forward LGN input, in the summed responses of LGN cells afferent to a cortical cell, and it is achieved through the interplay of 1) different visual response dynamics of ON and OFF LGN cells and 2) the wiring of ON and OFF LGN neurons to cortex. We identify specific temporal differences in the ON/OFF pathways that, together with item 2, produce distinct response time courses in separated subregions; analysis and simulations confirm the efficacy of the mechanisms proposed. To constrain the theory, we present data on Simple cells in layer 4Cα in response to drifting gratings. About half of the cells were found to have high DS, and the DS was broadband in spatial and temporal frequency (SF and TF). The proposed theory includes a complete analysis of how stimulus features such as SF and TF interact with ON/OFF dynamics and LGN-to-cortex wiring to determine the preferred direction and magnitude of DS. 
    more » « less
  2. Abstract The fluorescent glutamate indicator iGluSnFR enables imaging of neurotransmission with genetic and molecular specificity. However, existing iGluSnFR variants exhibit low in vivo signal-to-noise ratios, saturating activation kinetics and exclusion from postsynaptic densities. Using a multiassay screen in bacteria, soluble protein and cultured neurons, we generated variants with improved signal-to-noise ratios and kinetics. We developed surface display constructs that improve iGluSnFR’s nanoscopic localization to postsynapses. The resulting indicator iGluSnFR3 exhibits rapid nonsaturating activation kinetics and reports synaptic glutamate release with decreased saturation and increased specificity versus extrasynaptic signals in cultured neurons. Simultaneous imaging and electrophysiology at individual boutons in mouse visual cortex showed that iGluSnFR3 transients report single action potentials with high specificity. In vibrissal sensory cortex layer 4, we used iGluSnFR3 to characterize distinct patterns of touch-evoked feedforward input from thalamocortical boutons and both feedforward and recurrent input onto L4 cortical neuron dendritic spines. 
    more » « less
  3. Abstract In the primate visual system, visual object recognition involves a series of cortical areas arranged hierarchically along the ventral visual pathway. As information flows through this hierarchy, neurons become progressively tuned to more complex image features. The circuit mechanisms and computations underlying the increasing complexity of these receptive fields (RFs) remain unidentified. To understand how this complexity emerges in the secondary visual area (V2), we investigated the functional organization of inputs from the primary visual cortex (V1) to V2 by combining retrograde anatomical tracing of these inputs with functional imaging of feature maps in macaque monkey V1 and V2. We found that V1 neurons sending inputs to single V2 orientation columns have a broad range of preferred orientations, but are strongly biased towards the orientation represented at the injected V2 site. For each V2 site, we then constructed a feedforward model based on the linear combination of its anatomically- identified large-scale V1 inputs, and studied the response proprieties of the generated V2 RFs. We found that V2 RFs derived from the linear feedforward model were either elongated versions of V1 filters or had spatially complex structures. These modeled RFs predicted V2 neuron responses to oriented grating stimuli with high accuracy. Remarkably, this simple model also explained the greater selectivity to naturalistic textures of V2 cells compared to their V1 input cells. Our results demonstrate that simple linear combinations of feedforward inputs can account for the orientation selectivity and texture sensitivity of V2 RFs. 
    more » « less
  4. Abstract High-resolution awake mouse fMRI remains challenging despite extensive efforts to address motion-induced artifacts and stress. This study introduces an implantable radiofrequency (RF) surface coil design that minimizes image distortion caused by the air/tissue interface of mouse brains while simultaneously serving as a headpost for fixation during scanning. Using a 14T scanner, high-resolution fMRI enabled brain-wide functional mapping of visual and vibrissa stimulation at 100x100x200µm resolution with a 2s per frame sampling rate. Besides activated ascending visual and vibrissa pathways, robust BOLD responses were detected in the anterior cingulate cortex upon visual stimulation and spread through the ventral retrosplenial area (VRA) with vibrissa air-puff stimulation, demonstrating higher-order sensory processing in association cortices of awake mice. In particular, the rapid hemodynamic responses in VRA upon vibrissa stimulation showed a strong correlation with the hippocampus, thalamus, and prefrontal cortical areas. Cross-correlation analysis with designated VRA responses revealed early positive BOLD signals at the contralateral barrel cortex (BC) occurring 2 seconds prior to the air-puff in awake mice with repetitive stimulation, which was not detectable with the randomized stimulation paradigm. This early BC activation indicated learned anticipation through the vibrissa system and association cortices in awake mice under continuous training of repetitive air-puff stimulation. This work establishes a high-resolution awake mouse fMRI platform, enabling brain-wide functional mapping of sensory signal processing in higher association cortical areas. Significance StatementThis awake mouse fMRI platform was developed by implementing an advanced implantable radiofrequency (RF) coil scheme, which simultaneously served as a headpost to secure the mouse head during scanning. The ultra-high spatial resolution (100x100x200µm) BOLD fMRI enabled the brain-wide mapping of activated visual and vibrissa systems during sensory stimulation in awake mice, including association cortices, e.g. anterior cingulate cortex and retrosplenial cortex, for high order sensory processing. Also, the activation of barrel cortex at 2 s prior to the air-puff indicated a learned anticipation of awake mice under continuous training of the repetitive vibrissa stimulation. 
    more » « less
  5. Abstract To produce consistent sensory perception, neurons must maintain stable representations of sensory input. However, neurons in many regions exhibit progressive drift across days. Longitudinal studies have found stable responses to artificial stimuli across sessions in visual areas, but it is unclear whether this stability extends to naturalistic stimuli. We performed chronic 2-photon imaging of mouse V1 populations to directly compare the representational stability of artificial versus naturalistic visual stimuli over weeks. Responses to gratings were highly stable across sessions. However, neural responses to naturalistic movies exhibited progressive representational drift across sessions. Differential drift was present across cortical layers, in inhibitory interneurons, and could not be explained by differential response strength or higher order stimulus statistics. However, representational drift was accompanied by similar differential changes in local population correlation structure. These results suggest representational stability in V1 is stimulus-dependent and may relate to differences in preexisting circuit architecture of co-tuned neurons. 
    more » « less