skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Toward implantable devices for angle-sensitive, lens-less, multifluorescent, single-photon lifetime imaging in the brain using Fabry–Perot and absorptive color filters
Abstract Implantable image sensors have the potential to revolutionize neuroscience. Due to their small form factor requirements; however, conventional filters and optics cannot be implemented. These limitations obstruct high-resolution imaging of large neural densities. Recent advances in angle-sensitive image sensors and single-photon avalanche diodes have provided a path toward ultrathin lens-less fluorescence imaging, enabling plenoptic sensing by extending sensing capabilities to include photon arrival time and incident angle, thereby providing the opportunity for separability of fluorescence point sources within the context of light-field microscopy (LFM). However, the addition of spectral sensitivity to angle-sensitive LFM reduces imager resolution because each wavelength requires a separate pixel subset. Here, we present a 1024-pixel, 50  µm thick implantable shank-based neural imager with color-filter-grating-based angle-sensitive pixels. This angular-spectral sensitive front end combines a metal–insulator–metal (MIM) Fabry–Perot color filter and diffractive optics to produce the measurement of orthogonal light-field information from two distinct colors within a single photodetector. The result is the ability to add independent color sensing to LFM while doubling the effective pixel density. The implantable imager combines angular-spectral and temporal information to demix and localize multispectral fluorescent targets. In this initial prototype, this is demonstrated with 45 μm diameter fluorescently labeled beads in scattering medium. Fluorescent lifetime imaging is exploited to further aid source separation, in addition to detecting pH through lifetime changes in fluorescent dyes. While these initial fluorescent targets are considerably brighter than fluorescently labeled neurons, further improvements will allow the application of these techniques to in-vivo multifluorescent structural and functional neural imaging.  more » « less
Award ID(s):
1706207
PAR ID:
10341932
Author(s) / Creator(s):
; ; ; ;
Date Published:
Journal Name:
Light: Science & Applications
Volume:
11
Issue:
1
ISSN:
2047-7538
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Multiplexed fluorescence detection has become increasingly important in the fields of biosensing and bioimaging. Although a variety of excitation/detection optical designs and fluorescence unmixing schemes have been proposed to allow for multiplexed imaging, rapid and reliable differentiation and quantification of multiple fluorescent species at each imaging pixel is still challenging. Here we present a pulsed interleaved excitation spectral fluorescence lifetime microscopic (PIE-sFLIM) system that can simultaneously image six fluorescent tags in live cells in a single hyperspectral snapshot. Using an alternating pulsed laser excitation scheme at two different wavelengths and a synchronized 16-channel time-resolved spectral detector, our PIE-sFLIM system can effectively excite multiple fluorophores and collect their emission over a broad spectrum for analysis. Combining our system with the advanced live-cell labeling techniques and the lifetime/spectral phasor analysis, our PIE-sFLIM approach can well unmix the fluorescence of six fluorophores acquired in a single measurement, thus improving the imaging speed in live-specimen investigation. 
    more » « less
  2. Light-field fluorescence microscopy can record large-scale population activity of neurons expressing genetically-encoded fluorescent indicators within volumes of tissue. Conventional light-field microscopy (LFM) suffers from poor lateral resolution when using wide-field illumination. Here, we demonstrate a structured-illumination light-field microscopy (SI-LFM) modality that enhances spatial resolution over the imaging volume. This modality increases resolution by illuminating sample volume with grating patterns that are invariant over the axial direction. The size of the SI-LFM point-spread-function (PSF) was approximately half the size of the conventional LFM PSF when imaging fluorescent beads. SI-LFM also resolved fine spatial features in lens tissue samples and fixed mouse retina samples. Finally, SI-LFM reported neural activity with approximately three times the signal-to-noise ratio of conventional LFM when imaging live zebrafish expressing a genetically encoded calcium sensor. 
    more » « less
  3. Simultaneous spectral and polarimetric imaging enables versatile detection and multimodal characterization of targets of interest. Current architectures incorporate a 2×2 pixel arrangement to acquire the full linear polarimetric information causing spatial sampling artifacts. Additionally, they suffer from limited spectral selectivity and high color crosstalk. Here, we demonstrate a bio-inspired spectral and polarization sensor structure based on integrating semitransparent polarization-sensitive organic photovoltaics (P-OPVs) and liquid crystal polymer (LCP) retarders in a tandem configuration. Color tuning is realized by leveraging the dynamic chromatic retardation control of LCP films, while polarization sensitivity is realized by exploiting the flexible anisotropic properties of P-OPVs. The structure is marked by its ultra-thin design and its ability to detect spectral and polarimetric contents along the same optical axis, thereby overcoming the inherent limitations associated with conventional division-of-focal plane sensors. 
    more » « less
  4. Colorimetric sensors offer the prospect for on-demand sensing diagnostics in simple and low-cost form factors, enabling rapid spatiotemporal inspection by digital cameras or the naked eye. However, realizing strong dynamic color variations in response to small changes in sample properties has remained a considerable challenge, which is often pursued through the use of highly responsive materials under broadband illumination. In this work, we demonstrate a general colorimetric sensing technique that overcomes the performance limitations of existing chromatic and luminance-based sensing techniques. Our approach combines structural color optical filters as sensing elements alongside a multichromatic laser illuminant. We experimentally demonstrate our approach in the context of label-free biosensing and achieve ultrasensitive and perceptually enhanced chromatic color changes in response to refractive index changes and small molecule surface attachment. Using structurally enabled chromaticity variations, the human eye is able to resolve ∼0.1-nm spectral shifts with low-quality factor (e.g., Q ∼ 15) structural filters. This enables spatially resolved biosensing in large area (approximately centimeters squared) lithography-free sensing films with a naked eye limit of detection of ∼3 pg/mm 2 , lower than industry standard sensors based on surface plasmon resonance that require spectral or angular interrogation. This work highlights the key roles played by both the choice of illuminant and design of structural color filter, and it offers a promising pathway for colorimetric devices to meet the strong demand for high-performance, rapid, and portable (or point-of-care) diagnostic sensors in applications spanning from biomedicine to environmental/structural monitoring. 
    more » « less
  5. Schmidt, Dirk; Schreiber, Laura; Vernet, Elise (Ed.)
    Inner working angle is a key parameter for enabling scientific discovery in direct exoplanet imaging and characterization. Approaches to improving the inner working angle to reach the diffraction limit center on the sensing and control of wavefront errors, starlight suppression via coronagraphy, and differential techniques applied in post-processing. These approaches are ultimately limited by the shot noise of the residual starlight, placing a premium on the ability of the adaptive optics system to sense and control wavefront errors so that the coronagraph can effectively suppress starlight reaching the science focal plane. Photonic lanterns are attractive for use in the science focal plane because of their ability to spatially filter light using a finite basis of accepted modes and effectively couple the results to diffraction-limited spectrometers, providing a compact and cost-effective means to implement post-processing based on spectral diversity. We aim to characterize the ability of photonic lanterns to serve as focal-plane wavefront sensors, allowing the adaptive optics system to control aberrations affecting the science focal plane and reject additional stellar photon noise. By serving as focal-plane wavefront sensors, photonic lanterns can improve sensitivity to exoplanets through both direct and coronagraphic observations. We have studied the sensing capabilities of photonic lanterns in the linear and quadratic regimes with analytical and numerical treatments for different lantern geometries (including non-mode-selective, mode-selective, and hybrid geometries) as a function of port number. In this presentation we report on the sensitivity of such lanterns and comment on the relative suitability and sensitivity impacts of different lantern geometries for focal-plane wavefront sensing. 
    more » « less