skip to main content


Title: Using deep learning for the automated identification of cone and rod photoreceptors from adaptive optics imaging of the human retina

Adaptive optics imaging has enabled the enhanced in vivo retinal visualization of individual cone and rod photoreceptors. Effective analysis of such high-resolution, feature rich images requires automated, robust algorithms. This paper describes RC-UPerNet, a novel deep learning algorithm, for identifying both types of photoreceptors, and was evaluated on images from central and peripheral retina extending out to 30° from the fovea in the nasal and temporal directions. Precision, recall and Dice scores were 0.928, 0.917 and 0.922 respectively for cones, and 0.876, 0.867 and 0.870 for rods. Scores agree well with human graders and are better than previously reported AI-based approaches.

 
more » « less
Award ID(s):
2133650
NSF-PAR ID:
10370317
Author(s) / Creator(s):
; ; ; ; ; ;
Publisher / Repository:
Optical Society of America
Date Published:
Journal Name:
Biomedical Optics Express
Volume:
13
Issue:
10
ISSN:
2156-7085
Page Range / eLocation ID:
Article No. 5082
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Non-confocal adaptive optics scanning laser ophthalmoscopy (AOSLO) has enhanced the study of human retinal photoreceptors by providing complementary information to standard confocal AOSLO images. Previously we developed the first confocal handheld AOSLO (HAOSLO) capable ofin vivocone photoreceptor imaging in supine and non-cooperative patients. Here, we introduce the first multimodal (M-)HAOSLO for confocal and non-confocal split-detection (SD) imaging to allow for more comprehensive patient data collection. Aside from its unprecedented miniature size and weight, M-HAOSLO is also the first system to perform sensorless wavefront-corrected SD imaging of cone photoreceptors.

     
    more » « less
  2. The fovea is one of the most studied retinal specializations in vertebrates, which consists of an invagination of the retinal tissue with high packing of cone photoreceptors, leading to high visual resolution. Between species, foveae differ morphologically in the depth and width of the foveal pit and the steepness of the foveal walls, which could influence visual perception. However, there is no standardized methodology to measure the contour of the foveal pit across species. We present here FOVEA, a program for the quantification of foveal parameters (width, depth, slope of foveal pit) using images from histological cross-sections or optical coherence tomography (OCT). FOVEA is based on a new algorithm to detect the inner retina contour based on the color variation of the image. We evaluated FOVEA by comparing the fovea morphology of two Passerine birds based on histological cross-sections and its performance with data from previously published OCT images. FOVEA detected differences between species and its output was not significantly different from previous estimates using OCT software. FOVEA can be used for comparative studies to better understand the evolution of the fovea morphology in vertebrates as well as for diagnostic purposes in veterinary pathology. FOVEA is freely available for academic use and can be downloaded at:http://estebanfj.bio.purdue.edu/fovea.

     
    more » « less
  3. Bioengineering systems have transformed scientific knowledge of cellular behaviors in the nervous system (NS) and pioneered innovative, regenerative therapies to treat adult neural disorders. Microscale systems with characteristic lengths of single to hundreds of microns have examined the development and specialized behaviors of numerous neuromuscular and neurosensory components of the NS. The visual system is comprised of the eye sensory organ and its connecting pathways to the visual cortex. Significant vision loss arises from dysfunction in the retina, the photosensitive tissue at the eye posterior that achieves phototransduction of light to form images in the brain. Retinal regenerative medicine has embraced microfluidic technologies to manipulate stem-like cells for transplantation therapies, where de/differentiated cells are introduced within adult tissue to replace dysfunctional or damaged neurons. Microfluidic systems coupled with stem cell biology and biomaterials have produced exciting advances to restore vision. The current article reviews contemporary microfluidic technologies and microfluidics-enhanced bioassays, developed to interrogate cellular responses to adult retinal cues. The focus is on applications of microfluidics and microscale assays within mammalian sensory retina, or neuro retina, comprised of five types of retinal neurons (photoreceptors, horizontal, bipolar, amacrine, retinal ganglion) and one neuroglia (Müller), but excludes the non-sensory, retinal pigmented epithelium. 
    more » « less
  4. Key points

    Most vertebrate eyes have rods for dim‐light vision and cones for brighter light and higher temporal sensitivity.

    Rods evolved from cone‐like precursors through expression of different transduction genes or the same genes at different expression levels, but we do not know which molecular differences were most important.

    We approached this problem by analysing rod and cone responses with the same model but with different values for model parameters. We showed that, in addition to outer‐segment volume, the most important differences between rods and cones are: (1) decreased transduction gain, reflecting smaller amplification in the G‐protein cascade; (2) a faster rate of turnover of the second messenger cGMP in darkness; and (3) an accelerated rate of decay of the effector enzyme phosphodiesterase and perhaps also of activated visual pigment.

    We believe our analysis has identified the principal alterations during evolution responsible for the duplex retina.

    Abstract

    Most vertebrates have rod and cone photoreceptors, which differ in their sensitivity and response kinetics. We know that rods evolved from cone‐like precursors through the expression of different transduction genes or the same genes at different levels, but we do not know which molecular differences were most important. We have approached this problem in mouse retina by analysing the kinetic differences between rod flash responses and recent voltage‐clamp recordings of cone flash responses, using a model incorporating the principal features of photoreceptor transduction. We apply a novel method of analysis using the log‐transform of the current, and we ask which of the model's dynamic parameters need be changed to transform the flash response of a rod into that of a cone. The most important changes are a decrease in the gain of the response, reflecting a reduction in amplification of the transduction cascade; an increase in the rate of turnover of cGMP in darkness; and an increase in the rate of decay of activated phosphodiesterase, with perhaps also an increase in the rate of decay of light‐activated visual pigment. Although we cannot exclude other differences, and in particular alterations in the Ca2+economy of the photoreceptors, we believe that we have identified the kinetic parameters principally responsible for the differences in the flash responses of the two kinds of photoreceptors, which were likely during evolution to have resulted in the duplex retina.

     
    more » « less
  5. Abstract

    During vertebrate retinal development, transient populations of retinal progenitor cells with restricted cell fate choices are formed. One of these progenitor populations expresses the Thrb gene and can be identified by activity of the ThrbCRM1 cis-regulatory element. Short-term assays have concluded that these cells preferentially generate cone photoreceptors and horizontal cells, however developmental timing has precluded an extensive cell type characterization of their progeny. Here we describe the development and validation of a recombinase-based lineage tracing system for the chicken embryo to further characterize the lineage of these cells. The ThrbCRM1 element was found to preferentially form photoreceptors and horizontal cells, as well as a small number of retinal ganglion cells. The photoreceptor cell progeny are exclusively cone photoreceptors and not rod photoreceptors, confirming that ThrbCRM1 progenitor cells are restricted from the rod fate. In addition, specific subtypes of horizontal cells and retinal ganglion cells were overrepresented, suggesting that ThrbCRM1 progenitor cells are not only restricted for cell type, but for cell subtype as well.

     
    more » « less