An official website of the United States government
Traditional miniaturized fluorescence microscopes are critical tools for modern biology. Invariably, they struggle to simultaneously image with a high spatial resolution and a large field of view (FOV). Lensless microscopes offer a solution to this limitation. However, real-time visualization of samples is not possible with lensless imaging, as image reconstruction can take minutes to complete. This poses a challenge for usability, as real-time visualization is a crucial feature that assists users in identifying and locating the imaging target. The issue is particularly pronounced in lensless microscopes that operate at close imaging distances. Imaging at close distances requires shift-varying deconvolution to account for the variation of the point spread function (PSF) across the FOV. Here, we present a lensless microscope that achieves real-time image reconstruction by eliminating the use of an iterative reconstruction algorithm. The neural network-based reconstruction method we show here, achieves more than 10000 times increase in reconstruction speed compared to iterative reconstruction. The increased reconstruction speed allows us to visualize the results of our lensless microscope at more than 25 frames per second (fps), while achieving better than 7 µm resolution over a FOV of 10 mm2. This ability to reconstruct and visualize samples in real-time empowers a more user-friendly interaction with lensless microscopes. The users are able to use these microscopes much like they currently do with conventional microscopes.
more »
« less
Diffuser-based computational imaging funduscope
Poor access to eye care is a major global challenge that could be ameliorated by low-cost, portable, and easy-to-use diagnostic technologies. Diffuser-based imaging has the potential to enable inexpensive, compact optical systems that can reconstruct a focused image of an object over a range of defocus errors. Here, we present a diffuser-based computational funduscope that reconstructs important clinical features of a model eye. Compared to existing diffuser-imager architectures, our system features an infinite-conjugate design by relaying the ocular lens onto the diffuser. This offers shift-invariance across a wide field-of-view (FOV) and an invariant magnification across an extended depth range. Experimentally, we demonstrate fundus image reconstruction over a 33°FOV and robustness to ±4D refractive error using a constant point-spread-function. Combined with diffuser-based wavefront sensing, this technology could enable combined ocular aberrometry and funduscopic screening through a single diffuser sensor.
more »
« less
- PAR ID:
- 10163253
- Publisher / Repository:
- Optical Society of America
- Date Published:
- Journal Name:
- Optics Express
- Volume:
- 28
- Issue:
- 13
- ISSN:
- 1094-4087; OPEXFF
- Format(s):
- Medium: X Size: Article No. 19641
- Size(s):
- Article No. 19641
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Alterations in ocular blood flow have been identified as important risk factors for the onset and progression of numerous diseases of the eye. In particular, several population-based and longitudinal-based studies have provided compelling evidence of hemodynamic biomarkers as independent risk factors for ocular disease throughout several different geographic regions. Despite this evidence, the relative contribution of blood flow to ocular physiology and pathology in synergy with other risk factors and comorbidities (e.g., age, gender, race, diabetes and hypertension) remains uncertain. There is currently no gold standard for assessing all relevant vascular beds in the eye, and the heterogeneous vascular biomarkers derived from multiple ocular imaging technologies are non-interchangeable and difficult to interpret as a whole. As a result of these disease complexities and imaging limitations, standard statistical methods often yield inconsistent results across studies and are unable to quantify or explain a patient's overall risk for ocular disease. Combining mathematical modeling with artificial intelligence holds great promise for advancing data analysis in ophthalmology and enabling individualized risk assessment from diverse, multi-input clinical and demographic biomarkers. Mechanism-driven mathematical modeling makes virtual laboratories available to investigate pathogenic mechanisms, advance diagnostic ability and improve disease management. Artificial intelligence provides a novel method for utilizing a vast amount of data from a wide range of patient types to diagnose and monitor ocular disease. This article reviews the state of the art and major unanswered questions related to ocular vascular anatomy and physiology, ocular imaging techniques, clinical findings in glaucoma and other eye diseases, and mechanistic modeling predictions, while laying a path for integrating clinical observations with mathematical models and artificial intelligence. Viable alternatives for integrated data analysis are proposed that aim to overcome the limitations of standard statistical approaches and enable individually tailored precision medicine in ophthalmology.more » « less
-
Alterations in ocular blood flow have been identified as important risk factors for the onset and progression of numerous diseases of the eye. In particular, several population-based and longitudinal-based studies have provided compelling evidence of hemodynamic biomarkers as independent risk factors for ocular disease throughout several different geographic regions. Despite this evidence, the relative contribution of blood flow to ocular physiology and pathology in synergy with other risk factors and comorbidities (e.g., age, gender, race, diabetes and hypertension) remains uncertain. There is currently no gold standard for assessing all relevant vascular beds in the eye, and the heterogeneous vascular biomarkers derived from multiple ocular imaging technologies are non-interchangeable and difficult to interpret as a whole. As a result of these disease complexities and imaging limitations, standard statistical methods often yield inconsistent results across studies and are unable to quantify or explain a patient's overall risk for ocular disease. Combining mathematical modeling with artificial intelligence holds great promise for advancing data analysis in ophthalmology and enabling individualized risk assessment from diverse, multi-input clinical and demographic biomarkers. Mechanism-driven mathematical modeling makes virtual laboratories available to investigate pathogenic mechanisms, advance diagnostic ability and improve disease management. Artificial intelligence provides a novel method for utilizing a vast amount of data from a wide range of patient types to diagnose and monitor ocular disease. This article reviews the state of the art and major unanswered questions related to ocular vascular anatomy and physiology, ocular imaging techniques, clinical findings in glaucoma and other eye diseases, and mechanistic modeling predictions, while laying a path for integrating clinical observations with mathematical models and artificial intelligence. Viable alternatives for integrated data analysis are proposed that aim to overcome the limitations of standard statistical approaches and enable individually tailored precision medicine in ophthalmology.more » « less
-
Virtual reality sickness typically results from visual-vestibular conflict. Because self-motion from optical flow is driven most strongly by motion at the periphery of the retina, reducing the user’s field-of-view (FOV) during locomotion has proven to be an effective strategy to minimize visual vestibular conflict and VR sickness. Current FOV restrictor implementations reduce the user’s FOV by rendering a restrictor whose center is fixed at the center of the head mounted display (HMD), which is effective when the user’s eye gaze is aligned with head gaze. However, during eccentric eye gaze, users may look at the FOV restrictor itself, exposing them to peripheral optical flow which could lead to increased VR sickness. To address these limitations, we develop a foveated FOV restrictor and we explore the effect of dynamically moving the center of the FOV restrictor according to the user’s eye gaze position. We conducted a user study (n=22) where each participant uses a foveated FOV restrictor and a head-fixed FOV restrictor while navigating a virtual environment. We found no statistically significant difference in VR sickness measures or noticeability between both restrictors. However, there was a significant difference in eye gaze behavior, as measured by eye gaze dispersion, with the foveated FOV restrictor allowing participants to have a wider visual scan area compared to the head-fixed FOV restrictor, which confined their eye gaze to the center of the FOV.more » « less
-
ABSTRACT We present a comprehensive simulation-based study of the bayeseor code for 21 cm power spectrum recovery when analytically marginalizing over foreground parameters. To account for covariance between the 21 cm signal and contaminating foreground emission, bayeseor jointly constructs models for both signals within a Bayesian framework. Due to computational constraints, the forward model is constructed using a restricted field of view (FoV) in the image domain. When the only Epoch of Reionization contaminants are noise and foregrounds, we demonstrate that bayeseor can accurately recover the 21 cm power spectrum when the component of sky emission outside this forward-modelled region is downweighted by the beam at the level of the dynamic range between the foreground and 21 cm signals. However, when all-sky foreground emission is included along with a realistic instrument primary beam with sidelobes above this threshold extending to the horizon, the recovered power spectrum is contaminated by unmodelled sky emission outside the restricted FoV model. Expanding the combined cosmological and foreground model to cover the whole sky is computationally prohibitive. To address this, we present a modified version of bayeseor that allows for an all-sky foreground model, while the modelled 21 cm signal remains only within the primary FoV of the telescope. With this modification, it will be feasible to run an all-sky bayeseor analysis on a sizeable compute cluster. We also discuss several future directions for further reducing the need to model all-sky foregrounds, including wide-field foreground subtraction, an image-domain likelihood utilizing a tapering function, and instrument primary beam design.more » « less
