Traditional miniaturized fluorescence microscopes are critical tools for modern biology. Invariably, they struggle to simultaneously image with a high spatial resolution and a large field of view (FOV). Lensless microscopes offer a solution to this limitation. However, real-time visualization of samples is not possible with lensless imaging, as image reconstruction can take minutes to complete. This poses a challenge for usability, as real-time visualization is a crucial feature that assists users in identifying and locating the imaging target. The issue is particularly pronounced in lensless microscopes that operate at close imaging distances. Imaging at close distances requires shift-varying deconvolution to account for the variation of the point spread function (PSF) across the FOV. Here, we present a lensless microscope that achieves real-time image reconstruction by eliminating the use of an iterative reconstruction algorithm. The neural network-based reconstruction method we show here, achieves more than 10000 times increase in reconstruction speed compared to iterative reconstruction. The increased reconstruction speed allows us to visualize the results of our lensless microscope at more than 25 frames per second (fps), while achieving better than 7 µm resolution over a FOV of 10 mm2. This ability to reconstruct and visualize samples in real-time empowers a more user-friendly interaction with lensless microscopes. The users are able to use these microscopes much like they currently do with conventional microscopes.
- Award ID(s):
- 1633516
- NSF-PAR ID:
- 10288504
- Date Published:
- Journal Name:
- Science Advances
- Volume:
- 6
- Issue:
- 43
- ISSN:
- 2375-2548
- Page Range / eLocation ID:
- eabb7508
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
more » « less
-
Light-sheet microscopes must compromise among field of view, optical sectioning, resolution, and detection efficiency. High-numerical-aperture (NA) detection objective lenses provide higher resolution, but their narrow depth of field inefficiently captures the fluorescence signal generated throughout the thickness of the illumination light sheet when imaging large volumes. Here, we present ExD-SPIM (extended depth-of-field selective-plane illumination microscopy), an improved light-sheet microscopy strategy that solves this limitation by extending the depth of field (DOF) of high-NA detection objectives to match the thickness of the illumination light sheet. This extension of the DOF uses a phase mask to axially stretch the point-spread function of the objective lens while largely preserving lateral resolution. This matching of the detection DOF to the illumination-sheet thickness increases the total fluorescence collection, reduces the background, and improves the overall signal-to-noise ratio (SNR), as shown by numerical simulations, imaging of bead phantoms, and imaging living animals. In comparison to conventional light sheet imaging with low-NA detection that yields equivalent DOF, the results show that ExD-SPIM increases the SNR by more than threefold and dramatically reduces the rate of photobleaching. Compared to conventional high-NA detection, ExD-SPIM improves the signal sensitivity and volumetric coverage of whole-brain activity imaging, increasing the number of detected neurons by over a third.more » « less
-
An eight-element oil-filled hydrophone array is used to measure the acoustic field in littoral waters. This prototype array was deployed during an experiment between Jeffrey’s Ledge and the Stellwagen Bank region off the coast of Rockport, Massachusetts USA. During the experiment, several humpback whale vocalizations, distant ship tonals and high frequency conventional echosounder pings were recorded. Visual confirmation of humpback moving in bearing relative to the array verifies the directional sensing from array beamforming. During deployment, the array is towed at speeds varying from 4-7 kts in water depths of roughly 100 m with conditions at sea state 2 to 3. This array system consists of a portable winch with array, tow cable and 3 water-resistant boxes housing electronics. This system is deployed and operated by 2 crew members onboard a 13 m commercial fishing vessel during the experiment. Non-acoustic sensor (NAS) information is obtained to provide depth, temperature, and heading data using commercial off the shelf (COTS) components utilizing RS485/232 data communications. Acoustic data sampling was performed at 8 kHz, 30 kHz and 100 kHz with near real-time processing of data and enhanced Signal to Noise Ratio (SNR) from beamforming. The electrical system components are deployed with 3 stacked electronics boxes housing power, data acquisition and data processing components in water resistant compartments. A laptop computer with 8 TB of external storage and an independent Global Positioning System (GPS) antenna is used to run Passive Ocean Acoustic Waveguide Remote Sensing (POAWRS) software providing beamformed spectrogram data and live NAS data with capability of capturing several days of data. The acquisition system consists of Surface Mount Device (SMD) pre-amplifiers with filter to an analog differential pair shipboard COTS acquisition system. Pre-amplifiers are constructed using SMD technology where components are pressure tolerant and potting is not necessary. Potting of connectors, electronics and hydrophones via 3D printed molding techniques will be discussed. Array internal components are manufactured with Thermoplastic Polyurethane (TPU) 3D printed material to dampen array vibrations with forward and aft vibration isolation modules (VIM). Polyurethane foam (PUF) used to scatter breathing waves and dampen contact from wires inside the array without attenuating high frequencies and allowing for significant noise reduction. A single Tygon array section with a length of 7.5 m and diameter of 38 mm contains 8 transducer elements with a spacing of 75 cm (1 kHz design frequency). Pre- amplifiers and NAS modules are affixed using Vectran and steel wire rope positioned by swaged stops along the strength member. The tow cable length is 100 m with a diameter of 22 mm that is potted to a hose adapter to break out 12 braided copper wire twisted pair conductors and terminates the tow cable Vectran braid. This array in its current state of development is a low-cost alternative to obtain quality acoustic data from a towed array system. Used here for observation of whale vocalizations, this type of array also has many applications in military sonar and seismic surveying. Maintenance on the array can be performed without the use of special facilities or equipment for dehosing and conveniently uses castor oil as an environmentally safe pressure compensating and coupling fluid. Array development including selection of transducers, NAS modules, acoustic acquisition system, array materials and method of construction with results from several deployments will be discussed. We also present beamformed spectrograms containing humpback whale downsweep moans and underwater blowing (bubbles) sounds associated with feeding on sand lance (Ammodytes dubius).more » « less
-
more » « less
Light field microscopy (LFM) is an emerging technology for high-speed wide-field 3D imaging by capturing 4D light field of 3D volumes. However, its 3D imaging capability comes at a cost of lateral resolution. In addition, the lateral resolution is not uniform across depth in the light field dconvolution reconstructions. To address these problems, here, we propose a snapshot multifocal light field microscopy (MFLFM) imaging method. The underlying concept of the MFLFM is to collect multiple focal shifted light fields simultaneously. We show that by focal stacking those focal shifted light fields, the depth-of-field (DOF) of the LFM can be further improved but without sacrificing the lateral resolution. Also, if all differently focused light fields are utilized together in the deconvolution, the MFLFM could achieve a high and uniform lateral resolution within a larger DOF. We present a house-built MFLFM system by placing a diffractive optical element at the Fourier plane of a conventional LFM. The optical performance of the MFLFM are analyzed and given. Both simulations and proof-of-principle experimental results are provided to demonstrate the effectiveness and benefits of the MFLFM. We believe that the proposed snapshot MFLFM has potential to enable high-speed and high resolution 3D imaging applications.
-
more » « less
Confocal microscopes and two-photon microscopes are powerful tools for early cancer diagnosis because of their high-resolution 3D imaging capability, but applying them for clinical use in internal organs is hindered by the lack of axially tunable lens modules with small size, high image quality and large tuning range. This paper reports a compact MEMS lens scanner that has the potential to overcome this limitation. The MEMS lens scanner consists of a MEMS microstage and a microlens. The MEMS microstage is based on a unique serpentine inverted-series-connected (ISC) electrothermal bimorph actuator design. The microlens is an aspheric glass lens to ensure optical quality. The MEMS microstage has been fabricated and the lens scanner has been successfully assembled. The entire lens scanner is circular with an outer diameter of 4.4 mm and a clear optical aperture of 1.8 mm. Experiments show that the tunable range reaches over 200 µm at only 10.5 V and the stiffness of the microstage is 6.2 N/m. Depth scan imaging by the MEMS lens scanner has also been demonstrated with a 2.2 µm resolution, only limited by the available resolution target.
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Journal Article:
- https://doi.org/10.1126/sciadv.abb7508
