Search for: All records

Recent advances in computer vision algorithms and video streaming technologies have facilitated the development of edge-server-based video analytics systems, enabling them to process sophisticated real-world tasks, such as traffic surveillance and workspace monitoring. Meanwhile, due to their omnidirectional recording capability, 360-degree cameras have been proposed to replace traditional cameras in video analytics systems to offer enhanced situational awareness. Yet, we found that providing an efficient 360-degree video analytics framework is a non-trivial task. Due to the higher resolution and geometric distortion in 360-degree videos, existing video analytics pipelines fail to meet the performance requirements for end-to-end latency and query accuracy. To address these challenges, we introduce the innovative ST-360 framework specifically designed for 360-degree video analytics. This framework features a spatial-temporal filtering algorithm that optimizes both data transmission and computational workloads. Evaluation of the ST-360 framework on a unique dataset of 360-degree first-responders videos reveals that it yields accurate query results with a 50% reduction in end-to-end latency compared to state-of-the-art methods.

 

Two-photon excited fluorescence (TPEF) is a powerful technique that enables the examination of intrinsic retinal fluorophores involved in cellular metabolism and the visual cycle. Although previous intensity-based TPEF studies in non-human primates have successfully imaged several classes of retinal cells and elucidated aspects of both rod and cone photoreceptor function, fluorescence lifetime imaging (FLIM) of the retinal cells under light-dark visual cycle has yet to be fully exploited. Here we demonstrate a FLIM assay of photoreceptors and retinal pigment epithelium (RPE) that reveals key insights into retinal physiology and adaptation. We found that photoreceptor fluorescence lifetimes increase and decrease in sync with light and dark exposure, respectively. This is likely due to changes in all-trans-retinol and all-trans-retinal levels in the outer segments, mediated by phototransduction and visual cycle activity. During light exposure, RPE fluorescence lifetime was observed to increase steadily over time, as a result of all-trans-retinol accumulation during the visual cycle and decreasing metabolism caused by the lack of normal perfusion of the sample. Our system can measure the fluorescence lifetime of intrinsic retinal fluorophores on a cellular scale, revealing differences in lifetime between retinal cell classes under different conditions of light and dark exposure.

 

Carbon and semiconductor nanoparticles are promising photothermal materials for various solar-driven applications. Inevitable recombination of photoinduced charge carriers in a single constituent, however, hinders the realization of a greater photothermal effect. Core–shell heterostructures utilizing the donor–acceptor pair concept with high-quality interfaces can inhibit energy loss from the radiation relaxation of excited species, thereby enhancing the photothermal effect. Here, core–shell structures composed of a covellite (CuS) shell (acceptor) and spherical carbon nanoparticle (CP) core (donor) (abbreviated as CP/CuS) are proposed to augment the photothermal conversion efficiency via the Förster resonance energy transfer (FRET) mechanism. The close proximity and spectral overlap of the donor and acceptor trigger the FRET mechanism, where the electronic excitation relaxation energy of the CP reinforces the plasmonic resonance and near-infrared absorption in CuS, resulting in boosting the overall photothermal conversion efficiency. CP/CuS core–shell coated on polyurethane (PU) foam exhibits a total solar absorption of 97.1%, leading to an elevation in surface temperature of 61.6 °C in dry conditions under simulated solar illumination at a power density of 1 kW m–2 (i.e., 1 sun). Leveraging the enhanced photothermal conversion emanated from the energy transfer effect in the core–shell structure, CP/CuS-coated PU foam achieves an evaporation rate of 1.62 kg m–2 h–1 and an energy efficiency of 93.8%. Thus, amplifying photothermal energy generation in core–shell structures via resonance energy transfer can be promising in solar energy-driven applications and thus merits further exploration. 

Multiplexed fluorescence detection has become increasingly important in the fields of biosensing and bioimaging. Although a variety of excitation/detection optical designs and fluorescence unmixing schemes have been proposed to allow for multiplexed imaging, rapid and reliable differentiation and quantification of multiple fluorescent species at each imaging pixel is still challenging. Here we present a pulsed interleaved excitation spectral fluorescence lifetime microscopic (PIE-sFLIM) system that can simultaneously image six fluorescent tags in live cells in a single hyperspectral snapshot. Using an alternating pulsed laser excitation scheme at two different wavelengths and a synchronized 16-channel time-resolved spectral detector, our PIE-sFLIM system can effectively excite multiple fluorophores and collect their emission over a broad spectrum for analysis. Combining our system with the advanced live-cell labeling techniques and the lifetime/spectral phasor analysis, our PIE-sFLIM approach can well unmix the fluorescence of six fluorophores acquired in a single measurement, thus improving the imaging speed in live-specimen investigation.