Search for: All records

We introduce a method for novel view synthesis given only a single wide-baseline stereo image pair. In this challenging regime, 3D scene points are regularly observed only once, requiring prior-based reconstruction of scene geometry and appearance. We find that existing approaches to novel view synthesis from sparse observations fail due to recovering incorrect 3D geometry and due to the high cost of differentiable rendering that precludes their scaling to large-scale training. We take a step towards resolving these shortcomings by formulating a multi-view transformer encoder, proposing an efficient, image-space epipolar line sampling scheme to assemble image features for a target ray, and a lightweight cross-attention-based renderer. Our contributions enable training of our method on a large-scale real-world dataset of indoor and outdoor scenes. We demonstrate that our method learns powerful multi-view geometry priors while reducing both rendering time and memory footprint. We conduct extensive comparisons on held-out test scenes across two real-world datasets, significantly outperforming prior work on novel view synthesis from sparse image observations and achieving multi-view-consistent novel view synthesis. 

Neural scene representations, both continuous and discrete, have recently emerged as a powerful new paradigm for 3D scene understanding. Recent efforts have tackled unsupervised discovery of object-centric neural scene representations. However, the high cost of ray-marching, exacerbated by the fact that each object representation has to be ray-marched separately, leads to insufficiently sampled radiance fields and thus, noisy renderings, poor framerates, and high memory and time complexity during training and rendering. Here, we propose to represent objects in an object-centric, compositional scene representation as light fields. We propose a novel light field compositor module that enables reconstructing the global light field from a set of object-centric light fields. Dubbed Compositional Object Light Fields (COLF), our method enables unsupervised learning of object-centric neural scene representations, state-of-the-art reconstruction and novel view synthesis performance on standard datasets, and rendering and training speeds at orders of magnitude faster than existing 3D approaches. 

Fluorescent organic dyes that absorb and emit in the near-infrared (NIR, 700–1000 nm) and shortwave infrared (SWIR, 1000–1700 nm) regions have the potential to produce noninvasive high-contrast biological images and videos. BODIPY dyes are well known for their high quantum yields in the visible energy region. To tune these chromophores to the NIR region, fused nitrogen-based heterocyclic indolizine donors were added to a BODIPY scaffold. The indolizine BODIPY dyes were synthesized via microwave-assisted Knoevenagel condensation with indolizine aldehydes. The non-protonated dyes showed NIR absorption and emission at longer wavelengths than an aniline benchmark. Protonation of the dyes produced a dramatic 0.35 eV bathochromic shift (230 nm shift from 797 nm to 1027 nm) to give a SWIR absorption and emission (λmaxemis = 1061 nm). Deprotonation demonstrates that material emission is reversibly switchable between the NIR and SWIR. 

Guest‐host Raman under liquid nitrogen spectroscopy (GHRUNS) is introduced whereby solid‐state guest molecules are isolated inside cage‐like host environments for the facile acquisition of their Raman spectra. This convenient method features reduced fluorescence, the analysis of populations in their ground states, and increased signal to noise ratios. Samples are also preserved through the reduction of thermal degradation and oxidation. To demonstrate the benefits of this new method, Raman spectra of the ubiquitous molecule C₆₀inside a cage of water ice are presented. Using this technique, a new normal mode of C₆₀is elucidated. The GHRUNS methodology is of interest to those seeking to acquire and characterize the vibrational spectra, structure, and properties of emissive, air‐sensitive molecules.

 

The challenges faced with current fluorescence imaging agents have motivated us to study two nanostructures based on a hydrophobic dye, 6 H -pyrrolo[3,2- b :4,5- b ’]bis [1,4]benzothiazine (TRPZ). TRPZ is a heteroacene with a rigid, pi-conjugated structure, multiple reactive sites, and unique spectroscopic properties. Here we coupled TRPZ to a tert-butyl carbamate (BOC) protected 2,2-bis(hydroxymethyl)propanoic acid (bisMPA) dendron via azide-alkyne Huisgen cycloaddition. Deprotection of the protected amine groups on the dendron afforded a cationic terminated amphiphile, TRPZ-bisMPA . TRPZ-bisMPA was nanoprecipitated into water to obtain nanoparticles (NPs) with a hydrodynamic radius that was <150 nm. For comparison, TRPZ-PG was encapsulated in pluronic-F127 (Mw = 12 kD), a polymer surfactant to afford NPs almost twice as large as those formed by TRPZ-bisMPA . Size and stability studies confirm the suitability of the TRPZ-bisMPA NPs for biomedical applications. The photophysical properties of the TRPZ-bisMPA NPs show a quantum yield of 49%, a Stokes shift of 201 nm (0.72 eV) and a lifetime of 6.3 ns in water. Further evidence was provided by cell viability and cellular uptake studies confirming the low cytotoxicity of TRPZ-bisMPA NPs and their potential in bioimaging. 

Shortwave infrared (SWIR) emission has great potential for deep-tissue in vivo biological imaging with high resolution. In this article, the synthesis and characterization of two new xanthene-based RosIndolizine dyes coded Ph RosIndz and tol RosIndz is presented. The dyes are characterized via femtosecond transient absorption spectroscopy as well as steady-state absorption and emission spectroscopies. The emission of these dyes is shown in the SWIR region with peak emission at 1097 nm. Tol RosIndz was encapsulated with an amphiphilic linear dendritic block co-polymer (LDBC) coded 10-PhPCL-G3 with high uptake yield. Further, cellular toxicity was examined in vitro using HEK (human embryonic kidney) cells where a >90% cell viability was observed at practical concentrations of the encapsulated dye which indicates low toxicity and reasonable biocompatibility.