skip to main content


Title: Flow Supervision for Deformable NeRF
In this paper we present a new method for deformable NeRF that can directly use optical flow as supervision. We overcome the major challenge with respect to the computationally inefficiency of enforcing the flow constraints to the backward deformation field, used by deformable NeRFs. Specifically, we show that inverting the backward deformation function is actually not needed for computing scene flows between frames. This insight dramatically simplifies the problem, as one is no longer constrained to deformation functions that can be analytically inverted. Instead, thanks to the weak assumptions required by our derivation based on the inverse function theorem, our approach can be extended to a broad class of commonly used backward deformation field. We present results on monocular novel view synthesis with rapid object motion, and demonstrate significant improvements over baselines without flow supervision.  more » « less
Award ID(s):
1925281
NSF-PAR ID:
10482402
Author(s) / Creator(s):
; ; ;
Publisher / Repository:
IEEE
Date Published:
Page Range / eLocation ID:
21128 to 21137
Format(s):
Medium: X
Location:
Vancouver, BC, Canada
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract

    We present a new computational fluid dynamics approach for simulating two‐phase flow in hybrid systems containing solid‐free regions and deformable porous matrices. Our approach is based on the derivation of a unique set of volume‐averaged partial differential equations that asymptotically approach the Navier‐Stokes Volume‐of‐Fluid equations in solid‐free regions and multiphase Biot Theory in porous regions. The resulting equations extend our recently developed Darcy‐Brinkman‐Biot framework to multiphase flow. Through careful consideration of interfacial dynamics (relative permeability and capillary effects) and extensive benchmarking, we show that the resulting model accurately captures the strong two‐way coupling that is often exhibited between multiple fluids and deformable porous media. Thus, it can be used to represent flow‐induced material deformation (swelling, compression) and failure (cracking, fracturing). The model's open‐source numerical implementation,hybridBiotInterFoam, effectively marks the extension of computational fluid mechanics into modeling multiscale multiphase flow in deformable porous systems. The versatility of the solver is illustrated through applications related to material failure in poroelastic coastal barriers and surface deformation due to fluid injection in poro‐visco‐plastic systems.

     
    more » « less
  2. In this paper, we present a novel Deformable Neural Articulations Network (DNA-Net), which is a template- free learning-based method for dynamic 3D human reconstruction from a single RGB-D sequence. Our proposed DNA-Net includes a Neural Articulation Prediction Net- work (NAP-Net), which is capable of representing non-rigid motions of a human by learning to predict a set of articulated bones to follow movements of the human in the in- put sequence. Moreover, DNA-Net also include Signed Distance Field Network (SDF-Net) and Appearance Network (Color-Net), which take advantage of the powerful neural implicit functions in modeling 3D geometries and appear- ance. Finally, to avoid the reliance on external optical flow estimators to obtain deformation cues like previous related works, we propose a novel training loss, namely Easy-to- Hard Geometric-based, which is a simple strategy that inherits the merits of Chamfer distance to achieve good de- formation guidance while still avoiding its limitation of lo- cal mismatches sensitivity. DNA-Net is trained end-to-end in a self-supervised manner directly on the input sequence to obtain 3D reconstructions of the input objects. Quantitative results on videos of DeepDeform dataset show that DNA-Net outperforms related state-of-the-art methods with an adequate gaps, qualitative results additionally prove that our method can reconstruct human shapes with high fidelity and details. 
    more » « less
  3. Abstract

    The water retention behavior—a critical factor of unsaturated flow in porous media—can be strongly affected by deformation in the solid matrix. However, it remains challenging to model the water retention behavior with explicit consideration of its dependence on deformation. Here, we propose a data-driven approach that can automatically discover an interpretable model describing the water retention behavior of a deformable porous material, which can be as accurate as non-interpretable models obtained by other data-driven approaches. Specifically, we present a divide-and-conquer approach for discovering a mathematical expression that best fits a neural network trained with the data collected from a series of image-based drainage simulations at the pore-scale. We validate the predictive capability of the symbolically regressed counterpart of the trained neural network against unseen pore-scale simulations. Further, through incorporating the discovered symbolic function into a continuum-scale simulation, we showcase the inherent portability of the proposed approach: The discovered water retention model can provide results comparable to those from a hierarchical multi-scale model, while bypassing the need for sub-scale simulations at individual material points.

     
    more » « less
  4. Abstract

    Geomechanical deformation can alter the flow field that impacts solute mass fluxes. Despite its importance, the effects of the coupling between geomechanical deformation and the flow field on solute transport behavior are not fully known. In this paper, we study the impact of this coupling on the solute concentration distribution. The concentration field is semianalytically derived by making use of the generalized integral transform technique. We apply the semianalytical solution to two uniaxial consolidation problems, the classical Terzaghi's problem with a constant load and the case of periodic loading of a porous deformable layer. Our results indicate that geomechanical parameters, such as the Skempton's coefficient and the soil compressibility, can affect the peak concentration as well as the spatial moments of solute plume. In case of periodic loading, we show that the frequency of loading also plays a key role in regulating the temporal dynamics of the concentration field.

     
    more » « less
  5. SUMMARY

    Mantle plumes form from thermal boundary layers, such as Earth's core–mantle boundary. As plumes rise towards the surface, they are laterally deflected by the surrounding mantle flow that is governed by deep mantle density and viscosity structures. The lateral motions of mantle plumes carry information of deep mantle structure and dynamics and are used to setup reference frames by which absolute plate motions are reconstructed. In this study, we compare two methods to compute deep mantle flow and lateral motion of plumes. In mantle convection (MC) models, the mantle flow field and lateral motions of plumes are determined by solving conservation equations forward-in-time from given initial conditions. In plume advection (PA) models, approximate viscosity and present-day density structures are used to calculate present-day mantle flow which is then propagated backward-in-time assuming zero thermal diffusion, and plume conduits are represented by continuous lines and are passively advected within the background mantle flow. The question is how assumptions in PA models influence the predictions of deep mantle flow and plume lateral motions. Here, we perform purely thermal MC models and thermochemical MC models with intrinsically dense materials in the lowermost mantle. The deep mantle flow and plume lateral motions are determined accurately in each MC model. We also perform PA models using the approximated present-day viscosity and temperature structures in these MC models. We find that PA models without considering temperature-dependence of viscosity and/or only using long wavelength present-day temperature structure (up to degree 20) often lead to an average of ∼50–60 per cent and ∼60–200 per cent differences of present-day mantle flow velocities than purely thermal MC models and thermochemical MC models, respectively. By propagating inaccurate flow fields backward-in-time in PA models often cause even larger errors of mantle flow velocities in the past. Even using the same parameters and starting from the same present-day mantle flow fields as in MC models, the PA models still show an average of ∼10–30 per cent misfit of mantle flow velocities after ∼40 Ma.

    In addition, we show that errors of mantle flow fields in PA models can cause ∼100–600 per cent differences of plume lateral motions than that constrained in MC models in the past 60 Ma. Even we use the mantle flow in MC models to advected virtual plumes in PA models, the virtual plumes could still show ∼50–300 per cent difference of lateral motions than dynamic plumes in MC models if the virtual plumes do not start with the same locations and/or shapes as plumes in MC models. We also find virtual plumes in PA models initiated at different locations and/or with different shapes can be later advected to similar locations, suggesting that the lateral motions of plumes in PA models can be non-unique. Therefore, it is important to consider the build-in assumptions of PA models when interpreting their predictions on deep mantle flow field and plume lateral motions. The accuracy of PA models would improve as we gain better understanding on Earth's deep mantle structure and dynamics.

     
    more » « less