OT-Flow: Fast and Accurate Continuous Normalizing Flows via Optimal Transport
A normalizing flow is an invertible mapping between an arbitrary probability distribution and a standard normal distribution; it can be used for density estimation and statistical inference. Computing the flow follows the change of variables formula and thus requires invertibility of the mapping and an efficient way to compute the determinant of its Jacobian. To satisfy these requirements, normalizing flows typically consist of carefully chosen components. Continuous normalizing flows (CNFs) are mappings obtained by solving a neural ordinary differential equation (ODE). The neural ODE's dynamics can be chosen almost arbitrarily while ensuring invertibility. Moreover, the log-determinant of the flow's Jacobian can be obtained by integrating the trace of the dynamics' Jacobian along the flow. Our proposed OT-Flow approach tackles two critical computational challenges that limit a more widespread use of CNFs. First, OT-Flow leverages optimal transport (OT) theory to regularize the CNF and enforce straight trajectories that are easier to integrate. Second, OT-Flow features exact trace computation with time complexity equal to trace estimators used in existing CNFs. On five high-dimensional density estimation and generative modeling tasks, OT-Flow performs competitively to state-of-the-art CNFs while on average requiring one-fourth of the number of weights with an 8x speedup in training time more »
Authors:
; ; ;
Award ID(s):
Publication Date:
NSF-PAR ID:
10232664
Journal Name:
Proceedings of the AAAI Conference on Artificial Intelligence
Volume:
35
Issue:
1-18
ISSN:
2374-3468
4. Abstract We investigate the feasibility of in-laboratory tomographic X-ray particle tracking velocimetry (TXPTV) and consider creeping flows with nearly density matched flow tracers. Specifically, in these proof-of-concept experiments we examined a Poiseuille flow, flow through porous media and a multiphase flow with a Taylor bubble. For a full 360 $$^\circ$$ ∘ computed tomography (CT) scan we show that the specially selected 60 micron tracer particles could be imaged in less than 3 seconds with a signal-to-noise ratio between the tracers and the fluid of 2.5, sufficient to achieve proper volumetric segmentation at each time step. In the pipe flow, continuous Lagrangian particle trajectories were obtained, after which all the standard techniques used for PTV or PIV (taken at visible wave lengths) could also be employed for TXPTV data. And, with TXPTV we can examine flows inaccessible with visible wave lengths due to opaque media or numerous refractive interfaces. In the case of opaque porous media we were able to observe material accumulation and pore clogging, and for flow with Taylor bubble we can trace the particles and hence obtain velocities in the liquid film between the wall and bubble, with thickness of liquid film itself also simultaneously obtained from themore »