 NSFPAR ID:
 10440561
 Date Published:
 Journal Name:
 International conference on learning representations (ICLR)
 Format(s):
 Medium: X
 Sponsoring Org:
 National Science Foundation
More Like this

null (Ed.)A normalizing flow is an invertible mapping between an arbitrary probability distribution and a standard normal distribution; it can be used for density estimation and statistical inference. Computing the flow follows the change of variables formula and thus requires invertibility of the mapping and an efficient way to compute the determinant of its Jacobian. To satisfy these requirements, normalizing flows typically consist of carefully chosen components. Continuous normalizing flows (CNFs) are mappings obtained by solving a neural ordinary differential equation (ODE). The neural ODE's dynamics can be chosen almost arbitrarily while ensuring invertibility. Moreover, the logdeterminant of the flow's Jacobian can be obtained by integrating the trace of the dynamics' Jacobian along the flow. Our proposed OTFlow approach tackles two critical computational challenges that limit a more widespread use of CNFs. First, OTFlow leverages optimal transport (OT) theory to regularize the CNF and enforce straight trajectories that are easier to integrate. Second, OTFlow features exact trace computation with time complexity equal to trace estimators used in existing CNFs. On five highdimensional density estimation and generative modeling tasks, OTFlow performs competitively to stateoftheart CNFs while on average requiring onefourth of the number of weights with an 8x speedup in training time and 24x speedup in inference.more » « less

Boundary integral numerical methods are among the most accurate methods for interfacial Stokes flow, and are widely applied. They have the advantage that only the boundary of the domain must be discretized, which reduces the number of discretization points and allows the treatment of complicated interfaces. Despite their popularity, there is no analysis of the convergence of these methods for interfacial Stokes flow. In practice, the stability of discretizations of the boundary integral formulation can depend sensitively on details of the discretization and on the application of numerical filters. We present a convergence analysis of the boundary integral method for Stokes flow, focusing on a rather general method for computing the evolution of an elastic capsule or viscous drop in 2D strain and shear flows. The analysis clarifies the role of numerical filters in practical computations.more » « less

Simulationfree methods for training continuoustime generative models construct probability paths that go between noise distributions and individual data samples. Recent works, such as Flow Matching, derived paths that are optimal for each data sample. However, these algorithms rely on independent data and noise samples, and do not exploit underlying structure in the data distribution for constructing probability paths. We propose Multisample Flow Matching, a more general framework that uses nontrivial couplings between data and noise samples while satisfying the correct marginal constraints. At very small overhead costs, this generalization allows us to (i) reduce gradient variance during training, (ii) obtain straighter flows for the learned vector field, which allows us to generate highquality samples using fewer function evaluations, and (iii) obtain transport maps with lower cost in high dimensions, which has applications beyond generative modeling. Importantly, we do so in a completely simulationfree manner with a simple minimization objective. We show that our proposed methods improve sample consistency on downsampled ImageNet data sets, and lead to better lowcost sample generation.more » « less

Abstract Thermal rectification is an exotic thermal transport phenomenon which allows heat to transfer in one direction but block the other. We demonstrate an unusual dualmode solidstate thermal rectification effect using a heterogeneous “irradiatedpristine” polyethylene nanofiber junction as a nanoscale thermal diode, in which heat flow can be rectified in both directions by changing the working temperature. For the nanofiber samples measured here, we observe a maximum thermal rectification factor as large as ~50%, which only requires a small temperature bias of <10 K. The tunable nanoscale thermal diodes with large rectification and narrow temperature bias open up new possibilities for developing advanced thermal management, energy conversion and, potentially thermophononic technologies.

Detecting outofdistribution (OOD) data is crucial for robust machine learning systems. Normalizing flows are flexible deep generative models that often surprisingly fail to distinguish between in and outofdistribution data: a flow trained on pictures of clothing assigns higher likelihood to handwritten digits. We investigate why normalizing flows perform poorly for OOD detection. We demonstrate that flows learn local pixel correlations and generic imagetolatentspace transformations which are not specific to the target image datasets, focusing on flows based on coupling layers. We show that by modifying the architecture of flow coupling layers we can bias the flow towards learning the semantic structure of the target data, improving OOD detection. Our investigation reveals that properties that enable flows to generate highfidelity images can have a detrimental effect on OOD detection.more » « less