An official website of the United States government
Many probabilistic modeling problems in machine learning use gradient-based optimization in which the objective takes the form of an expectation. These problems can be challenging when the parameters to be optimized determine the probability distribution under which the expectation is being taken, as the na\"ive Monte Carlo procedure is not differentiable. Reparameterization gradients make it possible to efficiently perform optimization of these Monte Carlo objectives by transforming the expectation to be differentiable, but the approach is typically limited to distributions with simple forms and tractable normalization constants. Here we describe how to differentiate samples from slice sampling to compute \textit{slice sampling reparameterization gradients}, enabling a richer class of Monte Carlo objective functions to be optimized. Slice sampling is a Markov chain Monte Carlo algorithm for simulating samples from probability distributions; it only requires a density function that can be evaluated point-wise up to a normalization constant, making it applicable to a variety of inference problems and unnormalized models. Our approach is based on the observation that when the slice endpoints are known, the sampling path is a deterministic and differentiable function of the pseudo-random variables, since the algorithm is rejection-free. We evaluate the method on synthetic examples and apply it to a variety of applications with reparameterization of unnormalized probability distributions.
more »
« less
This content will become publicly available on February 1, 2026
Monte Carlo method for constructing confidence intervals with unconstrained and constrained nuisance parameters in the NOvA experiment
Abstract Measuring observables to constrain models using maximum-likelihood estimation is fundamental to many physics experiments. Wilks' theorem provides a simple way to construct confidence intervals on model parameters, but it only applies under certain conditions. These conditions, such as nested hypotheses and unbounded parameters, are often violated in neutrino oscillation measurements and other experimental scenarios. Monte Carlo methods can address these issues, albeit at increased computational cost. In the presence of nuisance parameters, however, the best way to implement a Monte Carlo method is ambiguous. This paper documents the method selected by the NOvA experiment, the profile construction. It presents the toy studies that informed the choice of method, details of its implementation, and tests performed to validate it. It also includes some practical considerations which may be of use to others choosing to use the profile construction.
more »
« less
- Award ID(s):
- 2411700
- PAR ID:
- 10591082
- Author(s) / Creator(s):
- ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; more »
- Publisher / Repository:
- IOP Publishing
- Date Published:
- Journal Name:
- Journal of Instrumentation
- Volume:
- 20
- Issue:
- 02
- ISSN:
- 1748-0221
- Page Range / eLocation ID:
- T02001
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
In this paper, a novel way to compute derivativebased global sensitivity measures is presented. Conjugate Unscented Transform (CUT) is used to evaluate the multidimensional definite integrals which lead to the sensitivity measures. The method is compared with Monte Carlo estimates as well as the screening method of Morris. It is shown that using CUT provides a much more accurate estimate of sensitivity measures as compared to Monte Carlo (with far lesser computational cost) as well as the Morris method (with similar computational cost). Illustrations on three test functions are presented as evidence.more » « less
-
Abstract We introduce a new Python interface for the Cassandra Monte Carlo software, molecular simulation design framework (MoSDeF) Cassandra. MoSDeF Cassandra provides a simplified user interface, offers broader interoperability with other molecular simulation codes, enables the construction of programmatic and reproducible molecular simulation workflows, and builds the infrastructure necessary for high‐throughput Monte Carlo studies. Many of the capabilities of MoSDeF Cassandra are enabled via tight integration with MoSDeF. We discuss the motivation and design of MoSDeF Cassandra and proceed to demonstrate both simple use‐cases and more complex workflows, including adsorption in porous media and a combined molecular dynamics – Monte Carlo workflow for computing lateral diffusivity in graphene slit pores. The examples presented herein demonstrate how even relatively complex simulation workflows can be reduced to, at most, a few files of Python code that can be version‐controlled and shared with other researchers. We believe this paradigm will enable more rapid research advances and represents the future of molecular simulations.more » « less
-
We explore the possibility of implementing random walks in the manifold of Hartree–Fock–Bogoliubov wave functions. The goal is to extend state-of-the-art quantum Monte Carlo approaches, in particular the constrained-path auxiliary-field quantum Monte Carlo technique, to systems where finite pairing order parameters or complex pairing mechanisms, e.g., Fulde–Ferrell–Larkin–Ovchinnikov pairing or triplet pairing, may be expected. Leveraging the flexibility to define a vacuum state tailored to the physical problem, we discuss a method to use imaginary-time evolution of Hartree–Fock–Bogoliubov states to compute ground state correlations, extending beyond situations spanned by current formalisms. Illustrative examples are provided.more » « less
-
ABSTRACT Observations of gravitational waves emitted by merging compact binaries have provided tantalizing hints about stellar astrophysics, cosmology, and fundamental physics. However, the physical parameters describing the systems (mass, spin, distance) used to extract these inferences about the Universe are subject to large uncertainties. The most widely used method of performing these analyses requires performing many Monte Carlo integrals to marginalize over the uncertainty in the properties of the individual binaries and the survey selection bias. These Monte Carlo integrals are subject to fundamental statistical uncertainties. Previous treatments of this statistical uncertainty have focused on ensuring that the precision of the inferred inference is unaffected; however, these works have neglected the question of whether sufficient accuracy can also be achieved. In this work, we provide a practical exploration of the impact of uncertainty in our analyses and provide a suggested framework for verifying that astrophysical inferences made with the gravitational-wave transient catalogue are accurate. Applying our framework to models used by the LIGO–Virgo–KAGRA collaboration and in the wider literature, we find that Monte Carlo uncertainty in estimating the survey selection bias is the limiting factor in our ability to probe narrow population models and this will rapidly grow more problematic as the size of the observed population increases.more » « less
