Search for: All records

A long standing open problem in the theory of neural networks is the development of quantitative methods to estimate and compare the capabilities of different architectures. Here we define the capacity of an architecture by the binary logarithm of the number of functions it can compute, as the synaptic weights are varied. The capacity provides an upper bound on the number of bits that can be extracted from the training data and stored in the architecture during learning. We study the capacity of layered, fully-connected, architectures of linear threshold neurons with L layers and show that in essence the capacity is given by a cubic polynomial in the layer sizes. In proving the main result, we also develop new techniques (multiplexing, enrichment, and stacking) as well as new bounds on the capacity of finite sets. We use the main result to identify architectures with maximal or minimal capacity under a number of natural constraints. This leads to the notion of structural regularization for deep architectures. While in general, everything else being equal, shallow networks compute more functions than deep networks, the functions computed by deep networks are more regular and “interesting". 

The flux of cosmic ray muons at the Earth’s surface exhibits seasonal variations due to changes in the temperature of the atmosphere affecting the production and decay of mesons in the upper atmosphere. Using 1473 live days of data collected by the NuMI Off-axis ${\nu }_e$Appearance (NOvA) Near Detector during 2018–2022, we studied the seasonal pattern in the multiple-muon event rate. The data confirm an anticorrelation between the multiple-muon event rate and effective atmospheric temperature, consistent across all the years of data. Previous analyses from MINOS and NOvA saw a similar anticorrelation but did not include an explanation. We find that this anticorrelation is driven by altitude–geometry effects as the average muon production height changes with the season. This has been studied with a CORSIKA cosmic ray simulation package by varying atmospheric parameters, and provides an explanation to a longstanding discrepancy between the seasonal phases of single and multiple-muon events. 

This Letter reports measurements of muon-neutrino disappearance and electron-neutrino appearance and the corresponding antineutrino processes between the two NOvA detectors in the NuMI neutrino beam. These measurements use a dataset with double the neutrino mode beam exposure that was previously analyzed, along with improved simulation and analysis techniques. A joint fit to these samples in the three-flavor paradigm results in the most precise single-experiment constraint on the atmospheric neutrino mass splitting, $\mathrm{\Delta }{m}_{32}^2=2.431_{-0.034}^{+0.036}(-2.479_{-0.036}^{+0.036})\times {10}^{-3}{\mathrm{eV}}^2$if the mass ordering is normal (inverted). In both orderings, a region close to maximal mixing with ${\sin }^2{\theta }_{23}=0.55_{-0.06}^{+0.02}$is preferred. The NOvA data show a mild preference for the normal mass ordering with a Bayes factor of 2.4 (corresponding to 70% of the posterior probability), indicating that the normal ordering is 2.4 times more probable than the inverted ordering. When incorporating a 2D $\mathrm{\Delta }{m}_{32}^2-{\sin }^{2}2{\theta }_{13}$constraint based on Daya Bay data, this preference strengthens to a Bayes factor of 6.6 (87%). 

Recently, Approximate Policy Iteration (API) algorithms have achieved superhuman proficiency in two-player zero-sum games such as Go, Chess, and Shogi without human data. These API algorithms iterate between two policies: a slow policy (tree search), and a fast policy (a neural network). In these two-player games, a reward is always received at the end of the game. However, the Rubik’s Cube has only a single solved state, and episodes are not guaranteed to terminate. This poses a major problem for these API algorithms since they rely on the reward received at the end of the game. We introduce Autodidactic Iteration: an API algorithm that overcomes the problem of sparse rewards by training on a distribution of states that allows the reward to propagate from the goal state to states farther away. Autodidactic Iteration is able to learn how to solve the Rubik’s Cube without relying on human data. Our algorithm is able to solve 100% of randomly scrambled cubes while achieving a median solve length of 30 moves — less than or equal to solvers that employ human domain knowledge. 

Modern climate projections lack adequate spatial and temporal resolution due to computational constraints. A consequence is inaccurate and imprecise predictions of critical processes such as storms. Hybrid methods that combine physics with machine learning (ML) have introduced a new generation of higher fidelity climate simulators that can sidestep Moore's Law by outsourcing compute-hungry, short, high-resolution simulations to ML emulators. However, this hybrid ML-physics simulation approach requires domain-specific treatment and has been inaccessible to ML experts because of lack of training data and relevant, easy-to-use workflows. We present ClimSim, the largest-ever dataset designed for hybrid ML-physics research. It comprises multi-scale climate simulations, developed by a consortium of climate scientists and ML researchers. It consists of 5.7 billion pairs of multivariate input and output vectors that isolate the influence of locally-nested, high-resolution, high-fidelity physics on a host climate simulator's macro-scale physical state.The dataset is global in coverage, spans multiple years at high sampling frequency, and is designed such that resulting emulators are compatible with downstream coupling into operational climate simulators. We implement a range of deterministic and stochastic regression baselines to highlight the ML challenges and their scoring. The data (https://huggingface.co/datasets/LEAP/ClimSim_high-res) and code (https://leap-stc.github.io/ClimSim) are released openly to support the development of hybrid ML-physics and high-fidelity climate simulations for the benefit of science and society. 

We present the measurement of ${\pi }^{+}$-argon inelastic cross sections using the ProtoDUNE single-phase liquid argon time projection chamber in the incident ${\pi }^{+}$kinetic energy range of 500–800 MeV in multiple exclusive channels (absorption, charge exchange, and the remaining inelastic interactions). The results of this analysis are important inputs to simulations of liquid argon neutrino experiments such as the Deep Underground Neutrino Experiment and the Short Baseline Neutrino program at Fermi National Accelerator Laboratory. They will be employed to improve the modeling of final state interactions within neutrino event generators used by these experiments, as well as the modeling of ${\pi }^{+}$-argon secondary interactions within the liquid argon. This is the first measurement of ${\pi }^{+}$-argon absorption at this kinetic energy range as well as the first ever measurement of ${\pi }^{+}$-argon charge exchange. 

Double- and single-differential cross sections for inclusive charged-current ${\nu }_{\mu }$-nucleus scattering are reported for the kinematic domain 0 to $2\mathrm{GeV}/c$in three-momentum transfer and 0 to 2 GeV in available energy, at a mean ${\nu }_{\mu }$energy of 1.86 GeV. The measurements are based on an estimated 995,760 ${\nu }_{\mu }$charged-current (CC) interactions in the scintillator medium of the NOvA Near Detector. The subdomain populated by 2-particle-2-hole (2p2h) reactions is identified by the cross section excess relative to predictions for ${\nu }_{\mu }$-nucleus scattering that are constrained by a data control sample. Models for 2-particle-2-hole processes are rated by ${\chi }^2$comparisons of the predicted-versus-measured ${\nu }_{\mu }$CC inclusive cross section over the full phase space and in the restricted subdomain. Shortfalls are observed in neutrino generator predictions obtained using the theory-based València and SuSAv2 2p2h models. Published by the American Physical Society2025 

We report a search for neutrino oscillations to sterile neutrinos under a model with three active and one sterile neutrinos ( $3+1$model). This analysis uses the NOvA detectors exposed to the NuMI beam, running in neutrino mode. The data exposure, $13.6\times {10}^{20}$protons on target, doubles that previously analyzed by NOvA, and the analysis is the first to use ${\nu }_{\mu }$charged-current interactions in conjunction with neutral-current interactions. Neutrino samples in the near and far detectors are fitted simultaneously, enabling the search to be carried out over a $\mathrm{\Delta }{m}_{41}^2$range extending 2 (3) orders of magnitude above (below) $1{\mathrm{eV}}^2$. NOvA finds no evidence for active-to-sterile neutrino oscillations under the $3+1$model at 90% confidence level. New limits are reported in multiple regions of parameter space, excluding some regions currently allowed by IceCube at 90% confidence level. We additionally set the most stringent limits for anomalous ${\nu }_{\tau }$appearance for $\mathrm{\Delta }{m}_{41}^2\le 3{\mathrm{eV}}^2$. Published by the American Physical Society2025 

Abstract Measuring observables to constrain models using maximum-likelihood estimation is fundamental to many physics experiments. Wilks' theorem provides a simple way to construct confidence intervals on model parameters, but it only applies under certain conditions. These conditions, such as nested hypotheses and unbounded parameters, are often violated in neutrino oscillation measurements and other experimental scenarios. Monte Carlo methods can address these issues, albeit at increased computational cost. In the presence of nuisance parameters, however, the best way to implement a Monte Carlo method is ambiguous. This paper documents the method selected by the NOvA experiment, the profile construction. It presents the toy studies that informed the choice of method, details of its implementation, and tests performed to validate it. It also includes some practical considerations which may be of use to others choosing to use the profile construction. 

The 2x2 Demonstrator, a prototype for the Deep Underground Neutrino Experiment (DUNE) liquid argon (LAr) Near Detector, was exposed to the Neutrinos from the Main Injector (NuMI) neutrino beam at Fermi National Accelerator Laboratory (Fermilab). This detector is a prototype of a new modular design for a liquid argon time-projection chamber (LArTPC), comprising a two-by-two array of four modules, each further segmented into two optically isolated LArTPCs. The 2x2 Demonstrator features a number of pioneering technologies, including a low-profile resistive field shell to establish drift fields, native 3D ionization pixelated imaging, and a high-coverage dielectric light readout system. The 2.4-tonne active mass detector is flanked upstream and downstream by supplemental solid-scintillator tracking planes, repurposed from the MINERvA experiment, which track ionizing particles exiting the argon volume. The antineutrino beam data collected by the detector over a 4.5 day period in 2024 include over 30,000 neutrino interactions in the LAr active volume—the first neutrino interactions reported by a DUNE detector prototype. During its physics-quality run, the 2x2 Demonstrator operated at a nominal drift field of 500 V/cm and maintained good LAr purity, with a stable electron lifetime of approximately 1.25 ms. This paper describes the detector and supporting systems, summarizes the installation and commissioning, and presents the initial validation of collected NuMI beam and off-beam self-triggers. In addition, it highlights observed interactions in the detector volume, including candidate muon antineutrino events.