Search for: All records

Pruning the parameters of deep neural networks has generated intense interest due to potential savings in time, memory and energy both during training and at test time. Recent works have identified, through an expensive sequence of training and pruning cycles, the existence of winning lottery tickets or sparse trainable subnetworks at initialization. This raises a foundational question: can we identify highly sparse trainable subnetworks at initialization, without ever training, or indeed without ever looking at the data? We provide an affirmative answer to this question through theory driven algorithm design. We first mathematically formulate and experimentally verify a conservation law that explains why existing gradient-based pruning algorithms at initialization suffer from layer-collapse, the premature pruning of an entire layer rendering a network untrainable. This theory also elucidates how layer-collapse can be entirely avoided, motivating a novel pruning algorithm Iterative Synaptic Flow Pruning (SynFlow). This algorithm can be interpreted as preserving the total flow of synaptic strengths through the network at initialization subject to a sparsity constraint. Notably, this algorithm makes no reference to the training data and consistently competes with or outperforms existing state-of-the-art pruning algorithms at initialization over a range of models (VGG and ResNet), datasets (CIFAR-10/100 and Tiny ImageNet), and sparsity constraints (up to 99.99 percent). Thus our data-agnostic pruning algorithm challenges the existing paradigm that, at initialization, data must be used to quantify which synapses are important. 

We present a search for long-lived particles (LLPs), produced in kaon decays, that decay to two muons inside the ICARUS neutrino detector. This channel would be a signal of hidden sector models that can address outstanding issues in particle physics such as the strong CP problem and the microphysical origin of dark matter. The search is performed with data collected in the Neutrinos at the Main Injector (NuMI) beam at Fermilab corresponding to $2.41\times {10}^{20}$protons-on-target. No new physics signal is observed, and we set world leading limits on heavy QCD axions, as well as for the Higgs portal scalar among dedicated searches. Limits are also presented in a model-independent way applicable to any new physics model predicting the process $K\to \pi +S(\to \mu \mu )$, for a LLP $S$. This result is the first search for new physics performed with the ICARUS detector at Fermilab. It paves the way for the future program of LLP searches at ICARUS. Published by the American Physical Society2025 

A search for proton decay into $e^{+}/{\mu }^{+}$and a $\eta$meson has been performed using data from a $0.373\mathrm{Mton}·\mathrm{year}$exposure (6050.3 live days) of Super-Kamiokande. Compared to previous searches this work introduces an improved model of the intranuclear $\eta$interaction cross section, resulting in a factor of 2 reduction in uncertainties from this source and $\sim 10\%$increase in signal efficiency. No significant data excess was found above the expected number of atmospheric neutrino background events resulting in no indication of proton decay into either mode. Lower limits on the proton partial lifetime of $1.4\times {10}^{34}\mathrm{years}$for $p\to e^{+}\eta$and $7.3\times {10}^{33}\mathrm{years}$for $p\to {\mu }^{+}\eta$at the 90% CL were set. These limits are around 1.5 times longer than our previous study and are the most stringent to date. Published by the American Physical Society2024 

We present the results of the charge ratio ( $R$) and polarization ( $P_0^{\mu }$) measurements using decay electron events collected between September 2008 and June 2022 with the Super-Kamiokande detector. Because of its underground location and long operation, we are able to perform high-precision measurements by accumulating cosmic-ray muons. We measured the muon charge ratio to be $R=1.32\pm 0.02(\mathrm{stat}+\mathrm{syst})$at $E_{\mu }\cos {\theta }_{\text{Zenith}}={0.7}_{-0.2}^{+0.3}\mathrm{TeV}$, where $E_{\mu }$is the muon energy and ${\theta }_{\text{Zenith}}$is the zenith angle of incoming cosmic-ray muons. This result is consistent with the Honda flux model while indicating a tension with the $\pi K$model of $1.9\sigma$. We also measured the muon polarization at the production location to be $P_0^{\mu }=0.52\pm 0.02(\mathrm{stat}+\mathrm{syst})$at the muon momentum of ${0.9}_{-0.1}^{+0.6}\mathrm{TeV}/c$at the surface of the mountain; this also suggests a tension with the Honda flux model of $1.5\sigma$. This is the most precise measurement ever to experimentally determine the cosmic-ray muon polarization near $1\mathrm{TeV}/c$. These measurement results are useful to improve atmospheric neutrino simulations. Published by the American Physical Society2024 

Recently, deep feedforward neural networks have achieved considerable success in modeling biological sensory processing, in terms of reproducing the input-output map of sensory neurons. However, such models raise profound questions about the very nature of explanation in neuroscience. Are we simply replacing one complex system (a biological circuit) with another (a deep network), without understanding either? Moreover, beyond neural representations, are the deep network's computational mechanisms for generating neural responses the same as those in the brain? Without a systematic approach to extracting and understanding computational mechanisms from deep neural network models, it can be difficult both to assess the degree of utility of deep learning approaches in neuroscience, and to extract experimentally testable hypotheses from deep networks. We develop such a systematic approach by combining dimensionality reduction and modern attribution methods for determining the relative importance of interneurons for specific visual computations. We apply this approach to deep network models of the retina, revealing a conceptual understanding of how the retina acts as a predictive feature extractor that signals deviations from expectations for diverse spatiotemporal stimuli. For each stimulus, our extracted computational mechanisms are consistent with prior scientific literature, and in one case yields a new mechanistic hypothesis. Thus overall, this work not only yields insights into the computational mechanisms underlying the striking predictive capabilities of the retina, but also places the framework of deep networks as neuroscientific models on firmer theoretical foundations, by providing a new roadmap to go beyond comparing neural representations to extracting and understand computational mechanisms. 

The Super-Kamiokande and T2K Collaborations present a joint measurement of neutrino oscillation parameters from their atmospheric and beam neutrino data. It uses a common interaction model for events overlapping in neutrino energy and correlated detector systematic uncertainties between the two datasets, which are found to be compatible. Using 3244.4 days of atmospheric data and a beam exposure of $19.7\left(16.3\right)\times {10}^{20}$protons on target in (anti)neutrino mode, the analysis finds a $1.9\sigma$exclusion of $CP$conservation (defined as $J_{CP}=0$) and a $1.2\sigma$exclusion of the inverted mass ordering. Published by the American Physical Society2025 

Abstract The Pandora Software Development Kit and algorithm libraries perform reconstruction of neutrino interactions in liquid argon time projection chamber detectors. Pandora is the primary event reconstruction software used at the Deep Underground Neutrino Experiment, which will operate four large-scale liquid argon time projection chambers at the far detector site in South Dakota, producing high-resolution images of charged particles emerging from neutrino interactions. While these high-resolution images provide excellent opportunities for physics, the complex topologies require sophisticated pattern recognition capabilities to interpret signals from the detectors as physically meaningful objects that form the inputs to physics analyses. A critical component is the identification of the neutrino interaction vertex. Subsequent reconstruction algorithms use this location to identify the individual primary particles and ensure they each result in a separate reconstructed particle. A new vertex-finding procedure described in this article integrates a U-ResNet neural network performing hit-level classification into the multi-algorithm approach used by Pandora to identify the neutrino interaction vertex. The machine learning solution is seamlessly integrated into a chain of pattern-recognition algorithms. The technique substantially outperforms the previous BDT-based solution, with a more than 20% increase in the efficiency of sub-1 cm vertex reconstruction across all neutrino flavours. 

Abstract Neutrinos from very nearby supernovae, such as Betelgeuse, are expected to generate more than ten million events over 10 s in Super-Kamokande (SK). At such large event rates, the buffers of the SK analog-to-digital conversion board (QBEE) will overflow, causing random loss of data that are critical for understanding the dynamics of the supernova explosion mechanism. In order to solve this problem, two new data-acquisition (DAQ) modules were developed to aid in the observation of very nearby supernovae. The first of these, the SN module, is designed to save only the number of hit photomultiplier tubes during a supernova burst and the second, the Veto module, prescales the high-rate neutrino events to prevent the QBEE from overflowing based on information from the SN module. In the event of a very nearby supernova, these modules allow SK to reconstruct the time evolution of the neutrino event rate from beginning to end using both QBEE and SN module data. This paper presents the development and testing of these modules together with an analysis of supernova-like data generated with a flashing laser diode. We demonstrate that the Veto module successfully prevents DAQ overflows for Betelgeuse-like supernovae as well as the long-term stability of the new modules. During normal running the Veto module is found to issue DAQ vetos a few times per month resulting in a total dead-time less than 1 ms, and does not influence ordinary operations. Additionally, using simulation data we find that supernovae closer than 800 pc will trigger the Veto module, resulting in a prescaling of the observed neutrino data. 

Abstract Preceding a core-collapse supernova (CCSN), various processes produce an increasing amount of neutrinos of all flavors characterized by mounting energies from the interior of massive stars. Among them, the electron antineutrinos are potentially detectable by terrestrial neutrino experiments such as KamLAND and Super-Kamiokande (SK) via inverse beta decay interactions. Once these pre-supernova (pre-SN) neutrinos are observed, an early warning of the upcoming CCSN can be provided. In light of this, KamLAND and SK, both located in the Kamioka mine in Japan, have been monitoring pre-SN neutrinos since 2015 and 2021, respectively. Recently, we performed a joint study between KamLAND and SK on pre-SN neutrino detection. A pre-SN alert system combining the KamLAND detector and the SK detector was developed and put into operation, which can provide a supernova alert to the astrophysics community. Fully leveraging the complementary properties of these two detectors, the combined alert is expected to resolve a pre-SN neutrino signal from a 15M_⊙star within 510 pc of the Earth at a significance level corresponding to a false alarm rate of no more than 1 per century. For a Betelgeuse-like model with optimistic parameters, it can provide early warnings up to 12 hr in advance. 

The determination of the direction of a stellar core collapse via its neutrino emission is crucial for the identification of the progenitor for a multimessenger follow-up. A highly effective method of reconstructing supernova directions within the Deep Underground Neutrino Experiment (DUNE) is introduced. The supernova neutrino pointing resolution is studied by simulating and reconstructing electron-neutrino charged-current absorption on ${}^{40}\mathrm{Ar}$and elastic scattering of neutrinos on electrons. Procedures to reconstruct individual interactions, including a newly developed technique called “brems flipping,” as well as the burst direction from an ensemble of interactions are described. Performance of the burst direction reconstruction is evaluated for supernovae happening at a distance of 10 kpc for a specific supernova burst flux model. The pointing resolution is found to be 3.4 degrees at 68% coverage for a perfect interaction-channel classification and a fiducial mass of 40 kton, and 6.6 degrees for a 10 kton fiducial mass respectively. Assuming a 4% rate of charged-current interactions being misidentified as elastic scattering, DUNE’s burst pointing resolution is found to be 4.3 degrees (8.7 degrees) at 68% coverage. Published by the American Physical Society2025