Search for: All records

The development of generative language models that can create long and coherent textual outputs via autoregression has lead to a proliferation of uses and a corresponding sweep of analyses as researches work to determine the limitations of this new paradigm. Unlike humans, these ‘Large Language Models’ (LLMs) are highly sensitive to small changes in their inputs, leading to unwanted inconsistency in their behavior. One problematic inconsistency when LLMs are used to answer multiple-choice questions or analyze multiple inputs is order dependency: the output of an LLM can (and often does) change significantly when sub-sequences are swapped, despite both orderings being semantically identical. In this paper we present Set-Based Prompting, a technique that guarantees the output of an LLM will not have order dependence on a specified set of sub-sequences. We show that this method provably eliminates order dependency, and that it can be applied to any transformer-based LLM to enable text generation that is unaffected by re-orderings. Delving into the implications of our method, we show that, despite our inputs being out of distribution, the impact on expected accuracy is small, where the expectation is over the order of uniformly chosen shuffling of the candidate responses, and usually significantly less in practice. Thus, Set-Based Prompting can be used as a ‘dropped-in’ method on fully trained models. Finally, we discuss how our method’s success suggests that other strong guarantees can be obtained on LLM performance via modifying the input representations. Code is available at github.com/reidmcy/set-based-prompting. 

Narrative planning is the use of automated planning to construct, communicate, and understand stories, a form of information to which human cognition and enaction is pre-disposed. We review the narrative planning problem in a manner suitable as an introduction to the area, survey different plan-based methodologies and affordances for reasoning about narrative, and discuss open challenges relevant to the broader AI community. 

Hurricanes have been the most expensive and devastating natural disasters in US history. Nevertheless, our understanding of the turbulence processes in these flows is limited due to the lack of sufficient measurements and high-resolution turbulence-resolving simulations. Our objective in this study is to bridge this knowledge gap by conducting a thorough sensitivity analysis of the hurricane boundary layer using large-eddy simulations. We characterize the impacts of the radius, surface roughness, gradient wind, and sub-grid scale viscosity models on the hurricane’s mean and turbulence dynamics. Our results indicate that increasing the Rossby number (rotation) increases the hurricane’s maximum jet velocity, reduces the boundary layer height, and decreases the size of coherent turbulent structures at the same elevation. This study provides insights into the turbulence dynamics in hurricanes and can guide the development of more accurate turbulence models for rotating hurricane flows. 

The Radio Neutrino Observatory in Greenland (RNO-G) is the first in-ice radio array in the northern hemisphere for the detection of ultra-high energy neutrinos via the coherent radio emission from neutrino-induced particle cascades within the ice. The array is currently in phased construction near Summit Station on the Greenland ice sheet, with 7 stations deployed during the first two boreal summer field seasons of 2021 and 2022. In this paper, we describe the installation and system design of these initial RNO-G stations, and discuss the performance of the array as of summer 2024. 

Abstract The recent IceCube detection of TeV neutrino emission from the nearby active galaxy NGC 1068 suggests that active galactic nuclei (AGNs) could make a sizable contribution to the diffuse flux of astrophysical neutrinos. The absence of TeVγ-rays from NGC 1068 indicates neutrino production in the vicinity of the supermassive black hole, where the high radiation density leads toγ-ray attenuation. Therefore, any potential neutrino emission from similar sources is not expected to correlate with high-energyγ-rays. Disk-corona models predict neutrino emission from Seyfert galaxies to correlate with keV X-rays because they are tracers of coronal activity. Using through-going track events from the Northern Sky recorded by IceCube between 2011 and 2021, we report results from a search for individual and aggregated neutrino signals from 27 additional Seyfert galaxies that are contained in the Swift's Burst Alert Telescope AGN Spectroscopic Survey. Besides the generic single power law, we evaluate the spectra predicted by the disk-corona model assuming stochastic acceleration parameters that match the measured flux from NGC 1068. Assuming all sources to be intrinsically similar to NGC 1068, our findings constrain the collective neutrino emission from X-ray bright Seyfert galaxies in the northern sky, but, at the same time, show excesses of neutrinos that could be associated with the objects NGC 4151 and CGCG 420-015. These excesses result in a 2.7σsignificance with respect to background expectations. 

We report a study of the inelasticity distribution in the scattering of neutrinos of energy 80–560 GeV off nucleons. Using atmospheric muon neutrinos detected in IceCube’s sub-array DeepCore during 2012–2021, we fit the observed inelasticity in the data to a parameterized expectation and extract the values that describe it best. Finally, we compare the results to predictions from various combinations of perturbative QCD calculations and atmospheric neutrino flux models. Published by the American Physical Society2025