An official website of the United States government
Retrieving evidence to support or refute claims is a core part of automatic fact-checking. Prior work makes simplifying assumptions in retrieval that depart from real-world use cases: either no access to evidence, access to evidence curated by a human fact-checker, or access to evidence published after a claim was made. In this work, we present the first realistic pipeline to check real-world claims by retrieving raw evidence from the web. We restrict our retriever to only search documents available prior to the claim’s making, modeling the realistic scenario of emerging claims. Our pipeline includes five components: claim decomposition, raw document retrieval, fine-grained evidence retrieval, claim-focused summarization, and veracity judgment. We conduct experiments on complex political claims in the ClaimDecomp dataset and show that the aggregated evidence produced by our pipeline improves veracity judgments. Human evaluation finds the evidence summary produced by our system is reliable (it does not hallucinate information) and relevant to answering key questions about a claim, suggesting that it can assist fact-checkers even when it does not reflect a complete evidence set.
more »
« less
On the cosmological constant, the KK mass scale, and the cut-off dependence in the dark dimension scenario
Abstract In this short note we comment on the relation between the cosmological and the Kaluza–Klein mass scale in the dark dimension scenario [1], also in view of some recent claims [2] that would raise some doubts about the validity of this scenario. Here we argue that these claims have serious flaws and cannot be trusted.
more »
« less
- Award ID(s):
- 2112527
- PAR ID:
- 10473312
- Publisher / Repository:
- Springer Science + Business Media
- Date Published:
- Journal Name:
- The European Physical Journal C
- Volume:
- 83
- Issue:
- 11
- ISSN:
- 1434-6052
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Abstract Pluvial floods pose a significant threat to properties, yet comprehensive impact analysis is hindered by data limitations on pluvial inundation. To assess pluvial flood impacts, we leveraged U.S. flood insurance claims and policy records for a subset of properties outside 100-year floodplains, streamflow records, and nationwide precipitation data, enabling us to distinguish damage claims caused by pluvial floods over 1978–2021. Strikingly, 87.1% of the claims analyzed from this subset were due to pluvial floods. Utilizing these pluvial flood claims unveiled distinct regional patterns of pluvial impacts across the contiguous U.S. These patterns are informed by the relationship between claim frequency and precipitation within each region. Remarkably, despite the pervasiveness of impacts, many states are seeing declining uptake in pluvial flood insurance coverage. Our study highlights regions facing heightened pluvial flood risks and underscores the critical need for enhanced consideration of pluvial inundation within risk management frameworks.more » « less
-
null (Ed.)Abstract In this paper we consider some questions surrounding whether or not regional climate models “add value,” a controversial issue in climate science today. We highlight some objections frequently made about regional climate models both within and outside the community of modelers, including several claims that regional climate models do not “add value.” We show that there are a number of issues involved in the latter claims, the primary ones centering on the fact that different research questions are being pursued by the modelers making the complaints against regional climate models. Further issues focus on historical deficiencies of particular—but not generalizable—failures of individual regional models. We provide tools to sort out these different research questions and particular failures, and to improve communication and understanding surrounding added value in climate modeling and philosophy of climate science.more » « less
-
Abstract A hallmark of the Trump presidency was a stream of false statements, many of which were repeated dozens or even hundreds of times. But whether (and to what extent) this repetition translates into public misperceptions remains an open question. We address this question by leveraging the most comprehensive data on Trump’s repetition of misleading claims during his presidency. In a national survey asking Americans to evaluate the truth of claims from this database, we find a clear partisan asymmetry. An increase in the number of repetitions of a falsehood corresponded with increased belief among Republicans but decreased belief among Democrats. We also find an important moderating role of media consumption. The effects of repetition were larger when people consumed more right-leaning cable news and when falsehoods were mostly repeated on Twitter. We discuss implications of these findings for misinformation research.more » « less
-
Abstract Validity is a fundamental consideration of test development and test evaluation. The purpose of this study is to define and reify three key aspects of validity and validation, namely test‐score interpretation, test‐score use, and the claims supporting interpretation and use. This study employed a Delphi methodology to explore how experts in validity and validation conceptualize test‐score interpretation, use, and claims. Definitions were developed through multiple iterations of data collection and analysis. By clarifying the language used when conducting validation, validation may be more accessible to a broader audience, including but not limited to test developers, test users, and test consumers.more » « less
