skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


Title: Trust me, my neighbors say it's raining outside: ensuring data trustworthiness for crowdsourced weather stations
Decision making in utilities, municipal, and energy companies depends on accurate and trustworthy weather information and predictions. Recently, crowdsourced personal weather stations (PWS) are being increasingly used to provide a higher spatial and temporal resolution of weather measurements. However, tools and methods to ensure the trustworthiness of the crowdsourced data in real-time are lacking. In this paper, we present a Reputation System for Crowdsourced Rainfall Networks (RSCRN) to assign trust scores to personal weather stations in a region. Using real PWS data from the Weather Underground service in the high flood risk region of Norfolk, Virginia, we evaluate the performance of the proposed RSCRN. The proposed method is able to converge to a confident trust score for a PWS within 10--20 observations after installation. Collectively, the results indicate that the trust score derived from the RSCRN can reflect the collective measure of trustworthiness to the PWS, ensuring both useful and trustworthy data for modeling and decision-making in the future.  more » « less
Award ID(s):
1735587
PAR ID:
10112263
Author(s) / Creator(s):
; ;
Date Published:
Journal Name:
BuildSys '18 Proceedings of the 5th Conference on Systems for Built Environments
Page Range / eLocation ID:
25 to 28
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; (, Water Resources Research)
    Abstract High resolution and accurate rainfall information is essential to modeling and predicting hydrological processes. Crowdsourced personal weather stations (PWSs) have become increasingly popular in recent years and can provide dense spatial and temporal resolution in rainfall estimates. However, their usefulness could be limited due to less trust in crowdsourced data compared to traditional data sources. Using crowdsourced PWSs data without a robust evaluation of its trustworthiness can result in inaccurate rainfall estimates as PWSs are installed and maintained by non‐experts. In this study, we advance the Reputation System for Crowdsourced Rainfall Networks (RSCRN) to bridge this trust gap by assigning dynamic trust scores to PWSs. Based on rainfall data collected from 18 PWSs in two dense clusters in Houston, Texas, USA as a case study, we found that using RSCRN‐derived trust scores can increase the accuracy of 15‐min PWS rainfall estimates when compared to rainfall observations recorded at the city's high‐fidelity rainfall stations. Overall, RSCRN rainfall estimates improved for 77% (48 out of 62) of the analyzed storm events, with a median root‐mean‐square error (RMSE) improvement of 27.3%. Compared to an existing PWS quality control method, results showed that RSCRN improved rainfall estimates for 71% of the storm events (44 out of 62), with a median RMSE improvement of 18.7%. Using RSCRN‐derived trust scores can make the rapidly growing network of PWSs a more useful resource for hydrologic applications, greatly improving knowledge of rainfall patterns in areas with dense PWSs. 
    more » « less
  2. ; ; ; (, Evolution and Human Behavior)
    The concept of TRUSTWORTHINESS plays a role in the formation, maintenance, and dissolution of friendships, marriages, and cooperative relationships from small to large scales. Here, we analyze TRUSTWORTHINESS under the assumption that such concepts evolved to guide action adaptively. Intuition and research suggest that actors trust targets who have not engaged in betrayals. However, this perspective fails to capture certain real-world behaviors (e.g., when two people cheating on their spouses enter a relationship with each other and expect mutual fidelity). Evolutionary task analysis suggests that TRUSTWORTHINESS is structured to help actors address challenges of extending trust, where actors may gain or lose from doing so. In six experiments with American adults (N=1,718), we test the hypothesis that TRUSTWORTHINESS tracks not only (i) whether targets refrain from betraying trust when given opportunities, but also (ii) the impact of betrayal on the actor. Data generally support this hypothesis across relationships (friendships, romantic, professional): Actors deem non-betrayers more trustworthy than betrayers, but also deem betrayers more trustworthy when betrayals benefit actors. TRUSTWORTHINESS may incline actors to trust to those who refrain from betraying others—a potent signal of reluctance to betray oneself—while also favoring those who betray others if it serves oneself. 
    more » « less
  3. ; ; ; ; ; (, Transportation Research Record: Journal of the Transportation Research Board)
    null (Ed.)
    Climate change and sea-level rise are increasingly leading to higher and prolonged high tides, which, in combination with the growing intensity of rainfall and storm surges, and insufficient drainage infrastructure, result in frequent recurrent flooding in coastal cities. There is a pressing need to understand the occurrence of roadway flooding incidents in order to enact appropriate mitigation measures. Agency data for roadway flooding events are scarce and resource-intensive to collect. Crowdsourced data can provide a low-cost alternative for mapping roadway flood incidents in real time; however, the reliability is questionable. This research demonstrates a framework for asserting trustworthiness on crowdsourced flood incident data in a case study of Norfolk, Virginia. Publicly available (but spatially limited) flood incident data from the city in combination with different environmental and topographical factors are used to create a logistic regression model to predict the probability of roadway flooding at any location on the roadway network. The prediction accuracy of the model was found to be 90.5%. When applying this model to crowdsourced Waze flood incident data, 71.7% of the reports were predicted to be trustworthy. This study demonstrates the potential for using Waze incident report data for roadway flooding detection, providing a framework for cities to identify trustworthy reports in real time to enable rapid situation assessment and mitigation to reduce incident impact. 
    more » « less
  4. ; ; ; ; ; ; ; ; ; ; et al (, Risk Analysis)
    Abstract Demands to manage the risks of artificial intelligence (AI) are growing. These demands and the government standards arising from them both call for trustworthy AI. In response, we adopt a convergent approach to review, evaluate, and synthesize research on the trust and trustworthiness of AI in the environmental sciences and propose a research agenda. Evidential and conceptual histories of research on trust and trustworthiness reveal persisting ambiguities and measurement shortcomings related to inconsistent attention to the contextual and social dependencies and dynamics of trust. Potentially underappreciated in the development of trustworthy AI for environmental sciences is the importance of engaging AI users and other stakeholders, which human–AI teaming perspectives on AI development similarly underscore. Co‐development strategies may also help reconcile efforts to develop performance‐based trustworthiness standards with dynamic and contextual notions of trust. We illustrate the importance of these themes with applied examples and show how insights from research on trust and the communication of risk and uncertainty can help advance the understanding of trust and trustworthiness of AI in the environmental sciences. 
    more » « less
  5. ; ; ; ; ; ; (, npj Natural Hazards)
    Abstract Artificial Intelligence applications are rapidly expanding across weather, climate, and natural hazards. AI can be used to assist with forecasting weather and climate risks, including forecasting both the chance that a hazard will occur and the negative impacts from it, which means AI can help protect lives, property, and livelihoods on a global scale in our changing climate. To ensure that we are achieving this goal, the AI must be developed to be trustworthy, which is a complex and multifaceted undertaking. We present our work from the NSF AI Institute for Research on Trustworthy AI in Weather, Climate, and Coastal Oceanography (AI2ES), where we are taking a convergence research approach. Our work deeply integrates across AI, environmental, and risk communication sciences. This involves collaboration with professional end-users to investigate how they assess the trustworthiness and usefulness of AI methods for forecasting natural hazards. In turn, we use this knowledge to develop AI that is more trustworthy. We discuss how and why end-users may trust or distrust AI methods for multiple natural hazards, including winter weather, tropical cyclones, severe storms, and coastal oceanography. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email