skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Development of high performance computing tools for estimation of high-resolution surface energy balance products using sUAS information
sUAS (small-Unmanned Aircraft System) and advanced surface energy balance models allow detailed assessment and monitoring (at plant scale) of different (agricultural, urban, and natural) environments. Significant progress has been made in the understanding and modeling of atmosphere-plant-soil interactions and numerical quantification of the internal processes at plant scale. Similarly, progress has been made in ground truth information comparison and validation models. An example of this progress is the application of sUAS information using the Two-Source Surface Energy Balance (TSEB) model in commercial vineyards by the Grape Remote sensing Atmospheric Profile and Evapotranspiration eXperiment - GRAPEX Project in California. With advances in frequent sUAS data collection for larger areas, sUAS information processing becomes computationally expensive on local computers. Additionally, fragmentation of different models and tools necessary to process the data and validate the results is a limiting factor. For example, in the referred GRAPEX project, commercial software (ArcGIS and MS Excel) and Python and Matlab code are needed to complete the analysis. There is a need to assess and integrate research conducted with sUAS and surface energy balance models in a sharing platform to be easily migrated to high performance computing (HPC) resources. This research, sponsored by the National Science Foundation FAIR Cyber Training Fellowships, is integrating disparate software and code under a unified language (Python). The Python code for estimating the surface energy fluxes using TSEB2T model as well as the EC footprint analysis code for ground truth information comparison were hosted in myGeoHub site https://mygeohub.org/ to be reproducible and replicable.  more » « less
Award ID(s):
1829764
PAR ID:
10284896
Author(s) / Creator(s):
; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ;
Editor(s):
Thomasson, J. Alex; Torres-Rua, Alfonso F.
Date Published:
Journal Name:
Development of high performance computing tools for estimation of high-resolution surface energy balance products using sUAS information
Page Range / eLocation ID:
18
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. null (Ed.)
    The Chequamegon Heterogeneous Ecosystem Energy-Balance Study Enabled by a High-Density Extensive Array of Detectors 2019 (CHEESEHEAD19) is an ongoing National Science Foundation project based on an intensive field campaign that occurred from June to October 2019. The purpose of the study is to examine how the atmospheric boundary layer (ABL) responds to spatial heterogeneity in surface energy fluxes. One of the main objectives is to test whether lack of energy balance closure measured by eddy covariance (EC) towers is related to mesoscale atmospheric processes. Finally, the project evaluates data-driven methods for scaling surface energy fluxes, with the aim to improve model–data comparison and integration. To address these questions, an extensive suite of ground, tower, profiling, and airborne instrumentation was deployed over a 10 km × 10 km domain of a heterogeneous forest ecosystem in the Chequamegon–Nicolet National Forest in northern Wisconsin, United States, centered on an existing 447-m tower that anchors an AmeriFlux/NOAA supersite (US-PFa/WLEF). The project deployed one of the world’s highest-density networks of above-canopy EC measurements of surface energy fluxes. This tower EC network was coupled with spatial measurements of EC fluxes from aircraft; maps of leaf and canopy properties derived from airborne spectroscopy, ground-based measurements of plant productivity, phenology, and physiology; and atmospheric profiles of wind, water vapor, and temperature using radar, sodar, lidar, microwave radiometers, infrared interferometers, and radiosondes. These observations are being used with large-eddy simulation and scaling experiments to better understand submesoscale processes and improve formulations of subgrid-scale processes in numerical weather and climate models. 
    more » « less
  2. Software depends on upstream projects that regularly fix vulnerabilities, but the documentation of those vulnerabilities is often unreliable or unavailable. Automating the collection of existing vulnerability fixes is essential for downstream projects to reliably update their dependencies due to the sheer number of dependencies in modern software. Prior efforts rely solely on incomplete databases or imprecise or inaccurate statistical analysis of upstream repositories. In this paper, we introduce Differential Alert Analysis (DAA) to discover vulnerability fixes in software projects. In contrast to statistical analysis, DAA leverages static analysis security testing (SAST) tools, which reason over code context and semantics. We provide a language-independent implementation of DAA and show that for Python and Java based projects, DAA has high precision for a ground-truth dataset of vulnerability fixes — even with noisy and low-precision SAST tools. We then use DAA in two large-scale empirical studies covering several prominent ecosystems, finding hundreds of resolved alerts, including many never publicly disclosed. DAA thus provides a powerful, accurate primitive for software projects, code analysis tools, vulnerability databases, and researchers to characterize and enhance the security of software supply chains. 
    more » « less
  3. The BigCode project is an open-scientific collaboration working on the responsible development of large language models for code. This tech report describes the progress of the collaboration until December 2022, outlining the current state of the Personally Identifiable Information (PII) redaction pipeline, the experiments conducted to de-risk the model architecture, and the experiments investigating better preprocessing methods for the training data. We train 1.1B parameter models on the Java, JavaScript, and Python subsets of The Stack and evaluate them on the MultiPL-E text-to-code benchmark. We find that more aggressive filtering of near-duplicates can further boost performance and, surprisingly, that selecting files from repositories with 5+ GitHub stars deteriorates performance significantly. Our best model outperforms previous open-source multilingual code generation models (InCoder-6.7B and CodeGen-Multi-2.7B) in both left-to-right generation and infilling on the Java, JavaScript, and Python portions of MultiPL-E, despite being a substantially smaller model. All models are released under an OpenRAIL license. 
    more » « less
  4. ABSTRACT Recent works have suggested that energy balance spectral energy distribution (SED) fitting codes may be of limited use for studying high-redshift galaxies for which the observed ultraviolet and far-infrared emission are offset (spatially ‘decoupled’). It has been proposed that such offsets could lead energy balance codes to miscalculate the overall energetics, preventing them from recovering such galaxies’ true properties. In this work, we test how well the SED fitting code magphys can recover the stellar mass, star formation rate (SFR), specific SFR, dust mass, and luminosity by fitting 6706 synthetic SEDs generated from four zoom-in simulations of dusty, high-redshift galaxies from the FIRE project via dust continuum radiative transfer. Comparing our panchromatic results (using wavelengths 0.4–500 μm, and spanning 1 < z < 8) with fits based on either the starlight ($$\lambda _\mathrm{eff} \le 2.2\, \mu$$m) or dust ($$\ge 100\, \mu$$m) alone, we highlight the power of considering the full range of multiwavelength data alongside an energy balance criterion. Overall, we obtain acceptable fits for 83 per cent of the synthetic SEDs, though the success rate falls rapidly beyond z ≈ 4, in part due to the sparser sampling of the priors at earlier times since SFHs must be physically plausible (i.e. shorter than the age of the universe). We use the ground truth from the simulations to show that when the quality of fit is acceptable, the fidelity of magphys estimates is independent of the degree of UV/FIR offset, with performance very similar to that previously reported for local galaxies. 
    more » « less
  5. Abstract. This study analyzes turbulent energy fluxes in the Arctic atmospheric boundary layer (ABL) using measurements with a small uncrewed aircraft system (sUAS). Turbulent fluxes constitute a major part of the atmospheric energy budget and influence the surface heat balance by distributing energy vertically in the atmosphere. However, only few in situ measurements of the vertical profile of turbulent fluxes in the Arctic ABL exist. The study presents a method to derive turbulent heat fluxes from DataHawk2 sUAS turbulence measurements, based on the flux gradient method with a parameterization of the turbulent exchange coefficient. This parameterization is derived from high-resolution horizontal wind speed measurements in combination with formulations for the turbulent Prandtl number and anisotropy depending on stability. Measurements were taken during the MOSAiC (Multidisciplinary drifting Observatory for the Study of Arctic Climate) expedition in the Arctic sea ice during the melt season of 2020. For three example cases from this campaign, vertical profiles of turbulence parameters and turbulent heat fluxes are presented and compared to balloon-borne, radar, and near-surface measurements. The combination of all measurements draws a consistent picture of ABL conditions and demonstrates the unique potential of the presented method for studying turbulent exchange processes in the vertical ABL profile with sUAS measurements. 
    more » « less