An official website of the United States government
Many astrophysical analyses depend on estimates of redshifts (a proxy for distance) determined from photometric (i.e., imaging) data alone. Inaccurate estimates of photometric redshift uncertainties can result in large systematic errors. However, probability distribution outputs from many photometric redshift methods do not follow the frequentist definition of a Probability Density Function (PDF) for redshift -- i.e., the fraction of times the true redshift falls between two limits z1 and z2 should be equal to the integral of the PDF between these limits. Previous works have used the global distribution of Probability Integral Transform (PIT) values to re-calibrate PDFs, but offsetting inaccuracies in different regions of feature space can conspire to limit the efficacy of the method. We leverage a recently developed regression technique that characterizes the local PIT distribution at any location in feature space to perform a local re-calibration of photometric redshift PDFs. Though we focus on an example from astrophysics, our method can produce PDFs which are calibrated at all locations in feature space for any use case.
more »
« less
This content will become publicly available on June 15, 2026
A conditioned backward fractional-derivative model for identifying super-diffusive pollutant source in aquatic systems with multiple observation data
Backward models for super-diffusion have been developed to identify pollutant source locations, but they are limited to a single observation and disregard field-measured concentrations. To overcome these limitations, this study derives the adjoint of the space-fractional advection–dispersion equation, incorporating measured concentrations from multiple observation data. Backward probabilities, such as the backward location probability density function (PDF), describe the likely source location(s) at a fixed time before sampling, offering a comprehensive modeling approach for source identification. By applying Bayes’ theorem, the individual PDFs from each observation and its corresponding concentration are combined into a joint PDF, enhancing both the information and reliability compared to the previous single PDF. Field applications show that the improved model enhances accuracy (with PDF peak locations closer to the actual source) and precision (with reduced variance) of backward PDFs for identifying point sources in a natural river and aquifer. The model’s performance is affected by observation count and measurement errors, with double peaks in the backward location PDF possible due to source mass uncertainty. Future refinements, such as incorporating backward travel time analysis and extending applications to reactive pollutants, could further enhance the utility of the conditioned backward fractional-derivative model developed in this study.
more »
« less
- Award ID(s):
- 2412673
- PAR ID:
- 10655837
- Publisher / Repository:
- Advances in Water Resources
- Date Published:
- Journal Name:
- Advances in Water Resources
- Volume:
- 203
- Issue:
- C
- ISSN:
- 0309-1708
- Page Range / eLocation ID:
- 105039
- Subject(s) / Keyword(s):
- Backward probability method Super-diffusion Bayes’ theorem Space fractional advection–dispersion equation
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Many astrophysical analyses depend on estimates of redshifts (a proxy for distance) determined from photometric (i.e., imaging) data alone. Inaccurate estimates of photometric redshift uncertainties can result in large systematic errors. However, probability distribution outputs from many photometric redshift methods do not follow the frequentist definition of a Probability Density Function (PDF) for redshift — i.e., the fraction of times the true redshift falls between two limits z1 and z2 should be equal to the integral of the PDF between these limits. Previous works have used the global distribution of Probability Integral Transform (PIT) values to re-calibrate PDFs, but offsetting inaccuracies in different regions of feature space can conspire to limit the efficacy of the method. We leverage a recently developed regression technique that characterizes the local PIT distribution at any location in feature space to perform a local re-calibration of photometric redshift PDFs resulting in calibrated predictive distributions. Though we focus on an example from astrophysics, our method can produce predictive distributions which are calibrated at all locations in feature space for any use case.more » « less
-
A novel automated high-throughput screening approach,ClusterFinder, is reported for finding candidate structures for atomic pair distribution function (PDF) structural refinements. Finding starting models for PDF refinements is notoriously difficult when the PDF originates from nanoclusters or small nanoparticles. The reportedClusterFinderalgorithm can screen 104to 105candidate structures from structural databases such as the Inorganic Crystal Structure Database (ICSD) in minutes, using the crystal structures as templates in which it looks for atomic clusters that result in a PDF similar to the target measured PDF. The algorithm returns a rank-ordered list of clusters for further assessment by the user. The algorithm has performed well for simulated and measured PDFs of metal–oxido clusters such as Keggin clusters. This is therefore a powerful approach to finding structural cluster candidates in a modelling campaign for PDFs of nanoparticles and nanoclusters.more » « less
-
Recently, there have been rapid developments in lattice-QCD calculations of proton structure, especially in the parton distribution functions (PDFs). We overcame a longstanding obstacle and for the first time in lattice-QCD are able to directly calculate the Bjorken- x dependence of the quark, helicity and transversity distributions. The PDFs are obtained using the large-momentum effective field theory (LaMET) framework where the full Bjorken- x dependence of finite-momentum PDFs, called “quasi-PDFs”, can be calculated on the lattice. The quasi-PDF nucleon matrix elements are renormalized non-perturbatively in RI/MOM-scheme. Following a nonperturbative renormalization of the parton quasi-distribution in a regularization-independent momentum-subtraction scheme, we establish its matching to the $$ \overline {{\rm{MS}}} $$ PDF and calculate the non-singlet matching coefficient at next-to-leading order in perturbation theory. In this proceeding, I will show the progress that has been made in recent years, highlighting the latest state-of-the art PDF calculations at the physical pion mass. Future impacts on the large- x global PDF fits are also discussed.more » « less
-
A method is presented for predicting the space group of a structure given a calculated or measured atomic pair distribution function (PDF) from that structure. The method utilizes machine learning models trained on more than 100 000 PDFs calculated from structures in the 45 most heavily represented space groups. In particular, a convolutional neural network (CNN) model is presented which yields a promising result in that it correctly identifies the space group among the top-6 estimates 91.9% of the time. The CNN model also successfully identifies space groups for 12 out of 15 experimental PDFs. Interesting aspects of the failed estimates are discussed, which indicate that the CNN is failing in similar ways as conventional indexing algorithms applied to conventional powder diffraction data. This preliminary success of the CNN model shows the possibility of model-independent assessment of PDF data on a wide class of materials.more » « less
