skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


Title: The Sensitivity of GPz Estimates of Photo-z Posterior PDFs to Realistically Complex Training Set Imperfections
Abstract The accurate estimation of photometric redshifts is crucial to many upcoming galaxy surveys, for example, the Vera C. Rubin Observatory Legacy Survey of Space and Time (LSST). Almost all Rubin extragalactic and cosmological science requires accurate and precise calculation of photometric redshifts; many diverse approaches to this problem are currently in the process of being developed, validated, and tested. In this work, we use the photometric redshift code GPz to examine two realistically complex training set imperfections scenarios for machine learning based photometric redshift calculation: (i) where the spectroscopic training set has a very different distribution in color–magnitude space to the test set, and (ii) where the effect of emission line confusion causes a fraction of the training spectroscopic sample to not have the true redshift. By evaluating the sensitivity of GPz to a range of increasingly severe imperfections, with a range of metrics (both of photo- z point estimates as well as posterior probability distribution functions, PDFs), we quantify the degree to which predictions get worse with higher degrees of degradation. In particular, we find that there is a substantial drop-off in photo- z quality when line-confusion goes above ∼1%, and sample incompleteness below a redshift of 1.5, for an experimental setup using data from the Buzzard Flock synthetic sky catalogs.  more » « less
Award ID(s):
1715122
PAR ID:
10382166
Author(s) / Creator(s):
; ; ; ;
Date Published:
Journal Name:
Publications of the Astronomical Society of the Pacific
Volume:
134
Issue:
1034
ISSN:
0004-6280
Page Range / eLocation ID:
044501
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; ; ; ; ; ; ; ; ; et al (, The Open Journal of Astrophysics)
    Photometric redshifts will be a key data product for the Rubin Observatory Legacy Survey of Space and Time (LSST) as well as for future ground and space-based surveys. The need for photometric redshifts, or photo-zs, arises from sparse spectroscopic coverage of observed galaxies. LSST is expected to observe billions of objects, making it crucial to have a photo-z estimator that is accurate and efficient. To that end, we present DeepDISC photo-z, a photo-z estimator that is an extension of the DeepDISC framework. The base DeepDISC network simultaneously detects, segments, and classifies objects in multi-band coadded images. We introduce photo-z capabilities to DeepDISC by adding a redshift estimation Region of Interest head, which produces a photo-z probability distribution function for each detected object. On simulated LSST images, DeepDISC photo-z outperforms traditional catalog-based estimators, in both point estimate and probabilistic metrics. We validate DeepDISC by examining dependencies on systematics including galactic extinction, blending and PSF effects. We also examine the impact of the data quality and the size of the training set and model. We find that the biggest factor in DeepDISC photo-z quality is the signal-to-noise of the imaging data, and see a reduction in photo-z scatter approximately proportional to the image data signal-to-noise. Our code is fully public and integrated in the RAIL photo-z package for ease of use and comparison to other codes at https://github.com/LSSTDESC/rail_deepdisc 
    more » « less
  2. ; ; ; ; ; ; ; ; ; ; et al (, Astronomy & Astrophysics)
    Aims.We present a method for refining photometric redshift galaxy catalogs based on a comparison of their color-space matching with overlapping spectroscopic calibration data. We focus on cases where photometric redshifts (photo-z) are estimated empirically. Identifying galaxies that are poorly represented in spectroscopic data is crucial, as their photo-zmay be unreliable due to extrapolation beyond the training sample. Methods.Our approach uses a self-organizing map (SOM) to project a multidimensional parameter space of magnitudes and colors onto a 2D manifold, allowing us to analyze the resulting patterns as a function of various galaxy properties. Using SOM, we compared the Kilo-Degree Survey’s bright galaxy sample (KiDS-Bright), limited tor < 20 mag, with various spectroscopic samples, including the Galaxy And Mass Assembly (GAMA). Results.Our analysis reveals that GAMA tends to underrepresent KiDS-Bright at its faintest (r ≳ 19.5) and highest-redshift (z ≳ 0.4) ranges; however, no strong trends are seen in terms of color or stellar mass. By incorporating additional spectroscopic data from the SDSS, 2dF, and early DESI, we identified SOM cells where the photo-zvalues are estimated suboptimally. We derived a set of SOM-based criteria to refine the photometric sample and improve photo-zstatistics. For the KiDS-Bright sample, this improvement is modest, namely, it excludes the least represented 20% of the sample reduces photo-zscatter by less than 10%. Conclusions.We conclude that GAMA, used for KiDS-Bright photo-ztraining, is sufficiently representative for reliable redshift estimation across most of the color space. Future spectroscopic data from surveys such as DESI should be better suited for exploiting the full improvement potential of our method. 
    more » « less
  3. ; ; ; ; ; ; ; ; ; ; et al (, Monthly Notices of the Royal Astronomical Society)
    ABSTRACT Although photometric redshifts (photo-z’s) are crucial ingredients for current and upcoming large-scale surveys, the high-quality spectroscopic redshifts currently available to train, validate, and test them are substantially non-representative in both magnitude and colour. We investigate the nature and structure of this bias by tracking how objects from a heterogeneous training sample contribute to photo-z predictions as a function of magnitude and colour, and illustrate that the underlying redshift distribution at fixed colour can evolve strongly as a function of magnitude. We then test the robustness of the galaxy–galaxy lensing signal in 120 deg2 of HSC–SSP DR1 data to spectroscopic completeness and photo-z biases, and find that their impacts are sub-dominant to current statistical uncertainties. Our methodology provides a framework to investigate how spectroscopic incompleteness can impact photo-z-based weak lensing predictions in future surveys such as LSST and WFIRST. 
    more » « less
  4. ; (, The Astrophysical Journal)
    Abstract Upcoming photometric surveys will discover tens of thousands of Type Ia supernovae (SNe Ia), vastly outpacing the capacity of our spectroscopic resources. In order to maximize the scientific return of these observations in the absence of spectroscopic information, we must accurately extract key parameters, such as SN redshifts, with photometric information alone. We present Photo-zSNthesis, a convolutional neural network-based method for predicting full redshift probability distributions from multi-band supernova lightcurves, tested on both simulated Sloan Digital Sky Survey (SDSS) and Vera C. Rubin Legacy Survey of Space and Time data as well as observed SDSS SNe. We show major improvements over predictions from existing methods on both simulations and real observations as well as minimal redshift-dependent bias, which is a challenge due to selection effects, e.g., Malmquist bias. Specifically, we show a 61× improvement in prediction bias 〈Δz〉 on PLAsTiCC simulations and 5× improvement on real SDSS data compared to results from a widely used photometric redshift estimator, LCFIT+Z. The PDFs produced by this method are well constrained and will maximize the cosmological constraining power of photometric SNe Ia samples. 
    more » « less
  5. ; ; ; ; ; ; ; ; ; ; et al (, Astronomy & Astrophysics)
    Context.The determination of accurate photometric redshifts (photo-zs) in large imaging galaxy surveys is key for cosmological studies. One of the most common approaches is machine learning techniques. These methods require a spectroscopic or reference sample to train the algorithms. Attention has to be paid to the quality and properties of these samples since they are key factors in the estimation of reliable photo-zs. Aims.The goal of this work is to calculate the photo-zsfor the Year 3 (Y3) Dark Energy Survey (DES) Deep Fields catalogue using the Directional Neighborhood Fitting (DNF) machine learning algorithm. Moreover, we want to develop techniques to assess the incompleteness of the training sample and metrics to study how incompleteness affects the quality of photometric redshifts. Finally, we are interested in comparing the performance obtained by DNF on the Y3 DES Deep Fields catalogue with that of the EAzY template fitting approach. Methods.We emulated – at a brighter magnitude – the training incompleteness with a spectroscopic sample whose redshifts are known to have a measurable view of the problem. We used a principal component analysis to graphically assess the incompleteness and relate it with the performance parameters provided by DNF. Finally, we applied the results on the incompleteness to the photo-zcomputation on the Y3 DES Deep Fields with DNF and estimated its performance. Results.The photo-zsof the galaxies in the DES deep fields were computed with the DNF algorithm and added to the Y3 DES Deep Fields catalogue. We have developed some techniques to evaluate the performance in the absence of “true” redshift and to assess the completeness. We have studied the tradeoff in the training sample between the highest spectroscopic redshift quality versus completeness. We found some advantages in relaxing the highest-quality spectroscopic redshift requirements at fainter magnitudes in favour of completeness. The results achieved by DNF on the Y3 Deep Fields are competitive with the ones provided by EAzY, showing notable stability at high redshifts. It should be noted that the good results obtained by DNF in the estimation of photo-zsin deep field catalogues make DNF suitable for the future Legacy Survey of Space and Time (LSST) andEucliddata, which will have similar depths to the Y3 DES Deep Fields. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email