skip to main content


Title: Propagating sample variance uncertainties in redshift calibration: simulations, theory, and application to the COSMOS2015 data
ABSTRACT Cosmological analyses of galaxy surveys rely on knowledge of the redshift distribution of their galaxy sample. This is usually derived from a spectroscopic and/or many-band photometric calibrator survey of a small patch of sky. The uncertainties in the redshift distribution of the calibrator sample include a contribution from shot noise, or Poisson sampling errors, but, given the small volume they probe, they are dominated by sample variance introduced by large-scale structures. Redshift uncertainties have been shown to constitute one of the leading contributions to systematic uncertainties in cosmological inferences from weak lensing and galaxy clustering, and hence they must be propagated through the analyses. In this work, we study the effects of sample variance on small-area redshift surveys, from theory to simulations to the COSMOS2015 data set. We present a three-step Dirichlet method of resampling a given survey-based redshift calibration distribution to enable the propagation of both shot noise and sample variance uncertainties. The method can accommodate different levels of prior confidence on different redshift sources. This method can be applied to any calibration sample with known redshifts and phenotypes (i.e. cells in a self-organizing map, or some other way of discretizing photometric space), and provides a simple way of propagating prior redshift uncertainties into cosmological analyses. As a worked example, we apply the full scheme to the COSMOS2015 data set, for which we also present a new, principled SOM algorithm designed to handle noisy photometric data. We make available a catalogue of the resulting resamplings of the COSMOS2015 galaxies.  more » « less
Award ID(s):
2009210
NSF-PAR ID:
10288833
Author(s) / Creator(s):
; ; ;
Date Published:
Journal Name:
Monthly Notices of the Royal Astronomical Society
Volume:
498
Issue:
2
ISSN:
0035-8711
Page Range / eLocation ID:
2984 to 2999
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. null (Ed.)
    ABSTRACT Photometric galaxy surveys constitute a powerful cosmological probe but rely on the accurate characterization of their redshift distributions using only broad-band imaging, and can be very sensitive to incomplete or biased priors used for redshift calibration. A hierarchical Bayesian model has recently been developed to estimate those from the robust combination of prior information, photometry of single galaxies, and the information contained in the galaxy clustering against a well-characterized tracer population. In this work, we extend the method so that it can be applied to real data, developing some necessary new extensions to it, especially in the treatment of galaxy clustering information, and we test it on realistic simulations. After marginalizing over the mapping between the clustering estimator and the actual density distribution of the sample galaxies, and using prior information from a small patch of the survey, we find the incorporation of clustering information with photo-z’s tightens the redshift posteriors and overcomes biases in the prior that mimic those happening in spectroscopic samples. The method presented here uses all the information at hand to reduce prior biases and incompleteness. Even in cases where we artificially bias the spectroscopic sample to induce a shift in mean redshift of $\Delta \bar{z} \approx 0.05,$ the final biases in the posterior are $\Delta \bar{z} \lesssim 0.003.$ This robustness to flaws in the redshift prior or training samples would constitute a milestone for the control of redshift systematic uncertainties in future weak lensing analyses. 
    more » « less
  2. Abstract We present the Young Supernova Experiment Data Release 1 (YSE DR1), comprised of processed multicolor PanSTARRS1 griz and Zwicky Transient Facility (ZTF) gr photometry of 1975 transients with host–galaxy associations, redshifts, spectroscopic and/or photometric classifications, and additional data products from 2019 November 24 to 2021 December 20. YSE DR1 spans discoveries and observations from young and fast-rising supernovae (SNe) to transients that persist for over a year, with a redshift distribution reaching z ≈ 0.5. We present relative SN rates from YSE’s magnitude- and volume-limited surveys, which are consistent with previously published values within estimated uncertainties for untargeted surveys. We combine YSE and ZTF data, and create multisurvey SN simulations to train the ParSNIP and SuperRAENN photometric classification algorithms; when validating our ParSNIP classifier on 472 spectroscopically classified YSE DR1 SNe, we achieve 82% accuracy across three SN classes (SNe Ia, II, Ib/Ic) and 90% accuracy across two SN classes (SNe Ia, core-collapse SNe). Our classifier performs particularly well on SNe Ia, with high (>90%) individual completeness and purity, which will help build an anchor photometric SNe Ia sample for cosmology. We then use our photometric classifier to characterize our photometric sample of 1483 SNe, labeling 1048 (∼71%) SNe Ia, 339 (∼23%) SNe II, and 96 (∼6%) SNe Ib/Ic. YSE DR1 provides a training ground for building discovery, anomaly detection, and classification algorithms, performing cosmological analyses, understanding the nature of red and rare transients, exploring tidal disruption events and nuclear variability, and preparing for the forthcoming Vera C. Rubin Observatory Legacy Survey of Space and Time. 
    more » « less
  3. We measured the cross-correlation between galaxy weak lensing data from the Kilo Degree Survey (KiDS-1000, DR4) and cosmic microwave background (CMB) lensing data from the Atacama Cosmology Telescope (ACT, DR4) and the Planck Legacy survey. We used two samples of source galaxies, selected with photometric redshifts, (0.1 <  z B  < 1.2) and (1.2 <  z B  < 2), which produce a combined detection significance of the CMB lensing and weak galaxy lensing cross-spectrum of 7.7 σ . With the lower redshift galaxy sample, for which the cross-correlation was detected at a significance of 5.3 σ , we present joint cosmological constraints on the matter density parameter, Ω m , and the matter fluctuation amplitude parameter, σ 8 , marginalising over three nuisance parameters that model our uncertainty in the redshift and shear calibration as well as the intrinsic alignment of galaxies. We find our measurement to be consistent with the best-fitting flat ΛCDM cosmological models from both Planck and KiDS-1000. We demonstrate the capacity of CMB weak lensing cross-correlations to set constraints on either the redshift or shear calibration by analysing a previously unused high-redshift KiDS galaxy sample (1.2 <  z B  < 2), with the cross-correlation detected at a significance of 7 σ . This analysis provides an independent assessment for the accuracy of redshift measurements in a regime that is challenging to calibrate directly owing to known incompleteness in spectroscopic surveys. 
    more » « less
  4. ABSTRACT

    China Space Station Telescope (CSST) is a forthcoming powerful Stage IV space-based optical survey equipment. It is expected to explore a number of important cosmological problems in extremely high precision. In this work, we focus on investigating the constraints on neutrino mass and other cosmological parameters under the model of cold dark matter with a constant equation of state of dark energy (wCDM), using the mock data from the CSST photometric galaxy clustering and cosmic shear surveys (i.e. 3 × 2 pt). The systematics from galaxy bias, photometric redshift uncertainties, intrinsic alignment, shear calibration, baryonic feedback, non-linear, and instrumental effects are also included in the analysis. We generate the mock data based on the COSMOS catalogue considering the instrumental and observational effects of the CSST, and make use of the Markov chain Monte Carlo method to perform the constraints. Comparing to the results from current similar measurements, we find that CSST 3 × 2 pt surveys can improve the constraints on the cosmological parameters by one order of magnitude at least. We can obtain an upper limit for the sum of neutrino mass Σmν ≲ 0.36 (0.56) eV at 68 per cent (95 per cent) confidence level (CL), and Σmν ≲ 0.23 (0.29) eV at 68 per cent (95 per cent) CL if we ignore the baryonic effect, which is comparable to the Planck results and much better than the current photometric surveys. This indicates that the CSST photometric surveys can provide stringent constraints on the neutrino mass and other cosmological parameters, and the results also can be further improved by including data from other kinds of CSST cosmological surveys.

     
    more » « less
  5. ABSTRACT As the statistical power of galaxy weak lensing reaches per cent level precision, large, realistic, and robust simulations are required to calibrate observational systematics, especially given the increased importance of object blending as survey depths increase. To capture the coupled effects of blending in both shear and photometric redshift calibration, we define the effective redshift distribution for lensing, nγ(z), and describe how to estimate it using image simulations. We use an extensive suite of tailored image simulations to characterize the performance of the shear estimation pipeline applied to the Dark Energy Survey (DES) Year 3 data set. We describe the multiband, multi-epoch simulations, and demonstrate their high level of realism through comparisons to the real DES data. We isolate the effects that generate shear calibration biases by running variations on our fiducial simulation, and find that blending-related effects are the dominant contribution to the mean multiplicative bias of approximately $-2{{\ \rm per\ cent}}$. By generating simulations with input shear signals that vary with redshift, we calibrate biases in our estimation of the effective redshift distribution, and demonstrate the importance of this approach when blending is present. We provide corrected effective redshift distributions that incorporate statistical and systematic uncertainties, ready for use in DES Year 3 weak lensing analyses. 
    more » « less