ABSTRACT Our Universe is homogeneous and isotropic, and its perturbations obey translation and rotation symmetry. In this work, we develop translation and rotation equivariant normalizing flow (TRENF), a generative normalizing flow (NF) model which explicitly incorporates these symmetries, defining the data likelihood via a sequence of Fourier space-based convolutions and pixel-wise non-linear transforms. TRENF gives direct access to the high dimensional data likelihood p(x|y) as a function of the labels y, such as cosmological parameters. In contrast to traditional analyses based on summary statistics, the NF approach has no loss of information since it preserves the full dimensionality of the data. On Gaussian random fields, the TRENF likelihood agrees well with the analytical expression and saturates the Fisher information content in the labels y. On non-linear cosmological overdensity fields from N-body simulations, TRENF leads to significant improvements in constraining power over the standard power spectrum summary statistic. TRENF is also a generative model of the data, and we show that TRENF samples agree well with the N-body simulations it trained on, and that the inverse mapping of the data agrees well with a Gaussian white noise both visually and on various summary statistics: when this is perfectly achieved the resulting p(x|y) likelihood analysis becomes optimal. Finally, we develop a generalization of this model that can handle effects that break the symmetry of the data, such as the survey mask, which enables likelihood analysis on data without periodic boundaries.
more »
« less
Quantification of High-dimensional Non-Gaussianities and Its Implication to Fisher Analysis in Cosmology
Abstract It is well known that the power spectrum is not able to fully characterize the statistical properties of non-Gaussian density fields. Recently, many different statistics have been proposed to extract information from non-Gaussian cosmological fields that perform better than the power spectrum. The Fisher matrix formalism is commonly used to quantify the accuracy with which a given statistic can constrain the value of the cosmological parameters. However, these calculations typically rely on the assumption that the sampling distribution of the considered statistic follows a multivariate Gaussian distribution. In this work, we follow Sellentin & Heavens and use two different statistical tests to identify non-Gaussianities in different statistics such as the power spectrum, bispectrum, marked power spectrum, and wavelet scattering transform (WST). We remove the non-Gaussian components of the different statistics and perform Fisher matrix calculations with theGaussianizedstatistics using Quijote simulations. We show that constraints on the parameters can change by a factor of ∼2 in some cases. We show with simple examples how statistics that do not follow a multivariate Gaussian distribution can achieve artificially tight bounds on the cosmological parameters when using the Fisher matrix formalism. We think that the non-Gaussian tests used in this work represent a powerful tool to quantify the robustness of Fisher matrix calculations and their underlying assumptions. We release the code used to compute the power spectra, bispectra, and WST that can be run on both CPUs and GPUs.
more »
« less
- Award ID(s):
- 2019786
- PAR ID:
- 10505459
- Publisher / Repository:
- AAS
- Date Published:
- Journal Name:
- The Astrophysical Journal
- Volume:
- 946
- Issue:
- 2
- ISSN:
- 0004-637X
- Page Range / eLocation ID:
- 107
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Abstract Combining dependent tests of significance has broad applications but the related p-value calculation is challenging. For Fisher's combination test, current p-value calculation methods (eg, Brown's approximation) tend to inflate the type I error rate when the desired significance level is substantially less than 0.05. The problem could lead to significant false discoveries in big data analyses. This paper provides two main contributions. First, it presents a general family of Fisher type statistics, referred to as the GFisher, which covers many classic statistics, such as Fisher's combination, Good's statistic, Lancaster's statistic, weighted Z-score combination, and so forth. The GFisher allows a flexible weighting scheme, as well as an omnibus procedure that automatically adapts proper weights and the statistic-defining parameters to a given data. Second, the paper presents several new p-value calculation methods based on two novel ideas: moment-ratio matching and joint-distribution surrogating. Systematic simulations show that the new calculation methods are more accurate under multivariate Gaussian, and more robust under the generalized linear model and the multivariate t-distribution. The applications of the GFisher and the new p-value calculation methods are demonstrated by a gene-based single nucleotide polymorphism (SNP)-set association study. Relevant computation has been implemented to an R package GFisher available on the Comprehensive R Archive Network.more » « less
-
Abstract An observational program focused on the high redshift (2<6) Universe has the opportunity to dramatically improve over upcoming LSS and CMB surveys on measurements of both the standard cosmological model and its extensions. Using a Fisher matrix formalism that builds upon recent advances in Lagrangian perturbation theory, we forecast constraints for future spectroscopic and 21-cm surveys on the standard cosmological model, curvature, neutrino mass, relativistic species, primordial features, primordial non-Gaussianity, dynamical dark energy, and gravitational slip. We compare these constraints with those achievable by current or near-future surveys such as DESI and Euclid, all under the same forecasting formalism, and compare our formalism with traditional linear methods. Our Python code FishLSS — used to calculate the Fisher information of the full shape power spectrum, CMB lensing, the cross-correlation of CMB lensing with galaxies, and combinations thereof — is publicly available.more » « less
-
ABSTRACT We derive a Fisher matrix for the parameters characterizing a population of gravitational-wave events. This provides a guide to the precision with which population parameters can be estimated with multiple observations, which becomes increasingly accurate as the number of events and the signal-to-noise ratio of the sampled events increase. The formalism takes into account individual event measurement uncertainties and selection effects, and can be applied to arbitrary population models. We illustrate the framework with two examples: an analytical calculation of the Fisher matrix for the mean and variance of a Gaussian model describing a population affected by selection effects, and an estimation of the precision with which the slope of a power-law distribution of supermassive black hole masses can be measured using extreme-mass-ratio inspiral observations. We compare the Fisher predictions to results from Monte Carlo analyses, finding very good agreement.more » « less
-
Parameter estimation with non-Gaussian stochastic fields is a common challenge in astrophysics and cosmology. In this paper, we advocate performing this task using the scattering transform, a statistical tool sharing ideas with convolutional neural networks (CNNs) but requiring neither training nor tuning. It generates a compact set of coefficients, which can be used as robust summary statistics for non-Gaussian information. It is especially suited for fields presenting localized structures and hierarchical clustering, such as the cosmological density field. To demonstrate its power, we apply this estimator to a cosmological parameter inference problem in the context of weak lensing. On simulated convergence maps with realistic noise, the scattering transform outperforms classic estimators and is on a par with the state-of-the-art CNN. It retains advantages of traditional statistical descriptors, has provable stability properties, allows to check for systematics, and importantly, the scattering coefficients are interpretable. It is a powerful and attractive estimator for observational cosmology and the study of physical fields in general.more » « less