skip to main content

Title: From EMBER to FIRE: predicting high resolution baryon fields from dark matter simulations with deep learning
ABSTRACT Hydrodynamic simulations provide a powerful, but computationally expensive, approach to study the interplay of dark matter and baryons in cosmological structure formation. Here, we introduce the EMulating Baryonic EnRichment (EMBER) Deep Learning framework to predict baryon fields based on dark matter-only simulations thereby reducing computational cost. EMBER comprises two network architectures, U-Net and Wasserstein Generative Adversarial Networks (WGANs), to predict 2D gas and H i densities from dark matter fields. We design the conditional WGANs as stochastic emulators, such that multiple target fields can be sampled from the same dark matter input. For training we combine cosmological volume and zoom-in hydrodynamical simulations from the Feedback in Realistic Environments (FIRE) project to represent a large range of scales. Our fiducial WGAN model reproduces the gas and H i power spectra within 10 per cent accuracy down to ∼10 kpc scales. Furthermore, we investigate the capability of EMBER to predict high resolution baryon fields from low resolution dark matter inputs through upsampling techniques. As a practical application, we use this methodology to emulate high-resolution H i maps for a dark matter simulation of a $L=100\, \text{Mpc}\, h^{ -1}$ comoving cosmological box. The gas content of dark matter haloes and the H i column density distributions predicted by EMBER more » agree well with results of large volume cosmological simulations and abundance matching models. Our method provides a computationally efficient, stochastic emulator for augmenting dark matter only simulations with physically consistent maps of baryon fields. « less
; ; ; ; ; ;
Award ID(s):
2009687 1910346 1752913 2108944
Publication Date:
Journal Name:
Monthly Notices of the Royal Astronomical Society
Page Range or eLocation-ID:
1323 to 1341
Sponsoring Org:
National Science Foundation
More Like this
  1. Context. Inferences about dark matter, dark energy, and the missing baryons all depend on the accuracy of our model of large-scale structure evolution. In particular, with cosmological simulations in our model of the Universe, we trace the growth of structure, and visualize the build-up of bigger structures from smaller ones and of gaseous filaments connecting galaxy clusters. Aims. Here we aim to reveal the complexity of the large-scale structure assembly process in great detail and on scales from tens of kiloparsecs up to more than 10 Mpc with new sensitive large-scale observations from the latest generation of instruments. We also aim to compare our findings with expectations from our cosmological model. Methods. We used dedicated SRG/eROSITA performance verification (PV) X-ray, ASKAP/EMU Early Science radio, and DECam optical observations of a ~15 deg 2 region around the nearby interacting galaxy cluster system A3391/95 to study the warm-hot gas in cluster outskirts and filaments, the surrounding large-scale structure and its formation process, the morphological complexity in the inner parts of the clusters, and the (re-)acceleration of plasma. We also used complementary Sunyaev-Zeldovich (SZ) effect data from the Planck survey and custom-made Galactic total (neutral plus molecular) hydrogen column density maps based onmore »the HI4PI and IRAS surveys. We relate the observations to expectations from cosmological hydrodynamic simulations from the Magneticum suite. Results. We trace the irregular morphology of warm and hot gas of the main clusters from their centers out to well beyond their characteristic radii, r 200 . Between the two main cluster systems, we observe an emission bridge on large scale and with good spatial resolution. This bridge includes a known galaxy group but this can only partially explain the emission. Most gas in the bridge appears hot, but thanks to eROSITA’s unique soft response and large field of view, we discover some tantalizing hints for warm, truly primordial filamentary gas connecting the clusters. Several matter clumps physically surrounding the system are detected. For the “Northern Clump,” we provide evidence that it is falling towards A3391 from the X-ray hot gas morphology and radio lobe structure of its central AGN. Moreover, the shapes of these X-ray and radio structures appear to be formed by gas well beyond the virial radius, r 100 , of A3391, thereby providing an indirect way of probing the gas in this elusive environment. Many of the extended sources in the field detected by eROSITA are also known clusters or new clusters in the background, including a known SZ cluster at redshift z = 1. We find roughly an order of magnitude more cluster candidates than the SPT and ACT surveys together in the same area. We discover an emission filament north of the virial radius of A3391 connecting to the Northern Clump. Furthermore, the absorption-corrected eROSITA surface brightness map shows that this emission filament extends south of A3395 and beyond an extended X-ray-emitting object (the “Little Southern Clump”) towards another galaxy cluster, all at the same redshift. The total projected length of this continuous warm-hot emission filament is 15 Mpc, running almost 4 degrees across the entire eROSITA PV observation field. The Northern and Southern Filament are each detected at >4 σ . The Planck SZ map additionally appears to support the presence of both new filaments. Furthermore, the DECam galaxy density map shows galaxy overdensities in the same regions. Overall, the new datasets provide impressive confirmation of the theoretically expected structure formation processes on the individual system level, including the surrounding warm-hot intergalactic medium distribution; the similarities of features found in a similar system in the Magneticum simulation are striking. Our spatially resolved findings show that baryons indeed reside in large-scale warm-hot gas filaments with a clumpy structure.« less

    Dark Energy Spectroscopic Instrument (DESI) will construct a large and precise three-dimensional map of our Universe. The survey effective volume reaches $\sim 20\, h^{-3}\, \mathrm{Gpc}^{3}$. It is a great challenge to prepare high-resolution simulations with a much larger volume for validating the DESI analysis pipelines. AbacusSummit is a suite of high-resolution dark-matter-only simulations designed for this purpose, with $200\, h^{-3}\, \mathrm{Gpc}^{3}$ (10 times DESI volume) for the base cosmology. However, further efforts need to be done to provide a more precise analysis of the data and to cover also other cosmologies. Recently, the CARPool method was proposed to use paired accurate and approximate simulations to achieve high statistical precision with a limited number of high-resolution simulations. Relying on this technique, we propose to use fast quasi-N-body solvers combined with accurate simulations to produce accurate summary statistics. This enables us to obtain 100 times smaller variance than the expected DESI statistical variance at the scales we are interested in, e.g. $k \lt 0.3\, h\, \mathrm{Mpc}^{-1}$ for the halo power spectrum. In addition, it can significantly suppress the sample variance of the halo bispectrum. We further generalize the method for other cosmologies with only one realization in AbacusSummit suite to extend the effectivemore »volume ∼20 times. In summary, our proposed strategy of combining high-fidelity simulations with fast approximate gravity solvers and a series of variance suppression techniques sets the path for a robust cosmological analysis of galaxy survey data.

    « less
  3. Cosmological simulations of galaxy formation are limited by finite computational resources. We draw from the ongoing rapid advances in artificial intelligence (AI; specifically deep learning) to address this problem. Neural networks have been developed to learn from high-resolution (HR) image data and then make accurate superresolution (SR) versions of different low-resolution (LR) images. We apply such techniques to LR cosmological N-body simulations, generating SR versions. Specifically, we are able to enhance the simulation resolution by generating 512 times more particles and predicting their displacements from the initial positions. Therefore, our results can be viewed as simulation realizations themselves, rather than projections, e.g., to their density fields. Furthermore, the generation process is stochastic, enabling us to sample the small-scale modes conditioning on the large-scale environment. Our model learns from only 16 pairs of small-volume LR-HR simulations and is then able to generate SR simulations that successfully reproduce the HR matter power spectrum to percent level up to16h1Mpcand the HR halo mass function to within10%down to1011M. We successfully deploy the model in a box 1,000 times larger than the training simulation box, showing that high-resolution mock surveys can be generated rapidly. We conclude that AI assistance has themore »potential to revolutionize modeling of small-scale galaxy-formation physics in large cosmological volumes.

    « less
  4. null (Ed.)
    ABSTRACT In this work, we expand and test the capabilities of our recently developed superresolution (SR) model to generate high-resolution (HR) realizations of the full phase-space matter distribution, including both displacement and velocity, from computationally cheap low-resolution (LR) cosmological N-body simulations. The SR model enhances the simulation resolution by generating 512 times more tracer particles, extending into the deeply nonlinear regime where complex structure formation processes take place. We validate the SR model by deploying the model in 10 test simulations of box size 100 h−1 Mpc, and examine the matter power spectra, bispectra, and two-dimensional power spectra in redshift space. We find the generated SR field matches the true HR result at per cent level down to scales of k ∼ 10 h  Mpc−1. We also identify and inspect dark matter haloes and their substructures. Our SR model generates visually authentic small-scale structures that cannot be resolved by the LR input, and are in good statistical agreement with the real HR results. The SR model performs satisfactorily on the halo occupation distribution, halo correlations in both real and redshift space, and the pairwise velocity distribution, matching the HR results with comparable scatter, thus demonstrating its potential in making mock halo catalogues. The SR technique can be amore »powerful and promising tool for modelling small-scale galaxy formation physics in large cosmological volumes.« less
  5. The goal of generative models is to learn the intricate relations between the data to create new simulated data, but current approaches fail in very high dimensions. When the true data-generating process is based on physical processes, these impose symmetries and constraints, and the generative model can be created by learning an effective description of the underlying physics, which enables scaling of the generative model to very high dimensions. In this work, we propose Lagrangian deep learning (LDL) for this purpose, applying it to learn outputs of cosmological hydrodynamical simulations. The model uses layers of Lagrangian displacements of particles describing the observables to learn the effective physical laws. The displacements are modeled as the gradient of an effective potential, which explicitly satisfies the translational and rotational invariance. The total number of learned parameters is only of order 10, and they can be viewed as effective theory parameters. We combine N-body solver fast particle mesh (FastPM) with LDL and apply it to a wide range of cosmological outputs, from the dark matter to the stellar maps, gas density, and temperature. The computational cost of LDL is nearly four orders of magnitude lower than that of the full hydrodynamical simulations, yet itmore »outperforms them at the same resolution. We achieve this with only of order 10 layers from the initial conditions to the final output, in contrast to typical cosmological simulations with thousands of time steps. This opens up the possibility of analyzing cosmological observations entirely within this framework, without the need for large dark-matter simulations.

    « less