The 1D power spectrum P1D of the Ly α forest provides important information about cosmological and astrophysical parameters, including constraints on warm dark matter models, the sum of the masses of the three neutrino species, and the thermal state of the intergalactic medium. We present the first measurement of P1D with the quadratic maximum likelihood estimator (QMLE) from the Dark Energy Spectroscopic Instrument (DESI) survey early data sample. This early sample of 54 600 quasars is already comparable in size to the largest previous studies, and we conduct a thorough investigation of numerous instrumental and analysis systematic errors to evaluate their impact on DESI data with QMLE. We demonstrate the excellent performance of the spectroscopic pipeline noise estimation and the impressive accuracy of the spectrograph resolution matrix with 2D image simulations of raw DESI images that we processed with the DESI spectroscopic pipeline. We also study metal line contamination and noise calibration systematics with quasar spectra on the red side of the Ly α emission line. In a companion paper, we present a similar analysis based on the Fast Fourier Transform estimate of the power spectrum. We conclude with a comparison of these two approaches and discuss the key sources of systematic error that we need to address with the upcoming DESI Year 1 analysis.
We demonstrate the use of an eigenbasis that is derived from principal component analysis (PCA) applied on an ensemble of random-noise images that have a “red” power spectrum; i.e., a spectrum that decreases smoothly from large to small spatial scales. The pattern of the resulting eigenbasis allows for the reconstruction of images with a broad range of image morphologies. In particular, we show that this general eigenbasis can be used to efficiently reconstruct images that resemble possible astronomical sources for interferometric observations, even though the images in the original ensemble used to generate the PCA basis are significantly different from the astronomical images. We further show that the efficiency and fidelity of the image reconstructions depends only weakly on the particular parameters of the red-noise power spectrum used to generate the ensemble of images.
more » « less- Award ID(s):
- 1903847
- NSF-PAR ID:
- 10363808
- Publisher / Repository:
- DOI PREFIX: 10.3847
- Date Published:
- Journal Name:
- The Astrophysical Journal
- Volume:
- 927
- Issue:
- 1
- ISSN:
- 0004-637X
- Format(s):
- Medium: X Size: Article No. 111
- Size(s):
- ["Article No. 111"]
- Sponsoring Org:
- National Science Foundation
More Like this
-
more » « less
ABSTRACT -
Yap, Pew-Thian (Ed.)Diffusion weighted imaging (DWI) with multiple, high b-values is critical for extracting tissue microstructure measurements; however, high b-value DWI images contain high noise levels that can overwhelm the signal of interest and bias microstructural measurements. Here, we propose a simple denoising method that can be applied to any dataset, provided a low-noise, single-subject dataset is acquired using the same DWI sequence. The denoising method uses a one-dimensional convolutional neural network (1D-CNN) and deep learning to learn from a low-noise dataset, voxel-by-voxel. The trained model can then be applied to high-noise datasets from other subjects. We validated the 1D-CNN denoising method by first demonstrating that 1D-CNN denoising resulted in DWI images that were more similar to the noise-free ground truth than comparable denoising methods, e.g., MP-PCA, using simulated DWI data. Using the same DWI acquisition but reconstructed with two common reconstruction methods, i.e. SENSE1 and sum-of-square, to generate a pair of low-noise and high-noise datasets, we then demonstrated that 1D-CNN denoising of high-noise DWI data collected from human subjects showed promising results in three domains: DWI images, diffusion metrics, and tractography. In particular, the denoised images were very similar to a low-noise reference image of that subject, more than the similarity between repeated low-noise images (i.e. computational reproducibility). Finally, we demonstrated the use of the 1D-CNN method in two practical examples to reduce noise from parallel imaging and simultaneous multi-slice acquisition. We conclude that the 1D-CNN denoising method is a simple, effective denoising method for DWI images that overcomes some of the limitations of current state-of-the-art denoising methods, such as the need for a large number of training subjects and the need to account for the rectified noise floor.more » « less
-
more » « less
Abstract The sparse interferometric coverage of the Event Horizon Telescope (EHT) poses a significant challenge for both reconstruction and model fitting of black hole images.
PRIMO is a new principal components analysis-based algorithm for image reconstruction that uses the results of high-fidelity general relativistic, magnetohydrodynamic simulations of low-luminosity accretion flows as a training set. This allows the reconstruction of images that are consistent with the interferometric data and that live in the space of images that is spanned by the simulations.PRIMO follows Monte Carlo Markov Chains to fit a linear combination of principal components derived from an ensemble of simulated images to interferometric data. We show thatPRIMO can efficiently and accurately reconstruct synthetic EHT data sets for several simulated images, even when the simulation parameters are significantly different from those of the image ensemble that was used to generate the principal components. The resulting reconstructions achieve resolution that is consistent with the performance of the array and do not introduce significant biases in image features such as the diameter of the ring of emission. -
more » « less
ABSTRACT While the direct detection of the dark-matter particle remains very challenging, the nature of dark matter could be possibly constrained by comparing the observed abundance and properties of small-scale sub-galactic mass structures with predictions from the phenomenological dark-matter models, such as cold, warm, or hot dark matter. Galaxy-galaxy strong gravitational lensing provides a unique opportunity to search for tiny surface-brightness anomalies in the extended lensed images (i.e. Einstein rings or gravitational arcs), induced by possible small-scale mass structures in the foreground lens galaxy. In this paper, the first in a series, we introduce and test a methodology to measure the power spectrum of such surface-brightness anomalies from high-resolution Hubble Space Telescope (HST) imaging. In particular, we focus on the observational aspects of this statistical approach, such as the most suitable observational strategy and sample selection, the choice of modelling techniques, and the noise correction. We test the feasibility of the power-spectrum measurement by applying it to a sample of galaxy-galaxy strong gravitational lens systems from the Sloan Lens ACS Survey, with the most extended, bright, high-signal-to-noise-ratio lensed images, observed in the rest-frame ultraviolet. In the companion paper, we present the methodology to relate the measured power spectrum to the statistical properties of the underlying small-scale mass structures in the lens galaxy and infer the first observational constraints on the sub-galactic matter power spectrum in a massive elliptical (lens) galaxy.
-
more » « less
Abstract Purpose Synthetic digital mammogram (SDM) is a 2D image generated from digital breast tomosynthesis (DBT) and used as a substitute for a full‐field digital mammogram (FFDM) to reduce the radiation dose for breast cancer screening. The previous deep learning‐based method used FFDM images as the ground truth, and trained a single neural network to directly generate SDM images with similar appearances (e.g., intensity distribution, textures) to the FFDM images. However, the FFDM image has a different texture pattern from DBT. The difference in texture pattern might make the training of the neural network unstable and result in high‐intensity distortion, which makes it hard to decrease intensity distortion and increase perceptual similarity (e.g., generate similar textures) at the same time. Clinically, radiologists want to have a 2D synthesized image that feels like an FFDM image in vision and preserves local structures such as both mass and microcalcifications (MCs) in DBT because radiologists have been trained on reading FFDM images for a long time, while local structures are important for diagnosis. In this study, we proposed to use a deep convolutional neural network to learn the transformation to generate SDM from DBT.
Method To decrease intensity distortion and increase perceptual similarity, a multi‐scale cascaded network (MSCN) is proposed to generate low‐frequency structures (e.g., intensity distribution) and high‐frequency structures (e.g., textures) separately. The MSCN consist of two cascaded sub‐networks: the first sub‐network is used to predict the low‐frequency part of the FFDM image; the second sub‐network is used to generate a full SDM image with textures similar to the FFDM image based on the prediction of the first sub‐network. The mean‐squared error (MSE) objective function is used to train the first sub‐network, termed low‐frequency network, to generate a low‐frequency SDM image. The gradient‐guided generative adversarial network's objective function is to train the second sub‐network, termed high‐frequency network, to generate a full SDM image with textures similar to the FFDM image.
Results 1646 cases with FFDM and DBT were retrospectively collected from the Hologic Selenia system for training and validation dataset, and 145 cases with masses or MC clusters were independently collected from the Hologic Selenia system for testing dataset. For comparison, the baseline network has the same architecture as the high‐frequency network and directly generates a full SDM image. Compared to the baseline method, the proposed MSCN improves the peak‐to‐noise ratio from 25.3 to 27.9 dB and improves the structural similarity from 0.703 to 0.724, and significantly increases the perceptual similarity.
Conclusions The proposed method can stabilize the training and generate SDM images with lower intensity distortion and higher perceptual similarity.
