skip to main content


Title: A Bayesian approach to high-fidelity interferometric calibration – I. Mathematical formalism
ABSTRACT

High-fidelity radio interferometric data calibration that minimizes spurious spectral structure in the calibrated data is essential in astrophysical applications, such as 21 cm cosmology, which rely on knowledge of the relative spectral smoothness of distinct astrophysical emission components to extract the signal of interest. Existing approaches to radio interferometric calibration have been shown to impart spurious spectral structure to the calibrated data if the sky model used to calibrate the data is incomplete. In this paper, we introduce BayesCal: a novel solution to the sky-model incompleteness problem in interferometric calibration, designed to enable high-fidelity data calibration. The BayesCal data model supplements the a priori known component of the forward model of the sky with a statistical model for the missing and uncertain flux contribution to the data, constrained by a prior on the power in the model. We demonstrate how the parameters of this model can be marginalized out analytically, reducing the dimensionality of the parameter space to be sampled from and allowing one to sample directly from the posterior probability distribution of the calibration parameters. Additionally, we show how physically motivated priors derived from theoretical and measurement-based constraints on the spectral smoothness of the instrumental gains can be used to constrain the calibration solutions. In a companion paper, we apply this algorithm to simulated observations with a HERA-like array and demonstrate that it enables up to four orders of magnitude suppression of power in spurious spectral fluctuations relative to standard calibration approaches.

 
more » « less
Award ID(s):
1907777
NSF-PAR ID:
10372897
Author(s) / Creator(s):
; ;
Publisher / Repository:
Oxford University Press
Date Published:
Journal Name:
Monthly Notices of the Royal Astronomical Society
Volume:
517
Issue:
1
ISSN:
0035-8711
Page Range / eLocation ID:
p. 910-934
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ABSTRACT

    In a companion paper, we presented bayescal, a mathematical formalism for mitigating sky-model incompleteness in interferometric calibration. In this paper, we demonstrate the use of bayescal to calibrate the degenerate gain parameters of full-Stokes simulated observations with a HERA-like hexagonal close-packed redundant array, for three assumed levels of completeness of the a priori known component of the calibration sky model. We compare the bayescal calibration solutions to those recovered by calibrating the degenerate gain parameters with only the a priori known component of the calibration sky model both with and without imposing physically motivated priors on the gain amplitude solutions and for two choices of baseline length range over which to calibrate. We find that bayescal provides calibration solutions with up to 4 orders of magnitude lower power in spurious gain amplitude fluctuations than the calibration solutions derived for the same data set with the alternate approaches, and between ∼107 and ∼1010 times smaller than in the mean degenerate gain amplitude, on the full range of spectral scales accessible in the data. Additionally, we find that in the scenarios modelled only bayescal has sufficiently high fidelity calibration solutions for unbiased recovery of the 21-cm power spectrum on large spectral scales (k∥ ≲ 0.15 hMpc−1). In all other cases, in the completeness regimes studied, those scales are contaminated.

     
    more » « less
  2. null (Ed.)
    ABSTRACT In 21-cm cosmology, precision calibration is key to the separation of the neutral hydrogen signal from very bright but spectrally smooth astrophysical foregrounds. The Hydrogen Epoch of Reionization Array (HERA), an interferometer specialized for 21-cm cosmology and now under construction in South Africa, was designed to be largely calibrated using the self-consistency of repeated measurements of the same interferometric modes. This technique, known as redundant-baseline calibration resolves most of the internal degrees of freedom in the calibration problem. It assumes, however, on antenna elements with identical primary beams placed precisely on a redundant grid. In this work, we review the detailed implementation of the algorithms enabling redundant-baseline calibration and report results with HERA data. We quantify the effects of real-world non-redundancy and how they compare to the idealized scenario in which redundant measurements differ only in their noise realizations. Finally, we study how non-redundancy can produce spurious temporal structure in our calibration solutions – both in data and in simulations – and present strategies for mitigating that structure. 
    more » « less
  3. Abstract The response of the Advanced Laser Interferometer Gravitational-wave Observatory (Advanced LIGO) interferometers is known to vary with time (Tuyenbayev et al 2017 Class. Quantum Grav. 34 015002). Accurate calibration of the interferometers must therefore track and compensate for temporal variations in calibration model parameters. These variations were tracked during the first three Advanced LIGO observing runs, and compensation for some of them has been implemented in the calibration procedure. During the second observing run, multiplicative corrections to the interferometer response were applied while producing calibrated strain data both in real time and in high latency. In a high-latency calibration produced after the second observing run and during the entirety of the third observing run, a correction requiring periodic filter updates was applied to the calibration–the time dependence of the coupled cavity pole frequency f c c . This paper describes the methods developed to compensate for variations in the interferometer response requiring time-dependent filters, including variable zeros, poles, gains, and time delays. The described methods were used to provide compensation for well-modeled time dependence of the interferometer response, which has helped to reduce systematic errors in the calibration to < 2% in magnitude and < 2 ∘ in phase across LIGO’s most sensitive frequency band of 20–2000 Hz (Sun et al 2020 Class. Quantum Grav. 37 225008; Sun et al 2021 arXiv:2107.00129 [astro-ph.IM]). Additionally, this paper shows how such compensation is relevant for astrophysical inference studies by reducing uncertainty and bias in the sky localization for a simulated binary neutron star merger. 
    more » « less
  4. Abstract

    Coronal magnetic fields are well known to be one of the crucial parameters defining coronal physics and space weather. However, measuring the global coronal magnetic fields remains challenging. The polarization properties of coronal radio emissions are sensitive to coronal magnetic fields. While they can prove to be useful probes of coronal and heliospheric magnetic fields, their usage has been limited by technical and algorithmic challenges. We present a robust algorithm for precise polarization calibration and imaging of low-radio frequency solar observations and demonstrate it on data from the Murchison Widefield Array, a Square Kilometre Array (SKA) precursor. This algorithm is based on theMeasurement Equationframework, which forms the basis of all modern radio interferometric calibration and imaging. It delivers high-dynamic-range and high-fidelity full-Stokes solar radio images with instrumental polarization leakages <1%, on par with general astronomical radio imaging, and represents the state of the art. Opening up this rewarding, yet unexplored, phase space will enable multiple novel science investigations and offer considerable discovery potential. Examples include detection of low-level circular polarization from thermal coronal emission to estimate large-scale quiescent coronal fields; polarization of faint gyrosynchrotron emissions from coronal mass ejections for robust estimation of plasma parameters; and detection of the first-ever linear polarization at these frequencies. This method has been developed with the SKA in mind and will enable a new era of high-fidelity spectropolarimetric snapshot solar imaging at low radio frequencies.

     
    more » « less
  5. Abstract

    We describe the first-season CO Mapping Array Project (COMAP) analysis pipeline that converts raw detector readouts to calibrated sky maps. This pipeline implements four main steps: gain calibration, filtering, data selection, and mapmaking. Absolute gain calibration relies on a combination of instrumental and astrophysical sources, while relative gain calibration exploits real-time total-power variations. High-efficiency filtering is achieved through spectroscopic common-mode rejection within and across receivers, resulting in nearly uncorrelated white noise within single-frequency channels. Consequently, near-optimal but biased maps are produced by binning the filtered time stream into pixelized maps; the corresponding signal bias transfer function is estimated through simulations. Data selection is performed automatically through a series of goodness-of-fit statistics, includingχ2and multiscale correlation tests. Applying this pipeline to the first-season COMAP data, we produce a data set with very low levels of correlated noise. We find that one of our two scanning strategies (the Lissajous type) is sensitive to residual instrumental systematics. As a result, we no longer use this type of scan and exclude data taken this way from our Season 1 power spectrum estimates. We perform a careful analysis of our data processing and observing efficiencies and take account of planned improvements to estimate our future performance. Power spectrum results derived from the first-season COMAP maps are presented and discussed in companion papers.

     
    more » « less