skip to main content


Title: Time-Domain Science Pipelines for the OVRO-LWA
The Owens Valley Radio Observatory Long Wavelength Array is a low radio frequency all-sky imaging radio interferometer. The full 352-element array will generate more than 2 TB of visibility data per hour of observation. One of the array’s primary science cases, the search for variable radio emission from exoplanets and for transients, require fast and high dynamic range interferometric imaging. Here we detail the design and implementation of a two-pipeline infrastructure that minimizes development cost: an offline pipeline that facilitates experimentation with existing pack-ages, and a real-time pipeline that minimizes overhead.  more » « less
Award ID(s):
1828784
NSF-PAR ID:
10410958
Author(s) / Creator(s):
; ; ; ;
Date Published:
Journal Name:
2022 3rd URSI Atlantic and Asia Pacific Radio Science Meeting (AT-AP-RASC)
Page Range / eLocation ID:
1 to 5
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ABSTRACT

    Galactic plane radio surveys play a key role in improving our understanding of a wide range of astrophysical phenomena. Performing such a survey using the latest interferometric telescopes produces large data rates necessitating a shift towards fully or quasi-real-time data analysis with data being stored for only the time required to process them. We present here the overview and set-up for the 3000-h Max-Planck-Institut für Radioastronomie (MPIfR)–MeerKAT Galactic Plane Survey (MMGPS). The survey is unique by operating in a commensal mode, addressing key science objectives of the survey including the discovery of new pulsars and transients and studies of Galactic magnetism, the interstellar medium and star formation rates. We explain the strategy coupled with the necessary hardware and software infrastructure needed for data reduction in the imaging, spectral, and time domains. We have so far discovered 78 new pulsars including 17 confirmed binary systems of which two are potential double neutron star systems. We have also developed an imaging pipeline sensitive to the order of a few tens of micro-Jansky ($\mu{\rm Jy}$) with a spatial resolution of a few arcseconds. Further science operations with an in-house built S-band receiver operating between 1.7 and 3.5 GHz are about to commence. Early spectral line commissioning observations conducted at S-band, targeting transitions of the key molecular gas tracer CH at 3.3 GHz already illustrate the spectroscopic capabilities of this instrument. These results lay a strong foundation for future surveys with telescopes like the Square Kilometre Array (SKA).

     
    more » « less
  2. ABSTRACT

    High-fidelity radio interferometric data calibration that minimizes spurious spectral structure in the calibrated data is essential in astrophysical applications, such as 21 cm cosmology, which rely on knowledge of the relative spectral smoothness of distinct astrophysical emission components to extract the signal of interest. Existing approaches to radio interferometric calibration have been shown to impart spurious spectral structure to the calibrated data if the sky model used to calibrate the data is incomplete. In this paper, we introduce BayesCal: a novel solution to the sky-model incompleteness problem in interferometric calibration, designed to enable high-fidelity data calibration. The BayesCal data model supplements the a priori known component of the forward model of the sky with a statistical model for the missing and uncertain flux contribution to the data, constrained by a prior on the power in the model. We demonstrate how the parameters of this model can be marginalized out analytically, reducing the dimensionality of the parameter space to be sampled from and allowing one to sample directly from the posterior probability distribution of the calibration parameters. Additionally, we show how physically motivated priors derived from theoretical and measurement-based constraints on the spectral smoothness of the instrumental gains can be used to constrain the calibration solutions. In a companion paper, we apply this algorithm to simulated observations with a HERA-like array and demonstrate that it enables up to four orders of magnitude suppression of power in spurious spectral fluctuations relative to standard calibration approaches.

     
    more » « less
  3. Abstract

    Coronal magnetic fields are well known to be one of the crucial parameters defining coronal physics and space weather. However, measuring the global coronal magnetic fields remains challenging. The polarization properties of coronal radio emissions are sensitive to coronal magnetic fields. While they can prove to be useful probes of coronal and heliospheric magnetic fields, their usage has been limited by technical and algorithmic challenges. We present a robust algorithm for precise polarization calibration and imaging of low-radio frequency solar observations and demonstrate it on data from the Murchison Widefield Array, a Square Kilometre Array (SKA) precursor. This algorithm is based on theMeasurement Equationframework, which forms the basis of all modern radio interferometric calibration and imaging. It delivers high-dynamic-range and high-fidelity full-Stokes solar radio images with instrumental polarization leakages <1%, on par with general astronomical radio imaging, and represents the state of the art. Opening up this rewarding, yet unexplored, phase space will enable multiple novel science investigations and offer considerable discovery potential. Examples include detection of low-level circular polarization from thermal coronal emission to estimate large-scale quiescent coronal fields; polarization of faint gyrosynchrotron emissions from coronal mass ejections for robust estimation of plasma parameters; and detection of the first-ever linear polarization at these frequencies. This method has been developed with the SKA in mind and will enable a new era of high-fidelity spectropolarimetric snapshot solar imaging at low radio frequencies.

     
    more » « less
  4. ABSTRACT The recent demonstration of a real-time direct imaging radio interferometry correlator represents a new capability in radio astronomy. However, wide-field imaging with this method is challenging since wide-field effects and array non-coplanarity degrade image quality if not compensated for. Here, we present an alternative direct imaging correlation strategy using a direct Fourier transform (DFT), modelled as a linear operator facilitating a matrix multiplication between the DFT matrix and a vector of the electric fields from each antenna. This offers perfect correction for wide field and non-coplanarity effects. When implemented with data from the Long Wavelength Array (LWA), it offers comparable computational performance to previously demonstrated direct imaging techniques, despite having a theoretically higher floating point cost. It also has additional benefits, such as imaging sparse arrays and control over which sky coordinates are imaged, allowing variable pixel placement across an image. It is in practice a highly flexible and efficient method of direct radio imaging when implemented on suitable arrays. A functioning electric field direct imaging architecture using the DFT is presented, alongside an exploration of techniques for wide-field imaging similar to those in visibility-based imaging, and an explanation of why they do not fit well to imaging directly with the digitized electric field data. The DFT imaging method is demonstrated on real data from the LWA telescope, alongside a detailed performance analysis, as well as an exploration of its applicability to other arrays. 
    more » « less
  5. null (Ed.)
    Abstract Epoch of Reionisation (EoR) data analysis requires unprecedented levels of accuracy in radio interferometer pipelines. We have developed an imaging power spectrum analysis to meet these requirements and generate robust 21 cm EoR measurements. In this work, we build a signal path framework to mathematically describe each step in the analysis, from data reduction in the Fast Holographic Deconvolution (FHD) package to power spectrum generation in the ε ppsilon package. In particular, we focus on the distinguishing characteristics of FHD/ ε ppsilon: highly accurate spectral calibration, extensive data verification products, and end-to-end error propagation. We present our key data analysis products in detail to facilitate understanding of the prominent systematics in image-based power spectrum analyses. As a verification to our analysis, we also highlight a full-pipeline analysis simulation to demonstrate signal preservation and lack of signal loss. This careful treatment ensures that the FHD/ ε ppsilon power spectrum pipeline can reduce radio interferometric data to produce credible 21 cm EoR measurements. 
    more » « less