skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Identifying Witnesses to Noise Transients in Ground-based Gravitational-wave Observations using Auxiliary Channels with Matrix and Tensor Factorization Techniques
Ground-based gravitational-wave (GW) detectors are a frontier large-scale experiment in experimental astrophysics. Given the elusive nature of GWs, the ground-based detectors have complex interacting systems made up of exquisitely sensitive instruments which makes them susceptible to terrestrial noise sources. As these noise transients - termed as glitches - appear in the detector's main data channel, they can mask or mimic real GW signals resulting in false alarms in the detection pipelines. Given their high rate of occurrence compared to astrophysical signals, it is vital to examine these glitches and probe their origin in the detector's environment and instruments in order to possibly eliminate them from the science data. In this paper we present a tensor factorization-based data mining approach to finding witness events to these glitches in the network of heterogeneous sensors that monitor the detectors and build a catalog which can aid human operators in diagnosing the sources of these noise transients. Available from: https://openreview.net/forum?id=O9q0ma6Oh5e  more » « less
Award ID(s):
2141072 2046086
PAR ID:
10451550
Author(s) / Creator(s):
; ; ; ;
Date Published:
Journal Name:
NeurIPS 2022 AI for Science: Progress and Promises
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. The gravitational wave detectors used by the LIGO Scientific Collaboration, and the Virgo Collaboration are incredibly sensitive instruments which frequently detect non-stationary, non-Gaussian noise transients. iDQ is a statistical inference framework which leverages the use of auxiliary degrees of freedom monitored in the detectors to identify such transients. In this work, we describe the improvements to the iDQ pipeline made between the third and fourth observing run of the LIGO-Virgo-KAGRA (LVK) collaboration, and show the performance of these changes. We find that iDQ detects a total of 39,398 of the known 100,512 glitches identified by Omicron over the course of the second half of the third observing run. We construct a measure of the probability a glitch is present in the strain data of a given detector by combining information from iDQ and Omicron as well as extend the output of iDQ in a novel method which finds correlations between known glitch classifications, and auxiliary channels. We identify several channels over the course of O3b which frequently record instances of Scattered Light, Whistle, and Blip glitches and discuss use cases for this method in active observing runs. 
    more » « less
  2. Abstract Noise in various interferometer systems can sometimes couple non-linearly to create excess noise in the gravitational wave (GW) strain data. Third-order statistics, such as bicoherence and biphase, can identify these couplings and help discriminate those occurrences from astrophysical GW signals. However, the conventional analysis can yield large bicoherence values even when no phase-coupling is present, thereby, resulting in false identifications. Introducing artificial phase randomization in computing the bicoherence reduces such occurrences with negligible impact on its effectiveness for detecting true phase-coupled disturbances. We demonstrate this property with simulated disturbances—focusing only on short-duration ones (lasting up to a few seconds) and employing mainly the auto-bicoherence in this work. Statistical hypothesis testing is used for distinguishing phase-coupled disturbances from non-phase coupled ones when employing the phase-randomized bicoherence. We also obtain an expression for the bicoherence value that minimizes the sum of the probabilities of false positives and false negatives. This can be chosen as a threshold for shortlisting bicoherence triggers for further scrutiny for the presence of non-linear coupling. Finally, the utility of the phase-randomized bicoherence analysis in GW time-series data is demonstrated for the following three scenarios: (1) Finding third-order statistical similarities within categories of noise transients, such as blips and koi fish. If these non-Gaussian noise transients, or glitches, have a common source, their bicoherence maps can have similarities arising from common bifrequencies related to that source. (2) Differentiating linear or non-linear phase-coupled glitches from compact binary coalescence signals through their bicoherence maps. This is explained with a simulated signal. (3) Identifying repeated bifrequencies in the second and third observation runs (i.e. O2 and O3) of LIGO and Virgo. 
    more » « less
  3. We present an enhanced method for the application of Gaussian mixture modeling (GMM) to the coherent WaveBurst (cWB) algorithm in the search for short-duration gravitational wave (GW) transients. The supervised machine learning method of GMM allows for the multidimensional distributions of noise and signal to be modeled over a set of representative attributes, which aids in the classification of GW signals against noise transients (glitches) in the data. We demonstrate that updating the approach to model construction eliminates bias previously seen in the GMM analysis, increasing the robustness and sensitivity of the analysis over a wider range of burst source populations. The enhanced methodology is applied to the generic burst all-sky short search in the LIGO-Virgo full third observing run (O3), marking the first application of GMM to the 3 detector Livingston-Hanford-Virgo network. For both 2- and 3- detector networks, we observe comparable sensitivities to an array of generic signal morphologies, with significant sensitivity improvements to waveforms in the low quality factor parameter space at false alarm rates of 1 per 100 years. This proves that GMM can effectively mitigate blip glitches, which are one of the most problematic sources of noise for unmodeled GW searches. The cWB-GMM search recovers similar numbers of compact binary coalescence (CBC) events as other cWB postproduction methods, and concludes on no new gravitational wave detection after known CBC events are removed. Published by the American Physical Society2024 
    more » « less
  4. Abstract The observation of transient gravitational waves (GWs) is hindered by the presence of transient noise, colloquially referred to as glitches. These glitches can often be misidentified as GWs by searches for unmodeled transients using the excess-power type of methods and sometimes even excite template waveforms for compact binary coalescences while using matched filter techniques. They thus create a significant background in the searches. This background is more critical in getting identified promptly and efficiently within the context of real-time searches for GW transients. Such searches are the ones that have enabled multi-messenger astrophysics with the start of the Advanced LIGO and Advanced Virgo data taking in 2015 and they will continue to enable the field for further discoveries. With this work we propose and demonstrate the use of a signal-based test that quantifies the fidelity of the time-frequency decomposition of the putative signal based on first principles on how astrophysical transients are expected to be registered in the detectors and empirically measuring the instrumental noise. It is based on the Q-transform and a measure of the occupancy of the corresponding time-frequency pixels over select time-frequency volumes; we call it ‘QoQ’. Our method shows a 40% reduction in the number of retraction of public alerts that were issued by the LIGO-Virgo-KAGRA collaborations during the third observing run with negligible loss in sensitivity. Receiver Operator Characteristic measurements suggest the method can be used in online and offline searches for transients, reducing their background significantly. 
    more » « less
  5. Abstract Matched-filtering detection techniques for gravitational-wave (GW) signals in ground-based interferometers rely on having well-modeled templates of the GW emission. Such techniques have been traditionally used in searches for compact binary coalescences (CBCs), and have been employed in all known GW detections so far. However, interesting science cases aside from compact mergers do not yet have accurate enough modeling to make matched filtering possible, including core-collapse supernovae and sources where stochasticity may be involved. Therefore the development of techniques to identify sources of these types is of significant interest. In this paper, we present a method of anomaly detection based on deep recurrent autoencoders to enhance the search region to unmodeled transients. We use a semi-supervised strategy that we name‘Gravitational Wave Anomalous Knowledge’(GWAK). While the semi-supervised approach to this problem entails a potential reduction in accuracy compared to fully supervised methods, it offers a generalizability advantage by enhancing the reach of experimental sensitivity beyond the constraints of pre-defined signal templates. We construct a low-dimensional embedded space using the GWAK method, capturing the physical signatures of distinct signals on each axis of the space. By introducing signal priors that capture some of the salient features of GW signals, we allow for the recovery of sensitivity even when an unmodeled anomaly is encountered. We show that regions of the GWAK space can identify CBCs, detector glitches and also a variety of unmodeled astrophysical sources. 
    more » « less