skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Glitch subtraction from gravitational wave data using adaptive spline fitting
Abstract Transient signals of instrumental and environmental origins (‘glitches’) in gravitational wave data elevate the false alarm rate of searches for astrophysical signals and reduce their sensitivity. Glitches that directly overlap astrophysical signals hinder their detection and worsen parameter estimation errors. As the fraction of data occupied by detectable astrophysical signals will be higher in next generation detectors, such problematic overlaps could become more frequent. These adverse effects of glitches can be mitigated by estimating and subtracting them out from the data, but their unpredictable waveforms and large morphological diversity pose a challenge. Subtraction of glitches using data from auxiliary sensors as predictors works but not for the majority of cases. Thus, there is a need for nonparametric glitch mitigation methods that do not require auxiliary data, work for a large variety of glitches, and have minimal effect on astrophysical signals in the case of overlaps. In order to cope with the high rate of glitches, it is also desirable that such methods be computationally fast. We show that adaptive spline fitting, in which the placement of free knots is optimized to estimate both smooth and non-smooth curves in noisy data, offers a promising approach to satisfying these requirements for broadband short-duration glitches, the type that appear quite frequently. The method is demonstrated on glitches drawn from three distinct classes in the Gravity Spy database as well as on the glitch that overlapped the binary neutron star signal GW170817. The impact of glitch subtraction on the GW170817 signal, or those like it injected into the data, is seen to be negligible.  more » « less
Award ID(s):
2207935 2018900
PAR ID:
10440419
Author(s) / Creator(s):
;
Publisher / Repository:
IOP Publishing
Date Published:
Journal Name:
Classical and Quantum Gravity
Volume:
40
Issue:
12
ISSN:
0264-9381
Page Range / eLocation ID:
Article No. 125001
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract Gravitational wave (GW) interferometers are able to detect a change in distance of ~1/10 000th the size of a proton. Such sensitivity leads to large rates of non-gaussian, transient bursts of noise, also known as glitches, which hinder the detection and parameter estimation of short- and long-lived GW signals in the main detector strain. Glitches, come in a wide range of frequency-amplitude-time morphologies and may be caused by environmental or instrumental processes, so a key step towards their mitigation is to understand their population. Current approaches for their identification use supervised models to learn their morphology in the main strain with a fixed set of classes, but do not consider relevant information provided by auxiliary channels that monitor the state of the interferometers. In this work, we present an unsupervised algorithm to find anomalous glitches. Firstly, we encode a subset of auxiliary channels from Laser Interferometer Gravitational-Wave Observatory Livingston in the fractal dimension (FD), which measures the complexity of the signal. For this aim, we speed up the fractal dimension calculation to encode 1 h of data in 11 s. Secondly, we learn the underlying distribution of the data using an autoencoder with cyclic periodic convolutions. In this way, we learn the underlying distribution of glitches and we uncover unknown glitch morphologies, and overlaps in time between different glitches and misclassifications. This led to the discovery of 6.6 % anomalies in the input data. The results of this investigation stress the learnable structure of auxiliary channels encoded in FD and provide a flexible framework for glitch discovery. 
    more » « less
  2. The classification of frequently occurring terrestrial-origin transient signals, called glitches, in the time series data from gravitational wave detectors is important for mitigating their adverse effects on searches for rare and valuable astrophysical signals. While formally a time series classification problem, recent successes in glitch classification have all come from using their time-frequency image representations. Using transfer learning with the VGG16 deep convolutional neural network for image classification, we compare the efficacy of different types of image representations for classifying simulated glitches. We find the novel result that training the network with 2D plots of the noisy glitch time series provides better classification accuracy than their time-frequency images. 
    more » « less
  3. ABSTRACT The global network of interferometric gravitational wave (GW) observatories (LIGO, Virgo, KAGRA) has detected and characterized nearly 100 mergers of binary compact objects. However, many more real GWs are lurking sub-threshold, which need to be sifted from terrestrial-origin noise triggers (known as glitches). Because glitches are not due to astrophysical phenomena, inference on the glitch under the assumption it has an astrophysical source (e.g. binary black hole coalescence) results in source parameters that are inconsistent with what is known about the astrophysical population. In this work, we show how one can extract unbiased population constraints from a catalogue of both real GW events and glitch contaminants by performing Bayesian inference on their source populations simultaneously. In this paper, we assume glitches come from a specific class with a well-characterized effective population (blip glitches). We also calculate posteriors on the probability of each event in the catalogue belonging to the astrophysical or glitch class, and obtain posteriors on the number of astrophysical events in the catalogue, finding it to be consistent with the actual number of events included. 
    more » « less
  4. This dataset contains the data used in the paper (arXiv:2301.02398) on the estimation and subtraction of glitches in gravitational wave data using an adaptive spline fitting method called SHAPES . Each .zip file corresponds to one of the glitches considered in the paper. The name of the class to which the glitch belongs (e.g., "Blip") is included in the name of the corresponding .zip file (e.g., BLIP_SHAPESRun_20221229T125928.zip). When uncompressed, each .zip file expands to a folder containing the following. An HDF5 file containing the Whitened gravitational wave (GW) strain data in which the glitch appeared. The data has been whitened using a proprietary code. The original (unwhitened) strain data file is available from gwosc.org. The name of the original data file is the part preceding the token '__dtrndWhtnBndpss' in the name of the file.A JSON file containing information pertinent to the glitch that was analyzed (e.g., start and stop indices in the whitened data time series).A set of .mat  files containing segmented estimates of the glitch as described in the paper.  A MATLAB script, plotglitch.m, has been provided that plots, for a given glitch folder name, the data segment that was analyzed in the paper. Another script, plotshapesestimate.m, plots the estimated glitch. These scripts require the JSONLab package. 
    more » « less
  5. Ground-based gravitational-wave (GW) detectors are a frontier large-scale experiment in experimental astrophysics. Given the elusive nature of GWs, the ground-based detectors have complex interacting systems made up of exquisitely sensitive instruments which makes them susceptible to terrestrial noise sources. As these noise transients - termed as glitches - appear in the detector's main data channel, they can mask or mimic real GW signals resulting in false alarms in the detection pipelines. Given their high rate of occurrence compared to astrophysical signals, it is vital to examine these glitches and probe their origin in the detector's environment and instruments in order to possibly eliminate them from the science data. In this paper we present a tensor factorization-based data mining approach to finding witness events to these glitches in the network of heterogeneous sensors that monitor the detectors and build a catalog which can aid human operators in diagnosing the sources of these noise transients. Available from: https://openreview.net/forum?id=O9q0ma6Oh5e 
    more » « less