skip to main content


Title: SNGuess: A method for the selection of young extragalactic transients
Context. With a rapidly rising number of transients detected in astronomy, classification methods based on machine learning are increasingly being employed. Their goals are typically to obtain a definitive classification of transients, and for good performance they usually require the presence of a large set of observations. However, well-designed, targeted models can reach their classification goals with fewer computing resources. Aims. The aim of this study is to assist in the observational astronomy task of deciding whether a newly detected transient warrants follow-up observations. Methods. This paper presents SNGuess, a model designed to find young extragalactic nearby transients with high purity. SNGuess works with a set of features that can be efficiently calculated from astronomical alert data. Some of these features are static and associated with the alert metadata, while others must be calculated from the photometric observations contained in the alert. Most of the features are simple enough to be obtained or to be calculated already at the early stages in the lifetime of a transient after its detection. We calculate these features for a set of labeled public alert data obtained over a time span of 15 months from the Zwicky Transient Facility (ZTF). The core model of SNGuess consists of an ensemble of decision trees, which are trained via gradient boosting. Results. Approximately 88% of the candidates suggested by SNGuess from a set of alerts from ZTF spanning from April 2020 to August 2021 were found to be true relevant supernovae (SNe). For alerts with bright detections, this number ranges between 92% and 98%. Since April 2020, transients identified by SNGuess as potential young SNe in the ZTF alert stream are being published to the Transient Name Server (TNS) under the AMPEL_ZTF_NEW group identifier. SNGuess scores for any transient observed by ZTF can be accessed via a web service https://ampel.zeuthen.desy.de/api/live/docs . The source code of SNGuess is publicly available https://github.com/nmiranda/SNGuess . Conclusions. SNGuess is a lightweight, portable, and easily re-trainable model that can effectively suggest transients for follow-up. These properties make it a useful tool for optimizing follow-up observation strategies and for assisting humans in the process of selecting candidate transients.  more » « less
Award ID(s):
2034437
PAR ID:
10423982
Author(s) / Creator(s):
; ; ; ; ; ; ; ; ;
Date Published:
Journal Name:
Astronomy & Astrophysics
Volume:
665
ISSN:
0004-6361
Page Range / eLocation ID:
A99
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract

    We present Lightcurve Anomaly Identification and Similarity Search (LAISS), an automated pipeline to detect anomalous astrophysical transients in real-time data streams. We deploy our anomaly detection model on the nightly Zwicky Transient Facility (ZTF) Alert Stream via the ANTARES broker, identifying a manageable ∼1–5 candidates per night for expert vetting and coordinating follow-up observations. Our method leverages statistical light-curve and contextual host galaxy features within a random forest classifier, tagging transients of rare classes (spectroscopicanomalies), of uncommon host galaxy environments (contextualanomalies), and of peculiar or interaction-powered phenomena (behavioralanomalies). Moreover, we demonstrate the power of a low-latency (∼ms) approximate similarity search method to find transient analogs with similar light-curve evolution and host galaxy environments. We use analogs for data-driven discovery, characterization, (re)classification, and imputation in retrospective and real-time searches. To date, we have identified ∼50 previously known and previously missed rare transients from real-time and retrospective searches, including but not limited to superluminous supernovae (SLSNe), tidal disruption events, SNe IIn, SNe IIb, SNe I-CSM, SNe Ia-91bg-like, SNe Ib, SNe Ic, SNe Ic-BL, and M31 novae. Lastly, we report the discovery of 325 total transients, all observed between 2018 and 2021 and absent from public catalogs (∼1% of all ZTF Astronomical Transient reports to the Transient Name Server through 2021). These methods enable a systematic approach to finding the “needle in the haystack” in large-volume data streams. Because of its integration with the ANTARES broker,LAISSis built to detect exciting transients in Rubin data.

     
    more » « less
  2. Abstract

    The Bright Transient Survey (BTS) aims to obtain a classification spectrum for all bright (mpeak≤ 18.5 mag) extragalactic transients found in the Zwicky Transient Facility (ZTF) public survey. BTS critically relies on visual inspection (“scanning”) to select targets for spectroscopic follow-up, which, while effective, has required a significant time investment over the past ∼5 yr of ZTF operations. We presentBTSbot, a multimodal convolutional neural network, which provides a bright transient score to individual ZTF detections using their image data and 25 extracted features.BTSbotis able to eliminate the need for daily human scanning by automatically identifying and requesting spectroscopic follow-up observations of new bright transient candidates.BTSbotrecovers all bright transients in our test split and performs on par with scanners in terms of identification speed (on average, ∼1 hr quicker than scanners). We also find thatBTSbotis not significantly impacted by any data shift by comparing performance across a concealed test split and a sample of very recent BTS candidates.BTSbothas been integrated intoFritzandKowalski, ZTF’s first-party marshal and alert broker, and now sends automatic spectroscopic follow-up requests for the new transients it identifies. Between 2023 December and 2024 May,BTSbotselected 609 sources in real time, 96% of which were real extragalactic transients. WithBTSbotand other automation tools, the BTS workflow has produced the first fully automatic end-to-end discovery and classification of a transient, representing a significant reduction in the human time needed to scan.

     
    more » « less
  3. ABSTRACT

    We present our follow-up observations with GRANDMA of transient sources revealed by the Zwicky Transient Facility (ZTF). Over a period of six months, all ZTF alerts were examined in real time by a dedicated science module implemented in the Fink broker, which will be used in filtering of transients discovered by the Vera C. Rubin Observatory. In this article, we present three selection methods to identify kilonova candidates. Out of more than 35 million alerts, a hundred sources have passed our selection criteria. Six were then followed-up by GRANDMA (by both professional and amateur astronomers). The majority were finally classified either as asteroids or as supernovae events. We mobilized 37 telescopes, bringing together a large sample of images, taken under various conditions and quality. To complement the orphan kilonova candidates, we included three additional supernovae alerts to conduct further observations during summer 2021. We demonstrate the importance of the amateur astronomer community that contributed images for scientific analyses of new sources discovered in a magnitude range r′ = 17 − 19 mag. We based our rapid kilonova classification on the decay rate of the optical source that should exceed 0.3 mag d−1. GRANDMA’s follow-up determined the fading rate within 1.5 ± 1.2 d post-discovery, without waiting for further observations from ZTF. No confirmed kilonovae were discovered during our observing campaign. This work will be continued in the coming months in the view of preparing for kilonova searches in the next gravitational-wave observing run O4.

     
    more » « less
  4. Abstract

    We present the Young Supernova Experiment Data Release 1 (YSE DR1), comprised of processed multicolor PanSTARRS1grizand Zwicky Transient Facility (ZTF)grphotometry of 1975 transients with host–galaxy associations, redshifts, spectroscopic and/or photometric classifications, and additional data products from 2019 November 24 to 2021 December 20. YSE DR1 spans discoveries and observations from young and fast-rising supernovae (SNe) to transients that persist for over a year, with a redshift distribution reachingz≈ 0.5. We present relative SN rates from YSE’s magnitude- and volume-limited surveys, which are consistent with previously published values within estimated uncertainties for untargeted surveys. We combine YSE and ZTF data, and create multisurvey SN simulations to train the ParSNIP and SuperRAENN photometric classification algorithms; when validating our ParSNIP classifier on 472 spectroscopically classified YSE DR1 SNe, we achieve 82% accuracy across three SN classes (SNe Ia, II, Ib/Ic) and 90% accuracy across two SN classes (SNe Ia, core-collapse SNe). Our classifier performs particularly well on SNe Ia, with high (>90%) individual completeness and purity, which will help build an anchor photometric SNe Ia sample for cosmology. We then use our photometric classifier to characterize our photometric sample of 1483 SNe, labeling 1048 (∼71%) SNe Ia, 339 (∼23%) SNe II, and 96 (∼6%) SNe Ib/Ic. YSE DR1 provides a training ground for building discovery, anomaly detection, and classification algorithms, performing cosmological analyses, understanding the nature of red and rare transients, exploring tidal disruption events and nuclear variability, and preparing for the forthcoming Vera C. Rubin Observatory Legacy Survey of Space and Time.

     
    more » « less
  5. While optical surveys regularly discover slow transients like supernovae on their own, the most common way to discover extragalactic fast transients, fading away in a few nights, is via follow-up observations of gamma-ray burst and gravitational-wave triggers. However, wide-field surveys have the potential to also identify rapidly fading transients independently of such external triggers. The volumetric survey speed of the Zwicky Transient Facility (ZTF) makes it sensitive to faint and fast-fading objects as kilonovae, the optical counterparts to binary neutron stars and neutron star-black hole mergers, out to almost 200Mpc. We introduce an open-source software infrastructure, the ZTF REaltime Search and Triggering, ZTFReST, designed to identify kilonovae and fast optical transients in ZTF data. Using the ZTF alert stream combined with forced photometry, we have implemented automated candidate ranking based on their photometric evolution and fitting to kilonova models. Automated triggering of follow-up systems, such as Las Cumbres Observatory, has also been implemented. In 13 months of science validation, we found several extragalactic fast transients independent of any external trigger (though some counterparts were identified later), including at least one supernova with post-shock cooling emission, two known afterglows with an associated gamma-ray burst, two known afterglows without any known gamma-ray counterpart, and three new fast-declining sources (ZTF20abtxwfx, ZTF20acozryr, and ZTF21aagwbjr) that are likely associated with GRB200817A, GRB201103B, and GRB210204A. However, we have not found any objects which appear to be kilonovae; therefore, we constrain the rate of GW170817-like kilonovae to R<900Gpc−3yr−1. A framework such as ZTFReST could become a prime tool for kilonova and fast transient discovery with the Vera C. Rubin Observatory. 
    more » « less