Abstract We present Lightcurve Anomaly Identification and Similarity Search (LAISS), an automated pipeline to detect anomalous astrophysical transients in real-time data streams. We deploy our anomaly detection model on the nightly Zwicky Transient Facility (ZTF) Alert Stream via the ANTARES broker, identifying a manageable ∼1–5 candidates per night for expert vetting and coordinating follow-up observations. Our method leverages statistical light-curve and contextual host galaxy features within a random forest classifier, tagging transients of rare classes (spectroscopicanomalies), of uncommon host galaxy environments (contextualanomalies), and of peculiar or interaction-powered phenomena (behavioralanomalies). Moreover, we demonstrate the power of a low-latency (∼ms) approximate similarity search method to find transient analogs with similar light-curve evolution and host galaxy environments. We use analogs for data-driven discovery, characterization, (re)classification, and imputation in retrospective and real-time searches. To date, we have identified ∼50 previously known and previously missed rare transients from real-time and retrospective searches, including but not limited to superluminous supernovae (SLSNe), tidal disruption events, SNe IIn, SNe IIb, SNe I-CSM, SNe Ia-91bg-like, SNe Ib, SNe Ic, SNe Ic-BL, and M31 novae. Lastly, we report the discovery of 325 total transients, all observed between 2018 and 2021 and absent from public catalogs (∼1% of all ZTF Astronomical Transient reports to the Transient Name Server through 2021). These methods enable a systematic approach to finding the “needle in the haystack” in large-volume data streams. Because of its integration with the ANTARES broker,LAISSis built to detect exciting transients in Rubin data.
more »
« less
SNGuess: A method for the selection of young extragalactic transients
Context. With a rapidly rising number of transients detected in astronomy, classification methods based on machine learning are increasingly being employed. Their goals are typically to obtain a definitive classification of transients, and for good performance they usually require the presence of a large set of observations. However, well-designed, targeted models can reach their classification goals with fewer computing resources. Aims. The aim of this study is to assist in the observational astronomy task of deciding whether a newly detected transient warrants follow-up observations. Methods. This paper presents SNGuess, a model designed to find young extragalactic nearby transients with high purity. SNGuess works with a set of features that can be efficiently calculated from astronomical alert data. Some of these features are static and associated with the alert metadata, while others must be calculated from the photometric observations contained in the alert. Most of the features are simple enough to be obtained or to be calculated already at the early stages in the lifetime of a transient after its detection. We calculate these features for a set of labeled public alert data obtained over a time span of 15 months from the Zwicky Transient Facility (ZTF). The core model of SNGuess consists of an ensemble of decision trees, which are trained via gradient boosting. Results. Approximately 88% of the candidates suggested by SNGuess from a set of alerts from ZTF spanning from April 2020 to August 2021 were found to be true relevant supernovae (SNe). For alerts with bright detections, this number ranges between 92% and 98%. Since April 2020, transients identified by SNGuess as potential young SNe in the ZTF alert stream are being published to the Transient Name Server (TNS) under the AMPEL_ZTF_NEW group identifier. SNGuess scores for any transient observed by ZTF can be accessed via a web service https://ampel.zeuthen.desy.de/api/live/docs . The source code of SNGuess is publicly available https://github.com/nmiranda/SNGuess . Conclusions. SNGuess is a lightweight, portable, and easily re-trainable model that can effectively suggest transients for follow-up. These properties make it a useful tool for optimizing follow-up observation strategies and for assisting humans in the process of selecting candidate transients.
more »
« less
- Award ID(s):
- 2034437
- PAR ID:
- 10423982
- Date Published:
- Journal Name:
- Astronomy & Astrophysics
- Volume:
- 665
- ISSN:
- 0004-6361
- Page Range / eLocation ID:
- A99
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Abstract We present an exploration of technosignature research that is possible using real-time alert brokers from surveys such as the Zwicky Transient Facility (ZTF) and the upcoming Legacy Survey of Space and Time (LSST). Nine alert brokers currently stream up to one million alerts each night from ZTF, and LSST is projected to increase this volume by an order of magnitude. While these brokers are primarily designed to facilitate real-time follow-up of explosive transients such as supernovae, they offer a unique platform to discover rare forms of variability from nearby stars in real time, which is crucial for follow-up and characterization. We evaluate the capability for both spatial and temporal search for extraterrestrial intelligence (SETI) methods using the currently available brokers, and present examples of technosignature searches using ZTF alert and archival data. We have deployed optical SETI techniques, such as planetary transit zone geometries and the SETI Ellipsoid. We have also developed a search for novel high-amplitude stellar dippers, and present a workflow that integrates features available directly through the brokers, as well as postprocessing steps that build on the existing capabilities. Though the SETI methods that alert brokers can execute are currently limited, we provide suggestions that may enhance future technosignature and anomaly searches in the era of the Vera C. Rubin Observatory.more » « less
-
Abstract The Bright Transient Survey (BTS) aims to obtain a classification spectrum for all bright (mpeak≤ 18.5 mag) extragalactic transients found in the Zwicky Transient Facility (ZTF) public survey. BTS critically relies on visual inspection (“scanning”) to select targets for spectroscopic follow-up, which, while effective, has required a significant time investment over the past ∼5 yr of ZTF operations. We presentBTSbot, a multimodal convolutional neural network, which provides a bright transient score to individual ZTF detections using their image data and 25 extracted features.BTSbotis able to eliminate the need for daily human scanning by automatically identifying and requesting spectroscopic follow-up observations of new bright transient candidates.BTSbotrecovers all bright transients in our test split and performs on par with scanners in terms of identification speed (on average, ∼1 hr quicker than scanners). We also find thatBTSbotis not significantly impacted by any data shift by comparing performance across a concealed test split and a sample of very recent BTS candidates.BTSbothas been integrated intoFritzandKowalski, ZTF’s first-party marshal and alert broker, and now sends automatic spectroscopic follow-up requests for the new transients it identifies. Between 2023 December and 2024 May,BTSbotselected 609 sources in real time, 96% of which were real extragalactic transients. WithBTSbotand other automation tools, the BTS workflow has produced the first fully automatic end-to-end discovery and classification of a transient, representing a significant reduction in the human time needed to scan.more » « less
-
Abstract Modern time-domain surveys like the Zwicky Transient Facility (ZTF) and the Legacy Survey of Space and Time (LSST) generate hundreds of thousands to millions of alerts, demanding automatic, unified classification of transients and variable stars for efficient follow-up. We present Applying multimodal learning to Classify transient Detections Early (AppleCiDEr), a novel framework that integrates four key data modalities (photometry, image cutouts, metadata, and spectra) to overcome limitations of single-modality classification approaches. Our architecture introduces (i) two transformer encoders for photometry, (ii) a multimodal convolutional neural network (CNN) with domain-specialized metadata towers and Mixture-of-Experts fusion for combining metadata and images, and (iii) a CNN for spectra classification. Training on ∼30,000 real ZTF alerts,AppleCiDErachieves high accuracy, allowing early identification and suggesting follow-up for rare transient spectra. The system provides the first unified framework for transients classification using real observational data, with seamless integration into brokering pipelines, demonstrating readiness for the LSST era.more » « less
-
ABSTRACT We present our follow-up observations with GRANDMA of transient sources revealed by the Zwicky Transient Facility (ZTF). Over a period of six months, all ZTF alerts were examined in real time by a dedicated science module implemented in the Fink broker, which will be used in filtering of transients discovered by the Vera C. Rubin Observatory. In this article, we present three selection methods to identify kilonova candidates. Out of more than 35 million alerts, a hundred sources have passed our selection criteria. Six were then followed-up by GRANDMA (by both professional and amateur astronomers). The majority were finally classified either as asteroids or as supernovae events. We mobilized 37 telescopes, bringing together a large sample of images, taken under various conditions and quality. To complement the orphan kilonova candidates, we included three additional supernovae alerts to conduct further observations during summer 2021. We demonstrate the importance of the amateur astronomer community that contributed images for scientific analyses of new sources discovered in a magnitude range r′ = 17 − 19 mag. We based our rapid kilonova classification on the decay rate of the optical source that should exceed 0.3 mag d−1. GRANDMA’s follow-up determined the fading rate within 1.5 ± 1.2 d post-discovery, without waiting for further observations from ZTF. No confirmed kilonovae were discovered during our observing campaign. This work will be continued in the coming months in the view of preparing for kilonova searches in the next gravitational-wave observing run O4.more » « less
An official website of the United States government

