skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


Title: YSE-PZ: A Transient Survey Management Platform that Empowers the Human-in-the-loop
Abstract The modern study of astrophysical transients has been transformed by an exponentially growing volume of data. Within the last decade, the transient discovery rate has increased by a factor of ∼20, with associated survey data, archival data, and metadata also increasing with the number of discoveries. To manage the data at this increased rate, we require new tools. Here we presentYSE-PZ, a transient survey management platform that ingests multiple live streams of transient discovery alerts, identifies the host galaxies of those transients, downloads coincident archival data, and retrieves photometry and spectra from ongoing surveys.YSE-PZalso presents a user with a range of tools to make and support timely and informed transient follow-up decisions. Those subsequent observations enhance transient science and can reveal physics only accessible with rapid follow-up observations. Rather than automating out human interaction,YSE-PZfocuses on accelerating and enhancing human decision making, a role we describe as empowering the human-in-the-loop. Finally,YSE-PZis built to be flexibly used and deployed;YSE-PZcan support multiple, simultaneous, and independent transient collaborations through group-level data permissions, allowing a user to view the data associated with the union of all groups in which they are a member.YSE-PZcan be used as a local instance installed via Docker or deployed as a service hosted in the cloud. We provideYSE-PZas an open-source tool for the community.  more » « less
Award ID(s):
1911206 1720756 1815935
PAR ID:
10491550
Author(s) / Creator(s):
; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; more » ; ; ; « less
Publisher / Repository:
Publications of the Astronomical Society of the Pacific
Date Published:
Journal Name:
Publications of the Astronomical Society of the Pacific
Volume:
135
Issue:
1048
ISSN:
0004-6280
Page Range / eLocation ID:
064501
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; ; ; ; ; ; ; ; ; et al (, The Astrophysical Journal)
    Abstract The Bright Transient Survey (BTS) aims to obtain a classification spectrum for all bright (mpeak≤ 18.5 mag) extragalactic transients found in the Zwicky Transient Facility (ZTF) public survey. BTS critically relies on visual inspection (“scanning”) to select targets for spectroscopic follow-up, which, while effective, has required a significant time investment over the past ∼5 yr of ZTF operations. We presentBTSbot, a multimodal convolutional neural network, which provides a bright transient score to individual ZTF detections using their image data and 25 extracted features.BTSbotis able to eliminate the need for daily human scanning by automatically identifying and requesting spectroscopic follow-up observations of new bright transient candidates.BTSbotrecovers all bright transients in our test split and performs on par with scanners in terms of identification speed (on average, ∼1 hr quicker than scanners). We also find thatBTSbotis not significantly impacted by any data shift by comparing performance across a concealed test split and a sample of very recent BTS candidates.BTSbothas been integrated intoFritzandKowalski, ZTF’s first-party marshal and alert broker, and now sends automatic spectroscopic follow-up requests for the new transients it identifies. Between 2023 December and 2024 May,BTSbotselected 609 sources in real time, 96% of which were real extragalactic transients. WithBTSbotand other automation tools, the BTS workflow has produced the first fully automatic end-to-end discovery and classification of a transient, representing a significant reduction in the human time needed to scan. 
    more » « less
  2. ; ; ; ; ; ; ; ; ; ; et al (, The Astrophysical Journal)
    Abstract We present Lightcurve Anomaly Identification and Similarity Search (LAISS), an automated pipeline to detect anomalous astrophysical transients in real-time data streams. We deploy our anomaly detection model on the nightly Zwicky Transient Facility (ZTF) Alert Stream via the ANTARES broker, identifying a manageable ∼1–5 candidates per night for expert vetting and coordinating follow-up observations. Our method leverages statistical light-curve and contextual host galaxy features within a random forest classifier, tagging transients of rare classes (spectroscopicanomalies), of uncommon host galaxy environments (contextualanomalies), and of peculiar or interaction-powered phenomena (behavioralanomalies). Moreover, we demonstrate the power of a low-latency (∼ms) approximate similarity search method to find transient analogs with similar light-curve evolution and host galaxy environments. We use analogs for data-driven discovery, characterization, (re)classification, and imputation in retrospective and real-time searches. To date, we have identified ∼50 previously known and previously missed rare transients from real-time and retrospective searches, including but not limited to superluminous supernovae (SLSNe), tidal disruption events, SNe IIn, SNe IIb, SNe I-CSM, SNe Ia-91bg-like, SNe Ib, SNe Ic, SNe Ic-BL, and M31 novae. Lastly, we report the discovery of 325 total transients, all observed between 2018 and 2021 and absent from public catalogs (∼1% of all ZTF Astronomical Transient reports to the Transient Name Server through 2021). These methods enable a systematic approach to finding the “needle in the haystack” in large-volume data streams. Because of its integration with the ANTARES broker,LAISSis built to detect exciting transients in Rubin data. 
    more » « less
  3. ; ; ; ; ; ; (, The Astrophysical Journal)
    Over the past decade wide-field optical time-domain surveys have increased the discovery rate of transients to the point that ≲10% are being spectroscopically classified. Despite this, these surveys have enabled the discovery of new and rare types of transients, most notably the class of hydrogen-poor superluminous supernovae (SLSN-I), with about 150 events confirmed to date. Here we present a machine-learning classification algorithm targeted at rapid identification of a pure sample of SLSN-I to enable spectroscopic and multiwavelength follow-up. This algorithm is part of the Finding Luminous and Exotic Extragalactic Transients (FLEET) observational strategy. It utilizes both light-curve and contextual information, but without the need for a redshift, to assign each newly discovered transient a probability of being a SLSN-I. This classifier can achieve a maximum purity of about 85% (with 20% completeness) when observing a selection of SLSN-I candidates. Additionally, we present two alternative classifiers that use either redshifts or complete light curves and can achieve an even higher purity and completeness. At the current discovery rate, the FLEET algorithm can provide about 20 SLSN-I candidates per year for spectroscopic follow-up with 85% purity; with the Legacy Survey of Space and Time we anticipate this will rise to more than $$\sim {10}^{3}$$ events per year. 
    more » « less
  4. ; ; ; ; ; ; ; ; ; ; et al (, Publications of the Astronomical Society of the Pacific)
    Abstract During the first half of the fourth observing run (O4a) of the International Gravitational Wave Network, the Zwicky Transient Facility (ZTF) conducted a systematic search for kilonova (KN) counterparts to binary neutron star (BNS) and neutron star–black hole (NSBH) merger candidates. Here, we present a comprehensive study of the five high-significance (False Alarm Rate less than 1 yr−1) BNS and NSBH candidates in O4a. Our follow-up campaigns relied on both target-of-opportunity observations and re-weighting of the nominal survey schedule to maximize coverage. We describe the toolkit we have been developing,Fritz, an instance ofSkyPortal, instrumental in coordinating and managing our telescope scheduling, candidate vetting, and follow-up observations through a user-friendly interface. ZTF covered a total of 2841 deg2within the skymaps of the high-significance GW events, reaching a median depth ofg≈ 20.2 mag. We circulated 15 candidates, but found no viable KN counterpart to any of the GW events. Based on the ZTF non-detections of the high-significance events in O4a, we used a Bayesian approach,nimbus, to quantify the posterior probability of KN model parameters that are consistent with our non-detections. Our analysis favors KNe with initial absolute magnitude fainter than −16 mag. The joint posterior probability of a GW170817-like KN associated with all our O4a follow-ups was 64%. Additionally, we use a survey simulation software,simsurvey, to determine that our combined filtered efficiency to detect a GW170817-like KN is 36%, when considering the 5 confirmed astrophysical events in O3 (1 BNS and 4 NSBH events), along with our O4a follow-ups. Following Kasliwal et al., we derived joint constraints on the underlying KN luminosity function based on our O3 and O4a follow-ups, determining that no more than 76% of KNe fading at 1 mag day−1can peak at a magnitude brighter than −17.5 mag. 
    more » « less
  5. ; ; ; ; ; ; ; ; ; ; et al (, ArXivorg)
    While optical surveys regularly discover slow transients like supernovae on their own, the most common way to discover extragalactic fast transients, fading away in a few nights, is via follow-up observations of gamma-ray burst and gravitational-wave triggers. However, wide-field surveys have the potential to also identify rapidly fading transients independently of such external triggers. The volumetric survey speed of the Zwicky Transient Facility (ZTF) makes it sensitive to faint and fast-fading objects as kilonovae, the optical counterparts to binary neutron stars and neutron star-black hole mergers, out to almost 200Mpc. We introduce an open-source software infrastructure, the ZTF REaltime Search and Triggering, ZTFReST, designed to identify kilonovae and fast optical transients in ZTF data. Using the ZTF alert stream combined with forced photometry, we have implemented automated candidate ranking based on their photometric evolution and fitting to kilonova models. Automated triggering of follow-up systems, such as Las Cumbres Observatory, has also been implemented. In 13 months of science validation, we found several extragalactic fast transients independent of any external trigger (though some counterparts were identified later), including at least one supernova with post-shock cooling emission, two known afterglows with an associated gamma-ray burst, two known afterglows without any known gamma-ray counterpart, and three new fast-declining sources (ZTF20abtxwfx, ZTF20acozryr, and ZTF21aagwbjr) that are likely associated with GRB200817A, GRB201103B, and GRB210204A. However, we have not found any objects which appear to be kilonovae; therefore, we constrain the rate of GW170817-like kilonovae to R<900Gpc−3yr−1. A framework such as ZTFReST could become a prime tool for kilonova and fast transient discovery with the Vera C. Rubin Observatory. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email