skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


This content will become publicly available on November 26, 2026

Title: An Efficient Shift-and-stack Algorithm Applied to Detection Catalogs
Abstract The boundary of solar system object discovery lies in detecting its faintest members. However, their discovery in detection catalogs from imaging surveys is fundamentally limited by the practice of thresholding detections at signal-to-noise (SNR) ≥ 5 to maintain catalog purity. Faint moving objects can be recovered from survey images using the shift-and-stack algorithm, which coadds pixels from multi-epoch images along a candidate trajectory. Trajectories matching real objects accumulate signal coherently, enabling high-confidence detections of very faint moving objects. Applying shift-and-stack comes with high computational cost, which scales with target object velocity, typically limiting its use to searches for slow-moving objects in the outer solar system. This work introduces a modified shift-and-stack algorithm that trades sensitivity for speedup. Our algorithm stacks low-SNR detection catalogs instead of pixels, the sparsity of which enables approximations that reduce the number of stacks required. Our algorithm achieves real-world speedups of 10–103× over image-based shift-and-stack while retaining the ability to find faint objects. We validate its performance by recovering synthetic inner and outer solar system objects injected into images from the DECam Ecliptic Exploration Project. Exploring the sensitivity–compute time trade-off of this algorithm, we find that our method achieves a speedup of ∼30× with 88% of the memory usage while sacrificing 0.25 mag in depth compared to image-based shift-and-stack. These speedups enable the broad application of shift-and-stack to large-scale imaging surveys and searches for faint inner solar system objects. We provide a reference implementation via thefind-asteroidsPython package and this URL:https://github.com/stevenstetzler/find-asteroids.  more » « less
Award ID(s):
2107800
PAR ID:
10654578
Author(s) / Creator(s):
; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; more » ; ; ; ; ; « less
Publisher / Repository:
American Astronomical Society.
Date Published:
Journal Name:
The Astronomical Journal
Volume:
170
Issue:
6
ISSN:
0004-6256
Page Range / eLocation ID:
352
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract We report the discovery of cometary activity from minor planet 2011 UG104, which we classify as a Jupiter Family Comet (JFC). This discovery was aided by our Artificial Intelligence (AI) classification system:TailNet. JFC's, short-period comets with eccentric Jupiter-crossing orbits, originate from the Kuiper Belt and thus give us unique insight into the composition and distribution of volatiles in the outer solar system, past and present. Our AI assistantTailNetfirst classified 2011 UG104as active, which was affirmed by Citizen Scientists on our NASA Partner ProgramActive Asteroids. Through further archival image searches our science team found evidence of activity on 2011 UG104on three separate observations from 2021 February to 2021 April (81.°8 < f < 95.°0).  
    more » « less
  2. Abstract While space-borne optical and near-infrared facilities have succeeded in delivering a precise and spatially resolved picture of our Universe, their small survey area is known to underrepresent the true diversity of galaxy populations. Ground-based surveys have reached comparable depths but at lower spatial resolution, resulting in source confusion that hampers accurate photometry extractions. What once was limited to the infrared regime has now begun to challenge ground-based ultradeep surveys, affecting detection and photometry alike. Failing to address these challenges will mean forfeiting a representative view into the distant Universe. We introduceThe Farmer: an automated, reproducible profile-fitting photometry package that pairs a library of smooth parametric models fromThe Tractorwith a decision tree that determines the best-fit model in concert with neighboring sources. Photometry is measured by fitting the models on other bands leaving brightness free to vary. The resulting photometric measurements are naturally total, and no aperture corrections are required. Supporting diagnostics (e.g.,χ2) enable measurement validation. As fitting models is relatively time intensive,The Farmeris built with high-performance computing routines. We benchmarkThe Farmeron a set of realistic COSMOS-like images and find accurate photometry, number counts, and galaxy shapes.The Farmeris already being utilized to produce catalogs for several large-area deep extragalactic surveys where it has been shown to tackle some of the most challenging optical and near-infrared data available, with the promise of extending to other ultradeep surveys expected in the near future.The Farmeris available to download from GitHub (https://github.com/astroweaver/the_farmer) and Zenodo (https://doi.org/10.5281/zenodo.8205817). 
    more » « less
  3. Abstract Despite extensive searches and the relative proximity of solar system objects (SSOs) to Earth, many remain undiscovered and there is still much to learn about their properties and interactions. This work is the first in a series dedicated to detecting and analyzing SSOs in the all-sky NOIRLab Source Catalog (NSC). We search the first data release of the NSC with CANFind, a Computationally Automated NSC tracklet Finder. NSC DR1 contains 34 billion measurements of 2.9 billion unique objects, which CANFind categorizes as belonging to “stationary” (distant stars, galaxies) or moving (SSOs) objects via an iterative clustering method. Detections of stationary bodies for proper-motion μ ≤ 2.″5 hr −1 (0.°017 day −1 ) are identified and analyzed separately. Remaining detections belonging to high- μ objects are clustered together over single nights to form “tracklets.” Each tracklet contains detections of an individual moving object, and is validated based on spatial linearity and motion through time. Proper motions are then calculated and used to connect tracklets and other unassociated measurements over multiple nights by predicting their locations at common times, forming “tracks.” This method extracted 527,055 tracklets from NSC DR1 in an area covering 29,971 square degrees of the sky. The data show distinct groups of objects with similar observed μ in ecliptic coordinates, namely Main Belt Asteroids, Jupiter Trojans, and Kuiper Belt Objects. Apparent magnitudes range from 10 to 25 mag in the ugrizY and VR bands. Color–color diagrams show a bimodality of tracklets between primarily carbonaceous and siliceous groups, supporting prior studies. 
    more » « less
  4. Abstract Deep optical and near-infrared imaging of the entire Galactic plane is essential for understanding our Galaxy’s stars, gas, and dust. The second data release of the Dark Energy Camera (DECam) Plane Survey extends the five-band optical and near-infrared survey of the southern Galactic plane to cover 6.5% of the sky, ∣b∣ ≤ 10°, and 6° >ℓ> −124°, complementary to coverage by Pan-STARRS1. Typical single-exposure effective depths, including crowding effects and other complications, are 23.5, 22.6, 22.1, 21.6, and 20.8 mag ing,r,i,z, andYbands, respectively, with around 1″ seeing. The survey comprises 3.32 billion objects built from 34 billion detections in 21,400 exposures, totaling 260 hr open shutter time on the DECam at Cerro Tololo. The data reduction pipeline features several improvements, including the addition of synthetic source injection tests to validate photometric solutions across the entire survey footprint. A convenient functional form for the detection bias in the faint limit was derived and leveraged to characterize the photometric pipeline performance. A new postprocessing technique was applied to every detection to debias and improve uncertainty estimates of the flux in the presence of structured backgrounds, specifically targeting nebulosity. The images and source catalogs are publicly available athttp://decaps.skymaps.info/. 
    more » « less
  5. Abstract Trans-Neptunian objects provide a window into the history of the solar system, but they can be challenging to observe due to their distance from the Sun and relatively low brightness. Here we report the detection of 75 moving objects that we could not link to any other known objects, the faintest of which has a VR magnitude of 25.02 ± 0.93 using the Kernel-Based Moving Object Detection (KBMOD) platform. We recover an additional 24 sources with previously known orbits. We place constraints on the barycentric distance, inclination, and longitude of ascending node of these objects. The unidentified objects have a median barycentric distance of 41.28 au, placing them in the outer solar system. The observed inclination and magnitude distribution of all detected objects is consistent with previously published KBO distributions. We describe extensions to KBMOD, including a robust percentile-based lightcurve filter, an in-line graphics-processing unit filter, new coadded stamp generation, and a convolutional neural network stamp filter, which allow KBMOD to take advantage of difference images. These enhancements mark a significant improvement in the readiness of KBMOD for deployment on future big data surveys such as LSST. 
    more » « less