An official website of the United States government
Higher-order gravitational wave modes from quasi-circular, spinning, non-precessing binary black hole mergers encode key information about these systems' nonlinear dynamics. We model these waveforms using transformer architectures, targeting the evolution from late inspiral through ringdown. Our data is derived from the \texttt{NRHybSur3dq8} surrogate model, which includes spherical harmonic modes up to ℓ≤4 (excluding (4,0), (4,±1) and including (5,5) modes). These waveforms span mass ratios q≤8, spin components sz1,2∈[−0.8,0.8], and inclination angles θ∈[0,π]. The model processes input data over the time interval t∈[−5000M,−100M) and generates predictions for the plus and cross polarizations, (h+,h×), over the interval t∈[−100M,130M]. Utilizing 16 NVIDIA A100 GPUs on the Delta supercomputer, we trained the transformer model in 15 hours on over 14 million samples. The model's performance was evaluated on a test dataset of 840,000 samples, achieving mean and median overlap scores of 0.996 and 0.997, respectively, relative to the surrogate-based ground truth signals. We further benchmark the model on numerical relativity waveforms from the SXS catalog, finding that it generalizes well to out-of-distribution systems, capable of reproducing the dynamics of systems with mass ratios up to q=15 and spin magnitudes up to 0.998, with a median overlap of 0.969 across 521 NR waveforms and up to 0.998 in face-on/off configurations. These results demonstrate that transformer-based models can capture the nonlinear dynamics of binary black hole mergers with high accuracy, even outside the surrogate training domain, enabling fast sequence modeling of higher-order wave modes.
more »
« less
A scalable framework for adaptive computational general relativity on heterogeneous clusters
We present a portable and highly-scalable framework that targets problems in the astrophysics and numerical relativity communities. This framework combines together the parallel Dendro octree with wavelet adaptive multiresolution and an automatic code-generation physics module to solve the Einstein equations of general relativity in the BSSNOK formulation. The goal of this work is to perform advanced, massively parallel numerical simulations of binary black hole and neutron star mergers, including Intermediate Mass Ratio Inspirals (IMRIs) of binary black holes with mass ratios on the order of 100:1. These studies will be used to study waveforms for use in LIGO data analysis and to calibrate approximate methods for generating gravitational waveforms. The key contribution of this work is the development of automatic code generators for computational relativity supporting SIMD vectorization, OpenMP, and CUDA combined with efficient distributed memory adaptive data-structures. These have enabled the development of efficient codes that demonstrate excellent weak scalability up to 131K cores on ORNL's Titan for binary mergers for mass ratios up to 100.
more »
« less
- PAR ID:
- 10106225
- Date Published:
- Journal Name:
- Proceedings of the ACM International Conference on Supercomputing ICS'19
- Page Range / eLocation ID:
- 1 to 12
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Subjected to the tidal field of its companion, each component of a coalescing binary suffers a slow change in its mass (tidal heating) and spin (tidal torquing) during the inspiral and merger. For black holes, these changes are associated with their absorption of energy and angular momentum fluxes. This effect modifies the inspiral rate of the binary, and consequently, the phase and amplitude of its gravitational waveform. Numerical relativity (NR) waveforms contain these effects inherently, whereas analytical approximants for the early inspiral phase have to include them manually in the energy balance equation. In this work, we construct IMRPhenomD_Horizon, a frequency-domain gravitational waveform model that incorporates the effects of tidal heating of black holes. This is achieved by recalibrating the inspiral phase of the waveform model IMRPhenomD to incorporate the phase corrections for tidal heating. We also include corrections to the amplitude, but add them directly to the inspiral amplitude model of IMRPhenomD. First we demonstrate that the inclusion of the corrections, especially in the phase, confers an overall improvement in the phase agreement between the analytical inspiral model (uncalibrated SEOBNRv2) and NR data. The model presented here is faithful, with less than 1% mismatches against a set of hybrid waveforms (except for one outlier that barely breaches this limit). The recalibrated model shows mismatches of up to ∼14% with IMRPhenomD for high mass ratios and spins. Amplitude corrections become less significant for higher mass ratios, whereas the phase corrections leave more impact—suggesting that the former is practically irrelevant for gravitational wave data analysis in Advanced LIGO (aLIGO), Virgo and KAGRA. Comparing with a set of 219 numerical relativity waveforms, we find that the median of mismatches decreases by ∼4% in aLIGO zero-detuned high power noise curve, and by ∼1.5% with a flat noise curve. This implies a modest but notable improvement in waveform accuracy.more » « less
-
Study of the intermediate mass ratio black hole binary merger up to 1000:1 with numerical relativityAbstract We explicitly demonstrate that current numerical relativity techniques are able to accurately evolve black hole binaries with mass ratios of the order of 1000:1. This proof of principle is relevant for future third generation gravitational wave detectors and space mission LISA, as by purely numerical methods we would be able to accurately compute gravitational waves from the last stages of black hole mergers, as directly predicted by general relativity. We perform a sequence of simulations in the intermediate to small mass ratio regime, m 1 p / m 2 p = 1 / 7 , 1 / 16 , 1 / 32 , 1 / 64 , 1 / 128 , 1 / 256 , 1 / 512 , 1 / 1024 , with the small hole starting from rest at a proper distance D ≈ 13 M . We compare these headon full numerical evolutions with the corresponding semianalytic point particle perturbative results finding an impressive agreement for the total gravitational radiated energy and linear momentum as well as for the waveform spectra. We display numerical convergence of the results and identify the minimal numerical resolutions required to accurately solve for these very low amplitude gravitational waves. This work represents a first step towards the considerable challenge of applying numerical-relativity waveforms to interpreting gravitational-wave observations by LISA and next-generation ground-based gravitational-wave detectors.more » « less
-
Simulations to calculate a single gravitational waveform (GW) can take several weeks. Yet, thousands of such simulations are needed for the detection and interpretation of gravitational waves. Future detectors will require even more accurate waveforms than those currently used. We present here the first large scale, adaptive mesh, multi-GPU numerical relativity (NR) code together with performance analysis and benchmarking. While comparisons are difficult to make, our GPU extension of the Dendro-GR NR code achieves a 6x speedup over existing state-of-the-art codes. We achieve 800 GFlops/s on a single NVIDIA A100 GPU with an overall 2.5x speedup over a two-socket, 128-core AMD EPYC 7763 CPU node with an equivalent CPU implementation. We present detailed performance analyses, parallel scalability results, and accuracy assessments for GWs computed for mass ratios q=1,2,4. We also present strong scalability up to 8 A100s and weak scaling up to 229,376 ×86 cores on the Texas Advanced Computing Center's Frontera system.more » « less
-
Abstract We demonstrate the flexibility and utility of the Berger–Rigoutsos adaptive mesh refinement (AMR) algorithm used in the open-source numerical relativity (NR) code GRC hombo for generating gravitational waveforms from binary black-hole (BH) inspirals, and for studying other problems involving non-trivial matter configurations. We show that GRC hombo can produce high quality binary BH waveforms through a code comparison with the established NR code L ean . We also discuss some of the technical challenges involved in making use of full AMR (as opposed to, e.g. moving box mesh refinement), including the numerical effects caused by using various refinement criteria when regridding. We suggest several ‘rules of thumb’ for when to use different tagging criteria for simulating a variety of physical phenomena. We demonstrate the use of these different criteria through example evolutions of a scalar field theory. Finally, we also review the current status and general capabilities of GRC hombo .more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Conference Paper:
- https://doi.org/10.1145/3330345.3330346
