Search for: All records

Abstract We presentAsterX, a novel open-source, modular, GPU-accelerated, fully general relativistic magnetohydrodynamic (GRMHD) code designed for dynamic spacetimes in 3D Cartesian coordinates, and tailored for exascale computing. We utilize block-structured adaptive mesh refinement (AMR) throughCarpetX, the new driver for theEinstein Toolkit, which is built onAMReX, a software framework for massively parallel applications.AsterXemploys the Valencia formulation for GRMHD, coupled with the ‘Z4c’ formalism for spacetime evolution, while incorporating high resolution shock capturing schemes to accurately handle the hydrodynamics.AsterXhas undergone rigorous testing in both static and dynamic spacetime, demonstrating remarkable accuracy and agreement with other codes in literature. Using subcycling in time, we find an overall performance gain of factor 2.5–4.5. Benchmarking the code through scaling tests on OLCF’s Frontier supercomputer, we demonstrate a weak scaling efficiency of about 67%–77% on 4096 nodes compared to an 8-node performance. 

Simulations to calculate a single gravitational waveform (GW) can take several weeks. Yet, thousands of such simulations are needed for the detection and interpretation of gravitational waves. Future detectors will require even more accurate waveforms than those currently used. We present here the first large scale, adaptive mesh, multi-GPU numerical relativity (NR) code together with performance analysis and benchmarking. While comparisons are difficult to make, our GPU extension of the Dendro-GR NR code achieves a 6x speedup over existing state-of-the-art codes. We achieve 800 GFlops/s on a single NVIDIA A100 GPU with an overall 2.5x speedup over a two-socket, 128-core AMD EPYC 7763 CPU node with an equivalent CPU implementation. We present detailed performance analyses, parallel scalability results, and accuracy assessments for GWs computed for mass ratios q=1,2,4. We also present strong scalability up to 8 A100s and weak scaling up to 229,376 ×86 cores on the Texas Advanced Computing Center's Frontera system. 

Abstract Accreting supermassive binary black holes (SMBBHs) are potential multimessenger sources because they emit both gravitational-wave and electromagnetic (EM) radiation. Past work has shown that their EM output may be periodically modulated by an asymmetric density distribution in the circumbinary disk, often called an “overdensity” or “lump;” this modulation could possibly be used to identify a source as a binary. We explore the sensitivity of the overdensity to SMBBH mass ratio and magnetic flux through the accretion disk. We find that the relative amplitude of the overdensity and its associated EM periodic signal both degrade with diminishing mass ratio, vanishing altogether somewhere between 1:2 and 1:5. Greater magnetization also weakens the lump and any modulation of the light output. We develop a model to describe how lump formation results from internal stress degrading faster in the lump region than it can be rejuvenated through accretion inflow, and predicts a threshold value in specific internal stress below which lump formation should occur and which all our lump-forming simulations satisfy. Thus, detection of such a modulation would provide a constraint on both mass ratio and magnetic flux piercing the accretion flow.