skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: H-AMR: A New GPU-accelerated GRMHD Code for Exascale Computing with 3D Adaptive Mesh Refinement and Local Adaptive Time Stepping
Abstract General relativistic magnetohydrodynamic (GRMHD) simulations have revolutionized our understanding of black hole accretion. Here, we present a GPU-accelerated GRMHD code H-AMR with multifaceted optimizations that, collectively, accelerate computation by 2–5 orders of magnitude for a wide range of applications. First, it introduces a spherical grid with 3D adaptive mesh refinement that operates in each of the three dimensions independently. This allows us to circumvent the Courant condition near the polar singularity, which otherwise cripples high-resolution computational performance. Second, we demonstrate that local adaptive time stepping on a logarithmic spherical-polar grid accelerates computation by a factor of ≲10 compared to traditional hierarchical time-stepping approaches. Jointly, these unique features lead to an effective speed of ∼109zone cycles per second per node on 5400 NVIDIA V100 GPUs (i.e., 900 nodes of the OLCF Summit supercomputer). We illustrate H-AMR's computational performance by presenting the first GRMHD simulation of a tilted thin accretion disk threaded by a toroidal magnetic field around a rapidly spinning black hole. With an effective resolution of 13,440 × 4608 × 8092 cells and a total of ≲22 billion cells and ∼0.65 × 108time steps, it is among the largest astrophysical simulations ever performed. We find that frame dragging by the black hole tears up the disk into two independently precessing subdisks. The innermost subdisk rotation axis intermittently aligns with the black hole spin, demonstrating for the first time that such long-sought alignment is possible in the absence of large-scale poloidal magnetic fields.  more » « less
Award ID(s):
2009884 2031997
PAR ID:
10524146
Author(s) / Creator(s):
; ; ; ; ; ; ; ; ; ; ; ;
Publisher / Repository:
IOP Publishing
Date Published:
Journal Name:
The Astrophysical Journal Supplement Series
Volume:
263
Issue:
2
ISSN:
0067-0049
Page Range / eLocation ID:
26
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract In many black hole (BH) systems, the accretion disk is expected to be misaligned with respect to the BH spin axis. If the scale height of the disk is much smaller than the misalignment angle, the spin of the BH can tear the disk into multiple, independently precessing “sub-disks.” This is most likely to happen during outbursts in black hole X-Ray binaries (BHXRBs) and in active galactic nuclei (AGNs) accreting above a few percent of the Eddington limit, because the disk becomes razor-thin. Disk tearing has the potential to explain variability phenomena including quasi-periodic oscillations in BHXRBs and changing-look phenomena in AGNs. Here, we present the first radiative two-temperature general relativistic magnetohydrodynamic (GRMHD) simulation of a strongly tilted (65°) accretion disk around anMBH= 10MBH, which tears and precesses. This leads to luminosity swings between a few percent and 50% of the Eddington limit on sub-viscous timescales. Surprisingly, even where the disk is radiation-pressure-dominated, the accretion disk is thermally stable overt≳ 14,000rg/c. This suggests warps play an important role in stabilizing the disk against thermal collapse. The disk forms two nozzle shocks perpendicular to the line of nodes where the scale height of the disk decreases tenfold and the electron temperature reachesTe∼ 108–109K. In addition, optically thin gas crossing the tear between the inner and outer disk gets heated toTe∼ 108K. This suggests that warped disks may emit a Comptonized spectrum that deviates substantially from idealized models. 
    more » « less
  2. Abstract Multiwavelength observations suggest that the accretion disk in the hard and intermediate states of X-ray binaries (XRBs) and active galactic nucleus transitions from a cold, thin disk at large distances into a hot, thick flow close to the black hole (BH). However, the formation, structure, and dynamics of such truncated disks are poorly constrained due to the complexity of the thermodynamic, magnetic, and radiative processes involved. We present the first radiation-transport two-temperature general relativistic magnetohydrodynamic (GRMHD) simulations of truncated disks radiating at ∼35% of the Eddington luminosity with and without large-scale poloidal magnetic flux. We demonstrate that when a geometrically thin accretion disk is threaded by large-scale net poloidal magnetic flux, it self-consistently transitions at small radii into a two-phase medium of cold gas clumps floating through a hot, magnetically dominated corona. This transition occurs at a well-defined truncation radius determined by the distance out to which the disk is saturated with magnetic flux. The average ion and electron temperatures in the semiopaque corona reach, respectively,Ti≳ 1010K andTe≳ 5 × 108K. The system produces radiation, powerful collimated jets, and broader winds at the total energy efficiency exceeding 90%, the highest ever energy extraction efficiency from a spinning BH by a radiatively efficient flow in a GRMHD simulation. This is consistent with jetted ejections observed during XRB outbursts. The two-phase medium may naturally lead to broadened iron line emission observed in the hard state. 
    more » « less
  3. Aims. The modelling of spectroscopic observations of tidal disruption events (TDEs) to date suggests that the newly formed accretion disks are mostly quasi-circular. In this work we study the transient event AT 2020zso, hosted by an active galactic nucleus (AGN; as inferred from narrow emission line diagnostics), with the aim of characterising the properties of its newly formed accretion flow. Methods. We classify AT 2020zso as a TDE based on the blackbody evolution inferred from UV/optical photometric observations and spectral line content and evolution. We identify transient, double-peaked Bowen (N  III ), He  I , He  II, and H α emission lines. We model medium-resolution optical spectroscopy of the He  II (after careful de-blending of the N  III contribution) and H α lines during the rise, peak, and early decline of the light curve using relativistic, elliptical accretion disk models. Results. We find that the spectral evolution before the peak can be explained by optical depth effects consistent with an outflowing, optically thick Eddington envelope. Around the peak, the envelope reaches its maximum extent (approximately 10 15 cm, or ∼3000–6000 gravitational radii for an inferred black hole mass of 5−10 × 10 5 M ⊙ ) and becomes optically thin. The H α and He  II emission lines at and after the peak can be reproduced with a highly inclined ( i  = 85 ± 5 degrees), highly elliptical ( e  = 0.97 ± 0.01), and relatively compact ( R in = several 100 R g and R out = several 1000 R g ) accretion disk. Conclusions. Overall, the line profiles suggest a highly elliptical geometry for the new accretion flow, consistent with theoretical expectations of newly formed TDE disks. We quantitatively confirm, for the first time, the high inclination nature of a Bowen (and X-ray dim) TDE, consistent with the unification picture of TDEs, where the inclination largely determines the observational appearance. Rapid line profile variations rule out the binary supermassive black hole hypothesis as the origin of the eccentricity; these results thus provide a direct link between a TDE in an AGN and the eccentric accretion disk. We illustrate for the first time how optical spectroscopy can be used to constrain the black hole spin, through (the lack of) disk precession signatures (changes in inferred inclination). We constrain the disk alignment timescale to > 15 days in AT2020zso, which rules out high black hole spin values ( a  < 0.8) for M BH  ∼ 10 6 M ⊙ and disk viscosity α  ≳ 0.1. 
    more » « less
  4. Abstract General relativistic magnetohydrodynamics (GRMHD) simulations are an indispensable tool in studying accretion onto compact objects. The Event Horizon Telescope (EHT) frequently uses libraries of ideal GRMHD simulations to interpret polarimetric, event-horizon-scale observations of supermassive black holes at the centers of galaxies. In this work, we present a library of 10 nonradiative, ideal GRMHD simulations that were utilized by the EHT Collaboration in their analysis of Sagittarius A*. The parameter survey explores both low (SANE) and high (MAD) magnetization states across five black hole spinsa* = −15/16, −1/2, 0, +1/2, +15/16 where each simulation was run out to 30,000GM/c−3. We find the angular momentum and energy flux in SANE simulations closely matches the thin-disk value, with minor deviations in prograde models due to fluid forces. This leads to spin equilibrium arounda* ∼ 0.94, consistent with previous studies. We study the flow of conserved quantities in our simulations and find mass, angular momentum, and energy transport in SANE accretion flows to be primarily inward and fluid dominated. MAD models produce powerful jets with outflow efficiency >1 fora* = + 0.94, leading to black hole spin-down in prograde cases. We observe outward directed energy and angular momentum fluxes on the horizon, as expected for the Blandford–Znajek mechanism. MAD accretion flows are sub-Keplerian and exhibit greater variability than their SANE counterpart. They are also hotter than SANE disks withinr ≲ 10GM/c−2. This study is accompanied by a public release of simulation data athttp://thz.astro.illinois.edu/. 
    more » « less
  5. Abstract We present the tidal disruption event (TDE) AT2022lri, hosted in a nearby (≈144 Mpc) quiescent galaxy with a low-mass massive black hole (104M<MBH< 106M). AT2022lri belongs to the TDE-H+He subtype. More than 1 Ms of X-ray data were collected with NICER, Swift, and XMM-Newton from 187 to 672 days after peak. The X-ray luminosity gradually declined from 1.5 × 1044erg s−1to 1.5 × 1043erg s−1and remains much above the UV and optical luminosity, consistent with a super-Eddington accretion flow viewed face-on. Sporadic strong X-ray dips atop a long-term decline are observed, with a variability timescale of ≈0.5 hr–1 days and amplitude of ≈2–8. When fitted with simple continuum models, the X-ray spectrum is dominated by a thermal disk component with inner temperature going from ∼146 to ∼86 eV. However, there are residual features that peak around 1 keV, which, in some cases, cannot be reproduced by a single broad emission line. We analyzed a subset of time-resolved spectra with two physically motivated models describing a scenario either where ionized absorbers contribute extra absorption and emission lines or where disk reflection plays an important role. Both models provide good and statistically comparable fits, show that the X-ray dips are correlated with drops in the inner disk temperature, and require the existence of subrelativistic (0.1–0.3c) ionized outflows. We propose that the disk temperature fluctuation stems from episodic drops of the mass accretion rate triggered by magnetic instabilities or/and wobbling of the inner accretion disk along the black hole’s spin axis. 
    more » « less