An official website of the United States government
AWP-ODC is a 4th-order finite difference code used by the SCEC community for linear wave propagation, Iwan-type nonlinear dynamic rupture and wave propagation, and Strain Green Tensor simulation. We have ported and verified the CUDA-version of AWP-ODC-SGT, a reciprocal version used in the SCEC CyberShake project, to HIP so that it can also run on AMD GPUs. This code achieved sustained 32.6 Petaflop/s performance and 95.6% parallel efficiency at full scale on Frontier, a Leadership Computing Facility at Oak Ridge National Laboratory. The readiness of this community software on AMD Radeon Instinct GPUs and EPYC CPUs allows SCEC to take advantage of exascale systems to produce more realistic ground motions and accurate seismic hazard products. We have also deployed AWP-ODC to Azure to leverage the array of tools and services that Azure provides for tightly coupled HPC simulation on commercial cloud. We collaborated with Internet 2/Azure Accelerator supporting team, as part of Microsoft Internet2/Azure Accelerator for Research Fall 2022 Program, with Azure credits awarded through Cloudbank, an NSF-funded initiative. We demonstrate the AWP performance with a benchmark of ground motion simulation on various GPU based cloud instances, and a comparison of the cloud solution to on-premises bare-metal systems. AWP-ODC currently achieves excellent speedup and efficiency on CPU and GPU architectures. The Iwan-type dynamic rupture and wave propagation solver faces significant challenges, however, due to the increased computational workload with the number of yield surfaces chosen. Compared to linear solution, the Iwan model adds 10x-30x more computational time plus 5x-13x more memory consumption that require substantial code changes to obtain excellent performance. Supported by NSF’s Characteristic Science Applications (CSA) program for the Leadership-Class Computing Facility (LCCF) at Texas Advanced Computing Center (TACC), we are porting and improving the performance of this nonlinear AWP-ODC software, preparing for the next generation NSF LCCF system called Horizon, to be installed at TACC. During Texascale days on the current TACC’s Frontera, we carried out an Iwan-type nonlinear dynamic rupture and wave propagation simulation of a Mw7.8 scenario earthquake on the southern San Andreas fault. This simulation modeled 83 seconds of rupture with a grid spacing of 25 m to resolve frequencies up to 4 Hz with a minimum shear-wave velocity of 500 m/s.
more »
« less
This content will become publicly available on September 10, 2026
CyberShake Study 24.8 PSHA Model for Northern California
The SCEC CyberShake platform implements a repeatable scientific workflow to perform 3D physics-based probabilistic seismic hazard analysis (PSHA). Earlier this year we calculated CyberShake Study 24.8 for the San Francisco Bay Area. Study 24.8 includes both low-frequency and broadband PSHA models, calculated at 315 sites. This study required building a regional velocity model from existing 3D models, with a near-surface low-velocity taper and a minimum Vs of 400 m/s. Pegasus-WMS managed the execution of Study 24.8 for 45 days on the OLCF Frontier and TACC Frontera systems. 127 million seismograms and 34 billion intensity measures were produced and automatically transferred to SCEC storage. Study 24.8 used a HIP language implementation of the AWP-ODC wave propagation code on AMD-GPU Frontier nodes to produce strain Green tensors, which were convolved with event realizations to synthesize seismograms. Seismograms were processed to derive data products such as intensity measures, site-specific hazard curves and regional hazard maps. CyberShake combines 3D low-frequency deterministic (≤1 Hz) simulations with high-frequency calculations using stochastic modules from the Broadband Platform to produce results up to 25 Hz, with validation performed using historical events. New CyberShake data products from this study include vertical seismograms, vertical response spectra, and period-dependent significant durations. The presented results include comparisons of hazard estimates between Study 24.8, the previous CyberShake study for this region (18.8), and the NGA-West2 ground motion models (GMMs). We find that Study 24.8 shows overall lower hazard than 18.8, likely due to changes in rupture coherency, with the exception of a few regions: 24.8 shows higher hazard than both the GMMs and 18.8 at long periods in the Livermore area, due to deepening of the Livermore basin in the velocity model, as well as higher hazard east of San Pablo Bay and south of San Jose. At high frequencies, Study 24.8 hazard is lower than that of the GMMs, reflecting reduced variability in the stochastic components. We are also using CyberShake ground motion data to investigate the effects of preferred rupture directions on site-specific hazard. By default, PSHA hazard products assume all events on a given fault and magnitude are equally likely, but by varying these probabilities we can examine the effects of preferred rupture directions on given faults on CyberShake hazard estimates.
more »
« less
- Award ID(s):
- 2311833
- PAR ID:
- 10630254
- Publisher / Repository:
- SCEC Publications
- Date Published:
- Format(s):
- Medium: X
- Location:
- Palm Springs
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Abstract Advances in physics‐based earthquake simulations, utilizing high‐performance computing, have been exploited to better understand the generation and characteristics of the high‐frequency seismic wavefield. However, direct comparison to ground motion observations of a specific earthquake is challenging. We here propose a new approach to simulate data‐fused broadband ground motion synthetics using 3D dynamic rupture modeling of the 2016Mw6.2 Amatrice, Italy earthquake. We augment a smooth, best‐fitting model from Bayesian dynamic rupture source inversion of strong‐motion data (<1 Hz) with fractal fault roughness, frictional heterogeneities, viscoelastic attenuation, and topography. The required consistency to match long periods allows us to quantify the role of small‐scale dynamic source heterogeneities, such as the 3D roughness drag, from observational broadband seismic waveforms. We demonstrate that 3D data‐constrained fully dynamic rupture synthetics show good agreement with various observed ground‐motion metrics up to ∼5 Hz and are an important avenue toward non‐ergodic, physics‐based seismic hazard assessment.more » « less
-
ABSTRACT CyberShake is a high-performance computing workflow for kinematic fault-rupture and earthquake ground-motion simulation developed by the Statewide California Earthquake Center to facilitate physics-based probabilistic seismic hazard assessment (PSHA). CyberShake exploits seismic reciprocity for wave propagation by computing strain green tensors along fault planes, which in turn are convolved with rupture models to generate surface seismograms. Combined with a faultwide hypocentral variation of each simulated rupture, this procedure allows for generating ground-motion synthetics that account for realistic source variability. This study validates the platform’s kinematic modeling of physics-based seismic wave propagation simulations in Southwest Iceland as the first step toward migrating CyberShake from its original study region in California. Specifically, we have implemented CyberShake workflows to model 2103 fault ruptures and simulate the corresponding two horizontal components of ground-motion velocity on a 5 km grid of 625 stations in Southwest Iceland. A 500-yr-long earthquake rupture forecast consisting of 223 hypothetical finite-fault sources of Mw 5–7 was generated using a physics-based model of the bookshelf fault system of the Southwest Iceland transform zone. For each station, every reciprocal simulation uses 0–1 Hz Gaussian point sources polarized along two horizontal grid directions. Comparison of the results in the form of rotation-invariant synthetic pseudoacceleration spectral response values at 3, 4, and 5 s periods are in good agreement with the Icelandic strong motion data set and a suite of empirical Bayesian ground-motion prediction equations (GMPEs). The vast majority of the physics-based simulations fall within one standard deviation of the mean GMPE predictions, previously estimated for the area. At large magnitudes for which no data exist in Iceland, the synthetic data set may play an important role in constraining GMPEs for future applications. Our results comprise the first step toward comprehensive and physics-based PSHA for Southwest Iceland.more » « less
-
Abstract Seismic faults are surrounded by damaged rocks with reduced rigidity and enhanced attenuation. These damaged fault zone structures can amplify seismic waves and affect earthquake dynamics, yet they are typically omitted in physics‐based regional ground motion simulations. We report on the significant effects of a shallow, flower‐shaped fault zone in foreshock‐mainshock 3D dynamic rupture models of the 2019 Ridgecrest earthquake sequence. We find that the fault zone structure both amplifies and reduces ground motions not only locally but at distances exceeding 100 km. This impact on ground motions is frequency‐ and magnitude‐dependent, particularly affecting higher frequency ground motions from the foreshock because its corner frequency is closer to the fault zone's fundamental eigenfrequency. Within the fault zone, the shallow transition to a velocity‐strengthening frictional regime leads to a depth‐dependent peak slip rate increase of up to 70% and confines fault zone‐induced supershear transitions mostly to the fault zone's velocity‐weakening roots. However, the interplay of fault zone waves, free surface reflections, and rupture directivity can generate localized supershear rupture, even in narrow velocity‐strengthening regions, which are typically thought to inhibit supershear rupture. This study demonstrates that shallow fault zone structures may significantly affect intermediate‐ and far‐field ground motions and cause localized supershear rupture penetrating into velocity‐strengthening regions, with important implications for seismic hazard assessment.more » « less
-
Abstract Seismicity in the Los Angeles metropolitan area has been primarily attributed to the regional stress loading. Below the urban areas, earthquake sequences have occurred over time showing migration off the faults and providing evidence that secondary processes may be involved in their evolution. Combining high-frequency seismic attenuation with other geophysical observations is a powerful tool for understanding which Earth properties distinguish regions with ongoing seismicity. We develop the first high-resolution 3D seismic attenuation models across the region east of downtown Los Angeles using 5,600 three-component seismograms from local earthquakes recorded by a dense seismic array. We present frequency-dependent peak delay and coda-attenuation tomography as proxies for seismic scattering and absorption, respectively. The scattering models show high sensitivity to the seismicity along some of the major faults, such as the Cucamonga fault and the San Jacinto fault zone, while a channel of low scattering in the basement extends from near the San Andreas fault westward. In the vicinity of the Fontana seismic sequence, high absorption, low scattering, and seismicity migration across a fault network suggest fluid-driven processes. Our attenuation and fault network imaging characterize near-fault zones and rock-fluid properties beneath the study area for future improvements in seismic hazard evaluation.more » « less
