skip to main content


Search for: All records

Creators/Authors contains: "Palla, A"

Note: When clicking on a Digital Object Identifier (DOI) number, you will be taken to an external site maintained by the publisher. Some full text articles may not yet be available without a charge during the embargo (administrative interval).
What is a DOI Number?

Some links on this page may take you to non-federal websites. Their policies may differ from this site.

  1. AWP-ODC is a 4th-order finite difference code used for linear wave propagation, Iwan-type nonlinear dynamic rupture and wave propagation, and Strain Green Tensor simulation2. We have ported and verified the linear and topography version of AWP-ODC, with discontinuous mesh as well as topography, to HIP so that it can also run on AMD GPUs. The topography code achieved a 99.6% parallel efficiency on 4,096 nodes on Frontier, a Leadership Computing Facility at Oak Ridge National Laboratory. We have also implemented CUDA-aware features and on-the-fly GDR compression in the linear version of the ported HIP code. These enhancements significantly improve data transfer efficiency between GPUs, reducing communication overhead and boosting overall performance. We have also extended CUDA-aware features to the topography version and are actively working on incorporating GDR compression into this version as well. We see 154% benefits over IMPI in MVAPICH2-GDR with CUDA-aware support and on-the-fly compression for linear AWP-ODC on Lonestar-6 A100 nodes. Furthermore, we have successfully integrated a checkpointing feature into the nonlinear IWAN version of AWP-ODC, prepared for future extreme-scale simulation during Texascale Days of Frontera at TACC. 
    more » « less
    Free, publicly-accessible full text available August 19, 2025
  2. AWP-ODC is a 4th-order finite difference code used by the SCEC community for linear wave propagation, Iwan-type nonlinear dynamic rupture and wave propagation, and Strain Green Tensor simulation. We have ported and verified the CUDA-version of AWP-ODC-SGT, a reciprocal version used in the SCEC CyberShake project, to HIP so that it can also run on AMD GPUs. This code achieved sustained 32.6 Petaflop/s performance and 95.6% parallel efficiency at full scale on Frontier, a Leadership Computing Facility at Oak Ridge National Laboratory. The readiness of this community software on AMD Radeon Instinct GPUs and EPYC CPUs allows SCEC to take advantage of exascale systems to produce more realistic ground motions and accurate seismic hazard products. We have also deployed AWP-ODC to Azure to leverage the array of tools and services that Azure provides for tightly coupled HPC simulation on commercial cloud. We collaborated with Internet 2/Azure Accelerator supporting team, as part of Microsoft Internet2/Azure Accelerator for Research Fall 2022 Program, with Azure credits awarded through Cloudbank, an NSF-funded initiative. We demonstrate the AWP performance with a benchmark of ground motion simulation on various GPU based cloud instances, and a comparison of the cloud solution to on-premises bare-metal systems. AWP-ODC currently achieves excellent speedup and efficiency on CPU and GPU architectures. The Iwan-type dynamic rupture and wave propagation solver faces significant challenges, however, due to the increased computational workload with the number of yield surfaces chosen. Compared to linear solution, the Iwan model adds 10x-30x more computational time plus 5x-13x more memory consumption that require substantial code changes to obtain excellent performance. Supported by NSF’s Characteristic Science Applications (CSA) program for the Leadership-Class Computing Facility (LCCF) at Texas Advanced Computing Center (TACC), we are porting and improving the performance of this nonlinear AWP-ODC software, preparing for the next generation NSF LCCF system called Horizon, to be installed at TACC. During Texascale days on the current TACC’s Frontera, we carried out an Iwan-type nonlinear dynamic rupture and wave propagation simulation of a Mw7.8 scenario earthquake on the southern San Andreas fault. This simulation modeled 83 seconds of rupture with a grid spacing of 25 m to resolve frequencies up to 4 Hz with a minimum shear-wave velocity of 500 m/s. 
    more » « less
  3. Abstract

    We review comprehensive observations of electromagnetic ion cyclotron (EMIC) wave-driven energetic electron precipitation using data collected by the energetic electron detector on the Electron Losses and Fields InvestigatioN (ELFIN) mission, two polar-orbiting low-altitude spinning CubeSats, measuring 50-5000 keV electrons with good pitch-angle and energy resolution. EMIC wave-driven precipitation exhibits a distinct signature in energy-spectrograms of the precipitating-to-trapped flux ratio: peaks at >0.5 MeV which are abrupt (bursty) (lasting ∼17 s, or$\Delta L\sim 0.56$ΔL0.56) with significant substructure (occasionally down to sub-second timescale). We attribute the bursty nature of the precipitation to the spatial extent and structuredness of the wave field at the equator. Multiple ELFIN passes over the same MLT sector allow us to study the spatial and temporal evolution of the EMIC wave - electron interaction region. Case studies employing conjugate ground-based or equatorial observations of the EMIC waves reveal that the energy of moderate and strong precipitation at ELFIN approximately agrees with theoretical expectations for cyclotron resonant interactions in a cold plasma. Using multiple years of ELFIN data uniformly distributed in local time, we assemble a statistical database of ∼50 events of strong EMIC wave-driven precipitation. Most reside at$L\sim 5-7$L57at dusk, while a smaller subset exists at$L\sim 8-12$L812at post-midnight. The energies of the peak-precipitation ratio and of the half-peak precipitation ratio (our proxy for the minimum resonance energy) exhibit an$L$L-shell dependence in good agreement with theoretical estimates based on prior statistical observations of EMIC wave power spectra. The precipitation ratio’s spectral shape for the most intense events has an exponential falloff away from the peak (i.e., on either side of$\sim 1.45$1.45MeV). It too agrees well with quasi-linear diffusion theory based on prior statistics of wave spectra. It should be noted though that this diffusive treatment likely includes effects from nonlinear resonant interactions (especially at high energies) and nonresonant effects from sharp wave packet edges (at low energies). Sub-MeV electron precipitation observed concurrently with strong EMIC wave-driven >1 MeV precipitation has a spectral shape that is consistent with efficient pitch-angle scattering down to ∼ 200-300 keV by much less intense higher frequency EMIC waves at dusk (where such waves are most frequent). At ∼100 keV, whistler-mode chorus may be implicated in concurrent precipitation. These results confirm the critical role of EMIC waves in driving relativistic electron losses. Nonlinear effects may abound and require further investigation.

     
    more » « less
  4. null (Ed.)
    Abstract The Electron Loss and Fields Investigation with a Spatio-Temporal Ambiguity-Resolving option (ELFIN-STAR, or heretoforth simply: ELFIN) mission comprises two identical 3-Unit (3U) CubeSats on a polar (∼93 ∘ inclination), nearly circular, low-Earth (∼450 km altitude) orbit. Launched on September 15, 2018, ELFIN is expected to have a >2.5 year lifetime. Its primary science objective is to resolve the mechanism of storm-time relativistic electron precipitation, for which electromagnetic ion cyclotron (EMIC) waves are a prime candidate. From its ionospheric vantage point, ELFIN uses its unique pitch-angle-resolving capability to determine whether measured relativistic electron pitch-angle and energy spectra within the loss cone bear the characteristic signatures of scattering by EMIC waves or whether such scattering may be due to other processes. Pairing identical ELFIN satellites with slowly-variable along-track separation allows disambiguation of spatial and temporal evolution of the precipitation over minutes-to-tens-of-minutes timescales, faster than the orbit period of a single low-altitude satellite (T orbit ∼ 90 min). Each satellite carries an energetic particle detector for electrons (EPDE) that measures 50 keV to 5 MeV electrons with $\Delta $ Δ E/E < 40% and a fluxgate magnetometer (FGM) on a ∼72 cm boom that measures magnetic field waves (e.g., EMIC waves) in the range from DC to 5 Hz Nyquist (nominally) with <0.3 nT/sqrt(Hz) noise at 1 Hz. The spinning satellites (T spin $\,\sim $ ∼ 3 s) are equipped with magnetorquers (air coils) that permit spin-up or -down and reorientation maneuvers. Using those, the spin axis is placed normal to the orbit plane (nominally), allowing full pitch-angle resolution twice per spin. An energetic particle detector for ions (EPDI) measures 250 keV – 5 MeV ions, addressing secondary science. Funded initially by CalSpace and the University Nanosat Program, ELFIN was selected for flight with joint support from NSF and NASA between 2014 and 2018 and launched by the ELaNa XVIII program on a Delta II rocket (with IceSatII as the primary). Mission operations are currently funded by NASA. Working under experienced UCLA mentors, with advice from The Aerospace Corporation and NASA personnel, more than 250 undergraduates have matured the ELFIN implementation strategy; developed the instruments, satellite, and ground systems and operate the two satellites. ELFIN’s already high potential for cutting-edge science return is compounded by concurrent equatorial Heliophysics missions (THEMIS, Arase, Van Allen Probes, MMS) and ground stations. ELFIN’s integrated data analysis approach, rapid dissemination strategies via the SPace Environment Data Analysis System (SPEDAS), and data coordination with the Heliophysics/Geospace System Observatory (H/GSO) optimize science yield, enabling the widest community benefits. Several storm-time events have already been captured and are presented herein to demonstrate ELFIN’s data analysis methods and potential. These form the basis of on-going studies to resolve the primary mission science objective. Broad energy precipitation events, precipitation bands, and microbursts, clearly seen both at dawn and dusk, extend from tens of keV to >1 MeV. This broad energy range of precipitation indicates that multiple waves are providing scattering concurrently. Many observed events show significant backscattered fluxes, which in the past were hard to resolve by equatorial spacecraft or non-pitch-angle-resolving ionospheric missions. These observations suggest that the ionosphere plays a significant role in modifying magnetospheric electron fluxes and wave-particle interactions. Routine data captures starting in February 2020 and lasting for at least another year, approximately the remainder of the mission lifetime, are expected to provide a very rich dataset to address questions even beyond the primary mission science objective. 
    more » « less