skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


This content will become publicly available on November 17, 2025

Title: RAJA Performance Suite: Performance Portability Analysis with Caliper and Thicket
Award ID(s):
2331152 2138811
PAR ID:
10631989
Author(s) / Creator(s):
; ; ; ; ; ; ; ; ; ;
Publisher / Repository:
IEEE
Date Published:
Page Range / eLocation ID:
1206 to 1218
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. The inequitable distribution of principal effectiveness raises concern among policymakers. Principal sorting likely contributes to wider achievement and opportunity gaps between low- and high-need schools. As a possible policy tool, policymakers proposed performance-based compensation systems (PBCS). Tennessee was one of the states that supported the implementation of PBCS. This study examined the relationship between PBCS and principal job performance in the state, using longitudinal administrative data, principal evaluation data, and unique PBCS data from 2012 to 2019. The study did not find consistently significant, positive relationships between PBCS and principal job performance. However, the relationships were generally more pronounced among high-need schools. The study concludes with detailed discussions about the results, the assumptions behind PBCS, limitations, and implications. 
    more » « less
  2. The performance of compute hardware varies: software run repeatedly on the same server (or a different server with supposedly identical parts) can produce performance results that differ with each execution. This variation has important effects on the reproducibility of systems research and ability to quantitatively compare the performance of different systems. It also has implications for commercial computing, where agreements are often made conditioned on meeting specific performance targets. Over a period of 10 months, we conducted a large-scale study capturing nearly 900,000 data points from 835 servers. We examine this data from two perspectives: that of a service provider wishing to offer a consistent environment, and that of a systems researcher who must understand how variability impacts experimental results. From this examination, we draw a number of lessons about the types and magnitudes of performance variability and the effects on confidence in experiment results. We also create a statistical model that can be used to understand how representative an individual server is of the general population. The full dataset and our analysis tools are publicly available, and we have built a system to interactively explore the data and make recommendations for experiment parameters based on statistical analysis of historical data. 
    more » « less
  3. In this paper, we study the impacts of latency variation versus latency mean on application runtime, library performance, and packet delivery. Our contributions include the design and implementation of a network latency injector that is suitable for most QLogic and Mellanox InfiniBand cards. We fit statistical distributions of latency mean and variation to varying levels of network contention for a range of parallel application workloads. We use the statistical distributions to characterize the latency variation impacts to application degradation. The level of application degradation caused by variation in network latency depends on application characteristics, and can be significant. Observed degradation varies from no degradation for applications without communicating processes to 3.5 times slower for communication-intensive parallel applications. We support our results with statistical analysis of our experimental observations. For communication-intensive high performance computing applications, we show statistically significant evidence that changes in performance are more highly correlated with changes of variation in network latency than with changes of mean network latency alone. 
    more » « less