skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: How to Supercharge the Amazon T2: Observations and Suggestions
Cloud service providers adopt a credit system to allow users to obtain periods of performance bursts without additional cost. For example, the Amazon EC2 T2 instance offers low baseline performance and the capability to achieve short periods of high performance using CPU credits. Once a T2 instance is created and assigned some initial credits, while its CPU utilization is above the baseline threshold, there is a transient period where performance is boosted and the assigned CPU credits are used. After all credits are used, the maximum achievable performance drops to baseline. Credits accrue periodically, when the instance utilization is below the baseline threshold. This paper proposes a methodology to increase the performance benefits of T2 by seamlessly extending the duration of the transient period while maintaining high performance. This extension of the high performance transient period is combined with proactive migration to further take advantage of the initially assigned credits. We conduct experiments to demonstrate the benefits of this methodology for both single-tier and multi-tier applications.  more » « less
Award ID(s):
1649087
PAR ID:
10065573
Author(s) / Creator(s):
; ; ; ; ;
Date Published:
Journal Name:
2017 IEEE 10th International Conference on Cloud Computing (CLOUD)
Page Range / eLocation ID:
278 to 285
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract The rotation period of a star is an important quantity that provides insight into its structure and state. For stars with surface features like starspots, their periods can be inferred from brightness variations as these features move across the stellar surface. TESS, with its all-sky coverage, is providing the largest sample of stars for obtaining rotation periods. However, most of the periods have been limited to shorter than the 13.7 days TESS orbital period due to strong background signals (e.g., scattered light) on those timescales. In this study, we investigated the viability of measuring longer periods (>10 days) from TESS light curves for stars in the Northern Continuous Viewing Zone (NCVZ). We first created a reference set of 272 period measurements longer than 10 days for K and M dwarfs in the NCVZ using data from the Zwicky Transient Facility (ZTF) that we consider as the “ground truth” given ZTF’s long temporal baseline of 6+ years. We then used theunpopularpipeline to detrend TESS light curves and implemented a modified Lomb–Scargle (LS) periodogram that accounts for flux offsets between observing sectors. For 179 out of the 272 sources (66%), the TESS-derived periods match the ZTF-derived periods to within 10%. The match rate increases to 81% (137 out of 170) when restricting to sources with a TESS LS power that exceeds a threshold. Our results confirm the capability of measuring periods longer than 10 days from TESS data, highlighting the data set’s potential for studying slow rotators. 
    more » « less
  2. Abstract Rice is an important global crop while also contributing significant anthropogenic methane (CH4) emissions. To support the future of rice production, more information is needed on the impacts of sustainability-driven management used to grow rice with lower associated methane emissions. Recent support for the impacts of different growing practices in the US has prompted the application of a regional methodology (Tier 2) to estimate methane emissions in different rice growing regions. The methodology estimates rice methane emissions from the US Mid-South (MdS) and California (Cal) using region-specific scaling factors applied to a region-specific baseline flux. In our study, we leverage land cover data and soil clay content to estimate methane emissions using this approach, while also examining how changes in common production practices can affect overall emissions in the US. Our results indicated US rice cultivation produced between 0.32 and 0.45 Tg CH4annually, which were approximately 7% and 42% lower on average compared to Food and Agriculture Organization of the UN (FAO) and US Environmental Protection Agency (EPA) inventories, respectively. Our estimates were 63% greater on average compared to similar methods that lack regional context. Introducing aeration events into irrigation resulted in the greatest methane reductions across both regions. When accounting for differences between baseline and reduction scenarios, the US MdS typically had higher mitigation potential compared to Cal. The differences in cumulative mitigation potential across the 2008–2020 period were likely driven by lower production area clay content for the US MdS compared to Cal. The added spatial representation in the Tier 2 approach is useful in surveying how impactful methane-reducing practices might be within and across regions. 
    more » « less
  3. Apptainer (Formerly known as Singularity) is a secure, portable, and easy-to-use container system that provides absolute trust and security. It is widely used across industry and academia and suitable for filling the gaps in integration between running applications on new software technologies and legacy hardware using the optimized resource utilization of CPU and memory. It runs complex applications on HPC clusters in a simple, reproducible way. In this paper we are discussing about various implementations of Artificial Intelligence and Machine learning container-based applications running on Pegasus Supercomputing Nodes using Singularity, Nextflow. It reduces configuration setup work manually by singularity applications and it increases current workflows of High-Performance Computing (HPC), High Throughput Computing (HTC) and run time performance by 3X. we also incorporated comparative based evaluation analytical results of running an application through normal LSF job with singularity container CPU, GPU utilization and its tradeoffs. 
    more » « less
  4. null (Ed.)
    A bstract The factor of four increase in the LHC luminosity, from 0 . 5 × 10 34 cm − 2 s − 1 to 2 . 0 × 10 34 cm − 2 s − 1 , and the corresponding increase in pile-up collisions during the 2015–2018 data-taking period, presented a challenge for the ATLAS trigger, particularly for those algorithms that select events with missing transverse momentum. The output data rate at fixed threshold typically increases exponentially with the number of pile-up collisions, so the legacy algorithms from previous LHC data-taking periods had to be tuned and new approaches developed to maintain the high trigger efficiency achieved in earlier operations. A study of the trigger performance and comparisons with simulations show that these changes resulted in event selection efficiencies of > 98% for this period, meeting and in some cases exceeding the performance of similar triggers in earlier run periods, while at the same time keeping the necessary bandwidth within acceptable limits. 
    more » « less
  5. Modern Datalog engines (e.g., LogicBlox, Soufflé, ddlog) enable their users to write declarative queries which com- pute recursive deductions over extensional facts, leaving high-performance operationalization (query planning, semi- naïve evaluation, and parallelization) to the engine. Such engines form the backbone of modern high-throughput ap- plications in static analysis, network monitoring, and social- media mining. In this paper, we present a methodology for implementing a modern in-memory Datalog engine on data center GPUs, allowing us to achieve significant (up to 45×) gains compared to Soufflé (a modern CPU-based en- gine) on context-sensitive points-to analysis of PostgreSQL. We present GPUlog, a Datalog engine backend that imple- ments iterated relational algebra kernels over a novel range- indexed data structure we call the hash-indexed sorted ar- ray (HISA). HISA combines the algorithmic benefits of in- cremental range-indexed relations with the raw computa- tion throughput of operations over dense data structures. Our experiments show that GPUlog is significantly faster than CPU-based Datalog engines while achieving a favorable memory footprint compared to contemporary GPU-based joins. 
    more » « less