More Like this

1. WattScope: Non-intrusive application-level power disaggregation in datacenters

   https://doi.org/10.1016/j.peva.2023.102369  

   Guan, Xiaoding; Bashir, Noman; Irwin, David; Shenoy, Prashant (November 2023, Performance Evaluation)

   Datacenter capacity is growing exponentially to satisfy the increasing demand for many emerging computationally-intensive applications, such as deep learning. This trend has led to concerns over datacenters’ increasing energy consumption and carbon footprint. The most basic prerequisite for optimizing a datacenter’s energy- and carbon-efficiency is accurately monitoring and attributing energy consumption to specific users and applications. Since datacenter servers tend to be multi-tenant, i.e., they host many applications, server- and rack-level power monitoring alone does not provide insight into the energy usage and carbon emissions of their resident applications. At the same time, current application-level energy monitoring and attribution techniques are intrusive: they require privileged access to servers and necessitate coordinated support in hardware and software, neither of which is always possible in cloud environments. To address the problem, we design WattScope, a system for non-intrusively estimating the power consumption of individual applications using external measurements of a server’s aggregate power usage and without requiring direct access to the server’s operating system or applications. Our key insight is that, based on an analysis of production traces, the power characteristics of datacenter workloads, e.g., low variability, low magnitude, and high periodicity, are highly amenable to disaggregation of a server’s total power consumption into application-specific values. WattScope adapts and extends a machine learning-based technique for disaggregating building power and applies it to server- and rack-level power meter measurements that are already available in data centers. We evaluate WattScope’s accuracy on a production workload and show that it yields high accuracy, e.g., often 10% normalized mean absolute error, and is thus a potentially useful tool for datacenters in externally monitoring application-level power usage. 

   more » « less
2. AARPA: Combining Mobile and Power-Line Sensing for Fine-Grained Appliance Usage and Energy Monitoring

   https://doi.org/10.1109/MDM.2015.64  

   Roy, Nirmalya; Pathak, Nilavra; Misra, Archan (June 2015, 2015 16th IEEE International Conference on Mobile Data Management)

   To promote energy-efficient operations in residential and office buildings, non-intrusive load monitoring (NILM) techniques have been proposed to infer the fine-grained power consumption and usage patterns of appliances from power-line measurement data. Fine-grained monitoring of everyday appliances (such as toasters and coffee makers) can not only promote energy-efficient building operations, but also provide unique insights into the context and activities of individuals. Current building-level NILM techniques are unable to identify the consumption characteristics of relatively low-load appliances, whereas smart-plug based solutions incur significant deployment and maintenance costs. In this paper, we investigate an intermediate architecture, where smart circuit breakers provide measurements of aggregate power consumption at room (or section) level granularity. We then investigate techniques to identify the usage and energy consumption of individual appliances from such measurements. We first develop a novel correlation-based approach called CBPA to identify individual appliances based on both their unique transient and steady-state power signatures. While promising, CBPA fails when the set of candidate appliances is too large. To further improve the accuracy of appliance level usage estimation, we then propose a hybrid system called AARPA, which uses mobile sensing to first infer high-level activities of daily living (ADLs), and then uses knowledge of such ADLs to effectively reduce the set of candidate appliances that potentially contribute to the aggregate readings at any point. We evaluate two variants of this algorithm, and show, using real-life data traces gathered from 10 domestic users, that our fusion of mobile and power-line sensing is very promising: it identified all devices that were used in each data trace, and it identified the usage duration and energy consumption of low-load consumer appliances with 87% accuracy. 

   more » « less
3. Accurately Simulating Energy Consumption of I/O-intensive Scientific Workflows

   https://doi.org/10.1007/978-3-030-22734-0_11  

   Ferreira da Silva, Rafael; Orgerie, Anne-Cecile; Casanova, Henri; Tanaka, Ryan; Deelman, Ewa; Suter, Frederic (July 2019, International Conference on Computational Science (ICCS))

   While distributed computing infrastructures can provide infrastructure-level techniques for managing energy consumption, application-level energy consumption models have also been developed to support energy-efficient scheduling and resource provisioning algorithms. In this work, we analyze the accuracy of a widely-used application-level model that have been developed and used in the context of scientific workflow executions. To this end, we profile two production scientific workflows on a distributed platform instrumented with power meters. We then conduct an analysis of power and energy consumption measurements. This analysis shows that power consumption is not linearly related to CPU utilization and that I/O operations significantly impact power, and thus energy, consumption. We then propose a power consumption model that accounts for I/O operations, including the impact of waiting for these operations to complete, and for concurrent task executions on multi-socket, multi-core compute nodes. We implement our proposed model as part of a simulator that allows us to draw direct comparisons between real-world and modeled power and energy consumption. We find that our model has high accuracy when compared to real-world executions. Furthermore, our model improves accuracy by about two orders of magnitude when compared to the traditional models used in the energy-efficient workflow scheduling literature. 

   more » « less
4. Enabling Low-Cost Server-Level Power Monitoring in Data Centers Using Conducted EMI

   https://doi.org/10.1145/3625687.3625801  

   Gupta, Pranjol Sen; Talukder, Zahidur; Abir, Tasnim Azad; Nguyen, Phuc; Islam, Mohammad A (November 2023, ACM)

   Server-level power monitoring in data centers can significantly contribute to its efficient management. Nevertheless, due to the cost of a dedicated power meter for each server, most data center power management only focuses on UPS or cluster-level power monitoring. In this paper, we propose a low-cost novel power monitoring approach that uses only one sensor to extract power consumption information of all servers. We utilize the conducted electromagnetic interference (EMI) of server power supplies to measure their power consumption from non-intrusive single-point voltage measurements. We present a theoretical characterization of conducted EMI generation in server power supply and its propagation through the data center power network. Using a set of ten commercial-grade servers (six Dell PowerEdge and four Lenovo ThinkSystem), we demonstrate that our approach can estimate each server's power consumption with less than ~7% mean absolute error. 

   more » « less
5. Towards Server-Level Power Monitoring in Data Centers Using Single-Point Voltage Measurement

   https://doi.org/10.1145/3560905.3568079  

   Gupta, Pranjol; Talukder, Zahidur; Islam, Mohammad A.; Nguyen, Phuc (November 2022, In Proceedings of the 20th ACM Conference on Embedded Networked Sensor Systems (SenSys '22))

   Server-level power monitoring in data centers can significantly contribute to its efficient management. Nevertheless, due to the cost of a dedicated power meter for each server, most data center power management only focuses on UPS or cluster-level power monitoring. In this paper, we propose a low-cost novel power monitoring approach that uses only one sensor to extract power consumption information of all servers. We utilize the conducted electromagnetic interference of server power supplies to measure its power consumption from non-intrusive single-point voltage measurement. Using a pair of commercial grade Dell PowerEdge servers, we demonstrate that our approach can estimate each server's power consumption with ~3% mean absolute percentage error. 

   more » « less