An official website of the United States government
Abstract Data centers have complex environments that undergo constant changes due to fluctuations in IT load, commissioning and decommissioning of IT equipment, heterogeneous rack architectures and varying environmental conditions. These dynamic factors often pose challenges in effectively provisioning cooling systems, resulting in higher energy consumption. To address this issue, it is crucial to consider data center thermal heterogeneity when allocating workloads and controlling cooling, as it can impact operational efficiency. Computational Fluid Dynamics (CFD) models are used to simulate data center heterogeneity and analyze the impact of two different cooling mechanisms on operational efficiency. This research focuses on comparing the cooling based on facility water for Rear Door Heat Exchanger (RDHx) and conventional Computer Room Air Conditioning (CRAH) systems in two different data center configurations. Efficiency is measured in terms of ΔT across facility water. Higher ΔT will result in efficient operation of chillers. The actual chiller efficiency is not calculated as it would depend on local ambient conditions in which the chiller is operated. The first data center model represents a typical enterpriselevel configuration where all servers and racks have homogeneous IT power. The second model represents a colocation facility where server/rack power configurations are randomly distributed. These models predict temperature variations at different locations based on IT workload and cooling parameters. Traditionally, CRAH configurations are selected based on total IT power consumption, rack power density, and required cooling capacity for the entire data center space. On the other hand, RDHx can be scaled based on individual rack power density, offering localized cooling advantages. Multiple workload distribution scenarios were simulated for both CRAH and RDHx-based data center models. The results showed that RDHx provides a uniform thermal profile across the data center, irrespective of server/rack power density or workload distribution. This characteristic reduces the risk of over- or under-provisioning racks when using RDHx. Operational efficiency is compared in terms of difference in supply and return temperature of facility water for CRAH and RDHx units based on spatial heat dissipation and workload distribution. RDHx demonstrated excellent cooling capabilities while maintaining a higher ΔT, resulting in reduced cooling energy consumption, operational carbon footprint (?), and water usage.
more »
« less
Coupled Calculations of Data Center Cooling and Power Distribution Systems
Abstract Physics-based modeling aids in designing efficient data center power and cooling systems. These systems have traditionally been modeled independently under the assumption that the inherent coupling of effects between the systems has negligible impact. This study tests the assumption through uncertainty quantification of models for a typical 300 kW data center supplied through either an alternating current (AC)-based or direct current (DC)-based power distribution system. A novel calculation scheme is introduced that couples the calculations of these two systems to estimate the resultant impact on predicted power usage effectiveness (PUE), computer room air conditioning (CRAC) return temperature, total system power requirement, and system power loss values. A two-sample z-test for comparing means is used to test for statistical significance with 95% confidence. The power distribution component efficiencies are calibrated to available published and experimental data. The predictions for a typical data center with an AC-based system suggest that the coupling of system calculations results in statistically significant differences for the cooling system PUE, the overall PUE, the CRAC return air temperature, and total electrical losses. However, none of the tested metrics are statistically significant for a DC-based system. The predictions also suggest that a DC-based system provides statistically significant lower overall PUE and electrical losses compared to the AC-based system, but only when coupled calculations are used. These results indicate that the coupled calculations impact predicted general energy efficiency metrics and enable statistically significant conclusions when comparing different data center cooling and power distribution strategies.
more »
« less
- Award ID(s):
- 1738782
- PAR ID:
- 10341785
- Date Published:
- Journal Name:
- Journal of Electronic Packaging
- Volume:
- 144
- Issue:
- 4
- ISSN:
- 1043-7398
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
null (Ed.)Massive data center (DC) energy demands lead to water consumption concerns. This study quantifies on-site and off-site DC water consumption and its holistic impact on regional water availability. This study proposes a new DC sustainability metrics, Water Scarcity Usage Effectiveness (WSUE), that captures the holistic impacts of water consumption on regional water availability by considering electricity and water source locations and their associated water scarcity. We examine the water consumption of various DC cooling systems by tracking on-site water consumption along with the direct and indirect water transfers associated with electricity transmission at the contiguous U.S. balancing authority (BA) level. This study then applies the WSUE metric for different DC cooling systems and locations to compare the holistic water stress impact by large on-site water consuming systems (e.g., via cooling towers) versus systems with higher electrical consumption and lower on-site water consumption such as the conventional use of computer room air conditioner (CRAC) units. Results suggest that WSUE is strongly dependent on location, and a water-intensive cooling solution could result in a lower WSUE than a solution requiring no or less on-site water consumption. The use of the WSUE metric aids in DC siting decisions and DC cooling system design from a sustainability point of view.more » « less
-
Two self-developed control schemes, ON/OFF and supervisory control and data acquisition (SCADA), were applied on a hybrid evaporative and direct expansion (DX)-based model data center cooling system to assess the impact of controls on reliability and energy efficiency. These control schemes can be applied independently or collectively, thereby saving the energy spent on mechanical refrigeration by using airside economization and/or evaporative cooling. Various combinations of system-level controls and component-level controls are compared to a baseline no-controls case. The results show that reliability is consistently met by employing only sophisticated component-level controls. However, the recommended conditions are met approximately 50% of the simulated time by employing system-level controls only (i.e., SCADA) but with a reduction in data center cooling system power usage effectiveness (PUE) values from 3.76 to 1.42. Moreover, the recommended conditions are met at all averaged times with an even lower cooling system PUE of 1.13 by combining system-level controls only (SCADA and ON/OFF controls). Thus, the study introduces a simple method to compare control schemes for reliable and energy-efficient data center operation. The work also highlights a potential source of capital expenses and operating expenses savings for data center owners by switching from expensive built-in component-based controls to inexpensive, yet effective, system-based controls that can easily be imbedded into existing data center infrastructure systems management.more » « less
-
Proponents of AC-powered data centers have implicitly assumed that the electrical load presented to all three phases of an AC data center are balanced. To assure this, servers are connected to the AC power phases to present identical loads, assuming an uniform expected utilization level for each server. We present an experimental study that demonstrates that with the inevitable temporal changes in server workloads or with dynamic sever capacity management based on known daily load patterns, balanced electrical loading across all power phases cannot be maintained. Such imbalances introduce a reactive power component that represents an effective power loss and brings down the overall energy efficiency of the data center, thereby resulting in a handicap against DC-powered data centers where such a loss is absent.more » « less
-
Proponents of AC-powered data centers have implicitly assumed that the electrical load presented to all three phases of an AC data center are balanced. To assure this, servers are connected to the AC power phases to present identical loads, assuming an uniform expected utilization level for each server. We present an experimental study that demonstrates that with the inevitable temporal changes in server workloads or with dynamic sever capacity management based on known daily load patterns, balanced electrical loading across all power phases cannot be maintained. Such imbalances introduce a reactive power component that represents an effective power loss and brings down the overall energy efficiency of the data center, thereby resulting in a handicap against DC-powered data centers where such a loss is absent.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Journal Article:
- https://doi.org/10.1115/1.4052101
