skip to main content


Title: Coupled Calculations of Data Center Cooling and Power Distribution Systems
Abstract Physics-based modeling aids in designing efficient data center power and cooling systems. These systems have traditionally been modeled independently under the assumption that the inherent coupling of effects between the systems has negligible impact. This study tests the assumption through uncertainty quantification of models for a typical 300 kW data center supplied through either an alternating current (AC)-based or direct current (DC)-based power distribution system. A novel calculation scheme is introduced that couples the calculations of these two systems to estimate the resultant impact on predicted power usage effectiveness (PUE), computer room air conditioning (CRAC) return temperature, total system power requirement, and system power loss values. A two-sample z-test for comparing means is used to test for statistical significance with 95% confidence. The power distribution component efficiencies are calibrated to available published and experimental data. The predictions for a typical data center with an AC-based system suggest that the coupling of system calculations results in statistically significant differences for the cooling system PUE, the overall PUE, the CRAC return air temperature, and total electrical losses. However, none of the tested metrics are statistically significant for a DC-based system. The predictions also suggest that a DC-based system provides statistically significant lower overall PUE and electrical losses compared to the AC-based system, but only when coupled calculations are used. These results indicate that the coupled calculations impact predicted general energy efficiency metrics and enable statistically significant conclusions when comparing different data center cooling and power distribution strategies.  more » « less
Award ID(s):
1738782
NSF-PAR ID:
10341785
Author(s) / Creator(s):
;
Date Published:
Journal Name:
Journal of Electronic Packaging
Volume:
144
Issue:
4
ISSN:
1043-7398
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract

    Data centers have complex environments that undergo constant changes due to fluctuations in IT load, commissioning and decommissioning of IT equipment, heterogeneous rack architectures and varying environmental conditions. These dynamic factors often pose challenges in effectively provisioning cooling systems, resulting in higher energy consumption. To address this issue, it is crucial to consider data center thermal heterogeneity when allocating workloads and controlling cooling, as it can impact operational efficiency. Computational Fluid Dynamics (CFD) models are used to simulate data center heterogeneity and analyze the impact of two different cooling mechanisms on operational efficiency. This research focuses on comparing the cooling based on facility water for Rear Door Heat Exchanger (RDHx) and conventional Computer Room Air Conditioning (CRAH) systems in two different data center configurations. Efficiency is measured in terms of ΔT across facility water. Higher ΔT will result in efficient operation of chillers. The actual chiller efficiency is not calculated as it would depend on local ambient conditions in which the chiller is operated.

    The first data center model represents a typical enterpriselevel configuration where all servers and racks have homogeneous IT power. The second model represents a colocation facility where server/rack power configurations are randomly distributed. These models predict temperature variations at different locations based on IT workload and cooling parameters. Traditionally, CRAH configurations are selected based on total IT power consumption, rack power density, and required cooling capacity for the entire data center space. On the other hand, RDHx can be scaled based on individual rack power density, offering localized cooling advantages. Multiple workload distribution scenarios were simulated for both CRAH and RDHx-based data center models. The results showed that RDHx provides a uniform thermal profile across the data center, irrespective of server/rack power density or workload distribution. This characteristic reduces the risk of over- or under-provisioning racks when using RDHx. Operational efficiency is compared in terms of difference in supply and return temperature of facility water for CRAH and RDHx units based on spatial heat dissipation and workload distribution. RDHx demonstrated excellent cooling capabilities while maintaining a higher ΔT, resulting in reduced cooling energy consumption, operational carbon footprint (?), and water usage.

     
    more » « less
  2. null (Ed.)
    Massive data center (DC) energy demands lead to water consumption concerns. This study quantifies on-site and off-site DC water consumption and its holistic impact on regional water availability. This study proposes a new DC sustainability metrics, Water Scarcity Usage Effectiveness (WSUE), that captures the holistic impacts of water consumption on regional water availability by considering electricity and water source locations and their associated water scarcity. We examine the water consumption of various DC cooling systems by tracking on-site water consumption along with the direct and indirect water transfers associated with electricity transmission at the contiguous U.S. balancing authority (BA) level. This study then applies the WSUE metric for different DC cooling systems and locations to compare the holistic water stress impact by large on-site water consuming systems (e.g., via cooling towers) versus systems with higher electrical consumption and lower on-site water consumption such as the conventional use of computer room air conditioner (CRAC) units. Results suggest that WSUE is strongly dependent on location, and a water-intensive cooling solution could result in a lower WSUE than a solution requiring no or less on-site water consumption. The use of the WSUE metric aids in DC siting decisions and DC cooling system design from a sustainability point of view. 
    more » « less
  3. Proponents of AC-powered data centers have implicitly assumed that the electrical load presented to all three phases of an AC data center are balanced. To assure this, servers are connected to the AC power phases to present identical loads, assuming an uniform expected utilization level for each server. We present an experimental study that demonstrates that with the inevitable temporal changes in server workloads or with dynamic sever capacity management based on known daily load patterns, balanced electrical loading across all power phases cannot be maintained. Such imbalances introduce a reactive power component that represents an effective power loss and brings down the overall energy efficiency of the data center, thereby resulting in a handicap against DC-powered data centers where such a loss is absent. 
    more » « less
  4. Proponents of AC-powered data centers have implicitly assumed that the electrical load presented to all three phases of an AC data center are balanced. To assure this, servers are connected to the AC power phases to present identical loads, assuming an uniform expected utilization level for each server. We present an experimental study that demonstrates that with the inevitable temporal changes in server workloads or with dynamic sever capacity management based on known daily load patterns, balanced electrical loading across all power phases cannot be maintained. Such imbalances introduce a reactive power component that represents an effective power loss and brings down the overall energy efficiency of the data center, thereby resulting in a handicap against DC-powered data centers where such a loss is absent. 
    more » « less
  5. Unfolding-based single-stage ac-dc converters offer benefits in terms of efficiency and power density due to the low-frequency operation of the Unfolder, resulting in negligible switching losses. However, the operation of the Unfolder results in time-varying dc voltages at the input of the subsequent dc-dc converter, complicating its soft-switching analysis. The complication is further enhanced due to the nonlinear nature of the output capacitance ( Coss ) of MOSFETs employed in the dc-dc converter. Furthermore, unlike two-stage topologies with a constant dc-link voltage, as seen in high-frequency grid-tied converters, grid voltage fluctuations also impact the dc input voltages of the dc-dc converter in unfolding-based systems. This work comprehensively analyzes the soft-switching phenomenon in the T-type primary bridge-based dc-dc converter used in unfolding-based topologies, considering all the aforementioned challenges. An energy-based methodology is proposed to determine the minimum zero-voltage switching (ZVS) current and ZVS time during various switching transitions of the T-type bridge. It is shown that the existing literature on the ZVS analysis of the T-type bridge-based resonant dc-dc converter, relying solely on capacitive energy considerations, substantially underestimates the required ZVS current values, with errors reaching up to 50%. The proposed analysis is verified through both simulation and hardware testing. The hardware testing is conducted on a 20-kW 3- ϕ unfolding-based ac-dc converter designed for high-power electric vehicle battery charging applications. The ZVS analysis is verified at various grid angles with the proposed analysis ensuring a complete ZVS operation of the ac-dc system throughout the grid cycle. 
    more » « less