An official website of the United States government
Abstract Data centers have complex environments that undergo constant changes due to fluctuations in IT load, commissioning and decommissioning of IT equipment, heterogeneous rack architectures and varying environmental conditions. These dynamic factors often pose challenges in effectively provisioning cooling systems, resulting in higher energy consumption. To address this issue, it is crucial to consider data center thermal heterogeneity when allocating workloads and controlling cooling, as it can impact operational efficiency. Computational Fluid Dynamics (CFD) models are used to simulate data center heterogeneity and analyze the impact of two different cooling mechanisms on operational efficiency. This research focuses on comparing the cooling based on facility water for Rear Door Heat Exchanger (RDHx) and conventional Computer Room Air Conditioning (CRAH) systems in two different data center configurations. Efficiency is measured in terms of ΔT across facility water. Higher ΔT will result in efficient operation of chillers. The actual chiller efficiency is not calculated as it would depend on local ambient conditions in which the chiller is operated. The first data center model represents a typical enterpriselevel configuration where all servers and racks have homogeneous IT power. The second model represents a colocation facility where server/rack power configurations are randomly distributed. These models predict temperature variations at different locations based on IT workload and cooling parameters. Traditionally, CRAH configurations are selected based on total IT power consumption, rack power density, and required cooling capacity for the entire data center space. On the other hand, RDHx can be scaled based on individual rack power density, offering localized cooling advantages. Multiple workload distribution scenarios were simulated for both CRAH and RDHx-based data center models. The results showed that RDHx provides a uniform thermal profile across the data center, irrespective of server/rack power density or workload distribution. This characteristic reduces the risk of over- or under-provisioning racks when using RDHx. Operational efficiency is compared in terms of difference in supply and return temperature of facility water for CRAH and RDHx units based on spatial heat dissipation and workload distribution. RDHx demonstrated excellent cooling capabilities while maintaining a higher ΔT, resulting in reduced cooling energy consumption, operational carbon footprint (?), and water usage.
more »
« less
Coupled Calculations of Data Center Cooling and Power Distribution Systems
Abstract Physics-based modeling aids in designing efficient data center power and cooling systems. These systems have traditionally been modeled independently under the assumption that the inherent coupling of effects between the systems has negligible impact. This study tests the assumption through uncertainty quantification of models for a typical 300 kW data center supplied through either an alternating current (AC)-based or direct current (DC)-based power distribution system. A novel calculation scheme is introduced that couples the calculations of these two systems to estimate the resultant impact on predicted power usage effectiveness (PUE), computer room air conditioning (CRAC) return temperature, total system power requirement, and system power loss values. A two-sample z-test for comparing means is used to test for statistical significance with 95% confidence. The power distribution component efficiencies are calibrated to available published and experimental data. The predictions for a typical data center with an AC-based system suggest that the coupling of system calculations results in statistically significant differences for the cooling system PUE, the overall PUE, the CRAC return air temperature, and total electrical losses. However, none of the tested metrics are statistically significant for a DC-based system. The predictions also suggest that a DC-based system provides statistically significant lower overall PUE and electrical losses compared to the AC-based system, but only when coupled calculations are used. These results indicate that the coupled calculations impact predicted general energy efficiency metrics and enable statistically significant conclusions when comparing different data center cooling and power distribution strategies.
more »
« less
- Award ID(s):
- 1738782
- PAR ID:
- 10341785
- Date Published:
- Journal Name:
- Journal of Electronic Packaging
- Volume:
- 144
- Issue:
- 4
- ISSN:
- 1043-7398
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
null (Ed.)Massive data center (DC) energy demands lead to water consumption concerns. This study quantifies on-site and off-site DC water consumption and its holistic impact on regional water availability. This study proposes a new DC sustainability metrics, Water Scarcity Usage Effectiveness (WSUE), that captures the holistic impacts of water consumption on regional water availability by considering electricity and water source locations and their associated water scarcity. We examine the water consumption of various DC cooling systems by tracking on-site water consumption along with the direct and indirect water transfers associated with electricity transmission at the contiguous U.S. balancing authority (BA) level. This study then applies the WSUE metric for different DC cooling systems and locations to compare the holistic water stress impact by large on-site water consuming systems (e.g., via cooling towers) versus systems with higher electrical consumption and lower on-site water consumption such as the conventional use of computer room air conditioner (CRAC) units. Results suggest that WSUE is strongly dependent on location, and a water-intensive cooling solution could result in a lower WSUE than a solution requiring no or less on-site water consumption. The use of the WSUE metric aids in DC siting decisions and DC cooling system design from a sustainability point of view.more » « less
-
Proponents of AC-powered data centers have implicitly assumed that the electrical load presented to all three phases of an AC data center are balanced. To assure this, servers are connected to the AC power phases to present identical loads, assuming an uniform expected utilization level for each server. We present an experimental study that demonstrates that with the inevitable temporal changes in server workloads or with dynamic sever capacity management based on known daily load patterns, balanced electrical loading across all power phases cannot be maintained. Such imbalances introduce a reactive power component that represents an effective power loss and brings down the overall energy efficiency of the data center, thereby resulting in a handicap against DC-powered data centers where such a loss is absent.more » « less
-
Proponents of AC-powered data centers have implicitly assumed that the electrical load presented to all three phases of an AC data center are balanced. To assure this, servers are connected to the AC power phases to present identical loads, assuming an uniform expected utilization level for each server. We present an experimental study that demonstrates that with the inevitable temporal changes in server workloads or with dynamic sever capacity management based on known daily load patterns, balanced electrical loading across all power phases cannot be maintained. Such imbalances introduce a reactive power component that represents an effective power loss and brings down the overall energy efficiency of the data center, thereby resulting in a handicap against DC-powered data centers where such a loss is absent.more » « less
-
The escalating information technology (IT) loads in modern data centers (DCs) present formidable challenges for traditional room-conditioning systems. The heat dissipated from IT equipment has witnessed a significant surge due to the rapid development of data processing, retrieval, and storage, driven by changing technology trends and the growing demand for online services. This evolving landscape poses a substantial burden on air-cooling systems, pushing them to their limits, especially with the prevailing trend of rising power densities in microprocessors and the emergence of hot spots. Amidst these challenges, singlephase cold plate cooling is gaining traction as IT power densities experience a dramatic climb. However, the widespread adoption of this cooling method faces impediments such as the limited availability of chilled water supplies, constrained air distribution pathways, and the absence of elevated floors in many older DCs. In response to these limitations, liquid-to-air (L2A) cooling distribution units (CDUs) have emerged as an alternative method. By incorporating hybrid air and liquid cooling technologies, the industry aims to achieve precise, ondemand cooling through the utilization of various techniques. In the realm of hybrid cooling systems that integrate both air and liquid cooling technologies, a partial failure of the Computer Room Air Handlers (CRAH) introduces unique challenges. Such a failure has the potential to disrupt the delicate balance between air and liquid cooling components, leading to uneven heat dissipation. Moreover, the interdependence of liquid and air cooling in hybrid systems means that even a partial failure can trigger a domino effect, reducing the overall cooling efficiency of the system. This comprehensive study delves into the implications of partial failure in the CRAH unit within the highpower density racks of a hybrid-cooled DC. The investigation explores how this partial failure impacts various critical parameters, including cooling capacity (CC), supply air temperature (SAT), air flow rate, supply fluid temperature (SFT), and thermal testing vehicle (TTV) heater case temperatures. For the purposes of this study, two L2A in-row CDUs were utilized, with a combined total heat load of 129 kW supplied to three racks. The experimental setup is meticulously equipped with the necessary instruments for monitoring and assessing tests on both the liquid coolant and air sides. By addressing these issues, the research contributes valuable insights to the ongoing efforts to optimize data center cooling solutions in the face of evolving IT demands and technological advancements.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Journal Article:
- https://doi.org/10.1115/1.4052101
