skip to main content


Title: AN EXPERIMENTAL INVESTIGATION ON THE FLUID DISTRIBUTION IN A TWO-PHASE COOLED RACK UNDER STEADY AND TRANSIENT IT LOAD
Increasing power densities in data centers due to the rise of Artificial Intelligence (AI), high-performance computing (HPC) and machine learning compel engineers to develop new cooling strategies and designs for high-density data centers. Two-phase cooling is one of the promising technologies which exploits the latent heat of the fluid. This technology is much more effective in removing high heat fluxes than when using the sensible heat of fluid and requires lower coolant flow rates. The latent heat also implies more uniformity in the temperature of a heated surface. Despite the benefits of two-phase cooling, the phase change adds complexities to a system when multiple evaporators (exposed to different heat fluxes potentially) are connected to one coolant distribution unit (CDU). In this paper, a commercial pumped two-phase cooling system is investigated in a rack level. Seventeen 2-rack unit (RU) servers from two distinct models are retrofitted and deployed in the rack. The flow rate and pressure distribution across the rack are studied in various filling ratios. Also, investigated is the transient behavior of the cooling system due to a step change in the information technology (IT) load.  more » « less
Award ID(s):
1738793
NSF-PAR ID:
10157106
Author(s) / Creator(s):
; ; ;
Date Published:
Journal Name:
ASME 2019 International Electronic Packaging Technical Conference and Exhibition on Packaging and Integration of Electronic and Photonic Microsystems
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. As the demand for faster and more reliable data processing is increasing in our daily lives, the power consumption of electronics and, correspondingly, Data Centers (DCs), also increases. It has been estimated that about 40% of this DCs power consumption is merely consumed by the cooling systems. A responsive and efficient cooling system would not only save energy and space but would also protect electronic devices and help enhance their performance. Although air cooling offers a simple and convenient solution for Electronic Thermal Management (ETM), it lacks the capacity to overcome higher heat flux rates. Liquid cooling techniques, on the other hand, have gained high attention due to their potential in overcoming higher thermal loads generated by small chip sizes. In the present work, one of the most commonly used liquid cooling techniques is investigated based on various conditions. The performance of liquid-to-liquid heat exchange is studied under multi-leveled thermal loads. Coolant Supply Temperature (CST) stability and case temperature uniformity on the Thermal Test Vehicles (TTVs) are the target indicators of the system performance in this study. This study was carried out experimentally using a rack-mount Coolant Distribution Unit (CDU) attached to primary and secondary cooling loops in a multi-server rack. The effect of various selected control settings on the aforementioned indicators is presented. Results show that the most impactful PID parameter when it comes to fluctuation reduction is the integral (reset) coefficient (IC). It is also concluded that fluctuation with amplitudes lower than 1 ᵒC is converged into higher amplitudes 
    more » « less
  2. Abstract The next radical change in the thermal management of data centers is to shift from conventional cooling methods like air-cooling to direct liquid cooling to enable high thermal mass and corresponding superior cooling. There has been in the past few years a limited adoption of direct liquid cooling in data centers because of its simplicity and high heat dissipation capacity. Single-phase engineered fluid immersion cooling has several other benefits like better server performance, even temperature profile, and higher rack densities and the ability to cool all components in a server without the need for electrical isolation. The reliability aspect of such cooling technology has not been well addressed in the open literature. This paper presents the performance of a fully single-phase dielectric fluid immersed server over wide temperature ranges in an environmental chamber. The server was placed in an environmental chamber and applied extreme temperatures ranging from −20 °C to 10 °C at 100% relative humidity and from 20 to 55 °C at constant 50% relative humidity for extended durations. This work is a first attempt of measuring the performance of a server and other components like pump including flow rate drop, starting trouble, and other potential issues under extreme climatic conditions for a completely liquid-submerged system. Pumping power consumption is directly proportional to the operating cost of a data center. The experiment was carried out until the core temperature reached the maximum junction temperature. This experiment helps to determine the threshold capacity and the robustness of the server for its applications in extreme climatic conditions. 
    more » « less
  3. null (Ed.)
    Abstract Data centers are a large group of networked servers used by organizations for computational and storage purposes. In 2014, data centers consumed an estimated 70 billion kWh in the United States alone. It is incumbent on thermal engineers to develop efficient methods in order to minimize the expenditure at least toward cooling considering the limited available power resources. One of the key areas where electronic cooling research has been focusing, is addressing the issue of nonuniform power distribution at the rack, server and even at package levels. Nonuniform heating at the chip level creates hotspots and temperature gradients across the chip which in turn significantly increases the cost of cooling, as cooling cost is a function of the maximum junction temperature. This challenge has increased the use of temperature sensing mechanisms to help in finding ways to mitigate the gradients. A very effective way to conserve pumping power and address hotspots on the single or multichip modules is by targeted delivery of liquid coolant. One way to enable such targeted delivery of coolant is by using dynamic cold plates coupled with self-regulating flow control device that can control flow rate based on temperature. This novel technology will have more effective implementation coupled with a good control strategy. This paper addresses the development and testing of such control strategy with minimal sensors along with less latency and optimization of the same. 
    more » « less
  4. Miniaturization and high heat flux of power electronic devices have posed a colossal challenge for adequate thermal management. Conventional air-cooling solutions are inadequate for high-performance electronics. Liquid cooling is an alternative solution thanks to the higher specific heat and latent heat associated with the coolants. Liquid-cooled cold plates are typically manufactured by different approaches such as: skived, forged, extrusion, electrical discharge machining. When researchers are facing challenges at creating complex geometries in small spaces, 3D-printing can be a solution. In this paper, a 3D-printed cold plate was designed and characterized with water coolant. The printed metal fin structures were strong enough to undergo pressure from the fluid flow even at high flow rates and small fin structures. A copper block with top surface area of 1 inch by 1 inch was used to mimic a computer chip. Experimental data has good match with a simulation model which was built using commercial software 6SigmaET. Effects of geometry parameters and operating parameters were investigated. Fin diameter was varied from 0.3 mm to 0.5 mm and fin height was maintained at 2 mm. A special manifold was designed to maximize the surface contact area between coolant and metal surface and therefore minimize thermal resistance. The flow rate was varied from 0.75 L/min to 2 L/min and coolant inlet temperature was varied from 25 to 48 oC. It was observed that for the coolant inlet temperature 25 oC and aluminum cold plate, the junction temperature was kept below 63.2 oC at input power 350 W and pressure drop did not exceed 23 Kpa. Effects of metal materials used in 3D-printing on the thermal performance of the cold plate were also studied in detail. 
    more » « less
  5. This study presents an experimental and numerical characterization of pressure drop in a commercially available direct liquid cooled (DLC) rack. It is important to investigate the pressure drop in the DLC system as it determines the required pumping power for the DLC system, which affects the energy efficiency of the data center. The main objective of this research is to assess the flow rate and pressure distributions in a DLC system to enhance the reliability and the cooling system efficiency. Other objectives of this research are to evaluate the accuracy of flow network modeling (FNM) in predicting the flow distribution in a DLC rack and identify manufacturing limitations in a commercial system that could impact the cooling system reliability. The main components of the investigated DLC system are: coolant distribution module (CDM), supply/return manifold module, and server module which contains a cold plate. Extensive experimental measurements were performed to study the flow distribution and to determine the pressure characteristic curves for the server modules and the coolant distribution module (CDM). Also, a methodology was described to develop an experimentally validated flow network model (FNM) of the DLC system to obtain high accuracy. The measurements revealed a flow maldistribution among the server modules, which is attributed to the manufacturing process of the micro-channel cold plate. The average errors in predicting the flow rate of the server module and the CDM using FNM are 2.5% and 3.8%, respectively. The accuracy and the short run time make FNM a good tool for design, analysis, and optimization for DLC systems. The pressure drop in the server module is found to account for 56% of the total pressure drop in the DLC rack. Further analysis showed that 69% of the pressure drop in the server module is associated with the module's plumbing (corrugated hoses, disconnects, fittings). The server cooling modules are designed to provide secured connections and flexibility, which come with a high pressure drop cost. 
    more » « less