Artificial intelligence (AI) promises revolutionary benefits.
But is the infrastructure ready?
Data center operators, together with their technology partners, are entering new technological territory. Rittal is now presenting a new cooling solution that delivers over 1 megawatt of cooling power and paves the way for AI. Because the demand for computing power is growing so rapidly that a whole new level of scaling, cooling, power distribution and energy efficiency is required. The global system provider is thus entering a new and expanding area within IT cooling, both in terms of performance and technology.
The possibilities offered by artificial intelligence can seem overwhelming. In June 2023, McKinsey predicted that the increased productivity generated by GenAI could create between $2.6 and $4.4 trillion in added value per year in the global economy. “If even a fraction of this could be achieved, the IT infrastructure would have to grow as quickly as possible and be technologically rethought in a number of key areas,” says Philip Guth, CTO of Rittal International board.
The power density for AI applications such as training and operating large language models (LLMs) in future data centers or high-performance computing, which is already widespread, will quickly push current traditional air cooling to its physical and economic limits. The new, ultra-fast graphics processors (GPUs) generate so much heat that manufacturers are already designing them for high-performance direct liquid cooling.
In close cooperation with several hyperscale data centers, Rittal has developed a modular cooling solution that delivers a cooling power of over 1 MW with direct water cooling, so that the required power densities can be achieved. “A high level of standardization and scalability using modular design and global availability is required to enable rapid technical expansion of the infrastructure, both financially and organizationally,” says Guth.
Module-based platform for single-phase direct liquid cooling
Rittal uses refrigerant distribution units for single-phase direct liquid cooling with water, designed specifically for ease of maintenance.
How it works? Using the modular structure and design advantages of the Open Rack V3, which Rittal has developed within the framework of the Open Compute Project (OCP). With the power supply as a model, the server in the rack is connected to the central inlet and outlet of the water circuit via standardized connections. Functional units such as the central control unit and multiple coolant transport units (CCUs) – depending on performance requirements – are fully modular and can be easily slid into the rack. They guarantee high availability thanks to an n+1 redundant design. Leakage monitoring already starts at the component level. This concept offers an important advantage when it comes to service: Components such as controllers, sensors or pump units in the in-row solution can be maintained during operation and easily replaced via “hot swap”. Power is supplied from the rack’s standardized DC bus bar.
Cooling power of over 1 MW
“The combination possibilities of the platform modules have been designed with a view to a high degree of flexibility. They supplement Rittal’s system range as additional building blocks with coordinated modules for all the pillars of the data center’s operating technology, such as rack, cooling, power, monitoring and security,” explains Lars Platzhoff, head of Rittal’s Business Unit Cooling Solutions.
The liquid-to-liquid solutions cool as an array solution for racks above 1 megawatt; up to 100 kW in a single rack. They are also ideal when it comes to reducing the CO2 footprint by means of heat recovery. Rittal utilizes its experience to support the design of data centers so that the heat is efficiently transported from the collector pipe in the rack for further use, for example in district heating networks.
For data centers without a water connection, liquid-to-air variants are also available, which release the heat to the air in the data center via the rear door of the rack or via a side cooler as a closed system.
Infrastructure directly in the racket
“Power, cooling and monitoring are increasingly being integrated directly into the standardized rack as fundamental pillars of the IT infrastructure. The main driving force behind this trend is a number of hyperscale data centers and server OEMs, to which we are the main supplier of racks,” says Philipp Guth: “We are convinced that this concept will soon become the standard for our global IT customers because there will be a need for ever higher performance and rapid scaling. In addition to hyperscale data centers, it will also be interesting for the growing number of colocation centers.”
Rittal offers its customers flexibility: “We do not limit ourselves to Open Rack V3 in 21 inches. There will also be variants for our VX IT racks in 19 inches,” points out Lars Platzhoff. Full integration into Rittal’s system platform is a relevant advantage when it comes to rolling out the necessary infrastructure for large-scale AI applications – from large hyperscale data centers to small business data centers. “Direct liquid cooling is the technology that enables AI. Our development is inspired by our largest global customers and Rittal’s many years of experience in IT and industry; 20 years of HD IT cooling and more than thirty years of climate control for control systems, circuits and machines under the most demanding industrial conditions,” explains Lars Platzhoff: “We want to make the results available to customers – large and small – as soon as possible .”
Rittal, which is part of the German group Friedhelm Loh Group, is a world leader in enclosures for industrial automation and physical IT security. Rittal’s product range includes enclosures, power distribution, climate technology, IT infrastructure and software & service. Founded in 1961, Rittal has 10 high-tech production sites, 63 subsidiaries and over 40 agencies worldwide. With over 10,000 employees, Rittal is the largest company in the Friedhelm Loh Group.
Source: it-kanalen.dk
