Technology
AI increase thrusts Europe between power-hungry records facilities and environmental targets
A massive hallway with supercomputers inside of a server room records middle.
Luza Studios | E+ | Getty Photographs
The increase in synthetic logic is ushering in an environmentally aware shift in how records facilities function, as Eu builders face drive to decrease the H2O temperatures in their energy-hungry amenities to deal with the higher-powered chips of companies equivalent to tech gigantic Nvidia.
AI is estimated to power a 160% growth in demand for records facilities by way of 2030, analysis from Goldman Sachs displays — an building up that might come at a value to Europe’s decarbonization targets, because the specialised chips impaired by way of AI companies are anticipated to hike the calories significance of the information facilities that deploy them.
Top-powered chips — sometimes called graphics processing devices, or GPUs — are crucial for coaching and deploying massive language fashions, which can be one of those AI. Those GPUs want prime density computing talent and assemble extra warmth, which in the long run calls for less warm H2O to backup significance cooling of the chips.
AI can eat 120 kilowatts of calories in only one sq. meter of an information middle, which is an identical to the ability intake and warmth dissipation of round 15 to twenty-five properties, in line with Andrey Korolenko, product and infrastructure officer at Nebius, who referred particularly to the deployment of Nvidia’s Blackwell GB200 chip.
“This is extremely dense, and from the cooling standpoint of view you need different solutions,” he stated.
The disease we’ve were given with the chipmakers, is AI is now a dimension race run by way of the American marketplace the place land rights, calories get right of entry to and sustainability are reasonably low at the pecking form, and the place marketplace domination is vital,” Winterson told CNBC
Michael Winterson
chair of the EUDCA
Michael Winterson, chair of the European Data Center Association (EUDCA), warned that lowering water temperatures will eventually “basically power us again to an unsustainable status that we had been in 25 years in the past.”
“The disease we’ve were given with the chipmakers is [that] AI is now a dimension race run by way of the American marketplace the place land rights, calories get right of entry to and sustainability are reasonably low at the pecking form, and the place marketplace domination is vital,” Winterson told CNBC.
Major equipment suppliers in Europe say that U.S. chip designers are calling on them to lower their water temperatures to accommodate the hotter AI chips, according to Herbert Radlinger, managing director at NDC-GARBE.
“That is surprising information, as a result of firstly everyone from the engineering aspect anticipated to travel for liquid cooling to run increased temperatures,” he told CNBC, referring to the technology of liquid cooling, which is said to be more efficient than the more traditional method of air cooling.
‘Evolution dialogue’
Energy efficiency is high on the European Commission’s agenda, as it seeks to reach its goal of reducing energy consumption by 11.7% by 2030. The EU predicted in 2018 that energy consumption of data centers could rise 28% by 2030, but the advent of AI is expected to boost that number two or threefold in some countries.
Winterson said that lowering water temperatures is “basically incompatible” with the EU’s recently launched Energy Efficiency Directive, which established a dedicated data base for data centers of a certain size to publicly report on their power consumption. The EUDCA has has been lobbying Brussels to consider these sustainability concerns.
Energy management firm Schneider Electric engages often with the EU on the topic. Many of the recent discussions have focused on different ways to source “top talent” for AI data centers and for the potential for more collaboration with utilities, said Steven Carlini, chief advocate of AI and data centers and vice president at Schneider Electric.
European Commission energy officials have also had exchanges with Nvidia to discuss energy consumption and the use of data centers with regard to the effectiveness of power use and that of chipsets.
CNBC has approached Nvidia and the Commission for comment.
“Cooling is the second-largest shopper of calories within the records middle later the IT load,” Carlini told CNBC in emailed comments. “The calories significance will get up however the PUE (Energy Utilization Effectiveness) won’t get up with decrease H2O temperatures in spite of the chillers having to paintings more difficult.”
Schneider Electric’s customers that are deploying Nvidia’s Blackwell GB200 super chip are asking for water temperatures of 20-24 degrees Celsius or between 68 and 75 degrees Fahrenheit, Carlini said.
He added that this compares to temperatures of around 32 degrees Celsius with liquid cooling, or of around 30 degrees Celsius that Meta has suggested for the water it supplies to the hardware.
Ferhan Gunen, vice president of data center operations for the U.K. at Equinix, told CNBC that there are a number of concerns about AI that Equinix has been discussing with its customers.
“They need to building up the density in their servers, which is, they need to have higher-power-using chips, or they need to have extra servers,” she said, adding that the shift is not “cloudless scale down.”
“It’s actually an evolution dialogue greater than anything else,” Gunen said.
Nvidia, which declined to comment on the cooling requirements of its chips, announced a new platform for its Blackwell GPUs earlier this year. It said that the architecture would enable organizations to run real-time generative AI on large language models at up to 25 times less cost and energy consumption compared to earlier technology.
Liquid cooling will require a “reconfiguration,” Gunen explained, adding that new data centers are already coming ready with this technology. “Sure, increased density will ruthless extra talent significance, and also will ruthless extra cooling requirement. However upcoming the era is converting, so that you’re doing it otherwise. That’s why there’s a stability in all of this,” she stated.
Race for potency
Nebius, which has round $2 billion in money on its stability sheet later splitting from Russia’s Yandex, has said it’s going to be one of the crucial first to deliver Nvidia’s Blackwell platform to shoppers in 2025. The company has additionally introduced plans to invest more than $1 billion on AI infrastructure in Europe by way of the center of after occasion.
Nebius’ Korolenko stated liquid cooling is a “first step,” where cost of ownership will initially be worse before improving over time.
“There’s a large push in order, however on the similar generation, whilst you travel to scale, you’re going to need to be able to select, to be economical and no longer sacrifice extra. Energy potency is remarkable for the working prices. It’s all the time a prime precedence,” Korolenko said.
Even before a boom in demand for AI applications hit the market, the data center industry in Europe was struggling to keep pace with the growing digital sector.
Sicco Boomsma, managing director of ING’s TMT team, said those involved in the market are “very delicate to talent” and that while Europe’s focus is on infrastructure, the U.S. has focused more on expanding assets in Europe where power is available.
“There’s an incredible quantity of knowledge middle operators additionally coming from the U.S. which can be aligning to bring to safeguard that their records middle infrastructure is in sequence with the numerous targets that the EU has as neatly, equivalent to being carbon impartial, equivalent to being environment friendly, on H2O usage, keeping up biodiversity.”
“This is a type of a race the place they need to reveal that their wisdom is eminent to tremendous environment friendly infrastructure,” he stated.