Plutux Logo
Plutux
번역 업데이트 중
Data Center InfrastructureNVDA / SMCI / VRT / DELL8분 읽기

Liquid Cooling Is Becoming the Default Thermal Stack for AI Data Centers

NVIDIA, Supermicro, Vertiv, and Dell are all describing 100kW+ racks, 120-132kW liquid-cooled designs, and large efficiency gains. The read-through is that liquid cooling has moved from an optional upgrade to the default thermal stack for AI factories.

게시일 2026년 7월 1일업데이트 2026년 7월 1일

Rack Density

100-132kW

Published AI rack designs are already past the old air-cooling comfort zone.

Water Efficiency

>300x

NVIDIA says Blackwell boosts water efficiency by over 300x.

Power Cost

-40%

Supermicro says liquid cooling can reduce power costs by up to 40%.

TCO

-20%

Supermicro says TCO can fall by up to 20% with liquid cooling.

Inference Gain

30x

NVIDIA says GB200 NVL72 delivers 30x faster real-time trillion-parameter inference.

CDU Range

70-2300kW

Vertiv's CoolChip CDU family spans small to very large liquid-cooled deployments.

Liquid-cooled AI rack and heat removal graphic

Bottom line

Liquid cooling is no longer a premium option. It is becoming the default answer.

AI racks are now dense enough that the old assumption set has broken. NVIDIA's current Blackwell and GB200 materials describe liquid-cooled rack-scale systems at 120kW, 132kW, and beyond. Supermicro says a single AI rack can now generate over 100kW of heat. That is not a nice-to-have cooling problem; it is a system design constraint.

The big picture is simple: once the rack crosses the 100kW line, liquid cooling stops looking experimental and starts looking like the baseline thermal stack.

My view: the cooling layer is moving from facilities plumbing to core AI infrastructure, and that changes who gets paid in the stack.

The density step-up

Rack power has moved past what air-only designs can comfortably absorb.

NVIDIA's Blackwell platform blog says its liquid-cooled architecture can address 120kW per rack, and its GB200 NVL72 page describes a rack-scale, liquid-cooled design built around 36 Grace CPUs and 72 Blackwell GPUs. Supermicro says its rack-scale liquid cooling solutions support 100kW+ racks. Schneider Electric's liquid-cooling infrastructure, as cited by NVIDIA, supports up to 132kW per rack.

That is the timeline in one sentence: the industry has moved from tens of kilowatts to triple-digit kilowatts, and liquid cooling is what makes that jump operationally possible.

Published rack density levels in the AI stack

The chart compares rack-power figures published by NVIDIA, Supermicro, and Schneider Electric in their official AI infrastructure materials.

단위: kW per rack

Supermicro

100kW+ liquid-cooled rack support

100

NVIDIA

GB200 NVL72 cooling capacity

120

Schneider Electric

Liquid-cooling infrastructure per rack

132

The economics

The market is not buying liquid cooling for aesthetics. It is buying lower friction per watt.

The economics now sound like a capital allocation conversation instead of a niche mechanical debate. Supermicro says liquid cooling can cut power costs by up to 40%, lower TCO by up to 20%, and improve deployment speed. NVIDIA says Blackwell can boost water efficiency by over 300x. Vertiv's CoolChip CDU family spans 70kW to 2300kW, which shows the product stack is already industrialized.

This is why the liquid-cooling market matters for investors. The winners are not only GPU vendors. They also include CDU, chiller, manifold, pump, heat-exchanger, rack-integration, and control-system vendors that can support higher density without destroying uptime or PUE.

What the vendors are actually claiming
VendorPublished detailImplication
NVIDIAGB200 NVL72 is a liquid-cooled rack-scale design with 30x faster real-time trillion-parameter inference.Cooling is now part of the compute platform itself.
SupermicroLiquid cooling reduces power costs up to 40% and TCO up to 20%.The payback case is now strong enough to influence procurement.
VertivCoolChip CDU covers 70kW to 2300kW high-density deployments.The ecosystem is moving from pilot projects to product families.
DellDirect-to-chip liquid cooling is part of its AI Factory stack.Liquid cooling is becoming a mainstream enterprise offer, not a hyperscaler-only tool.

Timeline

The industry has moved from retrofit to design rule.

My read is that liquid cooling has already gone through the normal adoption curve. First it was a workaround for special racks. Then it became a way to make dense systems feasible. Now it is increasingly a design requirement for next-generation AI clusters.

That same curve usually creates a second-order market: once the thermal architecture becomes mandatory, the supply chain around it gets deeper, more standardized, and more investable.

From air cooling to AI factory cooling
PhasePublished signalWhat it means
Air-first data centersDesigned for much lower rack density than current AI systems.No longer enough for the newest GPU racks.
Hybrid transitionRear-door exchangers, CDUs, and direct-to-chip systems enter the mix.Cooling becomes part of rack planning instead of facility afterthought.
Rack-scale liquid100kW+ to 132kW racks are now being published by major vendors.Liquid cooling becomes the practical default for AI factories.
Industrialized thermal stackCDU families scale to 2300kW and adjacent power/cooling systems broaden.The market is now about system integration, not just parts.

My conclusion

Liquid cooling is the HVAC moment for AI infrastructure.

The analogy I would use is commercial buildings moving from window units to central HVAC. Once the load gets high enough, the old patchwork stops being efficient, then stops being credible. AI infrastructure is reaching that point now.

The next bottleneck is not whether liquid cooling exists. It is whether suppliers can deliver enough integrated cooling, power, and controls to keep up with AI deployment cadence. That is a different market, and it is still early.

Disclosure: This article is personal analysis only. It is not investment advice, not investment research, and not a recommendation to buy or sell any security.
© Plutux Technology Limited 2026