[DigiKey TechForum] 800V Hot-Swap-Based AI Data Centers, Power Protection and Telemetry
TECHWORLD ·
✦ AI Summary
As AI data centers shift from 48V to ±400 V/800V high-voltage architectures, the importance of hot-swap protection and power protection and telemetry is increasing.
In high-voltage environments, inrush current control is needed, and demand is also growing for high-reliability telemetry for system diagnostics and safety.
The transition is driven by rising GPU power consumption and higher compute density per rack, with power components being separated from the main rack and moved to adjacent power sidecars.
Hot-swap protection is a system that supports the safe insertion and removal of individually rack-mounted nodes, such as server trays, while power is on.
In AI data centers based on 800V hot-swap, power protection and telemetry are emerging as key topics. As AI data centers shift from 48V to ±400 V/800V high-voltage architectures, the importance of hot-swap protection is also expanding.
In such high-voltage environments, inrush current control is needed. Demand is also growing for high-reliability telemetry that is necessary for system diagnostics and safety.
The transition in AI data center power architecture can be summarized as 48V → ±400 V/800V. Accordingly, rack-level power delivery for AI server infrastructure is also shifting to high-voltage systems.
Two major trends are presented as the background for these changes. The first is rising GPU power consumption.
The increase in GPU power consumption stems from growing compute demands in AI workloads. This is becoming the biggest factor behind rising power demand in modern data centers.
At the same time, GPU compute performance continues to improve. As a result, the power required has also increased significantly.
Another driver is the rising compute density per rack. Large-scale AI training and inference aim to maximize performance and reduce connection latency, and one response has been to concentrate GPUs in a single rack. This concentrated deployment shortens interconnect distances, and the shorter distances improve bandwidth utilization efficiency and reduce latency.
In parallel, power systems are being restructured to respond to rising rack power demand. The direction of change is to separate power components from the main rack, and the existing power components being separated are the power distribution unit (PDU), battery backup unit (BBU), and capacitor unit (CU). These components are being relocated from the main IT rack to adjacent power sidecars.
Separating the power components makes it possible to deliver high-voltage power such as 800V and also frees up space inside the rack. The recovered space is used to place more compute resources.
The provided content is not the body of the article, but a notice directing readers to the original source. The original source referenced is DigiKey's TechForum/Article.
The notice text was presented twice with the same content. The factual information is limited to the point that readers are directed to DigiKey's TechForum/Article and that the notice was repeated.
Source: TECHWORLD · Lee Gwang-jae
Original: https://www.epnc.co.kr/news/articleView.html?idxno=406567
References
This article was produced with the help of an automated content generation algorithm.
Source: TECHWORLD
View originalThis article was summarized and organized by BizCrush based on the original article from TECHWORLD. For exact quotations and full details, please refer to the original article.