TL;DR: JEDEC has released the HBM4 DRAM standard, enhancing bandwidth up to 2 TB/s, doubling channels, and improving power efficiency and capacity for high-performance computing, AI, and graphics.

TL;DR: Huawei's CloudMatrix 384 AI cluster, powered by 384 Ascend 910C chips, delivers nearly double the BF16 performance and significantly more HBM memory than NVIDIA's GB200 NVL72 AI server.