We Heard You Like HBM - NVIDIA's Blackwell Ultra GPUs Will Have 288 Gb Of It
The Register, Friday, March 21st, 2025
NVIDIA's Blackwell GPU architecture is barely out of the cradle - and the graphics chip giant is already looking to extend its lead over rival AMD with an Ultra-themed refresh of the technology.
Announced on stage at Nvidia's GPU Technology Conference (GTC) in San Jose, California, on Tuesday by CEO and leather jacket aficionado Jensen Huang, the Blackwell Ultra family of accelerators boasts up to 15 petaFLOPS of dense 4-bit floating-point performance and up to 288 GB of HBM3e memory per chip.
And if you're primarily interested in deploying GPUs for AI inference, that's a bigger deal than you might think. While training is generally limited by how much compute you can throw at the problem, inference is primarily a memory-bound workload. The more memory you have, the bigger the model you can serve.