NVIDIA Ethernet Networking Accelerates World's Largest AI Supercomputer, Built by xAI
NVIDIA News, Monday, October 28th, 2024
NVIDIA Spectrum-X Makes Colossal NVIDIA Hopper 100,000-GPU System Possible
NVIDIA announced that xAI's Colossus supercomputer cluster comprising 100,000 NVIDIA Hopper GPUs in Memphis, Tennessee, achieved this massive scale by using the NVIDIA Spectrum-X Ethernet networking platform, which is designed to deliver superior performance to multi-tenant, hyperscale AI factories using standards-based Ethernet, for its Remote Direct Memory Access (RDMA) network.
Colossus, the world's largest AI supercomputer, is being used to train xAI's Grok family of large language models, with chatbots offered as a feature for X Premium subscribers. xAI is in the process of doubling the size of Colossus to a combined total of 200,000 NVIDIA Hopper GPUs.