DDN Supplying Storage For xAI's Colossus Supercomputer
Blocks&Files, Tuesday, November 19th, 2024
DDN storage is being used in an expansion phase of Elon Musk's xAI Colossus supercomputer.
Grok is xAI's name for its large language model, while Colossus is the GPU server-based supercomputer used to train it and run inferencing tasks. The Colossus system is based in a set of datacenter halls in Memphis, Tennessee. The Grok LLM is available for use by X/Twitter subscribers and competes with OpenAI's ChatGPT, Google's Gemini, Anthropic's Claude, and Meta's LLaMA.
DDN is supplying its EXAScaler and Infinia systems, with EXAScaler being a Lustre parallel access file system layered on scale-out all-flash and hybrid hardware and Infinia being DDN's petabyte-scale object storage system, typically using all-flash nodes.