Scaling to New Heights: NVIDIA MLPerf Training Results Showcase Unprecedented Performance and Elasticity
NVIDIA News, Wednesday, June 12th, 2024
NVIDIA achieves unmatched performance and nearly 100% scaling efficiency in latest MLPerf Training benchmarks.
The full-stack NVIDIA accelerated computing platform has once again demonstrated exceptional performance in the latest MLPerf Training v4.0 benchmarks.
NVIDIA more than tripled the performance on the large language model (LLM) benchmark, based on GPT-3 175B, compared to the record-setting NVIDIA submission made last year. Using an AI supercomputer featuring 11,616 NVIDIA H100 Tensor Core GPUs connected with NVIDIA Quantum-2 InfiniBand networking, NVIDIA achieved this remarkable feat through larger scale - more than triple that of the 3,584 H100 GPU submission a year ago - and extensive full-stack engineering.