NVIDIA Hopper Leaps Ahead in Generative AI at MLPerf
NVIDIA News, Wednesday, March 27th, 2024
Industry-standard tests show NVIDIA Hopper-based systems running TensorRT-LLM software provide the world's most powerful platform for generative AI.
It's official: NVIDIA delivered the world's fastest platform in industry-standard tests for inference on generative AI.
In the latest MLPerf benchmarks, NVIDIA TensorRT-LLM - software that speeds and simplifies the complex job of inference on large language models - boosted the performance of NVIDIA Hopper architecture GPUs on the GPT-J LLM nearly 3x over their results just six months ago.