The Battle Begins For AI Inference Compute In The Datacenter
The Next Platform, Tuesday, September 10th, 2024
The major cloud builders and their hyperscaler brethren - in many cases, one company acts like both a cloud and a hyperscaler - have made their technology choices when it comes to deploying AI training platforms.
They all use Nvidia datacenter GPUs and, if they have them, their own homegrown XPU accelerators. Sometimes these days, they might use AMD GPUs.
With a few exceptions, AI training is all about research and development, both for the AI models and for the products that will leverage them, and because time is of the essence, money almost seems to be no object and it would be very difficult for these companies to pick a third option. (Much as has been the case with the top government-sponsored HPC centers in the world for at least four decades.)