Does AI Give InfiniBand A Moment To Shine? Or Will Ethernet Hold The Line?
The Register, Wednesday, January 24th, 2024
You could go all-in on Nvidia for the lower latency. Or tough it out with less exotic kit and tolerate slower training
Growing demand for AI will see the datacenter switching market grow by 50 percent, according to Dell'Oro analyst Sameh Boujelbene, who has also predicted considerable innovation in the switching arena.
Boujelbene estimates that AI systems currently account for "significantly less than 10 percent" of the total addressable market for network switching, and, of that, about 90 percent of deployments are using Nvidia/Mellanox's InfiniBand - not Ethernet. Those deployments propelled Nvidia's networking revenue to $10 billion a year and made it the second-biggest player in the field, ahead of Juniper and Arista.