Top500 Supers: This Is Peak NVIDIA For Accelerated Supercomputers
The Next Platform, Monday, May 13th, 2024
If high bandwidth memory was widely available and we had cheap and reliable fusion power, there never would have been a move to use GPU and other compute engines as vector and matrix math offload engines.
But unfortunately for Earth and very fortunately for Nvidia - and now, to a certain extent, AMD - neither HBM nor electricity are cheap, which means supercomputer architecture has been shifting to an accelerated model that pairs the CPUs we all know and love with a massively parallel offload engine of some kind.