Advancing Software-Driven, AI-Accelerated HPC
HPCwire, Tuesday, April 25,2023
AI and high-performance computing (HPC) face similar issues today. Compute workloads in both areas have grown big enough that they cannot run on a single node, regardless of size. And for energy efficiency and fast results, both need to use and embrace integrated and attached accelerator technologies.
In both arenas, but particularly in AI, there is a growing array of diverse and complex hardware for acceleration. Certainly, HPC has dealt with heterogeneous computing for years. What makes things more challenging is that a single executable program may want to call upon multiple architectures for a single job. For instance, a routine may want to stream data through the CPU, then GPU and/or FPGA, make a quick filter on that, build an array of data, and process that data on a different host.