Look Mom, No Inifiniband: Nvidia's DGX GH200 Glues 256 Superchips With NVLink
The Register, Monday, May 29,2023
Nvidia unveiled its latest party trick at Computex in Taipei: stitching together 256 Grace-Hopper superchips into an "AI supercomputer" using nothing but NVLink.
The kit, dubbed the DGX GH200, is being offered as a single system tuned for memory-intensive AI models for natural language processing (NPM) recommender systems, and graph neural networks.
In a press briefing ahead of CEO Jensen Huang's keynote, executives compared the GH200 to the biz's recently launched DGX H100 server, claiming up to 500x higher memory. However the two are nothing alike. The DGX H100 is an 8U system with dual Intel Xeons and eight H100 GPUs and about as many NICs. The DGX GH200, is a 24-rack cluster built on an all-Nvidia architecture - so not exactly comparable.