NVIDIA just announced DGX GH200, an AI supercomputer that combines whooping 256 Grace CPUs & Hopper GPUs in the same package with 144 Terabytes of shared memory!
GH200 integrates NVIDIA's Arm-based Grace CPU and H100 Tensor Core GPU in the same package
This increases bandwidth between GPU and CPU by 7x compared to latest PCIe while reducing power consumption by over 5x
2. Increased Scale and Speed
DGX GH200 is the first supercomputer to use Grace Hopper Superchips and the NVIDIA NVLink Switch System, allowing them to work together as one. Allowing simplicity of programming a single GPU