DGX systems

DGX A100:

• 8× A100 GPUs with NVLink and NVSwitch
• Up to 640 GB total GPU memory
• 400 Gb/s NVLink bandwidth
• Dual 200 Gb/s HDR InfiniBand ports
• ~6.5 kW power draw

DGX H100:

• 8× H100 SXM5 GPUs, NVLink 4.0, NVSwitch 3.0
• 900 GB/s NVLink bandwidth per GPU
• ~10.2 kW power draw

DGX SuperPOD — Scalable reference architecture:

• Building blocks: DGX nodes + NVIDIA Quantum InfiniBand switches + storage
• Scales from tens to hundreds of DGX nodes
• Managed with BCM