DCGM and dcgmi cheat sheet

sudo systemctl start nvidia-dcgm
dcgmi discovery -l                          # List GPUs + NVSwitches
dcgmi health -c                             # Health check
dcgmi diag -r 1                             # Short (1 min)
dcgmi diag -r 2                             # Medium (2 min)
dcgmi diag -r 3                             # Long stress test
dcgmi dmon -e 150,155,203                   # Temp, power, utilization