Enabling and using MIG

Step 1: Enable MIG mode

sudo nvidia-smi -i 0 -mig 1       # Enable MIG on GPU 0
sudo nvidia-smi -i 0 -mig 0       # Disable MIG on GPU 0

Requires root. GPU must have no active compute processes.

Step 2: Create GPU instances

sudo nvidia-smi mig -cgi 19,19,19,19,19,19,19   # 7× 1g.5gb on A100
sudo nvidia-smi mig -cci                          # Create default compute instances

Step 3: Verify

nvidia-smi mig -lgi               # List GPU instances
nvidia-smi mig -lci               # List compute instances
nvidia-smi -L                     # List all devices including MIG UUIDs

Cleanup:

sudo nvidia-smi mig -dci          # Delete all compute instances
sudo nvidia-smi mig -dgi          # Delete all GPU instances