What is MIG

Multi-Instance GPU (MIG) is a feature on NVIDIA A100 and later GPUs that partitions a single physical GPU into multiple isolated instances, each with its own dedicated compute resources and memory.

Supported GPUs: A100, A30, H100, H200, and newer.

Benefits:

Run multiple workloads on one GPU with strong isolation
Right-size GPU resources per workload
Improve overall GPU utilization
Each instance behaves like an independent GPU

Back to module Next: MIG concepts and profiles

Quiz

A few quick questions based on this unit. Mark it complete when you are done.

Completed

Question 1 / 2

What is Right?

LLMs generate step-by-step solutions (Chain-of-Thought prompting)container/gpgkey | \trust security architecturesize GPU resources per workload