GPU Operator

The NVIDIA GPU Operator automates GPU software in Kubernetes:

helm repo add nvidia https://helm.ngc.nvidia.com/nvidia
helm repo update

helm install --wait --generate-name \
  -n gpu-operator --create-namespace \
  nvidia/gpu-operator

The GPU Operator deploys as DaemonSets: NVIDIA driver, Container Toolkit, Device Plugin, DCGM Exporter, Node Feature Discovery.

Verify GPU availability:

kubectl run gpu-test --image=nvcr.io/nvidia/cuda:12.0-base \
  --restart=Never --limits=nvidia.com/gpu=1 \
  -- nvidia-smi

kubectl logs gpu-test
kubectl delete pod gpu-test