VISI

GPU Operator installation

BCM can deploy Kubernetes on NVIDIA nodes. After BCM provisions nodes with Kubernetes components, install the GPU Operator to enable GPU support.

# Add NVIDIA Helm repo
helm repo add nvidia https://helm.ngc.nvidia.com/nvidia
helm repo update

# Install GPU Operator
helm install --wait --generate-name \
  -n gpu-operator --create-namespace \
  nvidia/gpu-operator

# Verify
kubectl get pods -n gpu-operator

The GPU Operator deploys these DaemonSets automatically:

  • NVIDIA driver
  • NVIDIA Container Toolkit
  • NVIDIA Device Plugin
  • DCGM Exporter (Prometheus metrics)
  • Node Feature Discovery
  • GPU Feature Discovery (labels nodes with GPU properties)

Verify GPU access:

kubectl run gpu-test \
  --image=nvcr.io/nvidia/cuda:12.0-base \
  --restart=Never \
  --limits=nvidia.com/gpu=1 \
  -- nvidia-smi

kubectl logs gpu-test
kubectl delete pod gpu-test

Study tools

Mark this unit complete when you finish it.