Nvidia AI Cluster Runtime (AICR) combines the distributed inference framework Dynamo and its Kubernetes dependencies with recipes whose component versions have been validated together. The process covers cluster-state capture, recipe generation, bundle rendering, deployment, and validation, backed by cryptographically signed validation evidence. Version 1.0 was released in early October 2026, followed by deployment guides for Amazon EKS with H100 and GB200-class GPUs. Dynamic Resource Allocation requires Kubernetes 1.34 or later, while AICR’s usefulness will depend on the range of cloud, accelerator, and model combinations Nvidia validates.
Source: Read the original article


