NVIDIA Donates OpenShell to CNCF and Launches New DSX AI Factory Platform Components

What happened

At KubeCon + CloudNativeCon, NVIDIA announced a series of open source moves. First, it is contributing NVIDIA OpenShell, an open source runtime for securing and governing autonomous agents, to the Cloud Native Computing Foundation (CNCF) as a Sandbox project, to be governed by the organizations building it into their products. Second, NVIDIA is contributing to Agent Substrate, a Google-led framework, accepted into the CNCF Sandbox, for operating long-running agent workloads at scale on Kubernetes. In addition, NVIDIA announced three new open source components of its DSX AI Factory Platform: NVIDIA Kubernetes Engine (NVKE), NVIDIA Kubernetes Recipes (NVKR) and NVIDIA Snapshot.

Key details

• OpenShell applies deterministic controls to agent activity, letting teams enforce policies as agents use tools, access inference services and execute workloads; its extensible architecture supports plugging in an organization's own compute, inference providers, credential storage and monitoring tools. According to the announcement, hundreds of organizations have used OpenShell, which has received tens of thousands of contributions in under a year since launch.
• Agent Substrate preserves agent environments between tasks while releasing compute when agents are idle, suspending and resuming environments across a shared pool so teams can scale without dedicated compute per session. NVIDIA is ensuring it works with NVIDIA Dynamo for model inference and KAI Scheduler for shared cluster resource allocation; NVIDIA and Google are also collaborating on integrating OpenShell with Agent Substrate.
• NVKE and NVKR are now in public preview, automating cluster lifecycle management and providing signed, version-pinned images; Mirantis, Netris, OpenNebula Systems, Rafay, Spectro Cloud and vCluster, along with Firmus and SK Telecom, have aligned with NVIDIA on integration plans.
• NVIDIA Snapshot restores checkpointed replicas in seconds without model reload or warmup, addressing the delay of bringing additional inference capacity online. Design partners Crusoe and Saturn Cloud evaluated it on NVIDIA HGX B300 systems: Crusoe, testing GLM-5.3 on Crusoe Cloud, reduced workload-ready time from roughly eight minutes to 31 seconds; Saturn Cloud cut vLLM startup times from between two and 8.5 minutes to six and 34 seconds.

Why it matters

The announcement states that Kubernetes has become the foundation for AI, and that "the demands on it are only growing." These moves follow two threads. One is agent security and governance: with OpenShell entering the CNCF Sandbox, the community will "build, inspect and improve" it, and Linux Foundation CEO Jim Zemlin described giving agents secure environments as "a new infrastructure challenge" for the cloud-native community. The other is scale: NVKE, NVKR and Snapshot address running managed Kubernetes services on GPU infrastructure and scaling inference quickly for AI factories.

For the industry, the significance lies in bringing agent governance, inference acceleration and cluster management under open governance rather than tying them to a single vendor's closed products. The published benchmarks from Crusoe and Saturn Cloud also show that model loading and warmup delays — a real bottleneck for elastic inference scaling — have been substantially compressed.

Who it affects

• Cloud and infrastructure providers operating AI factories and delivering managed Kubernetes services on GPU infrastructure;
• Enterprise platform teams deploying agent workloads at scale who need unified governance across clouds and on-premises systems;
• Operators of inference services using frameworks such as vLLM who care about scale-out and recovery speed;
• Open source contributors and security practitioners in the cloud-native ecosystem, particularly potential participants in CNCF Sandbox projects.

Kubernetes, the open source system that manages how applications run across thousands of AI factories, has become the foundation for AI, and the demands on it are only growing.

To help meet them, NVIDIA is deepening its commitment to open source at KubeCon + CloudNativeCon, the flagship conference for the Kubernetes and cloud-native communities.

NVIDIA is contributing NVIDIA OpenShell, an open source runtime for securing and governing autonomous agents, to the Cloud Native Computing Foundation (CNCF), a nonprofit that is part of the Linux Foundation and the host of KubeCon. As a CNCF Sandbox project, OpenShell will be governed by the organizations building it into their products and strengthened by the expertise of security professionals worldwide.

NVIDIA is also contributing to Agent Substrate, an open source Google-led framework for operating long-running agent workloads at scale on Kubernetes that has been accepted into the CNCF Sandbox.

Additionally, NVIDIA announced new components of the NVIDIA DSX AI Factory Platform: NVIDIA Kubernetes Engine, NVIDIA Kubernetes Recipes and NVIDIA Snapshot. These tools help teams deploy, manage and scale GPU infrastructure on Kubernetes for AI factories.

Together, these advancements mark a step forward in making Kubernetes the leading foundation for AI workloads at scale — empowering developers to build safer, more efficient AI infrastructure for the future.

Securing AI Agents in the Open

NVIDIA’s contribution of OpenShell to CNCF puts security infrastructure for autonomous agents in the community’s hands to build, inspect and improve — accelerating development and hardening its safeguards.

“The cloud-native community has a new infrastructure challenge: giving agents secure environments in which to operate,” said Jim Zemlin, CEO of the Linux Foundation. “NVIDIA’s contribution of OpenShell to CNCF gives developers a shared foundation to build on and an opportunity to shape how agent security evolves. Bringing this work into the community enables broader collaboration on infrastructure that will be critical to the next generation of cloud-native applications.”

OpenShell gives organizations control over what AI agents can do. It applies deterministic controls to agent activity, so teams can enforce policies as agents use tools, access inference services and execute workloads. Its extensible architecture lets teams connect their own compute, inference providers, credential storage and monitoring tools. This allows organizations to apply governance across different deployment environments while integrating OpenShell with their existing enterprise systems.

Hundreds of organizations have put OpenShell to use, and the project has received tens of thousands of contributions in less than a year since launch.

Scaling Agent Execution on Kubernetes

Governing agents is only part of the challenge. Organizations also need to deploy them at scale.

NVIDIA is contributing to Agent Substrate, a Google-originated project in the CNCF Sandbox, and ensuring it works with NVIDIA Dynamo for model inference and KAI Scheduler for shared cluster resource allocation. This effort brings together agent execution, inference serving and resource scheduling on Kubernetes.

Agent Substrate preserves agent environments between tasks while releasing compute when agents are idle. By suspending and resuming those environments across a shared pool of agents, it lets teams scale agent workloads without keeping dedicated compute running for every session.

NVIDIA and Google are also collaborating on an integration of OpenShell and Agent Substrate, so enterprises can secure and govern agents across clouds and on-premises systems.

Building an Open Foundation for AI Factories

AI factories need to offer customers managed Kubernetes services while retaining control of their infrastructure, software and customer experience. Three new open source projects extend the DSX AI Factory Platform to make Kubernetes easier to run and inference faster to scale.

The NVIDIA DSX AI Factory Platform software stack, from GPU infrastructure and Kubernetes management to workload orchestration and model serving.

NVIDIA Kubernetes Engine (NVKE) and NVIDIA Kubernetes Recipes (NVKR) — now available in public preview — provide open source building blocks for delivering managed Kubernetes services on GPU infrastructure. They automate cluster lifecycle management and provide signed, version-pinned images.

NVKE and NVKR are launching with ecosystem support that extends their reach across AI infrastructure platforms and cloud services. Mirantis, Netris, OpenNebula Systems, Rafay, Spectro Cloud and vCluster, together with Firmus and SK Telecom, have aligned with NVIDIA on integration plans to bring NVKE and NVKR capabilities into their offerings.

NVIDIA Snapshot addresses the challenge of bringing additional inference capacity online quickly. Loading models and warming up workloads can delay scaling and recovery. The open source, modular component restores checkpointed replicas in seconds, without model reload or warmup, supporting faster startup, recovery and elasticity for inference and agentic workloads on Kubernetes.

Design partners Crusoe and Saturn Cloud have evaluated Snapshot on their own workloads using NVIDIA HGX B300 systems. Crusoe, an upstream contributor to Snapshot, tested GLM-5.3 on Crusoe Cloud and reduced the time for the workload to become ready from roughly eight minutes to 31 seconds. Saturn Cloud, a token factory platform, benchmarked Snapshot for scale-from-zero inference and reduced vLLM startup times from between two and 8.5 minutes to six and 34 seconds.

Learn more by joining NVIDIA at KubeCon.

The original belongs to NVIDIA Blog and its authors and is reproduced here for reading. To have it removed, write to support@aisa.one.