AIsaAIsaStudio English 打开 AIsa Studio

NVIDIA 在 GTC Berlin 公布本地 AI 硬件与软件多项更新,覆盖 RTX Spark、DGX Spark 和 DGX Station

原标题:Bringing the Spark to Europe: Local Intelligence Powers Next Wave of Agents

NVIDIA 在 GTC Berlin 展示本地 AI 硬件全线:RTX Spark 于 10 月 16 日上市,面向 Windows PC 个人智能体,最高 128GB 统一内存和 1 petaflop AI 算力;DGX Spark 64GB 于 10 月 23 日开售,支持最多八机集群共 1TB 统一内存;DGX Station 提供 748GB 一致性内存和 20 petaflops 性能,Windows 版预计 12 月推出。同步发布 Recursive Superintelligence 的本地编码模型 Recursive Flint(40B 参数 MoE、2.5B 激活参数),以 Apache 2.0 许可开放权重;并为 Nemotron、GLM、DeepSeek、Qwen、MiniMax、FLUX.3 等模型提供 day-zero 支持,同时优化 llama.cpp 和 …

为什么值得看

官方汇总了 RTX Spark、DGX Spark 与 DGX Station 在欧洲的一批发布与软件更新细节,方便读者按需选择本地 AI 硬件方案。

阅读原文 ↗10月22日 AI 日报

本页的摘要、推荐理由与解读出自 AIsa Studio 的 AI 风向智能体,原文版权归原作者所有。

深度解读

发生了什么

NVIDIA 在 GTC Berlin 上集中公布了本地 AI 硬件与软件的多项更新,覆盖三条产品线:面向 Windows PC 个人的 RTX Spark、面向 Linux 开发者的 DGX Spark,以及面向企业团队的 DGX Station(Windows 版将于 12 月推出)。RTX Spark 于 10 月 16 日发布,据称可支持个人代理、加速内容创作和 1440p 100 帧游戏,具备最高 128GB 统一内存和 1 petaflop AI 算力。

会上演示了在 RTX Spark 上运行的 AI 代理,用于训练 Hugging Face 的 Microduck 机器人,使用 NVIDIA Isaac Lab、Hermes Agent 和 Nemotron 3.5 Bolt 74B。ASUS、Dell、HP、Lenovo、Microsoft、MSI 的笔记本现已上市,Acer 即将推出。

关键细节

更新可按产品线归纳:

  • DGX Spark:64GB 版本于 10 月 23 日开始从合作伙伴出货;NVIDIA Sync 支持最多 8 台 DGX Spark 组成集群(手动配置),合计 1TB 统一内存,可运行 GLM 5.3 等前沿级模型;Model Launcher 本月晚些时候上线,简化单机或集群上的本地模型部署;10 月软件更新加入 Wi-Fi Assistant 并更新 DGX Spark Skills。
  • DGX Station:提供 748GB 一致性内存和最高 20 petaflops AI 性能,可服务 30+ 用户;新增与 Absolute Security、Splunk、Microsoft Intune、Tanium 等 7 家的企业管理集成;NVIDIA Cloud Functions 将以早期访问形式登陆 Linux 版 DGX Station;发布三个面向机器人的开源参考工作流,覆盖 Isaac Lab、Cosmos 世界模型后训练等用途;GTC 现场还预览了在 DGX Station 上运行 DSX OS 以模拟 AI 工厂运营。
  • 模型生态:Recursive Superintelligence 发布本地编码模型 Recursive Flint,为 400 亿参数 MoE、激活参数 25 亿,权重以 Apache 2.0 许可在 Hugging Face 开放;其 Eureka Machine 自动化研究流程在不改动模型权重的情况下,将 Flint 在 RTX Spark 上的生成速度提升 55%。NVIDIA 同时为 Nemotron、GLM、DeepSeek、Qwen、MiniMax、FLUX.3 等新模型提供 Day-0 支持,并发布了针对本地硬件优化的量化检查点集合(如 Qwen3.8-Flash-Next-FP4-Local)。
  • 推理加速:llama.cpp 中为 Qwen 3.8 Flash Next 加入带 MTP 的投机解码,在 RTX PRO 6000 Blackwell 上将端到端代理任务最高提速 1.4 倍;vLLM 方面,Qwen3.8 27B 在 DGX Spark 上最高提速 1.3 倍,GLM 5.3 Flash 在 DGX Station 上吞吐最高提升 1.2 倍。

为什么重要

这批发布的核心指向是「本地智能」——把代理式 AI 的运行从云端下沉到桌面和单机。DGX Spark 八机集群拼出 1TB 统一内存,意味着小型团队无需云资源也能运行前沿级开源模型;DGX Station 通过企业管理集成,把本地推理服务纳入企业合规与部署流程,并可通过 NVIDIA Cloud Functions 提供一个 OpenAI 兼容的共享模型端点。

模型侧的信号同样明确:Recursive Flint 由自动化研究系统 Eureka Machine 构建,展示了自动化 AI 研究流程对推理性能的直接优化路径;量化检查点、投机解码和内核优化则共同降低本地运行大模型与代理工作负载的门槛。

对谁有影响

  • 个人开发者和创作者:RTX Spark 笔记本支持完全本地、数据不出设备的个人代理(如 Underdog),且多款机型提供解锁的 bootloader,便于定制。
  • 小型开发团队:DGX Spark 集群可作为共享后端,多名开发者对同一模型并发会话。
  • 企业 IT 与工程团队:DGX Station Windows 版将支持 nTop、Dassault Systèmes、Siemens、MathWorks 等制造业软件,并可在本地运行 Hermes Agent、Perplexity 或 Aible 的代理。
  • 机器人团队:三个开源参考工作流让 DGX Station 承担后训练、仿真与评估,缩短迭代周期。
全文翻译

以下翻译只覆盖原文的前一部分,其余内容请看下方原文。

在柏林 GTC 大会上,英伟达展示了其完整的本地 AI 硬件产品线。RTX Spark(于上周发布)为 Windows PC 上的个人智能体提供动力;DGX Spark 支持在 Linux 上构建和扩展应用程序的开发者;而 DGX Station 则服务于在 Linux 上运行前沿工作负载的企业团队,Windows 版本将于 12 月推出。

公告内容包括:

  • Underdog Desktop Agent 现已适用于 RTX Spark
  • DGX Spark 64GB 版本将于 10 月 23 日(星期五)上市
  • NVIDIA Sync 本月将支持八个 DGX Spark 并新增 Model Launcher
  • 10 月 DGX Spark 软件更新增加了 Wi-Fi Assistant 并更新了 DGX Spark Skills
  • DGX Station 通过七项新集成提升了可管理性
  • 面向 Windows 的 DGX Station 将于 12 月推出,支持众多制造类应用和智能体框架
  • DGX Station 上推出三项用于机器人的全新开源参考工作流
  • NVIDIA Cloud Functions 即将以早期访问形式登陆 DGX Station
  • 全新的本地编码模型 Recursive Flint 现已适用于 NVIDIA 本地硬件
  • 新增 Nemotron、GLM、DeepSeek、Qwen、MiniMax 和 FLUX.3 AI 模型的 Day-0 支持
  • 针对 llama.cpp 和 vLLM 推理引擎的新加速功能,以及一组专为本地 AI 硬件优化的检查点集合。

请在下方了解更多关于这些本地 AI 的公告详情,并查看 GTC Berlin 的演示和会议。

RTX Spark 将个人智能体带入 Windows PC

RTX Spark 是 PC 的新起点——凭借高达 128GB 的统一内存和 1 petaflop 的 AI 算力,它可运行个人智能体、加速内容创作,并实现 1440p 分辨率下每秒 100 帧的游戏体验。

自 10 月 16 日发布以来,早期评论家对平台的评价如下:

“对于严肃的内容创作者来说是一台梦想中的机器……” — CGMag

“为 AI 的未来而设计……” — The Verge

“一台能力极强、令人惊讶地便携且高效的机器……” — PCMag

Underdog 是一款专为完全本地化、私密 AI 构建的新型桌面智能体应用,也将把其体验带给 RTX Spark。依托其专用的 Husky 模型推理引擎,Underdog 完全在设备端运行模型,因此个人智能体可以在用户数据永不离开 PC 的情况下完成工作。Underdog 现已开放下载。

为了更好地赋能开发者和爱好者构建和定制本地智能体,许多 RTX Spark 笔记本电脑配备了解锁的引导加载程序(bootloader)。

在 GTC 主题演讲期间,英伟达创始人兼首席执行官黄仁勋展示了如何在 RTX Spark 上运行的 AI 智能体利用 NVIDIA Isaac Lab、Hermes Agent 和 Nemotron 3.5 Bolt 74B 来训练 Hugging Face 的 Microduck 机器人。

ASUS、Dell Technologies、HP、Lenovo、Microsoft 和 MSI 的笔记本电脑今日即可购买,Acer 的产品也即将上市。

了解更多关于 RTX Spark 的信息,并开始使用最新的 RTX Spark 操作指南。

DGX Spark 为开发者提供构建空间

新的 DGX Spark 64GB 系统——能够运行包括 Nemotron 3.5 Bolt 74B 24GB、Qwen3.8 27B 和 Gemma 4 26B-A4B 在内的模型——将于 10 月 23 日(星期五)起由合作伙伴开始出货。

当工作负载需要更多容量时,开发者可以通过内置的 NVIDIA ConnectX-7 网络和 NVIDIA Sync Cluster Assistant 连接多个 DGX Spark 系统。这允许用户运行高级编码模型,如 Qwen 3.8 Flash Next、DeepSeek v4 Flash 0731 和 GLM 5.3 Flash。

现在,DGX Spark 支持手动配置最多八个单元组成的集群,从而支持更大的模型、更长的上下文、并发智能体和分布式开发。这对于共享单个集群作为后端的小型团队非常理想,每个开发者都可以针对同一模型运行并发会话,它提供了 1TB 的统一内存——足以运行像 GLM 5.3 这样的前沿级模型。

从 DGX Spark 集群操作指南 开始上手。

NVIDIA Sync Model Launcher 也将在本月晚些时候可用。它简化了在单个 DGX Spark 或集群上访问本地 AI 的过程。只需几次点击,Model Launcher 就会下载适合配置的模型和容器,并将模型连接到 OpenCode。它会自动加载 DGX Spark Skills,用于故障排除、设备维护、官方文档访问以及其他工作流指导。

10 月 DGX Spark 软件更新带来了一款新的 Wi-Fi Assistant,允许用户在 DGX Spark 以设备模式运行时切换网络。此外,DGX Spark Skills 通过 OpenCode 直接在 NVIDIA Sync 中提供针对工作流的故障排除和设备维护指导。

DGX Spark 系统可直接从 Acer、ASUS、Dell Technologies、GIGABYTE、HP、Lenovo、MSI 和 NVIDIA 处购买。

DGX Station 将前沿智能置于办公桌前

对于较大的团队,DGX Station 提供 748GB 的一致内存和高达 20 petaflops 的 AI 性能,使开发者能够运行像 GLM 5.3 这样的高级模型,并以与云模型相当的速度服务 30 多名用户。为了增加规模,NVIDIA Sync 现在支持 DGX Station,简化了两个基于 Linux 的系统之间的连接。

与 Absolute Security、Cisco 旗下的 Splunk、Fleet Device Management、Microsoft Intune、Perforce Puppet、Progress Software Chef 和 Tanium 的新集成,让 IT 团队能够通过企业设置、管理和合规流程管理 DGX Station 系统,帮助加快审批速度并降低部署风险,同时最小化首个 token 生成的时间。

随着即将推出的基于 Windows 的系统,开发者可以构建利用专业应用程序的工作流,这些应用程序在 NVIDIA RTX PRO GPU 上运行,并由在 NVIDIA GB300 系统上运行其大型语言模型 (LLM) 的智能体驱动——所有这些都在一台机器中完成。

面向 Windows 的 DGX Station 预计将于 12 月由系统制造商合作伙伴推出,将本地 AI 扩展到企业已经使用的应用程序和操作系统环境中。工程师可以在 Windows 原生软件中运行本地模型和智能体,并在同一系统上访问 AI 模型、工具和智能体。

面向 Windows 的 DGX Station 将支持来自 nTop、Dassault Systèmes、Keysight Technologies、MathWorks、Rockwell Automation、Siemens、Synopsys、Unity 和 Altera 的制造类应用,用于 AI 辅助的设计、仿真、验证和工程自动化。用户可以在企业内部使用 Hermes Agent、Perplexity 或 Aible 运行智能体,以实现企业环境中的智能体控制。

这种相同的本地、受控计算模式也延伸至机器人领域。DGX Station 为机器人团队提供专门的后训练、仿真和评估计算资源,缩短迭代周期,无需等待共享基础设施。

NVIDIA 发布了三项开源参考工作流,将 GPT-6 Astra、NVIDIA Isaac Lab、Isaac Lab-Arena 和 Cosmos 引入 NVIDIA DGX Station。开发者可以使用它们通过强化学习优化 GR00T 1.7 模型,训练灵巧操作技能,并对 Cosmos 世界模型进行后训练以生成合成数据。

NVIDIA Cloud Functions 即将以早期访问形式登陆基于 Linux 的 DGX Station。团队可以在共享目录中注册本地模型端点,并通过一个兼容 OpenAI 的入口点进行访问。

开发者可以在不更改应用程序代码的情况下升级端点背后的模型,而团队成员可以直接使用共享模型而无需直接访问机器。这将 DGX Station 转变为团队本地控制的推理服务。

DGX Station 将本地迭代带入 AI 工厂开发。在 GTC Berlin 的展台上,NVIDIA 正在预览在 DGX Station 上运行的 DSX OS,以便在全基础设施可用之前模拟 AI 工厂运营。另一个演示将展示 DGX Station 系统为超过 30 名软件开发人员提供本地 token 工厂的动力。

DGX Station 系统今日已从 ASUS、Dell Technologies、GIGABYTE、HP、MSI、Supermicro 和 Exxact 开始发货。面向 Windows 的 DGX Station 系统预计将于今年晚些时候由 ASUS、Dell Technologies、GIGABYTE、HP、MSI 和 Supermicro 开始发货。

介绍 Recursive Flint —— 一款专为 RTX Spark 优化的全新本地编码模型

今天,前沿 AI 实验室 Recursive Superintelligence 发布了 Recursive Flint,这是一款专为快速、准确编码而构建的本地 LLM。这是一个拥有 400 亿参数、其中 25 亿为活跃参数的混合专家 (MoE) 模型,Recursive Flint 实现了快速推理,并在 SWE-Bench Pro v2、Terminal-Bench 2.1 和 SWE-bench verified 等智能体编码基准测试中表现优异。

Recursive Flint 是使用 Recursive 的 Eureka Machine 构建的,这是一个用于大规模自动化 AI 研究的系统。它自动化了整个研究循环:提出想法、实施想法、运行实验以验证想法,并利用结果决定下一步尝试什么——创建了专用内核,在不改变模型权重的情况下,将 Flint 在 RTX Spark 上的生成速度提高了 55%。

开发者可以在 Hugging Face 上以 Apache 2.0 许可证下载开放权重,并在 RTX Spark 和 DGX Spark 系统以及 GeForce RTX 和 RTX PRO GPU 上运行该模型。开发者还可以使用 NeMo Automodel 对模型进行监督微调 (SFT) 和低秩适应 (LoRA),或使用 NeMo RL 进行组相对策略优化 (GRPO)。

具有 Day-Zero 支持的新模型

英伟达还添加了 day-zero

查看原文

At GTC Berlin, NVIDIA is showcasing its full lineup of local AI hardware. RTX Spark, which launched last week, powers personal agents on Windows PCs; DGX Spark supports developers building and scaling applications on Linux; and DGX Station serves enterprise teams running frontier workloads on Linux, with a Windows version arriving in December.

Announcements include:

  • Underdog Desktop Agent now available for RTX Spark
  • DGX Spark 64GB available on Friday, Oct. 23
  • NVIDIA Sync to support eight DGX Sparks and add Model Launcher this month
  • October DGX Spark software update adds Wi-Fi Assistant and updates DGX Spark Skills
  • DGX Station improves manageability with seven new integrations
  • DGX Station for Windows launches in December with support for many manufacturing apps and agent harnesses
  • Three new open source reference workflows for robotics on DGX Station
  • NVIDIA Cloud Functions is coming in early access to DGX Station
  • Recursive Flint, a new local coding model, is now available for NVIDIA local hardware
  • Day-0 support for new Nemotron, GLM, DeepSeek, Qwen, MiniMax and FLUX.3 AI models
  • New accelerations for llama.cpp and vLLM inference engines and a new collection of checkpoints optimized for local AI hardware.

Learn more about these local AI announcements below, and check out the demos and sessions at GTC Berlin.

RTX Spark Brings Personal Agents to the Windows PC

RTX Spark is a new beginning for the PC — running personal agents, accelerated content creation and 1440p 100 frames-per-second gaming with up to 128GB of unified memory and 1 petaflop of AI compute.

Here’s what early reviewers are saying about the platform since its October 16 release:

“A dream machine for serious creators … ” — CGMag

“Designed for the future of AI … ” — The Verge

“An extremely capable, surprisingly portable and efficient machine … ” — PCMag

Underdog, a new desktop agent app built for fully local, private AI, is also bringing its experience to RTX Spark. Powered by its Husky model-specific inference engine, Underdog runs models entirely on device, so personal agents can get work done without user data ever leaving the PC. Underdog is available now for download.

To better enable developers and enthusiasts to build and customize local agents, many RTX Spark laptops come with an unlocked bootloader.

During the GTC keynote, NVIDIA founder and CEO Jensen Huang showed off how AI agents running on RTX Spark can be used to train Hugging Face’s Microduck robot using NVIDIA Isaac Lab, Hermes Agent and Nemotron 3.5 Bolt 74B.

ASUS, Dell Technologies, HP, Lenovo, Microsoft and MSI laptops are available today, with Acer coming soon.

Learn more about RTX Spark, and get started with the latest RTX Spark playbooks.

DGX Spark Gives Developers Room to Build

New DGX Spark 64GB systems — that can run models including Nemotron 3.5 Bolt 74B 24GB, Qwen3.8 27B and Gemma 4 26B-A4B — start rolling out from partners on Friday, Oct. 23.

When workloads require more capacity, developers can connect multiple DGX Spark systems via built-in NVIDIA ConnectX-7 networking and NVIDIA Sync Cluster Assistant. This allows users to run advanced coding models like Qwen 3.8 Flash Next, DeepSeek v4 Flash 0731 and GLM 5.3 Flash.

Now, DGX Spark supports clusters of up to eight units in manual configuration, enabling larger models, longer contexts, concurrent agents and distributed development. Ideal for small teams sharing a single cluster as a backend, with each developer running concurrent sessions against the same model, it delivers 1TB of unified memory — enough to run frontier-class models like GLM 5.3.

Get started with the DGX Spark cluster playbook.

NVIDIA Sync Model Launcher will also be available later this month. It simplifies access to local AI on a single DGX Spark or a cluster. With a few clicks, Model Launcher downloads a model and container suited to the configuration and connects the model to OpenCode. It automatically loads DGX Spark Skills for troubleshooting, device maintenance, access to official documentation and other workflow guidance.

The October DGX Spark software update brings a new Wi-Fi Assistant that lets users switch networks when DGX Spark is running in appliance mode. Plus, DGX Spark Skills provide workflow-focused guidance in troubleshooting and device maintenance directly into NVIDIA Sync via OpenCode.

DGX Spark systems are available directly from Acer, ASUS, Dell Technologies, GIGABYTE, HP, Lenovo, MSI and NVIDIA.

DGX Station Puts Frontier Intelligence at the Desk

For larger teams, DGX Station offers 748GB of coherent memory and up to 20 petaflops of AI performance, enabling developers to run advanced models like GLM 5.3 and serve 30+ users at speeds comparable to those provided by cloud models. Adding scale, NVIDIA Sync now supports DGX Station, simplifying connections between two Linux-based systems.

New integrations with Absolute Security, Splunk by Cisco, Fleet Device Management, Microsoft Intune, Perforce Puppet, Progress Software Chef and Tanium let IT teams manage DGX Station systems through enterprise setup, management and conformity processes, helping accelerate approvals and reduce deployment risk while minimizing time to first token.

With the upcoming Windows-based systems, developers can build workflows that harness professional applications, run on NVIDIA RTX PRO GPUs and operate from agents that run their large language models (LLMs) on NVIDIA GB300 systems — all in one machine.

DGX Station for Windows, expected from system manufacturer partners in December, extends local AI into the applications and operating environment enterprises already use. Engineers can run local models and agents in Windows-native software with access to AI models, tools and agents on the same system.

DGX Station for Windows will feature support for manufacturing applications from nTop, Dassault Systèmes, Keysight Technologies, MathWorks, Rockwell Automation, Siemens, Synopsys, Unity and Altera for AI-guided design, simulation, validation and engineering automation. Users will be able to run agents using Hermes Agent, Perplexity or Aible on premises for agentic control in enterprise environments.

The same local, controlled computing model extends to robotics. DGX Station gives robotics teams dedicated compute for post-training, simulation and evaluation, shortening iteration cycles without waiting for shared infrastructure.

NVIDIA released three open source reference workflows that bring GPT-6 Astra, NVIDIA Isaac Lab, Isaac Lab-Arena and Cosmos to NVIDIA DGX Station. Developers can use them to refine GR00T 1.7 models with reinforcement learning, train dexterous manipulation skills and post-train Cosmos world models for synthetic data generation.

NVIDIA Cloud Functions is coming in early access to Linux-based DGX Station. Teams can register local model endpoints in a shared catalog and access them through one OpenAI-compatible entry point.

Developers can upgrade the model behind an endpoint without changing application code, while teammates can use shared models without direct machine access. This turns a DGX Station into a locally controlled inference service for a team.

DGX Station brings local iteration to AI factory development. On the show floor at GTC Berlin, NVIDIA is previewing DSX OS running on DGX Station to simulate AI factory operations before full infrastructure is available. Another demo will showcase DGX Station systems powering a local token factory for more than 30 software developers.

DGX Station systems are shipping today from ASUS, Dell Technologies, GIGABYTE, HP, MSI, Supermicro and Exxact. DGX Station for Windows systems are expected to begin shipping later this year from ASUS, Dell Technologies, GIGABYTE, HP, MSI and Supermicro.

Introducing Recursive Flint — A New Local Coding Model Optimized for RTX Spark

Today, frontier AI lab Recursive Superintelligence released Recursive Flint, a local LLM built for fast, accurate coding. A 40-billion-parameter mixture-of-experts model with 2.5 billion active parameters, Recursive Flint delivers fast inference and performs well in agentic coding benchmarks like SWE-Bench Pro v2, Terminal-Bench 2.1 and SWE-bench verified.

Recursive Flint was built using Recursive’s Eureka Machine, a system for large-scale automated AI research. It automates the full research loop: proposes ideas, implements them, runs experiments to validate ideas and uses the results to decide what to try next — creating specialized kernels that boosted Flint’s generation speed on RTX Spark by 55% without changing the model’s weights.

Developers can download the open weights on Hugging Face under the Apache 2.0 license and run the model on RTX Spark and DGX Spark systems, as well as GeForce RTX and RTX PRO GPUs. Developers can also post-train the model with NeMo Automodel for supervised fine-tuning and low-rank adaptation, or LoRa, as well as NeMo RL for group relative policy optimization.

New Models With Day-Zero Support

NVIDIA is also adding day-zero model support for NVIDIA Nemotron Bolt E4B 4B, GLM, DeepSeek, Qwen, MiniMax, Liquid AI’s LFM2.5-24B-A2B, plus the FLUX.3 Klein diffusion model.

Nemotron Bolt E4B 4GB packs natural conversation and multi-turn agentic skills into as little as 4GB of memory, powering fast local voice assistants, interactive game characters and embedded interfaces on NVIDIA GeForce RTX GPUs, NVIDIA Jetson devices, and RTX and DGX Spark. Bolt E4B 4GB releases on Friday, Oct. 23.

Black Forest Labs’ FLUX 3 Image Klein is a 5.6-billion-parameter open weights image model for generation and editing. NVIDIA-optimized builds let it run on GeForce RTX GPUs with as little as 8GB of VRAM and create a 1-megapixel image in about four seconds on an RTX 5090 GPU.

MiniMax M3.1 Flash is a new open model built for NVIDIA DGX Station and DGX Spark, bringing long-context AI to the desktop. Liquid AI’s LFM2.5-24B-A2B is an open weights reasoning model that activates just 2 billion of its 24 billion parameters per token, making it fast enough to run private, tool-calling AI agents directly on PCs.

Plus, NVIDIA has released a new collection of model checkpoints optimized for RAM efficiency on local AI hardware, enabling frontier-class open models to run with sufficient memory left over for KV cache. Each checkpoint is quantized while staying close to full-precision accuracy, starting with Qwen3.8-Flash-Next-FP4-Local on a single DGX Spark 128GB or RTX PRO 6000 and GLM-5.3-Flash-FP4-Local on two systems.

Developers can post-train on day zero with NeMo AutoModel on both DGX Spark and RTX Spark, with example recipes for Nemotron Bolt E4B, Flux 3 Image Klein and more.

Accelerated AI Inference

NVIDIA continues to work with the llama.cpp and vLLM open source communities to accelerate agentic workloads on local hardware.

In llama.cpp, new speculative decoding support with MTP for Qwen 3.8 Flash Next makes end-to-end agentic tasks up to 1.4x faster on NVIDIA RTX PRO 6000 Blackwell.

In vLLM, faster speculative decoding and new FlashInfer prefill kernels for Qwen’s linear-attention layers make agentic tasks with Qwen3.8 27B up to 1.3x faster on DGX Spark. On DGX Station, GLM 5.3 Flash gets up to 1.2x higher throughput.

Check out NVIDIA’s local AI inference recipes to try these latest optimizations.

Follow NVIDIA RTX Spark on X, Instagram, TikTok and Facebook — and stay informed by subscribing to the NVIDIA Local AI newsletter. Follow NVIDIA Workstation on LinkedIn and X.

See notice regarding software product information.

原文版权归 NVIDIA Blog 及原作者所有,本站转载仅供阅读。如需删除,请联系 support@aisa.one。