// AI news · 2026-10-30 · AWS Machine Learning Blog
Deploy NVIDIA Nemotron 3.5 Super VL on AWS EKS and SageMaker HyperPod EKS
NVIDIA Nemotron 3.5 Super VL, a 120B-parameter MoE model, is deployed on AWS EKS and SageMaker HyperPod EKS.
Published 2026-10-30 00:11 (Beijing time)Source AWS Machine Learning BlogAuto-summarised, fact-checked against source
01Summary
It supports multimodal inputs including text, image, document, and video with reasoning and tool use. The hybrid Mamba-2 and MoE architecture activates 12B parameters per token, enabling efficient long-context inference. Performance reaches 63.44% on Hermes Bench, 87.05% on LangChain agent tasks, and 80.8% on CharXiv chart reasoning. Deployment uses NVIDIA Dynamo and vLLM across standard EKS, EKS Auto Mode, and HyperPod EKS with GPU disaggregation and NCCL validation.
Summarised from the original article by an open-source model, then checked automatically: every number and English name must appear in the source. The original article is authoritative.
02Key points
- Nemotron 3.5 Super VL is a 120B MoE model activating 12B parameters per token for multimodal input.
- Uses hybrid Mamba-2 and MoE architecture with recursive MTP head for efficient long-context inference.
- Deployable on EKS, EKS Auto Mode, and SageMaker HyperPod EKS via NVIDIA Dynamo and vLLM.
- Achieves 63.44% on Hermes Bench, 87.05% on LangChain agent tasks, and 80.8% on CharXiv chart reasoning.
03Source
Accelerate agentic AI with NVIDIA Nemotron models on Amazon EKS and SageMaker HyperPod EKS
AWS Machine Learning Blog · published 2026-10-30 00:11 Beijing time
05Related news
- U.S. investigates Singapore exec for spying on China2026-10-30 · TechCrunch AI
- NVIDIA Enables Tensor Core Precision for ML Interatomic Potentials2026-10-29 · NVIDIA
- Trump Ignored Intel on Chinese Spy Targeting Nvidia CEO2026-10-30 · Ars Technica AI
- Hugging Face Launches Speech & Decision Models for Apple2026-10-29 · Hugging Face Blog
- AWS Enables Ray Train DLC Distributed Training on EKS2026-10-29 · AWS Machine Learning Blog
- RTX Spark Laptops Get New Models and Games2026-10-28 · NVIDIA Newsroom
From AIMap AI news: collected from 1,100+ official and media sources. Summaries only restate the original article; follow the link for the full story. All AI news · Today