NVIDIA Unveils Nemotron 3 Nano Omni Open-Source Multimodal Model
AI agents currently tend to call separate vision, speech and language models. Transferring data between them adds latency and can result in lost context. NVIDIA has integrated video, audio, image, text and document understanding into a single open model aimed at applications including computer control, customer service and monitoring. The launch has implications for enterprise deployment costs and competition within the AI software ecosystem.
NVIDIA released Nemotron 3 Nano Omni on April 28, 2026. The model uses a 30B-A3B mixture-of-experts architecture, with 30 billion total parameters and about 3 billion activated during inference, and supports a 256K context window. NVIDIA says it can deliver up to nine times the throughput of comparable open models. Seven companies, including Foxconn Technology Group and Palantir, have already adopted it.
All Coverage
4 original reportsThe Backstory
The history behind this eventNVIDIA Launches Cosmos 3 and Nemotron 3 Ultra to Advance Open-Source Physical AI Ecosystem
Physical AI systems must enable robots, autonomous vehicles and visual agents to understand their surroundings and take action, but development has long been constrained by limited real-world training data and fragmented simulation tools. NVIDIA is making the weights, data and training recipes for its world models and agentic reasoning models openly available, seeking to lower development barriers and bring GPUs, DGX Cloud and software tools into a shared ecosystem.
NVIDIA unveiled Cosmos 3 at GTC Taipei on May 31, 2026, with native integration of text, images, video, ambient sound and actions. It also formed the Cosmos Coalition with companies including Runway. On June 4, NVIDIA released Nemotron 3 Ultra, which has 550 billion total parameters and 55 billion active parameters. The model delivers up to five times the inference throughput and can reduce agentic-task costs by as much as 30%.
Subscribe to Mark Radar Weekly
Every Friday, the week's strongest signals in your inbox. Unsubscribe anytime.
If you search news on Google, you can set Mark Radar as a preferred source—our coverage will show up more often in your results. Set as preferred source on Google →