Nemotron-Labs-3-Puzzle-75B-A9B

A deployment-optimized open-weight model from NVIDIA, released July 6, 2026 — a compressed variant of Nemotron-3-Super-120B-A12B produced with "Iterative Puzzle", a post-training compression framework that jointly prunes MoE experts, active-parameter budget, and Mamba state to boost inference efficiency while preserving accuracy. Reduces the parent from 120.7B total / 12.8B active to 75.3B total / 9.3B active, keeping the hybrid Mamba-Transformer LatentMoE architecture with Multi-Token Prediction. Delivers ~2x higher server throughput than Nemotron-3-Super on a single 8xB200 node at matched user throughput and raises sustainable 1M-token single-H100 concurrency from 1 to 8 requests. Targets collaborative agents, chatbots, RAG, complex instruction-following, and long-context reasoning across English, code, and six other languages. Shipped in BF16, FP8, and NVFP4 variants under the OpenMDW-1.1 license.