AI正在发生 未来正在更新NVIDIA-Nemotron-3.5-Lightning-30B-A3B-Base-BF16
> *Looking for the post-trained model? See NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16 for the full-precision release, or NVIDIA-Nemotron-3.5-Lightning-30B-A3B-NVFP4 for optimized inference.* **NVIDIA-Nemotron-3.5-Lightning-30B-A3B-Base-BF16** is a large language model (LLM) trained by NVIDIA. This is the base (pre-trained) checkpoint of the Nemotron 3.5 Lightning family — no supervised fine-tuning, reinforcement learning, or distillation has been applied — making it the natural starting point for developers and researchers building their own post-trained models. The model employs a hybrid **Mixture-of-Experts (MoE)** architecture, utilizing interleaved Mamba-2 and MoE layers, along with select Attention layers. The model incorporates **Multi-Token Prediction (MTP)** layers — trained via a dedicated continued pre-training phase — for richer training signals and native speculative decoding, and it is pre-trained using an **NVFP4** recipe to maximize compute efficiency. The model has **3B active parameters** and **30B parameters in total**.
译文尚未就绪，显示来源原文
> *Looking for the post-trained model? See NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16 for the full-precision release, or NVIDIA-Nemotron-3.5-Lightning-30B-A3B-NVFP4 for optimized inference.* **NVIDIA-Nemotron-3.5-Lightning-30B-A3B-Base-BF16** is a large language model (LLM) trained by NVIDIA. This is the base (pre-trained) checkpoint of the Nemotron 3.5 Lightning family — no supervised fine-tuning, reinforcement learning, or distillation has been applied — making it the natural starting point for developers and researchers building their own post-trained models. The model employs a hybrid **Mixture-of-Experts (MoE)** architecture, utilizing interleaved Mamba-2 and MoE layers, along with select Attention layers. The model incorporates **Multi-Token Prediction (MTP)** layers — trained via a dedicated continued pre-training phase — for richer training signals and native speculative decoding, and it is pre-trained using an **NVFP4** recipe to maximize compute efficiency. The model has **3B active parameters** and **30B parameters in total**.