NVIDIA-Nemotron-3.5-Bolt-E4B-4GB-DFlash

The NVIDIA-Nemotron-3.5-Bolt-E4B-4GB-DFlash model is the GGUF (a binary model file format used by llama.cpp) version of NVIDIA-Nemotron-3.5-Bolt-E4B-BF16-DFlash, the DFlash speculative decoding draft checkpoint for NVIDIA-Nemotron-3.5-Bolt-E4B, a reasoning language model post-trained by NVIDIA from Google's Gemma 4 E4B IT. It is converted to GGUF in BF16 (bfloat16) for use with llama.cpp and must be loaded together with the GGUF version of the target model, Nemotron-3.5-Bolt-E4B-4GB. The draft model does not include token embeddings or an output head, and uses those of the target model at runtime. The model is intended for lower-latency local serving of NVIDIA-Nemotron-3.5-Bolt-E4B on workstation GPUs. Developers running NVIDIA-Nemotron-3.5-Bolt-E4B locally with llama.cpp for reasoning, chat, tool use, and agentic workflows that benefit from lower-latency speculative decoding on workstation GPUs. This release is intended for DFlash-assisted serving together with NVIDIA-Nemotron-3.5-Bolt-E4B-GGUF rather than as a standalone model checkpoint. **Architecture Type:** Transformer **Network Architecture:** Other - DFlash draft model (five Qwen3-style decoder layers) **Number of Model Parameters:** 360M (360,480,000), stored in BF16 in a single GGUF file of 736,812,096 bytes (736.81 MB / 702.68 MiB). The draft model shares the token embeddings and output head of the target model, so they are not included in this checkpoint.

译文尚未就绪，显示来源原文