NVIDIA-Nemotron-3.5-Bolt-74B-A9B-GGUF

Model overview

Atomic Dynamic (AD) quants, built from NVIDIA's original BF16 weights with our own importance matrix. At 21.9 GB, AD-IQ1_M_S stays closer to the original than NVIDIA's own 22.0 GB 2-bit file, measured side by side on one stand. The calibration corpora behind our builds are public. Every file here was measured against the BF16 original on the same stand as the other publishers' files. You can now run Nemotron 3.5 Bolt in Atomic Chat : 74B total parameters, 9B active per token. See our quantization analysis below for measurements and instructions. Lower is closer to the original. Each purple point is a file in this repo; the grey ones are other GGUF files of this model, downloaded and measured with exactly the same reference, text and llama.cpp build. NVIDIA's 2-bit file (the one Unsloth and LM Studio ship too) is a quantization-aware-trained checkpoint, so its distance to the BF16 weights also includes what that training changed; see below.

Key features

特点摘要待依据来源补齐，不凭模型名称推断能力。

Limitations & considerations

Sources are insufficient to establish specific limitations. Verify task performance, latency, data policies, licensing and version lifecycle.

Source prices & cost analysis

Prices vary by channel, region and configuration. Channel quotes are listed independently and are not treated as a single official provider price.

Public benchmarks & run configuration

暂无已采集的可核验公开评分。模型未上榜不代表能力较低。

Frequently asked questions

Sources & traceability

许可证：other。模型介绍与第三方评测均以原来源的具体版本和方法为准。