전체 검색
AI 모델 84761
- aimv2-large-patch14-448↗
apple
- Trinity-Large-Thinking-GGUF↗
arcee-ai
- Qwen3.5-9B-abliterated↗
asdasdsss124
- NVIDIA-Nemotron-3.5-Bolt-74B-A9B-GGUF↗
AtomicChat
Atomic Dynamic (AD) quants, built from NVIDIA's original BF16 weights with our own importance matrix. At 21.9 GB, AD-IQ1_M_S stays closer to the original than NVIDIA's own 22.0 GB 2-bit file, measured side by side on one stand. The calibration corpora behind our builds are public. Every file here was measured against the BF16 original on the same stand as the other publishers' files. You can now run Nemotron 3.5 Bolt in Atomic Chat : 74B total parameters, 9B active per token. See our quantization analysis below for measurements and instructions. Lower is closer to the original. Each purple point is a file in this repo; the grey ones are other GGUF files of this model, downloaded and measured with exactly the same reference, text and llama.cpp build. NVIDIA's 2-bit file (the one Unsloth and LM Studio ship too) is a quantization-aware-trained checkpoint, so its distance to the BF16 weights also includes what that training changed; see below.
- Psyonic-Cetacean-V1-20B-Ultra-Quality-GGUF↗
backyardai
- andrewzh_Absolute_Zero_Reasoner-Coder-7b-GGUF↗
bartowski
- Goekdeniz-Guelmez_Josiefied-Qwen3-14B-abliterated-v3-GGUF↗
bartowski
Some of these quants (Q3_K_XL, Q4_K_L etc) are the standard quantization method with the embeddings and output weights quantized to Q8_0 instead of what they would normally default to. If the model is bigger than 50GB, it will have been split into multiple files. In order to download them all to a local folder, run: You can either specify a new local-dir (Goekdeniz-Guelmez_Josiefied-Qwen3-14B-abliterated-v3-Q8_0) or download them all in place (./)
- OpenCoder-8B-Instruct-GGUF↗
bartowski
- QwQ-32B-Preview-GGUF↗
bartowski
Some of these quants (Q3_K_XL, Q4_K_L etc) are the standard quantization method with the embeddings and output weights quantized to Q8_0 instead of what they would normally default to. If the model is bigger than 50GB, it will have been split into multiple files. In order to download them all to a local folder, run: Click to view Q4_0_X_X information These are *NOT* for Metal (Apple) or GPU (nvidia/AMD/intel) offloading, only ARM chips (and certain AVX2/AVX512 CPUs).
- SUFE-AIFLM-Lab_Fin-R1-GGUF↗
bartowski
Some of these quants (Q3_K_XL, Q4_K_L etc) are the standard quantization method with the embeddings and output weights quantized to Q8_0 instead of what they would normally default to. If the model is bigger than 50GB, it will have been split into multiple files. In order to download them all to a local folder, run: You can either specify a new local-dir (SUFE-AIFLM-Lab_Fin-R1-Q8_0) or download them all in place (./)
