전체 검색

AI 모델 85003

• LFM2-2.6B-Exp-GGUF↗

  unsloth

• Qwen3.5-9B-GGUF-MoQ↗

  w-ahmad

  >MoQ (Mixture of Quants) is a smart way to shrink AI models without losing their "brainpower." Unlike old methods that treat every part of the model the same, MoQ identifies the most important parts and keeps them high-quality, while heavily compressing the rest to save space.****Stop settling for uniform bitrates.** Standard quantization is a relic of the past, treating vital cognitive weights the same as redundant noise. ** --- The result? A model that punches significantly above its weight class. Benjamin Marie evaluated MoQ GGUFs ("Mixture of Quants") against Unsloth Dynamic (UD) quants, focusing on low-bit versions below 4 bits on average — the range where GGUF models typically struggle most. Results: At similar bits-per-weight (Bpw), MoQ outperforms Unsloth Dynamic quants by ~10% on benchmarks, while also being roughly 2× more token-efficient on average. --- | Folder Link | BPW | Total Size | Description | | :--- | :---: | :---: | :--- | | 📂 **BF16** | **16** | **17.92 GB** | 📂 **F16** | **16** | **17.92 GB** | 📂 **MoQ-Quants-Latest** | **3.2** | **3.58 GB** | 📂 **MoQ-Quants-Latest** | **3.6** | **4.03 GB** | 📂 **MoQ-Quants-Latest** | **3.8** | **4.22 GB** | 📂 **MoQ-Quants-Latest** | **4.1** | **4.64 GB** | 📂 **MoQ-Quants-Latest** | **4.3** | **4.84 GB** | 📂 **MoQ-Quants-Latest** | **4.6** | **5.11 GB** | 📂 **MoQ-Quants-Latest** | **4.8** | **5.37 GB** | 📂 **MoQ-Quants-Latest** | **4.9** | **5.49 GB** | 📂 **MoQ-Quants-Latest** | **5.1** | **5.75 GB** | 📂 **MoQ-Quants-Latest** | **5.3** | **5.92 GB** | 📂 **MoQ-Quants-Latest** | **6.6** | **7.36 GB** | 📂 **MoQ-mmproj** | **16.0** | **0.92 GB**

• MiniMax-H3↗

  x-atm-x

• distilbert-base-uncased↗

  Xenova

• talkie-1930-13b-base-tf↗

  xlr8harder

• task-17-google-gemma-2b↗

  xueyj

• Qwen3.8-Flash-Next-Uncensored-TF-4bit-MTP↗

  yikoudazhong

• soro↗

  zaddyzaddy

• Llama-SEA-LION-v2-8B-IT↗

  aisingapore

• DataDecide-c4-300M↗

  allenai