全站搜索

AI 模型 85003

• MiMo-V2.6-Distill-Qwen-9B-OptiQ-4bit↗

  mlx-community

  > **Built with mlx-optiq**, the MLX-native toolkit to quantize, fine-tune, and serve LLMs locally on Apple Silicon, no PyTorch and no cloud. Try the Lab · All OptiQ quants · Docs A 4-bit mixed-precision MLX quant of XiaomiMiMo/MiMo-V2.6-Distill-Qwen-9B, a distillation of the Qwen3.5 9B architecture. Sensitive layers are kept at 8-bit and robust ones at 4-bit, rather than crushing everything to a uniform width. Honestly stated, because it differs from most OptiQ quants: **the per-layer allocation was not measured on this model.** It was transferred from mlx-community/Qwen3.5-9B-OptiQ-4bit, whose allocation came from a KL-divergence sensitivity pass over a six-domain calibration mix (prose, reasoning, code, agent, tool-call, instructions).

• MiniCPM5-2B-chat-mlx-16bit↗

  mlx-community

• borealis-12b-GGUF↗

  mradermacher

• cat-v1.0-13b-GGUF↗

  mradermacher

• Chocolatine-14B-Instruct-DPO-v1.1-GGUF↗

  mradermacher

• CodeLlama-7b-hf-GGUF↗

  mradermacher

• Cydonia-v4.1-MS3.2-Magnum-Diamond-24B-i1-GGUF↗

  mradermacher

• D_AU-Orac-13B-Tiefighter-slerp-GGUF↗

  mradermacher

• deepseek-uncensored-lore-GGUF↗

  mradermacher

• DeutschGPT-i1-GGUF↗

  mradermacher