Search FoxAI

AI Models 84759

• Llama-3.2-3B-bf16-GGUF↗

  MaziyarPanahi

• cvt-13-384-22k↗

  Microsoft

• VidTok↗

  Microsoft

• bert-base-personality↗

  Minej

• mnma_qwen3.8_27b_nvfp4↗

  minima-ai

• Meta-Llama-3.1-405B-4bit↗

  mlx-community

• MiMo-V2.6-Distill-Qwen-9B-OptiQ-4bit↗

  mlx-community

  > **Built with mlx-optiq**, the MLX-native toolkit to quantize, fine-tune, and serve LLMs locally on Apple Silicon, no PyTorch and no cloud. Try the Lab · All OptiQ quants · Docs A 4-bit mixed-precision MLX quant of XiaomiMiMo/MiMo-V2.6-Distill-Qwen-9B, a distillation of the Qwen3.5 9B architecture. Sensitive layers are kept at 8-bit and robust ones at 4-bit, rather than crushing everything to a uniform width. Honestly stated, because it differs from most OptiQ quants: **the per-layer allocation was not measured on this model.** It was transferred from mlx-community/Qwen3.5-9B-OptiQ-4bit, whose allocation came from a KL-divergence sensitivity pass over a six-domain calibration mix (prose, reasoning, code, agent, tool-call, instructions).

• MiniCPM5-2B-chat-mlx-16bit↗

  mlx-community

• borealis-12b-GGUF↗

  mradermacher

• cat-v1.0-13b-GGUF↗

  mradermacher