サイト内検索
AI モデル 84767
- minerva-chat-v0.1-alpha-sft↗
mii-llm
- gemma-4-12B-it-qat-OptiQ-4bit↗
mlx-community
> **Built with mlx-optiq**, the MLX-native toolkit to quantize, fine-tune, and serve LLMs locally on Apple Silicon, no PyTorch and no cloud. Try the Lab · All OptiQ quants · Docs A 4-bit mixed-precision MLX quant produced by mlx-optiq, built on Google's quantization-aware-trained (QAT) Gemma-4 base. OptiQ's sensitivity-guided per-layer bit allocation is applied on top of weights that were trained to survive low-bit quantization, and it still beats a uniform 4-bit quant of the same QAT base by +1.37 Capability Score points. This is a quant of google/gemma-4-12B-it-qat-q4_0-unquantized. Per-layer bit-widths come from a KL-divergence sensitivity pass on a six-domain calibration mix (prose, reasoning, code, agent, tool-call, constraint-bearing instructions). Sensitive layers go to 8-bit, robust ones stay at 4-bit.
- mlx-qwen3-asr-1.7b-8bit↗
moona3k
- CodeReasoner-7b-GGUF↗
mradermacher
- COSMO-PRO-7B-i1-GGUF↗
mradermacher
- Exurbia-Delta9-i1-GGUF↗
mradermacher
- Glistening-Gem-31B-v1.0-i1-GGUF↗
mradermacher
- GPT-Grug-355m-i1-GGUF↗
mradermacher
- JanusCoderV-7B-i1-GGUF↗
mradermacher
- KONI-7B-R-20250831-i1-GGUF↗
mradermacher
