Search FoxAI
AI Models 84760
- Qwen2-7B-Instruct-IFRS-Accountant-16B-GGUF↗
mradermacher
- Qwen3-32B-Malaysian-GGUF↗
mradermacher
- Qwen3.6-35B-A3B-Uncensored-HauhauCS-FP16-GGUF↗
mradermacher
- Qwen3-Deckard-Large-Almost-Human-6B-III-160-OMEGA-GGUF↗
mradermacher
- Spaetzle-v12-7b-i1-GGUF↗
mradermacher
- Stylographic-king-7B-i1-GGUF↗
mradermacher
- ThoughtStream-4B-v0.1-GGUF↗
mradermacher
- Triunvirato-7b-i1-GGUF↗
mradermacher
- gemma-4-26B-A4B-it-APEX-GGUF↗
mudler
⚡ Each donation = another big MoE quantized I host 25+ free APEX MoE quantizations as independent research. My only local hardware is an NVIDIA DGX Spark (122 GB unified memory), enough for ~30-50B-class MoEs, but bigger ones (200B+) require rented compute on H100/H200/Blackwell, typically $20-100 per quant. If APEX quants are useful to you, your support directly funds those bigger runs. Benchmarks coming soon (re-quantized with llama.cpp b8664 including Gemma 4 tokenizer and logit softcapping fixes). For reference APEX benchmarks on the Qwen3.5-35B-A3B architecture, see mudler/Qwen3.5-35B-A3B-APEX-GGUF. APEX is a quantization strategy for Mixture-of-Experts (MoE) models. It classifies tensors by role (routed expert, shared expert, attention) and applies a layer-wise precision gradient -- edge layers get higher precision, middle layers get more aggressive compression. I-variants use diverse imatrix calibration (chat, code, reasoning, tool-calling, agentic traces, Wikipedia).
- deberta-wrime-sentiment↗
neuralnaut
