Search FoxAI
AI Models 84760
- gemma-4-26B-A4B-it-APEX-GGUF↗
mudler
⚡ Each donation = another big MoE quantized I host 25+ free APEX MoE quantizations as independent research. My only local hardware is an NVIDIA DGX Spark (122 GB unified memory), enough for ~30-50B-class MoEs, but bigger ones (200B+) require rented compute on H100/H200/Blackwell, typically $20-100 per quant. If APEX quants are useful to you, your support directly funds those bigger runs. Benchmarks coming soon (re-quantized with llama.cpp b8664 including Gemma 4 tokenizer and logit softcapping fixes). For reference APEX benchmarks on the Qwen3.5-35B-A3B architecture, see mudler/Qwen3.5-35B-A3B-APEX-GGUF. APEX is a quantization strategy for Mixture-of-Experts (MoE) models. It classifies tensors by role (routed expert, shared expert, attention) and applies a layer-wise precision gradient -- edge layers get higher precision, middle layers get more aggressive compression. I-variants use diverse imatrix calibration (chat, code, reasoning, tool-calling, agentic traces, Wikipedia).
- deberta-wrime-sentiment↗
neuralnaut
- gepard-1.1↗
nineninesix
- Meta-Llama-3-8B↗
NousResearch
Meta developed and released the Meta Llama 3 family of large language models (LLMs), a collection of pretrained and instruction tuned generative text models in 8 and 70B sizes. The Llama 3 instruction tuned models are optimized for dialogue use cases and outperform many of the available open source chat models on common industry benchmarks. Further, in developing these models, we took great care to optimize helpfulness and safety. **Variations** Llama 3 comes in two sizes — 8B and 70B parameters — in pre-trained and instruction tuned variants. **Model Architecture** Llama 3 is an auto-regressive language model that uses an optimized transformer architecture. The tuned versions use supervised fine-tuning (SFT) and reinforcement learning with human feedback (RLHF) to align with human preferences for helpfulness and safety.
- OpenMed-PII-ClinicalE5-Small-33M-v1-onnx-android↗
OpenMed
- Tiel-Coder-35B-A3B-MLX-oQ6e-MTP↗
peculiar-ragdoll
- chujiezheng_-_Smaug-34B-v0.1-ExPO-gguf↗
RichardErkhov
- HumanF-MarkrAI_-_Gukbap-Qwen2-7B-gguf↗
RichardErkhov
- PygmalionAI_-_pygmalion-1.3b-gguf↗
RichardErkhov
- SongTonyLi_-_Phi-3.5-mini-instruct-LoRA-128-gguf↗
RichardErkhov
