全站搜索
AI 模型 84760
- MaLA-LM_-_lucky52-bloom-7b1-no-8-gguf↗
RichardErkhov
- styalai_-_gpt2o-chatbot-02-gguf↗
RichardErkhov
- subsystem-classifier↗
SeanCCC666
This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated. - **Developed by:** [More Information Needed] - **Funded by [optional]:** [More Information Needed] - **Shared by [optional]:** [More Information Needed] - **Model type:** [More Information Needed] - **Language(s) (NLP):** [More Information Needed] - **License:** [More Information Needed] - **Finetuned from model [optional]:** [More Information Needed] - **Repository:** [More Information Needed] - **Paper [optional]:** [More Information Needed] - **Demo [optional]:** [More Information Needed]
- Qwen3.8-Flash-Next-GSQ-RCO-abliterated-Hybrid-GGUF↗
shefowl
IQ3_XXS trunk, Q2_0 experts: 10-20% faster than IQ3_XXS on Strata, the perplexity of IQ3_XXS on our Vulkan fork Run it with Strata . On our RX 7900 XTX, Strata ran this file at 53-89 tokens/s, 1.6-2.3x the speed of our own fork, and read prompts about 6x faster (measured with IQ3_XXS). Our llama.cpp fork vulkan-moe-hot stays as the option for Vulkan (no ROCm or CUDA). With the fork, the hot experts come from the IQ3_XXS file, which gives this file the perplexity of IQ3_XXS. Small machine? This file ran at 9.0 tokens/s on a laptop with an RTX 4050 (6 GB) and 16 GB of RAM; the experts that do not fit in memory are read from the SSD. A copy with 352 of the 512 experts ran there at 10.8 and gives up about a seventh of the factual knowledge. The tables are under Small machines .
- SimpleStories-V2-11M↗
SimpleStories
- DeepSeek-R1-Distill-Qwen-7B-chat-mlx-8bit↗
SirSahOl
- Llama-3.1-8B-Lexi-Uncensored-V2-AWQ↗
solidrust
- test-gguf-moe-sample↗
SzymonOzog
- d38a15↗
tao1000
- Qwen3.8-27B-GLA-g2↗
TelperionAI
