全站搜索
AI 模型 85021
- Grok-1-GGUF↗
Arki05
This repository contains unofficial GGUF Quantizations of Grok-1, compatible with `llama.cpp` as of PR- Add grok-1 support #6204. - The splits have been updated to utilize the improvements from PR: llama_model_loader: support multiple split/shard GGUFs. As a result, manual merging with `gguf-split` is no longer required. With this, there is no need to merge the split files before use. Just download all splits and run llama.cpp with the first split like you would previously. It'll detect the other splits and load them as well.
- bloom-560m-safe-peft↗
artek0chumak
- Bunny-v1_0-4B-gguf↗
BAAI
- Flux-Uncensored-V2↗
Ballsworthy
- DeepSeek-R1-Distill-Qwen-32B-abliterated-GGUF↗
bartowski
Original model: https://huggingface.co/huihui-ai/DeepSeek-R1-Distill-Qwen-32B-abliterated All quants made using imatrix option with dataset from here Some of these quants (Q3_K_XL, Q4_K_L etc) are the standard quantization method with the embeddings and output weights quantized to Q8_0 instead of what they would normally default to.
- Hermes-2-Theta-Llama-3-70B-GGUF↗
bartowski
- Llama-3-Yggdrasil-8B-GGUF↗
bartowski
- Llama-Doctor-3.2-3B-Instruct-GGUF↗
bartowski
- OLMoE-1B-7B-0924-Instruct-GGUF↗
bartowski
Some of these quants (Q3_K_XL, Q4_K_L etc) are the standard quantization method with the embeddings and output weights quantized to Q8_0 instead of what they would normally default to. Some say that this improves the quality, others don't notice any difference. If you use these models PLEASE COMMENT with your findings. I would like feedback that these are actually used and useful so I don't keep uploading quants no one is using. If the model is bigger than 50GB, it will have been split into multiple files. In order to download them all to a local folder, run:
- DeepSeek-V4.1-Flash-EXL3-3.5bpw-Pollard↗
bot-lab-21
