全站搜索
AI 模型 84759
- RecursiveSI_flint-GGUF↗
bartowski
**Model details:** - Parameter count: 40B (source checkpoint) - Input support: text - Speculative decoding: no - imatrix: yes - details **Don't know which to choose?** Grab Q4_K_M (25.35GB) - usually a good mix of size and performance. Download instructions available here The files marked `true` in the Split column above are stored as multiple parts in a folder. To download all the parts to a local folder, run:
- soob3123_amoral-cogito-v1-preview-qwen-14B-GGUF↗
bartowski
- swiss-ai_Apertus-70B-Instruct-2509-GGUF↗
bartowski
- Qwen3.8-27B-BaseQuant-V1↗
basecompute
Quantized builds of Qwen/Qwen3.8-27B in five sizes. On held-out text, each one is closer to the BF16 model than the unsloth dynamic quant of the same size. Each GGUF is no larger than its unsloth counterpart. The Small bundle needs baseRT 0.4.0 or later. The XS files are text-only and have no MTP layer, like unsloth's `UD-IQ2_S`; the XS bundle was tested on baseRT 0.4.1. The XL GGUF keeps the MTP layer, like `UD-Q6_K_XL`. baseRT does not load Q8_0, so the XL bundle stores those tensors in baseRT's own 8-bit format at the same 8.5 bits per weight. The bundle carries the MTP head for `--speculate mtp-head`, and was tested with baseRT 0.4.1 and superfluid 0.1.4.
- Mistral-Small-24B-Instruct-2501-i1-GGUF↗
BasedAGI
- beetle-monolingual-fineweb-2b-kor↗
Beetle-FineWeb-24B-4
- test-32m-dec↗
blab-jhu
- Qwen3-Coder-REAP-25B-A3B↗
cerebras
- asymmetric-autoencoder-kl-x-2↗
cross-attention
- Trouper-12B-GGUF↗
DakkaWolf
