全站搜索
AI 模型 84762
- DeepSeek-V4.1-Flash-1017-GSQ-RCO-GGUF↗
ISTA-DASLab
**Non-uniform GGUF quantizations** of a 763B-parameter, 384-expert MoE, produced with **GSQ** and **RCO**. > **Update, October 27, 2026.** The files now use llama.cpp's own DeepSeek-V4.1 layout and load in llama.cpp b11870 or newer, including images. > - **Downloaded the earlier files?** You do not need to download the model again. Run convert_ds41_upstream.py on your model folder: it rewrites the files locally into exactly the current ones and fetches only 80 KB. See Updating an existing download. > - **New download?** The shared Engram file is shard 6 of every build, so link it once per build you use (` ` is `IQ1_M`, `IQ2_XXS` or `IQ2_XS`; see llama.cpp): > > This repository provides GGUF quantizations of **DeepSeek-V4.1-Flash-1017** at three sizes: **IQ1_M (1.75 bits per weight), IQ2_XXS (2.00) and IQ2_XS (2.25)**. In contrast to uniform quantization, which applies a single quantization type to all weight tensors, each model here assigns a separate quantization type to every tensor. The assignment is obtained by a gradient-based search that allocates precision according to per-tensor sensitivity, subject to a total size budget. The resulting files are standard GGUF.
- HIM-3B↗
ItsnotAilabs
- llama-3.2-1b-pg19-run1↗
jaydeepb
- madlad400-3b-mt↗
jbochi
- primus_exploit_finetune↗
kygbjs
- TheSpice-7b-v0.1.1-GGUF-IQ-Imatrix↗
Lewdiculous
- Delexa-7b↗
lex-hue
- spam-usernames-classifier↗
lokas
- ModernPubMedBERT↗
lokeshch19
- LTX_23SexFromBehind↗
lynaNSFW
