全站搜索
AI 模型 84762
- stable-audio-open-models↗
AEmotionStudio
- cobalt-seeded-rl-base-ramp25-stoppen-gen4k-ep2-ncp10-q4v3-iid16↗
agurung
- BioGravity-Inst↗
aigensciences
- ICD-10-Code-Prediction↗
AkshatSurolia
- PARD-Llama-4-1B↗
amd
- Qwen1.5-MoE-A2.7B-Chat-w-int8-a-int8-sym↗
amd
- deepseek-v4-gguf↗
antirez
This quants are specific for the DS4 inference engine. They may work with other inference engines or not (they should, but not the MTP model which requires a specific loader). Use **q2** on 128 GB Mac machines, **q4** on machines with ≥ 256 GB RAM, pair either with **MTP** for optional speculative decoding. For the **q4** file, only the three routed-expert classes change to `Q4_K`. Everything else is byte-for-byte identical to the q2 recipe.
- Falcon3-10B-Instruct-GGUF↗
bartowski
Some of these quants (Q3_K_XL, Q4_K_L etc) are the standard quantization method with the embeddings and output weights quantized to Q8_0 instead of what they would normally default to. If the model is bigger than 50GB, it will have been split into multiple files. In order to download them all to a local folder, run: You can either specify a new local-dir (Falcon3-10B-Instruct-Q8_0) or download them all in place (./)
- Gryphe_Pantheon-Reasoning-26B-A4B-1.1-V2-GGUF↗
bartowski
**Model details:** - Parameter count: 27B - Input support: text - Speculative decoding: no - imatrix: yes - details **Don't know which to choose?** Grab Q4_K_M (18.75GB) - usually a good mix of size and performance. Download instructions available here These quants were made with llama.cpp release b10842 - if this model's architecture is newly supported, you'll need that release or newer to run them.
- ibm-granite_granite-4.0-micro-GGUF↗
bartowski
