전체 검색
AI 모델 84761
- OLMoE-1B-7B-0924-Instruct-GGUF↗
bartowski
Some of these quants (Q3_K_XL, Q4_K_L etc) are the standard quantization method with the embeddings and output weights quantized to Q8_0 instead of what they would normally default to. Some say that this improves the quality, others don't notice any difference. If you use these models PLEASE COMMENT with your findings. I would like feedback that these are actually used and useful so I don't keep uploading quants no one is using. If the model is bigger than 50GB, it will have been split into multiple files. In order to download them all to a local folder, run:
- DeepSeek-V4.1-Flash-EXL3-3.5bpw-Pollard↗
bot-lab-21
- NovoMolGen_157M_SMILES_BPE↗
chandar-lab
- yejin-korean-8b-v3-cpt6000-distill-qwen36-lora-lr2e4-nothink-v2↗
cooler8
- MineStudio_VPT.foundation_model_2x↗
CraftJarvis
This model has been pushed to the Hub using the PytorchModelHubMixin integration: - Library: [More Information Needed] - Docs: [More Information Needed]
- gemma-4-31B-it-qat-AWQ-INT4↗
cyankiwi
> [!Note] > This model card is for the new versions of the Gemma 4 family optimized with Quantization-Aware Training (QAT), which allows preserving similar quality to bfloat16 while dramatically reducing the memory requirements to load the model. > Four versions of the QAT checkpoints are available: > * **Unquantized QAT checkpoints** (Q4_0): Half-precision weights extracted from the QAT pipeline, ideal for custom downstream compilation and research. Available for Gemma 4 E2B, E4B, 12B, 26B A4B, and 31B, and their drafter models. > * **GGUF** (Q4_0): Ready-to-deploy formats for broad ecosystem compatibility. Available for Gemma 4 E2B, E4B, 12B, 26B A4B, and 31B. > * **Mobile-optimized** (wNa8o8): A custom schema engineered explicitly for mobile hardware efficiency. It features targeted 2-bit decoding layers, optimized KV caches, and static activations to maximize VRAM savings. Available for Gemma 4 E2B and E4B. > * **Compressed Tensors** (w4a16): QAT checkpoints serialized in the compressed-tensors format for native, optimized inference with vLLM. Available for Gemma 4 E2B, E4B, 12B, and 31B. > * **Assistant Compatibility**: When using multi-token prediction (speculative decoding) with an assistant model alongside a QAT target model, the assistant model must also be a QAT checkpoint with the same precision to ensure compatibility. Gemma is a family of open models built by Google DeepMind. Gemma 4 models are multimodal, handling text and image input (with audio supported on E2B, E4B, and 12B) and generating text output. This release includes open-weights models in both pre-trained and instruction-tuned variants. Gemma 4 features a context window of up to 256K tokens and maintains multilingual support in over 140 languages. Featuring both Dense and Mixture-of-Experts (MoE) architectures, Gemma 4 is well-suited for tasks like text generation, coding, and reasoning. The models are available in five distinct sizes: **E2B**, **E4B**, **12B**, **26B A4B**, and **31B**. Their diverse sizes make them deployable in environments ranging from high-end phones to laptops and servers, democratizing access to state-of-the-art AI.
- Psyonic-Cetacean-Ultra-Quality-20b-GGUF↗
DavidAU
- covid-twitter-bert-v2↗
digitalepidemiologylab
- InternLM3-8B-Instruct-GGUF↗
DuoNeural
- OpenAi-GPT-oss-20b-HERETIC-uncensored-NEO-Imatrix-gguf↗
DzikuPL
