전체 검색
AI 모델 85021
- yejin-korean-8b-v3-cpt6000-distill-qwen36-lora-lr2e4-nothink-v2↗
cooler8
- MineStudio_VPT.foundation_model_2x↗
CraftJarvis
This model has been pushed to the Hub using the PytorchModelHubMixin integration: - Library: [More Information Needed] - Docs: [More Information Needed]
- gemma-4-31B-it-qat-AWQ-INT4↗
cyankiwi
> [!Note] > This model card is for the new versions of the Gemma 4 family optimized with Quantization-Aware Training (QAT), which allows preserving similar quality to bfloat16 while dramatically reducing the memory requirements to load the model. > Four versions of the QAT checkpoints are available: > * **Unquantized QAT checkpoints** (Q4_0): Half-precision weights extracted from the QAT pipeline, ideal for custom downstream compilation and research. Available for Gemma 4 E2B, E4B, 12B, 26B A4B, and 31B, and their drafter models. > * **GGUF** (Q4_0): Ready-to-deploy formats for broad ecosystem compatibility. Available for Gemma 4 E2B, E4B, 12B, 26B A4B, and 31B. > * **Mobile-optimized** (wNa8o8): A custom schema engineered explicitly for mobile hardware efficiency. It features targeted 2-bit decoding layers, optimized KV caches, and static activations to maximize VRAM savings. Available for Gemma 4 E2B and E4B. > * **Compressed Tensors** (w4a16): QAT checkpoints serialized in the compressed-tensors format for native, optimized inference with vLLM. Available for Gemma 4 E2B, E4B, 12B, and 31B. > * **Assistant Compatibility**: When using multi-token prediction (speculative decoding) with an assistant model alongside a QAT target model, the assistant model must also be a QAT checkpoint with the same precision to ensure compatibility. Gemma is a family of open models built by Google DeepMind. Gemma 4 models are multimodal, handling text and image input (with audio supported on E2B, E4B, and 12B) and generating text output. This release includes open-weights models in both pre-trained and instruction-tuned variants. Gemma 4 features a context window of up to 256K tokens and maintains multilingual support in over 140 languages. Featuring both Dense and Mixture-of-Experts (MoE) architectures, Gemma 4 is well-suited for tasks like text generation, coding, and reasoning. The models are available in five distinct sizes: **E2B**, **E4B**, **12B**, **26B A4B**, and **31B**. Their diverse sizes make them deployable in environments ranging from high-end phones to laptops and servers, democratizing access to state-of-the-art AI.
- Psyonic-Cetacean-Ultra-Quality-20b-GGUF↗
DavidAU
- covid-twitter-bert-v2↗
digitalepidemiologylab
- InternLM3-8B-Instruct-GGUF↗
DuoNeural
- OpenAi-GPT-oss-20b-HERETIC-uncensored-NEO-Imatrix-gguf↗
DzikuPL
- MiniCPM-V-2.6↗
EricZhang1412
- mms-tts-tes↗
facebook
- OTel-2.0-Decision-26B-A4B-4bit↗
farbodtavakkoli
> **Versioning notice:** This card describes the current OTel-2.0-Decision-26B-A4B-4bit checkpoint. The model weights may be updated over time. For reproducible evaluation or production deployment, pin a specific model revision, checkpoint hash, or release tag rather than relying on the floating latest version. Details on the training data, training method and configuration, data-processing pipeline, and training infrastructure will be added soon. **OTel-2.0-Decision-26B-A4B-4bit** is a 4-bit W4A16 build of Google's Gemma 4 26B-A4B-it for typed decisions: classification, Yes/No questions, and ordered levels. Questions are supplied at request time, and decisions are read from answer-label probabilities rather than generated prose.
