全站搜索
AI 模型 84762
- Solar-Open-100B-NVFP4A16↗
furiosa-ai
- gemma-1.1-2b-it-GGUF↗
Google
- Gemma 3n E4B Instruct Preview (May '25)↗
Google
- gemma-4-12B-it-qat-w4a16-ct↗
Google
Hugging Face | GitHub | Launch Blog | Documentation | Technical Report > [!Note] > This model card is for the new versions of the Gemma 4 family optimized with Quantization-Aware Training (QAT), which allows preserving similar quality to bfloat16 while dramatically reducing the memory requirements to load the model. > Four versions of the QAT checkpoints are available: > * **Unquantized QAT checkpoints** (Q4_0): Half-precision weights extracted from the QAT pipeline, ideal for custom downstream compilation and research. Available for Gemma 4 E2B, E4B, 12B, 26B A4B, and 31B, and their drafter models. > * **GGUF** (Q4_0): Ready-to-deploy formats for broad ecosystem compatibility. Available for Gemma 4 E2B, E4B, 12B, 26B A4B, and 31B. > * **Mobile-optimized** (wNa8o8): A custom schema engineered explicitly for mobile hardware efficiency. It features targeted 2-bit decoding layers, optimized KV caches, and static activations to maximize VRAM savings. Available for Gemma 4 E2B and E4B. > * **Compressed Tensors** (w4a16): QAT checkpoints serialized in the compressed-tensors format for native, optimized inference with vLLM. Available for Gemma 4 E2B, E4B, 12B, and 31B. > * **Assistant Compatibility**: When using multi-token prediction (speculative decoding) with an assistant model alongside a QAT target model, the assistant model must also be a QAT checkpoint with the same precision to ensure compatibility. Gemma is a family of open models built by Google DeepMind. Gemma 4 models are multimodal, handling text and image input (with audio supported on E2B, E4B, and 12B) and generating text output. This release includes open-weights models in both pre-trained and instruction-tuned variants. Gemma 4 features a context window of up to 256K tokens and maintains multilingual support in over 140 languages.
- t5-small-ssm-nq↗
Google
- GritLM-7B-KTO↗
GritLM
> GritLM is a generative representational instruction tuned language model. It unifies text representation (embedding) and text generation into a single model achieving state-of-the-art performance on both types of tasks.
- Holo-3.1-35B-A3B↗
Hcompany
- wai-nsfw-illustrious-v80-sdxl↗
John6666
- Kataguru-Sceptic-35B-A3B-v2.6-GGUF↗
kataguru
**Kataguru-Sceptic-35B-A3B-v2.6-GGUF** is the `llama.cpp` / LM Studio / Ollama GGUF release of **Kataguru-Sceptic-35B-A3B-v2.6**, a bilingual (English & Finnish) 35-billion parameter (3B active parameters per token, 254 routed experts per layer) multimodal Mixture-of-Experts (MoE) model. Unlike the 25.44 GB `NVFP4` and 27.85 GB `AWQ` server packages, these imatrix-calibrated 3-bit GGUF quantizations (`12.0 GiB` to `15.3 GiB`) are specifically engineered to fit **wholly inside the VRAM of a single 16 GB or 24 GB GPU**. 1. **Dual-Stage 2D Zero-Swap Epistemic Triage (System 1 Reflex)**: - Evaluates candidate training samples in ** 83.46 % | 81.72 % | **+1.74 pp** | 80.10 % | **+3.36 pp** | | 2 | **WinoGrande** | Contextual Reasoning (`acc`) | 75.45 % | 71.82 % | **+3.63 pp** | 71.10 % | **+4.35 pp** | | 3 | **MedQA (USMLE)** | Clinical Medicine 4-opts (`acc`) | 85.31 % | 84.10 % | **+1.21 pp** | 78.40 % | **+6.91 pp** | | 4 | **TruthfulQA MC2** | Epistemic Truthfulness (`acc`) | 52.47 % | 52.89 % | -0.42 pp | 49.80 % | **+2.67 pp** | | 5 | **TruthfulQA MC1** | Single-True Factuality (`acc`) | 36.23 % | 34.39 % | **+1.84 pp** | 31.40 % | **+4.83 pp** | | 6 | **ARC-Easy** | Standard STEM (`acc_norm`) | 82.95 % | 74.83 % | **+8.12 pp** | 72.98 % | **+9.97 pp** | | 7 | **HellaSwag** | Linguistic Coherence (`acc_norm`) | 82.42 % | 83.30 % | -0.88 pp | 74.60 % | **+7.82 pp** | | 8 | **OpenBookQA** | Scientific Application (`acc_norm`) | 45.00 % | 46.00 % | -1.00 pp | 44.80 % | **+0.20 pp** | | 9 | **ARC-Challenge** | Advanced STEM (`acc_norm`) | 62.54 % | 57.94 % | **+4.60 pp** | 58.62 % | **+3.92 pp** | | 10 | **BoolQ** | Natural Language Logic (`acc`) | 90.37 % | 85.78 % | **+4.59 pp** | 89.60 % | **+0.77 pp** | | 11 | **GSM8K Math** (CoT) | Exact Match (`strict` / `flex`) | 89.39 % / 90.07 % | 1.06 % / 12.36 %\* | **+88.33 pp** | 76.50 % | **+12.89 pp** | | **$\Sigma_{10}$** | **10-Task Mean (1–10)** | **Mean Excluding GSM8K Format Gap** | 69.62 % | **67.28 %** | **+2.34 pp** | **65.14 %** | **+4.48 pp** | | **$\Sigma_{11}$** | **11-Task Mean (1–11)** | **Official Overall Cognitive Mean** | 71.42 % | **61.26 % (62.28 % flex)** | **+10.16 pp** | **66.17 %** | **+5.25 p
- EXAONE-4.0-32B-FP8↗
LGAI-EXAONE
