UNSEEN_Gemma_4_26B_NSFW-GGUF

> 📌 **Base Model:** The full unquantized FP16/BF16 weights are hosted at 👉 **Jommarn/UNSEEN_Gemma_4_26B_NSFW** (surgically abliterated from `google/gemma-4-26B-A4B-it`). > > ⚡ **This Repository:** Dedicated to optimized **Quantized (2-bit / 3-bit / 4-bit / 5-bit / 6-bit / 8-bit / 16-bit Master)** and **GGUF** deployment formats for consumer GPUs, Apple Silicon Mac, and `llama.cpp` serving. - **2-bit (`IQ2_M` ~9.67GB):** ~8–10GB VRAM (e.g., RTX 3060 12GB, RTX 4060, Mac 16GB) — *Extreme Efficiency* - **3-bit (`IQ3_M` ~12.4GB):** ~12–14GB VRAM (e.g., RTX 4070 12GB, RTX 3080, Mac 16GB) — *High Efficiency* - **4-bit (`Q4_K_M` ~15.6GB / `NF4`):** ~16–18GB VRAM (e.g., RTX 3090, RTX 4090, NVIDIA L4) — *Recommended Standard* - **5-bit (`Q5_K_M` ~18.3GB):** ~20–22GB VRAM (e.g., RTX 3090/4090 24GB, A10G 24GB) — *Balanced High-Quality* - **6-bit (`Q6_K` ~22.6GB):** ~24–26GB VRAM (e.g., RTX 4090 24GB, A100 40GB) — *High Precision* - **8-bit (`Q8_0` ~28.0GB / `INT8`):** ~28–30GB VRAM (e.g., 2x RTX 3090/4090, A100 40GB/80GB) — *99.9% Lossless* - **16-bit (`BF16` ~50.5GB):** ~52GB VRAM (e.g., A100 80GB, Mac Studio 64GB/128GB) — *100% Uncompressed Master* - **Vision Projector (16-bit):** `mmproj-gemma4-vision-f16.gguf` (~1.11GB) — *Must be loaded with `--mmproj` for image perception in llama.cpp/GGUF.* - **GGUF Weights:** Available at 👉 **Jommarn/UNSEEN_Gemma_4_26B_NSFW-GGUF** > ⚠️ **Important for GGUF Users:** To enable image understanding in `llama.cpp` or LM Studio, you **MUST** download and pass `mmproj-gemma4-vision-f16.gguf` alongside the main model. Without it, the model will operate strictly as a text-only LLM!