gemma-4-E4B-it-GGUF

Jun 9 Update: Added MTP support. See our MTP Guide . Apr 11 Update: Re-download for Google's latest chat template and llama.cpp fixes. Gemma 4 can now be run and fine-tuned in Unsloth Studio . Read our guide . See all versions of Gemma 4 (GGUF, 16-bit etc.) in our collection . Example of Gemma 4 E4B (4-bit GGUF) running in Unsloth Studio with tool-calling: Gemma is a family of open models built by Google DeepMind. Gemma 4 models are multimodal, handling text and image input (with audio supported on small models) and generating text output. This release includes open-weights models in both pre-trained and instruction-tuned variants. Gemma 4 features a context window of up to 256K tokens and maintains multilingual support in over 140 languages. Featuring both Dense and Mixture-of-Experts (MoE) architectures, Gemma 4 is well-suited for tasks like text generation, coding, and reasoning. The models are available in four distinct sizes: **E2B**, **E4B**, **26B A4B**, and **31B**. Their diverse sizes make them deployable in environments ranging from high-end phones to laptops and servers, democratizing access to state-of-the-art AI.

译文尚未就绪，显示来源原文