AI is happening. The future is updating.gemma-4-26B-A4B-it-qat-GGUF
Jun 9 Update: Added MTP support. See our MTP Guide . Gemma 4 can now be run and fine-tuned in Unsloth Studio . Read our guide . See all versions of Gemma 4 QAT (GGUF, 16-bit etc.) in our collection . Example of Gemma 4 E4B (4-bit GGUF) running in Unsloth Studio with tool-calling: This model ships a Multi-Token Prediction drafter at the repo root (`mtp-gemma-4-26B-A4B-it.gguf`, a near-lossless smart Q4_0). A recent llama.cpp auto-discovers it from `-hf`, so you do not pass `--model-draft`: The drafter shares the target's KV cache and does not change the output (the target verifies every drafted token). See the `MTP/` folder for the other precisions and explicit usage.
Jun 9 Update: Added MTP support. See our MTP Guide . Gemma 4 can now be run and fine-tuned in Unsloth Studio . Read our guide . See all versions of Gemma 4 QAT (GGUF, 16-bit etc.) in our collection . Example of Gemma 4 E4B (4-bit GGUF) running in Unsloth Studio with tool-calling: This model ships a Multi-Token Prediction drafter at the repo root (`mtp-gemma-4-26B-A4B-it.gguf`, a near-lossless smart Q4_0). A recent llama.cpp auto-discovers it from `-hf`, so you do not pass `--model-draft`: The drafter shares the target's KV cache and does not change the output (the target verifies every drafted token). See the `MTP/` folder for the other precisions and explicit usage.