Qwen3.8-27B-MIX_GGUF
Two custom mixed-tensor quantizations of `Qwen/Qwen3.8-27B-FP8`, the dense 27B multimodal model with a hybrid GatedDeltaNet + Gated Attention architecture and Multi-Token Prediction (MTP) head. Built with `llama.cpp` at commit `1692f9e`, using an importance matrix (imatrix) and per-tensor quantization overrides. Both quantizations are designed around the **16 GB VRAM budget** of consumer GPUs such as the AMD Radeon RX 9070 XT.
Two custom mixed-tensor quantizations of `Qwen/Qwen3.8-27B-FP8`, the dense 27B multimodal model with a hybrid GatedDeltaNet + Gated Attention architecture and Multi-Token Prediction (MTP) head. Built with `llama.cpp` at commit `1692f9e`, using an importance matrix (imatrix) and per-tensor quantization overrides. Both quantizations are designed around the **16 GB VRAM budget** of consumer GPUs such as the AMD Radeon RX 9070 XT.
AI is happening. The future is updating.