Qwen3.6-27B-GPTQ-4bit

GPTQ 4-bit quantization of Qwen/Qwen3.6-27B, a 27B-parameter dense multimodal model. Uses **FOEM** (First-Order Error Matters, AAAI 2026) for outlier-aware error compensation, enabling pure 4-bit quantization without per-module FP16 exclusions. Includes the full vision encoder and MTP (Multi-Token Prediction) module for image understanding and speculative decoding support. - **Architecture**: Qwen3_5ForConditionalGeneration (multimodal: text + vision; dense sibling of `qwen3_5_moe`) - **Total parameters**: ~27B - **Layers**: 64 (48 linear-attention + 16 full-attention, repeating 3:1 pattern) - **Hidden size**: 5120, intermediate size: 17408 (dense MLP — no MoE) - **Context length**: 262,144 tokens - **Vision encoder**: 27-block ViT, BF16 (333 tensors) - **MTP module**: 1-layer speculative decoding head, BF16 (15 tensors)

译文尚未就绪，显示来源原文