KAT-Coder-V2.5-Dev-MTP-APEX-GGUF

模型介绍

MoE-aware, mixed-precision **APEX** quantization of Kwaipilot/KAT-Coder-V2.5-Dev, an agentic-coding fine-tune on the Qwen3.6-35B-A3B backbone (`qwen3_5_moe`: 40 layers, 256 routed + 1 shared expert, hybrid GatedDeltaNet linear-attention with periodic full attention). Kwaipilot reports SWE-bench Verified 69.40 for this size class, against Qwen3.6-35B-A3B's 64.40. **What makes this build different: it has a working MTP head.** KAT-Coder ships `mtp_num_hidden_layers: 0` — no multi-token-prediction head at all, so no speculative decoding is possible out of the box, and that is true of the vendor release and of every other quant of this model I am aware of. This repo transplants Qwen3.6-35B-A3B's own trained MTP head onto KAT-Coder and quantizes the result. Measured below: **2.03x on a hard agentic-coding suite, with correctness unchanged.** Full draft-depth x temperature surface, measured on `-v2`. One long-context prompt (~82 KB), `max_tokens=400`, 3 seeds per cell, median tok/s, `top_p 0.95 top_k 20`, ctx 32768, build `6d05498`. Speedup is against the no-drafter baseline **at the same temperature**:

主要特点

特点摘要待依据来源补齐，不凭模型名称推断能力。

局限与注意事项

暂无足够来源支持具体缺点结论。请重点验证实际任务表现、时延、数据政策、许可与版本生命周期。

来源报价与费用分析

同一模型在不同渠道、地区和配置下可能采用不同价格。下表独立保留各渠道报价，不将渠道价格视为厂商官方统一价格。

公开评测与运行配置

暂无已采集的可核验公开评分。模型未上榜不代表能力较低。

常见问题

资料来源与可追溯记录

许可证：apache-2.0。模型介绍与第三方评测均以原来源的具体版本和方法为准。