Qwen3.8-Distill-35B-A3B-Coder-Abliterated

Model overview

A 2-bit **ROCmFPX** GGUF of a distilled Qwen3.6-35B-A3B (MoE, 256 experts / ~3B active), sized to run on a **16GB consumer GPU**. Ships with the MTP (`nextn`) head and build instructions for the matching runtime. > **Honest status:** this is a proof-of-concept. On the internal 10-task smoke eval the distilled > model **tied its base** (6/10 vs 6/10) — no regression, no measurable gain yet — and it is now > quantized to 2-bit, which trades quality for fit. Publishing it as a reproducible artifact of the > pipeline (distill → graft MTP → ROCmFPX 2-bit GGUF), **not** as a benchmark-winning coder. > The quality fix is a larger, tool-calling-heavy corpus — a separate follow-up run. 16GB card: context and concurrency share one KV pool — pick single-stream long context (`-c 32768 -np 1`) **or** many short sessions (`-c 8192 -np 8`).

Key features

特点摘要待依据来源补齐，不凭模型名称推断能力。

Limitations & considerations

Sources are insufficient to establish specific limitations. Verify task performance, latency, data policies, licensing and version lifecycle.

Source prices & cost analysis

Prices vary by channel, region and configuration. Channel quotes are listed independently and are not treated as a single official provider price.

Public benchmarks & run configuration

暂无已采集的可核验公开评分。模型未上榜不代表能力较低。

Frequently asked questions

Sources & traceability

许可证：apache-2.0。模型介绍与第三方评测均以原来源的具体版本和方法为准。