Qwen3.8-Flash-Next-Orca-Abliterated-GSQ-RCO-Coder-GGUF
A standalone, **weight-baked uncensored & abliterated GGUF** of **`ISTA-DASLab/Qwen3.8-Flash-Next-GSQ-RCO-Coder-GGUF`.** This build is created by precisely transplanting 144 orthogonalized residual-writing tensors from **`orcarouter/Qwen3.8-Flash-Next-Uncensored`** (via `SC117/Qwen3.8-Flash-Next-GSQ-RCO-abliterated-GGUF`) directly into the optimized 256-expert pruned Coder architecture. `ISTA-DASLab/Qwen3.8-Flash-Next-GSQ-RCO-Coder-GGUF` compresses `Qwen3.8-Flash-Next` from 354 GB (BF16, 512 experts per layer) down to **58.4 GB** by combining: 1. **Structured Expert Pruning ($512 \rightarrow 256$ experts per layer):** Selects the 256 experts specialized for software engineering, coding, agentic tool calling, and vision. 2. **GSQ (Gumbel-Softmax Quantization) + RCO (Riemannian Co-design Search):** Assigns optimal mixed-precision GGUF quantization types across individual tensors while storing the retained weights at `~3.5 bits` (`IQ3_S`-equivalent fidelity, labeled `IQ1_M` for its `1.89` effective bits per parameter relative to the unpruned 512-expert model). --- Because this is an ultra-low-bit MoE model (`IQ1_M` effective / `IQ3_S` retained weights), **avoid pure greedy decoding (`--temp 0.0` with no repetition penalty)** on repetitive C/C++ struct definitions. Use standard Qwen sampling parameters with a light repetition/presence penalty:
翻訳準備中のため原文を表示しています
A standalone, **weight-baked uncensored & abliterated GGUF** of **`ISTA-DASLab/Qwen3.8-Flash-Next-GSQ-RCO-Coder-GGUF`.** This build is created by precisely transplanting 144 orthogonalized residual-writing tensors from **`orcarouter/Qwen3.8-Flash-Next-Uncensored`** (via `SC117/Qwen3.8-Flash-Next-GSQ-RCO-abliterated-GGUF`) directly into the optimized 256-expert pruned Coder architecture. `ISTA-DASLab/Qwen3.8-Flash-Next-GSQ-RCO-Coder-GGUF` compresses `Qwen3.8-Flash-Next` from 354 GB (BF16, 512 experts per layer) down to **58.4 GB** by combining: 1. **Structured Expert Pruning ($512 \rightarrow 256$ experts per layer):** Selects the 256 experts specialized for software engineering, coding, agentic tool calling, and vision. 2. **GSQ (Gumbel-Softmax Quantization) + RCO (Riemannian Co-design Search):** Assigns optimal mixed-precision GGUF quantization types across individual tensors while storing the retained weights at `~3.5 bits` (`IQ3_S`-equivalent fidelity, labeled `IQ1_M` for its `1.89` effective bits per parameter relative to the unpruned 512-expert model). --- Because this is an ultra-low-bit MoE model (`IQ1_M` effective / `IQ3_S` retained weights), **avoid pure greedy decoding (`--temp 0.0` with no repetition penalty)** on repetitive C/C++ struct definitions. Use standard Qwen sampling parameters with a light repetition/presence penalty:
AIが動く。未来が更新される。