OrcaRouter-Qwen3.8-Flash-Next-Uncensored-NVFP4-GPTQ-Strata

> [!WARNING] > **Withdrawn from Strata NVFP4's installer (2026-10-10): as an agent, this abliterated build is much worse than the > original Qwen.** > - **A multi-step Claude Code task** (building an interactive 3D page), same prompt on both models: the original > Qwen3.8-Flash-Next (our GPTQ of it) > ran 175 steps, checking and fixing its work from screenshots, and gave a clearly better result. This build > stopped after 10-70 steps (3 runs) and declared the work done. > - **It closes its thinking sooner.** Over 7,869 positions of the original model's thinking (teacher-forced), this > pack raises the probability of ` ` by +0.12 nats on average. > - On a captured 72K-token Claude Code request (5 greedy runs each) it thought 997 tokens on average, the original > 1,699. > - Its style of thinking is the same; it just stops earlier. > - The likely cause is OrcaRouter's weight edit: it removes the refusal direction from all 149 residual-writing > matrices of every layer, including the late layers whose edit pushes ` `. > - **What the installer offers instead.** From Strata NVFP4 0.1.41-nvfp4.5: > - the original Qwen (`--family qwen-nvfp4-gptq`), with an opt-in switch (`--uncensored on`, off by default); > - the switch removes refusals at run time, in layers 8-33 only, and leaves the weights untouched; > - with thinking on it refused 0 of 104 English and 0 of 30 Ukrainian held-out harmful requests; > - ` ` +0.02 nats; thinking length as the original's. > > An existing install of this model keeps working, and the files here are unchanged. **Installer:** Strata NVFP4 v0.1.41-nvfp4.1 to .4 listed this repository as `--family orca-nvfp4` (the default from .3). From v0.1.41-nvfp4.5 the installer no longer offers it (see the warning above). To run this model by hand, see Run it. - **Chain:** `Qwen/Qwen3.8-Flash-Next` → `orcarouter/Qwen3.8-Flash-Next-Uncensored` (abliteration, BF16) → this quantization. - **Same size and the same decode cost as the ModelOpt NVFP4 experts** (63.3 GiB, 4.5 bits a weight), about **33% of their error** on held-out tokens: the same format, other codes and scales. - End to end, an earlier build of the same recipe (2026-10-02, the fork's docs/NVFP4.md) had a median per-answer KL of 0.0070 against an all-Q8_0 reference where ModelOpt's experts had 0.0107 (65%), better in 12 of 12 prompts. This build was checked as described under Checks, not re-

번역 준비 중입니다. 원문을 표시합니다.