Qwen3.8-Flash-Next-NVFP4-Q8-Mix-Strata

Qwen's original Qwen3.8-Flash-Next with **our NVFP4 GPTQ experts, and Q8_0 in the layers that move the answers most**, packed for Strata NVFP4. It is the most accurate model that fits a **128 GB PC** with every expert in RAM. Its most likely next token is the Q8_0 model's 95.0% of the time, against 93.6% for the all-NVFP4 GPTQ, and it moves the answers 43% less (KL). It decodes at about half the GPTQ model's speed. **Quick start (Windows):** from the Strata NVFP4 release 0.1.42-nvfp4.2 or newer, run `START-HERE.bat --family qwen-nvfp4-mix`: it checks the PC, downloads this repository (only its experts if `qwen-nvfp4-gptq` is installed: the other files are the same) and starts the model. `pack/mix.json` has the plan. - **Everything but the experts is the same as in the NVFP4 GPTQ repository**, byte for byte: the dense GGUF (Q8_0 projections; router, small tensors and norms BF16 / F32), Qwen's own FP8 PLE table, the BF16 embedding and the MTP draft head. - **The original model, censored, with a switch.** It refuses what Qwen refuses. The fork can remove the refusal direction at run time (layers 8-33, the weights untouched): `--uncensored on` at install, the web app's "Disable censorship" switch, or `"uncensored": true` in a request. Checked on this pack: 5 of 5 held-out harmful requests refused with it off, 0 of 5 with it on. - **Only for Strata NVFP4.** The files are Strata's runtime formats. They do not load in transformers, vLLM or llama.cpp.

译文尚未就绪，显示来源原文