AI is happening. The future is updating.qwen3.8-27b-uncensored-nvfp4-modelopt
NVFP4 quantization of JonathanColetti/Qwen3.8-27B-Uncensored, produced with NVIDIA TensorRT Model Optimizer 0.43.0 for Blackwell-class inference under vLLM. **~65 GB bf16 → 19.2 GiB.** The multi-token-prediction head and the vision tower are both retained. Qwen3.8-27B is a hybrid stack — 64 layers of `3× (Gated DeltaNet → FFN) + 1× (Gated Attention → FFN)`. The DeltaNet decay and beta projections (`in_proj_a` / `in_proj_b`) are low-rank and precision-sensitive, so they are left at bf16 along with the causal `conv1d`.
NVFP4 quantization of JonathanColetti/Qwen3.8-27B-Uncensored, produced with NVIDIA TensorRT Model Optimizer 0.43.0 for Blackwell-class inference under vLLM. **~65 GB bf16 → 19.2 GiB.** The multi-token-prediction head and the vision tower are both retained. Qwen3.8-27B is a hybrid stack — 64 layers of `3× (Gated DeltaNet → FFN) + 1× (Gated Attention → FFN)`. The DeltaNet decay and beta projections (`in_proj_a` / `in_proj_b`) are low-rank and precision-sensitive, so they are left at bf16 along with the causal `conv1d`.