Qwen3-235B-A22B-abliterated-FP8

Model overview

An **FP8-quantized abliterated** version of Qwen/Qwen3-235B-A22B. **This is the recommended version for inference** — it fits on 4x RTX Pro 6000 GPUs (384 GB total) and serves well under vLLM. Abliteration removes the dominant refusal direction from model weights using the technique from *Refusal in Language Models Is Mediated by a Single Direction* (Arditi et al.), making the model significantly less likely to refuse prompts while retaining its full capabilities. This started as research into abliteration, but also as a search for the best creative writing model I could run locally. Qwen3-235B has excellent prose quality, but its refusal behavior gets in the way of fiction — injecting disclaimers, refusing to write morally complex characters, hedging on anything edgy. Abliteration fixes this well, especially with a good system prompt. The BF16 weights (~438 GB) don't fit in 384 GB of VRAM, so this FP8 version is what I actually serve.

Key features

特点摘要待依据来源补齐，不凭模型名称推断能力。

Limitations & considerations

Sources are insufficient to establish specific limitations. Verify task performance, latency, data policies, licensing and version lifecycle.

Source prices & cost analysis

Prices vary by channel, region and configuration. Channel quotes are listed independently and are not treated as a single official provider price.

Public benchmarks & run configuration

暂无已采集的可核验公开评分。模型未上榜不代表能力较低。

Frequently asked questions

Sources & traceability

许可证：apache-2.0。模型介绍与第三方评测均以原来源的具体版本和方法为准。