Offrail-27B-Uncensored

27B for 8GB and 12GB cards. OS-Software's uncensored Heretic build of Ternary Bonsai 2 27B (the 1.75 bpw PTQ1_0 file, 5.95 GB) with the Qwen 3.8 27B multi-token-prediction head grafted back on as block 64, so the PrismML llama.cpp fork runs `--spec-type draft-mtp` on it. The body is not ours: OS-Software baked a Heretic LoRA (rank 128, layers 27-44) into the official PQ2_0 ternary codes and kept the block scales, and their card calls it an approximate merge. Their test: **0/100 refusals** against the original's 95/100 at KL divergence 0.0135, WikiText-2 perplexity 10.1435. Their test, not ours: we have not run a refusal baseline of our own (HarmBench needs a second GPU for its judge model). What is ours: the graft, the two merged files and the graft tooling, plus the PTQ1_0 mat-vec kernel (PrismML-Eng/llama.cpp#218) on top of PrismML's fork. What is not ours: the head's weights are Qwen's, the MTP graph and the `GGML_CUDA_BATCH_INVARIANT` switch are PrismML's fork, the uncensoring is OS-Software's, the compression is PrismML's.

译文尚未就绪，显示来源原文