foxAIAI正在发生 未来正在更新
中文
中文English日本語한국어

Qwen3.6-27B-AEON-Ultimate-Uncensored-NVFP4

> [!IMPORTANT] > **Superseded by Qwen3.8 — use this instead:** `AEON-7/Qwen3.8-27B-AEON-ULTIMATE-UNCENSORED-NVFP4-MIXED` > > **Operator recipes (Spark Dynamic DFlash lattice, TP=2, RTX):** `AEON-7/Qwen3.8-27B-AEON-ULTIMATE-UNCENSORED` > > This Qwen3.6-27B card stays online for history and existing downloads. For new work, move to the Qwen3.8 Ultimate Uncensored NVFP4-MIXED release. That line is far superior in capability and reaches substantially more of what the architecture can do, with a more refined mixed quantization methodology (NVFP4 + FP8 lattice) than these older Qwen3.6 exports. > > Serve with the unified container: `ghcr.io/aeon-7/aeon-vllm-ultimate:latest` (Spark / GB10) or `ghcr.io/aeon-7/aeon-vllm-ultimate-rtx:latest` (RTX discrete). NVFP4 hardware-quantized release of `AEON-7/Qwen3.6-27B-AEON-Ultimate-Uncensored`. Same model, same 0/50 refusal rate, same preserved capabilities — now compressed from **51 GB BF16** to **26 GB NVFP4** for native FP4 hardware throughput on DGX Spark / GB10 / Blackwell sm_121a. This release is **multimodal-preserved** (vision tower stays BF16 — text + image inference fully functional) and **hybrid-attention-preserved** (the 48 linear-attention / GatedDeltaNet layers stay BF16; FP4 only applies to the 16 full-attention layers' output projections + all MLPs).

译文尚未就绪,显示来源原文

> [!IMPORTANT] > **Superseded by Qwen3.8 — use this instead:** `AEON-7/Qwen3.8-27B-AEON-ULTIMATE-UNCENSORED-NVFP4-MIXED` > > **Operator recipes (Spark Dynamic DFlash lattice, TP=2, RTX):** `AEON-7/Qwen3.8-27B-AEON-ULTIMATE-UNCENSORED` > > This Qwen3.6-27B card stays online for history and existing downloads. For new work, move to the Qwen3.8 Ultimate Uncensored NVFP4-MIXED release. That line is far superior in capability and reaches substantially more of what the architecture can do, with a more refined mixed quantization methodology (NVFP4 + FP8 lattice) than these older Qwen3.6 exports. > > Serve with the unified container: `ghcr.io/aeon-7/aeon-vllm-ultimate:latest` (Spark / GB10) or `ghcr.io/aeon-7/aeon-vllm-ultimate-rtx:latest` (RTX discrete). NVFP4 hardware-quantized release of `AEON-7/Qwen3.6-27B-AEON-Ultimate-Uncensored`. Same model, same 0/50 refusal rate, same preserved capabilities — now compressed from **51 GB BF16** to **26 GB NVFP4** for native FP4 hardware throughput on DGX Spark / GB10 / Blackwell sm_121a. This release is **multimodal-preserved** (vision tower stays BF16 — text + image inference fully functional) and **hybrid-attention-preserved** (the 48 linear-attention / GatedDeltaNet layers stay BF16; FP4 only applies to the 16 full-attention layers' output projections + all MLPs).

资料来源

huggingface.co ↗