AI正在发生 未来正在更新ThinkingCap-Qwen3.8-27B-GGUF
GGUF / llama.cpp quantizations of bottlecapai/ThinkingCap-Qwen3.8-27B — the ThinkingCap finetune of Qwen3.8-27B that cuts reasoning tokens by 37% on average while holding 85.8% average accuracy against the base model's 86.6%. ➡️ Full model description, evaluation results (multi-seed, statistically tested), the measured thinking-token reduction, recommended sampling params, and citation: see the main model card at bottlecapai/ThinkingCap-Qwen3.8-27B. The low-bit files are built with an **importance matrix** (activation statistics from a chat-templated calibration corpus) and a **per-tensor precision layout**: the attention projections of the full-attention layers and the linear-attention output projections stay at 6–8 bit while the feed-forward weights take the 4-bit hit.
译文尚未就绪，显示来源原文
GGUF / llama.cpp quantizations of bottlecapai/ThinkingCap-Qwen3.8-27B — the ThinkingCap finetune of Qwen3.8-27B that cuts reasoning tokens by 37% on average while holding 85.8% average accuracy against the base model's 86.6%. ➡️ Full model description, evaluation results (multi-seed, statistically tested), the measured thinking-token reduction, recommended sampling params, and citation: see the main model card at bottlecapai/ThinkingCap-Qwen3.8-27B. The low-bit files are built with an **importance matrix** (activation statistics from a chat-templated calibration corpus) and a **per-tensor precision layout**: the attention projections of the full-attention layers and the linear-attention output projections stay at 6–8 bit while the feed-forward weights take the 4-bit hit.