Dirk-Qwen3.8-27B-GGUF

モデル紹介

With our **Sharp chat template, MTP, and vision baked in**, the model answers lean and stays on-task out of the box. No template wrangling: download, point llama.cpp at it, go. If you want it to think deeper, set the effort level through `chat_template_kwargs`: Levels: `low`, `medium`, `xhigh` — `high` is accepted but is an alias for `xhigh`, not a step below it. Omit it for Dirk's lean default (medium). Turn thinking off entirely with `"enable_thinking": false`. - **Base:** `Qwen/Qwen3.8-27B`, a dense 27B **vision-language** model (vision preserved). - **Quant:** two quantizers, each where it is strongest. From 3 bpw up, Unsloth's **Dynamic 3.0** **UD** quants — their current generation, not an older ladder. Below that, **GSQ-RCO** quants from IST-DASLab, which hold up substantially better at 2–3 bpw (see the note under the file table). Every tier **keeps the model's MTP (`nextn`) head**: runtimes with multi-token-prediction speculative decoding can use it for faster generation. - **Template:** the Sharp chat template (Qwen 3.8-aware) — froggeric's fixed Qwen template plus a terseness system prompt, and turning off the xhigh thinking default. Every tier supports the terseness opt-out (`chat_template_kwargs: {"terse": false}`). The `GSQ-RCO-` tiers carry `v22.4.1`, which also stands down when the runtime injects its own tool protocol (an LM Studio fix); the `UD-` tiers carry `v22.4.0` and are otherwise identical — they pick up `v22.4.1` on the next pass. It is byte-swapped into the GGUF metadata; the weights and the MTP tensors are untouched.

主な特徴

特点摘要待依据来源补齐，不凭模型名称推断能力。

制約と注意点

具体的な制約を判断する出典が不足しています。実際の性能、遅延、データ方針、ライセンス、提供期間を確認してください。

出典別料金と費用分析

料金はチャネル・地域・設定によって異なります。各チャネルの料金は個別に表示し、提供元の統一公式料金とは見なしません。

公開評価と実行設定

暂无已采集的可核验公开评分。模型未上榜不代表能力较低。

よくある質問

出典と追跡記録

许可证：apache-2.0。模型介绍与第三方评测均以原来源的具体版本和方法为准。