Dirk-Qwen3.8-27B-GGUF

모델 소개

With our **Sharp chat template, MTP, and vision baked in**, the model answers lean and stays on-task out of the box. No template wrangling: download, point llama.cpp at it, go. If you want it to think deeper, set the effort level through `chat_template_kwargs`: Levels: `low`, `medium`, `xhigh` — `high` is accepted but is an alias for `xhigh`, not a step below it. Omit it for Dirk's lean default (medium). Turn thinking off entirely with `"enable_thinking": false`. - **Base:** `Qwen/Qwen3.8-27B`, a dense 27B **vision-language** model (vision preserved). - **Quant:** two quantizers, each where it is strongest. From 3 bpw up, Unsloth's **Dynamic 3.0** **UD** quants — their current generation, not an older ladder. Below that, **GSQ-RCO** quants from IST-DASLab, which hold up substantially better at 2–3 bpw (see the note under the file table). Every tier **keeps the model's MTP (`nextn`) head**: runtimes with multi-token-prediction speculative decoding can use it for faster generation. - **Template:** the Sharp chat template (Qwen 3.8-aware) — froggeric's fixed Qwen template plus a terseness system prompt, and turning off the xhigh thinking default. Every tier supports the terseness opt-out (`chat_template_kwargs: {"terse": false}`). The `GSQ-RCO-` tiers carry `v22.4.1`, which also stands down when the runtime injects its own tool protocol (an LM Studio fix); the `UD-` tiers carry `v22.4.0` and are otherwise identical — they pick up `v22.4.1` on the next pass. It is byte-swapped into the GGUF metadata; the weights and the MTP tensors are untouched.

주요 특징

特点摘要待依据来源补齐，不凭模型名称推断能力。

한계 및 유의 사항

구체적 한계를 판단할 출처가 부족합니다. 실제 성능, 지연, 데이터 정책, 라이선스와 버전 수명을 확인하세요.

출처별 요금 및 비용 분석

요금은 채널, 지역, 설정에 따라 다릅니다. 각 채널 요금은 개별 표시되며 제공사의 통일 공식 요금이 아닙니다.

공개 평가 및 실행 설정

暂无已采集的可核验公开评分。模型未上榜不代表能力较低。

자주 묻는 질문

출처 및 추적 기록

许可证：apache-2.0。模型介绍与第三方评测均以原来源的具体版本和方法为准。