Model overview
With our **Sharp chat template, MTP, and vision baked in**, the model answers lean and stays on-task out of the box. No template wrangling: download, point llama.cpp at it, go. If you want it to think deeper, set the effort level through `chat_template_kwargs`: Levels: `low`, `medium`, `xhigh` — `high` is accepted but is an alias for `xhigh`, not a step below it. Omit it for Dirk's lean default (medium). Turn thinking off entirely with `"enable_thinking": false`. - **Base:** `Qwen/Qwen3.8-27B`, a dense 27B **vision-language** model (vision preserved). - **Quant:** two quantizers, each where it is strongest. From 3 bpw up, Unsloth's **Dynamic 3.0** **UD** quants — their current generation, not an older ladder. Below that, **GSQ-RCO** quants from IST-DASLab, which hold up substantially better at 2–3 bpw (see the note under the file table). Every tier **keeps the model's MTP (`nextn`) head**: runtimes with multi-token-prediction speculative decoding can use it for faster generation. - **Template:** the Sharp chat template (Qwen 3.8-aware) — froggeric's fixed Qwen template plus a terseness system prompt, and turning off the xhigh thinking default. Every tier supports the terseness opt-out (`chat_template_kwargs: {"terse": false}`). The `GSQ-RCO-` tiers carry `v22.4.1`, which also stands down when the runtime injects its own tool protocol (an LM Studio fix); the `UD-` tiers carry `v22.4.0` and are otherwise identical — they pick up `v22.4.1` on the next pass. It is byte-swapped into the GGUF metadata; the weights and the MTP tensors are untouched.
Key features
特点摘要待依据来源补齐，不凭模型名称推断能力。
Limitations & considerations
Sources are insufficient to establish specific limitations. Verify task performance, latency, data policies, licensing and version lifecycle.
Source prices & cost analysis
Prices vary by channel, region and configuration. Channel quotes are listed independently and are not treated as a single official provider price.
| Source / channel | Input | Output | Billing unit | Collected at |
|---|---|---|---|---|
| No verified prices yet. Check the source channel. | ||||
Estimate monthly base token costs
Estimates exclude cache discounts, tiered pricing, multimodal surcharges, web search, taxes and additional reasoning output.
Public benchmarks & run configuration
暂无已采集的可核验公开评分。模型未上榜不代表能力较低。
View full indexed rankings →Frequently asked questions
Do open weights permit free commercial use?
Not necessarily. Check the version license, commercial conditions and usage policies. Self-hosting incurs compute and maintenance costs.
Are these real-time billing prices?
These are timestamped source snapshots, not live billing prices. Check the channel for current versions, regions, discounts and billing methods.
Sources & traceability
许可证：apache-2.0。模型介绍与第三方评测均以原来源的具体版本和方法为准。