Model overview
A 180 B model that runs **entirely on the GPU** of a 128 GB unified-memory box — 87.06 GiB at 4.23 bpw, within 2.5% perplexity of the unquantized model. Sized for the 96 GiB VRAM carve-out of a Strix Halo (Ryzen AI MAX+ 395 / Radeon 8060S). *Throughput against context depth, against our closest mainline-compatible quant run on both this fork and stock llama.cpp — numbers and discussion under Holding up at long context.* - **Everything stays on the GPU.** Not the experts, not the 51.2 B-parameter n-gram table. No host-RAM fallback, no CPU compute in the hot path. - **Fast prefill that holds at depth** — 423 t/s at 512 tokens, 357 t/s at 8k, still 245 t/s at 32k and 138 t/s at 128k. Prefill is compute-bound and the ROCmFP4 types are cheaper to dequantize. Matters most for long prompts, agentic loops, and anything that re-reads a large context. - **Better perplexity than that same mainline tier**, by about two standard errors, and better than AesSedai's IQ4_XS and IQ3_S at 20–30 GB smaller. - **Vision included** — the model's own tower, at f16, losslessly converted. - **Speculative decoding included** — the model's own MTP head. Up to **40 tok/s generation** observed on a Strix Halo with adaptive drafting; acceptance is content-dependent, so the rate moves with what you are generating. - **imatrix-calibrated** on 1540 chunks from two corpora, so the low-bit tensors are fitted to real activations rather than assumed.
Key features
特点摘要待依据来源补齐，不凭模型名称推断能力。
Limitations & considerations
Sources are insufficient to establish specific limitations. Verify task performance, latency, data policies, licensing and version lifecycle.
Source prices & cost analysis
Prices vary by channel, region and configuration. Channel quotes are listed independently and are not treated as a single official provider price.
| Source / channel | Input | Output | Billing unit | Collected at |
|---|---|---|---|---|
| No verified prices yet. Check the source channel. | ||||
Estimate monthly base token costs
Estimates exclude cache discounts, tiered pricing, multimodal surcharges, web search, taxes and additional reasoning output.
Public benchmarks & run configuration
暂无已采集的可核验公开评分。模型未上榜不代表能力较低。
View full indexed rankings →Frequently asked questions
Do open weights permit free commercial use?
Not necessarily. Check the version license, commercial conditions and usage policies. Self-hosting incurs compute and maintenance costs.
Are these real-time billing prices?
These are timestamped source snapshots, not live billing prices. Check the channel for current versions, regions, discounts and billing methods.
Sources & traceability
许可证：other。模型介绍与第三方评测均以原来源的具体版本和方法为准。