Model overview
The repository contains a verbatim repack of the 3-bit ISTA-DASLab/Qwen3.8-27B-3Bit-GSQ checkpoint into the native NInfer `.ninfer` artifact format, sized to run the full 100,000-token, vision, and speculative-decoding profile on a single 16 GB **RTX 4080**. It is intended only for the RTX 4080 NInfer fork; it is not a Transformers checkpoint, Safetensors distribution, or GGUF file. The Text body is 320 matrices in the registered `Q3G128_F16S` scheme: symmetric 3-bit codes in `[-4, 3]`, one FP16 multiplier per 128-value group, 3.125 bits per weight. The token embedding, full output head, and optimized draft head use `Q4G64_F16S`; the MTP layer and Vision tower follow NInfer's registered `groupwise-int` recipes; the DFlash2 companion was requantized to `Q4G64_F16S`. The file also carries the tokenizer, chat-template, generation, and media-processor objects required by NInfer. The 323 packed matrices that come from the publisher's checkpoint — the 320 Text-body matrices, the token embedding, the full output head, and the draft head (a row gather of the output head) — are a lossless repack: every code and every group scale was copied unchanged, with only the publisher's shifted bit-plane transform inverted (`compressed-tensors` stores the unsigned `code + 2^(bits-1)` form; the artifact stores two's-complement fields). No code was requantized. The only value deviation from the source is **218 of 240,271,360** multipliers: bf16 subnormal words whose FP16 rounding error is at most `2**-25` (max observed `2.98e-8`), audited per group in the conversion report. The publisher's task evaluations therefore describe the represented Text and vocabulary weights.
Key features
特点摘要待依据来源补齐，不凭模型名称推断能力。
Limitations & considerations
Sources are insufficient to establish specific limitations. Verify task performance, latency, data policies, licensing and version lifecycle.
Source prices & cost analysis
Prices vary by channel, region and configuration. Channel quotes are listed independently and are not treated as a single official provider price.
| Source / channel | Input | Output | Billing unit | Collected at |
|---|---|---|---|---|
| No verified prices yet. Check the source channel. | ||||
Estimate monthly base token costs
Estimates exclude cache discounts, tiered pricing, multimodal surcharges, web search, taxes and additional reasoning output.
Public benchmarks & run configuration
暂无已采集的可核验公开评分。模型未上榜不代表能力较低。
View full indexed rankings →Frequently asked questions
Do open weights permit free commercial use?
Not necessarily. Check the version license, commercial conditions and usage policies. Self-hosting incurs compute and maintenance costs.
Are these real-time billing prices?
These are timestamped source snapshots, not live billing prices. Check the channel for current versions, regions, discounts and billing methods.
Sources & traceability
许可证：apache-2.0。模型介绍与第三方评测均以原来源的具体版本和方法为准。