MODEL PROFILE

Ornith-1.0-35B-GGUF-llamacpp-tp1

LordNeel · Ornith-1.0-35B-GGUF-llamacpp-tp1

Single-GPU llama.cpp GGUF package for `deepreinforce-ai/Ornith-1.0-35B`. The supported serving policy is `tp=1` — one model copy per GPU. Multi-GPU tensor-parallel serving is intentionally out of scope for this version. This release ships six body quants (Q3_K_M → Q8_0) plus an **integrated IQ4_XS-MTP graft** that adds a native multi-token-prediction (MTP) draft head for low-concurrency speculative decode. Quant quality is measured against the upstream BF16 GGUF with a native llama.cpp next-token top-64 KL-divergence probe over 32 coding prompts. > **MTP graft note:** active MTP is byte-for-byte identical to target-only at the > next-token (API-visible) level, and gives ~1.3× single-stream decode. It is > **not** bit-exact to target-only over long deterministic sequences — see > MTP. Use target-only for strict reproduction, > MTP for throughput on open-ended work.

Text generationlicense:mit
Context windowNot disclosed
Input → OutputText → Text
Model weightsNot verified
Profile updated2026/11/2 19:16:38
OVERVIEW

Model overview

Single-GPU llama.cpp GGUF package for `deepreinforce-ai/Ornith-1.0-35B`. The supported serving policy is `tp=1` — one model copy per GPU. Multi-GPU tensor-parallel serving is intentionally out of scope for this version. This release ships six body quants (Q3_K_M → Q8_0) plus an **integrated IQ4_XS-MTP graft** that adds a native multi-token-prediction (MTP) draft head for low-concurrency speculative decode. Quant quality is measured against the upstream BF16 GGUF with a native llama.cpp next-token top-64 KL-divergence probe over 32 coding prompts. > **MTP graft note:** active MTP is byte-for-byte identical to target-only at the > next-token (API-visible) level, and gives ~1.3× single-stream decode. It is > **not** bit-exact to target-only over long deterministic sequences — see > MTP. Use target-only for strict reproduction, > MTP for throughput on open-ended work.

Key features

特点摘要待依据来源补齐,不凭模型名称推断能力。

Limitations & considerations

Sources are insufficient to establish specific limitations. Verify task performance, latency, data policies, licensing and version lifecycle.

PRICING & COST

Source prices & cost analysis

Prices vary by channel, region and configuration. Channel quotes are listed independently and are not treated as a single official provider price.

Source / channelInputOutputBilling unitCollected at
No verified prices yet. Check the source channel.

Estimate monthly base token costs

—

Estimates exclude cache discounts, tiered pricing, multimodal surcharges, web search, taxes and additional reasoning output.

INDEPENDENT BENCHMARKS

Public benchmarks & run configuration

暂无已采集的可核验公开评分。模型未上榜不代表能力较低。

View full indexed rankings →

Frequently asked questions

Do open weights permit free commercial use?

Not necessarily. Check the version license, commercial conditions and usage policies. Self-hosting incurs compute and maintenance costs.

Are these real-time billing prices?

These are timestamped source snapshots, not live billing prices. Check the channel for current versions, regions, discounts and billing methods.

Sources & traceability

许可证:mit。模型介绍与第三方评测均以原来源的具体版本和方法为准。