foxAIAI正在发生 未来正在更新
中文
中文English日本語한국어

Unsloth-Ornith-1.5-35B-A3B

An imatrix-calibrated, **Unsloth-Dynamic-style** GGUF ladder for **Ornith-1.5-35B-A3B** — the model's own weights and chat template, re-quantized with a per-tensor precision policy and a fresh importance matrix. **The MTP (`nextn`) block is removed from every tier** — Ornith-1.5 ships it untrained, so it could only add size. Why. > ### Not affiliated with Unsloth > This is an independent, best-effort community reproduction of Unsloth's > Dynamic GGUF method — **not** an > official Unsloth release, and not endorsed by or connected to Unsloth in any way. Unsloth had not > published their own Ornith-1.5 quants at the time of writing and a lot of people wanted them, so > we published these while we wait. If and when Unsloth ship an official build, use theirs. "Unsloth" > is used here only to name the *method* these quants reproduce. 1. **Unsloth-Dynamic per-tensor policy.** Instead of one bit-width for the whole model, each tensor gets a type chosen by sensitivity — more bits where they matter (embeddings, attention, early/late layers), fewer where they don't. We transfer the published per-tensor recipe from Unsloth's `Qwen3.6-35B-A3B-GGUF` (same `qwen35moe` architecture) tier-for-tier. 2. **A fresh importance matrix.** Computed on Ornith's own `BF16` over an interleaved multilingual + code calibration corpus, so the quantizer knows which weights to protect for *this* model rather than inheriting someone else's statistics.

译文尚未就绪,显示来源原文

An imatrix-calibrated, **Unsloth-Dynamic-style** GGUF ladder for **Ornith-1.5-35B-A3B** — the model's own weights and chat template, re-quantized with a per-tensor precision policy and a fresh importance matrix. **The MTP (`nextn`) block is removed from every tier** — Ornith-1.5 ships it untrained, so it could only add size. Why. > ### Not affiliated with Unsloth > This is an independent, best-effort community reproduction of Unsloth's > Dynamic GGUF method — **not** an > official Unsloth release, and not endorsed by or connected to Unsloth in any way. Unsloth had not > published their own Ornith-1.5 quants at the time of writing and a lot of people wanted them, so > we published these while we wait. If and when Unsloth ship an official build, use theirs. "Unsloth" > is used here only to name the *method* these quants reproduce. 1. **Unsloth-Dynamic per-tensor policy.** Instead of one bit-width for the whole model, each tensor gets a type chosen by sensitivity — more bits where they matter (embeddings, attention, early/late layers), fewer where they don't. We transfer the published per-tensor recipe from Unsloth's `Qwen3.6-35B-A3B-GGUF` (same `qwen35moe` architecture) tier-for-tier. 2. **A fresh importance matrix.** Computed on Ornith's own `BF16` over an interleaved multilingual + code calibration corpus, so the quantizer knows which weights to protect for *this* model rather than inheriting someone else's statistics.

资料来源

huggingface.co ↗