GLM-5.3-Flash-ewaste-edition-GGUF

模型介绍

This is a quantization of GLM-5.3-flash that is optimized to work better on older hardware. This quant was built using i-matrix GGUF quantizations with the same principle as the GLM-5.2 and GLM-5.3 e-waste editions: **K-quants for the routed experts, no codebook i-quants**, because on pre-AVX-512 CPUs and previous-generation datacenter GPUs (MI100 / gfx908) expert dequantization, not bandwidth, is the decode bottleneck. **Format: mainline llama.cpp `glm5-next`** (merged 2026-09-30, ggml-org/llama.cpp#27773). These files do **not** load in builds that only know the earlier `glm5next` arch from the unmerged PR #27754 (unsloth's September files are that format). Any llama.cpp from 2026-10 on loads them. The NextN/MTP head (blk.45) is in every file for when mainline's MTP support (#27917) lands. All are imatrix-quantized with unsloth's GLM-5.3-Flash importance matrix (88 chunks × 9216 tokens) from an **F32 intermediate** of the FP8 checkpoint (`fp8 × block scale` in F32; a BF16 intermediate re-rounds most weights because the scales are arbitrary floats). Tensors that mainline's quantizer keeps unquantized for this arch (hyper-connection mixers, DSA indexer, KDA gates/betas, `attn_kv_a_mqa`) are F32 in every file; `attn_q_a/q_b` and `nextn.eh_proj` are Q8_0 (mainline's floor). The MTP head's experts are Q4_K in every variant.

主要特点

特点摘要待依据来源补齐，不凭模型名称推断能力。

局限与注意事项

暂无足够来源支持具体缺点结论。请重点验证实际任务表现、时延、数据政策、许可与版本生命周期。

来源报价与费用分析

同一模型在不同渠道、地区和配置下可能采用不同价格。下表独立保留各渠道报价，不将渠道价格视为厂商官方统一价格。

公开评测与运行配置

暂无已采集的可核验公开评分。模型未上榜不代表能力较低。

常见问题

资料来源与可追溯记录

许可证：mit。模型介绍与第三方评测均以原来源的具体版本和方法为准。