MODEL PROFILE

GLM-5.3-Flash-GGUF

vcruz305 · GLM-5.3-Flash-GGUF

Community llama.cpp GGUFs of Z.ai's GLM-5.3-Flash (`Glm5NextForConditionalGeneration`, 320B-A18B, native multimodal). **This pack is the first working GGUF conversion of GLM-5.3-Flash.** The convert registers GGUF arch `glm5next` and maps the 5.3 hybrid end-to-end: **KDA** (gated delta-net), **NoPE sparse MLA** + lightning indexer + **IndexPool**, **mHC**, **288-expert MoE** + shared expert, **MTP / NextN**, and the **vision tower as mmproj**. It is a 5.3 convert, not a GLM-5.2 `GlmMoeDsa` class rename (that path only covers the 11 MLA blocks and drops the 34 KDA layers). `llama-quantize` on that same `glm5next` build wrote the K-quants below (Q2_K 2.91 BPW, Q4_K_M 4.81 BPW). **Run** these GGUFs on vcruz305/llama.cpp `main` / `glm5next-mtp` (`ea37b8b`): Unsloth glm5next graph plus **NextN `graph_mtp`**, with the trunk emitting `t_h_nextn` so `--spec-type draft-mtp` can accept. ggml-org drafts #27752, #27754, #27773 load the weights; MTP decode is on this fork.

Text generationmultimodallicense:mit
Context windowNot disclosed
Input → OutputText → Text
Model weightsNot verified
Profile updated2026/11/2 19:16:13
OVERVIEW

Model overview

Community llama.cpp GGUFs of Z.ai's GLM-5.3-Flash (`Glm5NextForConditionalGeneration`, 320B-A18B, native multimodal). **This pack is the first working GGUF conversion of GLM-5.3-Flash.** The convert registers GGUF arch `glm5next` and maps the 5.3 hybrid end-to-end: **KDA** (gated delta-net), **NoPE sparse MLA** + lightning indexer + **IndexPool**, **mHC**, **288-expert MoE** + shared expert, **MTP / NextN**, and the **vision tower as mmproj**. It is a 5.3 convert, not a GLM-5.2 `GlmMoeDsa` class rename (that path only covers the 11 MLA blocks and drops the 34 KDA layers). `llama-quantize` on that same `glm5next` build wrote the K-quants below (Q2_K 2.91 BPW, Q4_K_M 4.81 BPW). **Run** these GGUFs on vcruz305/llama.cpp `main` / `glm5next-mtp` (`ea37b8b`): Unsloth glm5next graph plus **NextN `graph_mtp`**, with the trunk emitting `t_h_nextn` so `--spec-type draft-mtp` can accept. ggml-org drafts #27752, #27754, #27773 load the weights; MTP decode is on this fork.

Key features

特点摘要待依据来源补齐,不凭模型名称推断能力。

Limitations & considerations

Sources are insufficient to establish specific limitations. Verify task performance, latency, data policies, licensing and version lifecycle.

PRICING & COST

Source prices & cost analysis

Prices vary by channel, region and configuration. Channel quotes are listed independently and are not treated as a single official provider price.

Source / channelInputOutputBilling unitCollected at
No verified prices yet. Check the source channel.

Estimate monthly base token costs

—

Estimates exclude cache discounts, tiered pricing, multimodal surcharges, web search, taxes and additional reasoning output.

INDEPENDENT BENCHMARKS

Public benchmarks & run configuration

暂无已采集的可核验公开评分。模型未上榜不代表能力较低。

View full indexed rankings →

Frequently asked questions

Do open weights permit free commercial use?

Not necessarily. Check the version license, commercial conditions and usage policies. Self-hosting incurs compute and maintenance costs.

Are these real-time billing prices?

These are timestamped source snapshots, not live billing prices. Check the channel for current versions, regions, discounts and billing methods.

Sources & traceability

许可证:mit。模型介绍与第三方评测均以原来源的具体版本和方法为准。