Qwen3.8-Flash-Next-REAP-288-MLX-4bit

模型介绍

Qwen3.8-Flash-Next with 288 of 512 experts per MoE layer, pruned with REAP saliency calibrated on the quantized weights, on the machine that serves them. It is a 180B-class MoE that runs on a 128 GB Mac for Claude Code-style agentic workloads and scores 91.5% on HumanEval. Decode is runtime-dependent: ~28 tok/s on stock mlx-vlm today, and 37 to 65 tok/s on the pmlx engine that ships with the tiered release (see "Decode speed" for the full breakdown). It supports MTP speculative decoding out of the box. Resident memory is ~68 GB as shipped, or ~39 GB when the n-gram table is streamed from NVMe (see "Running it"). For the ~39 GB streamed footprint, run under omlx v0.6.4 or newer. omlx offloads the n-gram table to NVMe automatically when the full model would not fit under the memory ceiling, so the build serves in about 39 GB resident. mlx-vlm runs the same build today at about 68 GB resident, with the n-gram table in memory. It streams to about 39 GB once PR #2045 (external PLE storage) lands in a release, since this repo already ships the `ple-store.json` manifest and `ple_storage` config that path reads. mlx-vlm needs `qwen4_exp` MTP support (git main after 2026-08-27, or any release that includes it):

主要特点

特点摘要待依据来源补齐，不凭模型名称推断能力。

局限与注意事项

暂无足够来源支持具体缺点结论。请重点验证实际任务表现、时延、数据政策、许可与版本生命周期。

来源报价与费用分析

同一模型在不同渠道、地区和配置下可能采用不同价格。下表独立保留各渠道报价，不将渠道价格视为厂商官方统一价格。

公开评测与运行配置

暂无已采集的可核验公开评分。模型未上榜不代表能力较低。

常见问题

资料来源与可追溯记录

许可证：other。模型介绍与第三方评测均以原来源的具体版本和方法为准。