Kolibri-1-mlx-mixed-4-8-bit

模型介绍

This model was converted to MLX format from `Aleph-Alpha/Kolibri-1` (FP8 checkpoint, 128x128 block scales) with the converter in kolibri-mlx, in mlx-lm 0.32.0 format: mixed affine quantisation, group size 64: routed experts (`switch_mlp.*`) 4-bit; attention projections, shared expert, embeddings and `lm_head` 8-bit; MoE router gates (`mlp.gate`) kept unquantised in bfloat16. Refer to the original model card for details on the model. Kolibri 1 is a mixture-of-experts model (50 layers, 384 experts, 6 routed plus 1 shared expert per token, sliding-window attention of 513 tokens in a 4:1 sliding:full pattern). The model is 42 GiB on disk and needs about 45.4 GB of unified memory, so it needs a Mac with 64 GB. **Stock mlx-lm cannot load this model yet.** mlx-lm does not include the `kolibri1` architecture, so `mlx_lm.load`, `mlx_lm.generate` and `mlx_lm.server` fail on it with an unsupported model type. Until mlx-lm gains `kolibri1` support, install kolibri-mlx and run `import kolibri_mlx.register` before loading; this registers the out-of-tree model file with mlx-lm in the current process.

主要特点

特点摘要待依据来源补齐，不凭模型名称推断能力。

局限与注意事项

暂无足够来源支持具体缺点结论。请重点验证实际任务表现、时延、数据政策、许可与版本生命周期。

来源报价与费用分析

同一模型在不同渠道、地区和配置下可能采用不同价格。下表独立保留各渠道报价，不将渠道价格视为厂商官方统一价格。

公开评测与运行配置

暂无已采集的可核验公开评分。模型未上榜不代表能力较低。

常见问题

资料来源与可追溯记录

许可证：apache-2.0。模型介绍与第三方评测均以原来源的具体版本和方法为准。