Qwen3-30B-A3B-GGUF
All quants made using the imatrix option with a bilingual (English + Chinese) and code-heavy calibration dataset, so low-bit quants keep more of their Chinese and coding ability than a English-only calibration would. The `.imatrix` file used to produce these quants is included in this repo, so anyone can reproduce or extend the quant set with the exact same importance matrix. The first thing to figure out is how big a model you can run. For that you need to know how much RAM and/or VRAM you have.
译文尚未就绪,显示来源原文
All quants made using the imatrix option with a bilingual (English + Chinese) and code-heavy calibration dataset, so low-bit quants keep more of their Chinese and coding ability than a English-only calibration would. The `.imatrix` file used to produce these quants is included in this repo, so anyone can reproduce or extend the quant set with the exact same importance matrix. The first thing to figure out is how big a model you can run. For that you need to know how much RAM and/or VRAM you have.
AI正在发生 未来正在更新