Qwen3-128k-30B-A3B-NEO-MAX-Imatrix-gguf

Special note: All quants of this model can be used on GPU and/or CPU/RAM only due to unique construction of the model. There are also several versions of quant sizes with special features too. GGUF NEO Imatrix ggufs of Qwen's new "Qwen3-30B-A3B" Mixture of experts model, extended to 128k (131072) (up from 32k/32768) context as per Qwen tech notes using "YARN". NEO Imatrix dataset was developed in house after testing and evaluating over 50 Imatrix datasets and a lot of "tinkering".

翻訳準備中のため原文を表示しています