tencent_UI-Mate-9B-GGUF
**Model details:** - Parameter count: 9B - Input support: text, image (with mmproj file) - details - Speculative decoding: no - imatrix: yes - details - Perplexity/KLD measured: no **Don't know which to choose?** Grab Q4_K_M (5.91GB) - usually a good mix of size and performance. Download instructions available here These quants were made with llama.cpp release b10472 - if this model's architecture is newly supported, you'll need that release or newer to run them.
译文尚未就绪,显示来源原文
**Model details:** - Parameter count: 9B - Input support: text, image (with mmproj file) - details - Speculative decoding: no - imatrix: yes - details - Perplexity/KLD measured: no **Don't know which to choose?** Grab Q4_K_M (5.91GB) - usually a good mix of size and performance. Download instructions available here These quants were made with llama.cpp release b10472 - if this model's architecture is newly supported, you'll need that release or newer to run them.
AI正在发生 未来正在更新