Lythri_Lythri-4B-A2B-GGUF

**Model details:** - Parameter count: 5B (source checkpoint) - Input support: text - Speculative decoding: no - imatrix: yes - details **Don't know which to choose?** Grab Q4_K_M (3.17GB) - usually a good mix of size and performance. Download instructions available here These quants were made with llama.cpp release b11279 - if this model's architecture is newly supported, you'll need that release or newer to run them.

번역 준비 중입니다. 원문을 표시합니다.