K2-Horizon-7B-GGUF

**Model details:** - Parameter count: 9B (source checkpoint) - Input support: text - Speculative decoding: no - imatrix: yes - details **Don't know which to choose?** Grab Q4_K_M (5.78GB) - usually a good mix of size and performance. Download instructions available here These quants were made with llama.cpp release b11462 - if this model's architecture is newly supported, you'll need that release or newer to run them.