AI is happening. The future is updating.K2-Horizon-MoVA-36B-A4B-GGUF
☕ If this GGUF made your day easier, a coffee would make mine. Send a coffee ☕ I build and test these releases myself. Your coffee helps keep me going. Thank you for supporting this work. K2-Horizon-MoVA-36B-A4B is a sparse Mixture-of-Experts model with Mixture-of-Values attention (MoVA). The upstream checkpoint has 36B total parameters and activates about 4B parameters per token. It advertises a native 524,288-token context window and is intended for reasoning, coding, agentic, and long-context workloads. See the official model card for the original model, serving recipes, prompt conventions, and upstream results. *Upstream K2-Horizon-MoVA-36B-A4B benchmark results; the image and scores are from the official model card.*
☕ If this GGUF made your day easier, a coffee would make mine. Send a coffee ☕ I build and test these releases myself. Your coffee helps keep me going. Thank you for supporting this work. K2-Horizon-MoVA-36B-A4B is a sparse Mixture-of-Experts model with Mixture-of-Values attention (MoVA). The upstream checkpoint has 36B total parameters and activates about 4B parameters per token. It advertises a native 524,288-token context window and is intended for reasoning, coding, agentic, and long-context workloads. See the official model card for the original model, serving recipes, prompt conventions, and upstream results. *Upstream K2-Horizon-MoVA-36B-A4B benchmark results; the image and scores are from the official model card.*