AI正在发生 未来正在更新K2-Horizon-0.9B-GGUF
> [!NOTE] > This repository contains GGUF versions of the IFM/K2-Horizon-0.9B for use with `llama.cpp`. > > Multiple precision and quantization variants are available, including `BF16`, `Q8_0`, `Q6_K`, `Q5_K_M`, `Q5_0`, and `Q4_K_M`. All GGUF files include tokenizer metadata and a llama.cpp-compatible chat template. > [!WARNING] > **💡 Important Deployment Notes:** These models require a version of `llama.cpp` containing K2 Horizon architecture support. Mainline support merged in release b11454. K2-Horizon-0.9B is the compact dense member of the K2-Horizon family: a 0.9B-class decoder-only model with a 128K context window.
译文尚未就绪，显示来源原文
> [!NOTE] > This repository contains GGUF versions of the IFM/K2-Horizon-0.9B for use with `llama.cpp`. > > Multiple precision and quantization variants are available, including `BF16`, `Q8_0`, `Q6_K`, `Q5_K_M`, `Q5_0`, and `Q4_K_M`. All GGUF files include tokenizer metadata and a llama.cpp-compatible chat template. > [!WARNING] > **💡 Important Deployment Notes:** These models require a version of `llama.cpp` containing K2 Horizon architecture support. Mainline support merged in release b11454. K2-Horizon-0.9B is the compact dense member of the K2-Horizon family: a 0.9B-class decoder-only model with a 128K context window.