AIが動く。未来が更新される。Hy3-GGUF
Dedicated to building a more intuitive, comprehensive, and efficient LLMs compression toolkit. 📖 Documentation    |   🤗 Hugging Face    |   🤖 ModelScope    |   💬 WeChat Low-bit quantized **Hy3 (hy_v3)** GGUFs for llama.cpp — ready to run out of the box, with MTP self-speculative decoding. This repo ships the quantized models, plus the mixed-precision recipes to build your own from a calibration set.
翻訳準備中のため原文を表示しています
Dedicated to building a more intuitive, comprehensive, and efficient LLMs compression toolkit. 📖 Documentation    |   🤗 Hugging Face    |   🤖 ModelScope    |   💬 WeChat Low-bit quantized **Hy3 (hy_v3)** GGUFs for llama.cpp — ready to run out of the box, with MTP self-speculative decoding. This repo ships the quantized models, plus the mixed-precision recipes to build your own from a calibration set.