AI正在发生 未来正在更新Hy3-GGUF
Dedicated to building a more intuitive, comprehensive, and efficient LLMs compression toolkit. 📖 Documentation    |   🤗 Hugging Face    |   🤖 ModelScope    |   💬 WeChat Low-bit quantized **Hy3 (hy_v3)** GGUFs for llama.cpp — ready to run out of the box, with MTP self-speculative decoding. This repo ships the quantized models, plus the mixed-precision recipes to build your own from a calibration set.
译文尚未就绪，显示来源原文
Dedicated to building a more intuitive, comprehensive, and efficient LLMs compression toolkit. 📖 Documentation    |   🤗 Hugging Face    |   🤖 ModelScope    |   💬 WeChat Low-bit quantized **Hy3 (hy_v3)** GGUFs for llama.cpp — ready to run out of the box, with MTP self-speculative decoding. This repo ships the quantized models, plus the mixed-precision recipes to build your own from a calibration set.