Ling-3.0-tiny-GGUF
GGUF conversions of inclusionAI/Ling-3.0-tiny, converted directly from the released BF16 safetensors. Consistent agentic use (tool calling, reasoning split) currently requires two unmerged llama.cpp PRs: - Dedicated Ling parser: #28682 (✅ Merged as of 9/19) - Invalid UTF-8 handling in the PEG parser: #29161 (✅ Merged as of 9/20) Without both, tool calls inside an unclosed think block are dropped and some turns fail with a 500. Will update this note as they merge.
译文尚未就绪,显示来源原文
GGUF conversions of inclusionAI/Ling-3.0-tiny, converted directly from the released BF16 safetensors. Consistent agentic use (tool calling, reasoning split) currently requires two unmerged llama.cpp PRs: - Dedicated Ling parser: #28682 (✅ Merged as of 9/19) - Invalid UTF-8 handling in the PEG parser: #29161 (✅ Merged as of 9/20) Without both, tool calls inside an unclosed think block are dropped and some turns fail with a 500. Will update this note as they merge.
AI正在发生 未来正在更新