AIが動く。未来が更新される。LFM2.5-2.6B-GGUF
17 GGUF files of LiquidAI/LFM2.5-2.6B at the sizes of bartowski's quants and LiquidAI's own, with 26–77 % less KL divergence than the published file of the same size (about half or less from 3 to 5 bits per weight). Two things make the difference: **Build your own size:** the qalloc app solves the mix for any size you pick and assembles the GGUF in your browser, tensor by tensor from the store. Per token, against the BF16 model: the mean KL divergence and its 99th percentile (lower is better), and how often the most likely next token is the BF16 model's (higher is better), for the published file of the same size → this file. Where two published files are within 1 % of each other's size, one file here serves both.
翻訳準備中のため原文を表示しています
17 GGUF files of LiquidAI/LFM2.5-2.6B at the sizes of bartowski's quants and LiquidAI's own, with 26–77 % less KL divergence than the published file of the same size (about half or less from 3 to 5 bits per weight). Two things make the difference: **Build your own size:** the qalloc app solves the mix for any size you pick and assembles the GGUF in your browser, tensor by tensor from the store. Per token, against the BF16 model: the mean KL divergence and its 99th percentile (lower is better), and how often the most likely next token is the BF16 model's (higher is better), for the published file of the same size → this file. Where two published files are within 1 % of each other's size, one file here serves both.