LFM2.5-2.6B-GGUF
17 GGUF files of LiquidAI/LFM2.5-2.6B at the sizes of bartowski's quants and LiquidAI's own, with 26–77 % less KL divergence than the published file of the same size (about half or less from 3 to 5 bits per weight). Two things make the difference: **Build your own size:** the qalloc app solves the mix for any size you pick and assembles the GGUF in your browser, tensor by tensor from the store. Per token, against the BF16 model: the mean KL divergence and its 99th percentile (lower is better), and how often the most likely next token is the BF16 model's (higher is better), for the published file of the same size → this file. Where two published files are within 1 % of each other's size, one file here serves both.
번역 준비 중입니다. 원문을 표시합니다.
17 GGUF files of LiquidAI/LFM2.5-2.6B at the sizes of bartowski's quants and LiquidAI's own, with 26–77 % less KL divergence than the published file of the same size (about half or less from 3 to 5 bits per weight). Two things make the difference: **Build your own size:** the qalloc app solves the mix for any size you pick and assembles the GGUF in your browser, tensor by tensor from the store. Per token, against the BF16 model: the mean KL divergence and its 99th percentile (lower is better), and how often the most likely next token is the BF16 model's (higher is better), for the published file of the same size → this file. Where two published files are within 1 % of each other's size, one file here serves both.
AI가 움직이고 미래가 업데이트됩니다.