LFM2.5-2.6B-GGUF-shards
- `source/`: LiquidAI's BF16 GGUF (LiquidAI/LFM2.5-2.6B-GGUF), unchanged. - `types/ -hq.gguf`, `types/ -hq1.gguf`: the tensors at llama.cpp type `T`, rebuilt from the BF16 weights in two Hessian-quantized (GPTQ-family) builds: `-hq`, the higher-quality one, the block tensors; `-hq1`, the first build, every quantized tensor. Same type, format and size as llama.cpp's: plain GGUF types, for stock llama.cpp (a GGUF assembled from them holds the plain type `T`); modified versions of the original weights. - `data/`: the calibration data the types were made from (token ids and their manifest). - `manifest.json` (`qcore-store/1`), `skeleton.gguf`, `store.json`, `records/`: what qalloc reads, with every tensor's offset and sha256. The first version of this store (bartowski's BF16 GGUF and imatrix, types by llama.cpp's `llama-quantize`) is at revision `fe50613`.
翻訳準備中のため原文を表示しています
- `source/`: LiquidAI's BF16 GGUF (LiquidAI/LFM2.5-2.6B-GGUF), unchanged. - `types/ -hq.gguf`, `types/ -hq1.gguf`: the tensors at llama.cpp type `T`, rebuilt from the BF16 weights in two Hessian-quantized (GPTQ-family) builds: `-hq`, the higher-quality one, the block tensors; `-hq1`, the first build, every quantized tensor. Same type, format and size as llama.cpp's: plain GGUF types, for stock llama.cpp (a GGUF assembled from them holds the plain type `T`); modified versions of the original weights. - `data/`: the calibration data the types were made from (token ids and their manifest). - `manifest.json` (`qcore-store/1`), `skeleton.gguf`, `store.json`, `records/`: what qalloc reads, with every tensor's offset and sha256. The first version of this store (bartowski's BF16 GGUF and imatrix, types by llama.cpp's `llama-quantize`) is at revision `fe50613`.
AIが動く。未来が更新される。