AI正在发生 未来正在更新LFM2.5-8B-A1B-DSpark-GGUF
GGUF build of `LiquidAI/LFM2.5-8B-A1B-DSpark` for **llama.cpp** (DSpark speculative decoding is in mainline, ggml-org/llama.cpp #25173). This is a standalone **draft sidecar**: it carries only the drafter (5 attention layers, rank-256 Markov head, confidence head, block size 9). Token embeddings and the LM head are shared from the target model at load time, so it must be paired with a LFM2.5-8B-A1B-GGUF target file. Draft quantization changes speed only marginally (the drafter is a small share of each cycle); choose by memory budget. The target model quant is the main speed/quality lever and is independent of this file. The block size is read from the sidecar metadata (n-max is clamped to it). Speculative decoding is **exact**: the target verifies every proposed token, so greedy output equals the target alone; per-response `timings` report `draft_n` / `draft_n_accepted`.
译文尚未就绪，显示来源原文
GGUF build of `LiquidAI/LFM2.5-8B-A1B-DSpark` for **llama.cpp** (DSpark speculative decoding is in mainline, ggml-org/llama.cpp #25173). This is a standalone **draft sidecar**: it carries only the drafter (5 attention layers, rank-256 Markov head, confidence head, block size 9). Token embeddings and the LM head are shared from the target model at load time, so it must be paired with a LFM2.5-8B-A1B-GGUF target file. Draft quantization changes speed only marginally (the drafter is a small share of each cycle); choose by memory budget. The target model quant is the main speed/quality lever and is independent of this file. The block size is read from the sidecar metadata (n-max is clamped to it). Speculative decoding is **exact**: the target verifies every proposed token, so greedy output equals the target alone; per-response `timings` report `draft_n` / `draft_n_accepted`.