AI is happening. The future is updating.Clef-Flash-GGUF
Low-bit quantizations (Q4_K_M, IQ3_XXS, IQ2_M, IQ2_XS) of Cloudflare/clef-flash in the native `clef` GGUF architecture. Serve with `llama-server` b11415 or later (`/v1/systemone`, llama.cpp#29831). Run through `llama-server` b11415 (`/v1/systemone`, Vulkan, AMD Radeon 8060S), one request at a time, with the same 600 items for every model: 200 each from SST-2 (validation), AG News (test) and BoolQ (validation), sampled with a fixed seed. Agreement and KL are against `Clef-Flash-Q8_0.gguf` from ggml-org, not against bf16. Livesport's per-tensor layout applied step by step to IQ2_M (all with the head at Q8_0), same 600 items, against the same Q8_0 baseline.
Low-bit quantizations (Q4_K_M, IQ3_XXS, IQ2_M, IQ2_XS) of Cloudflare/clef-flash in the native `clef` GGUF architecture. Serve with `llama-server` b11415 or later (`/v1/systemone`, llama.cpp#29831). Run through `llama-server` b11415 (`/v1/systemone`, Vulkan, AMD Radeon 8060S), one request at a time, with the same 600 items for every model: 200 each from SST-2 (validation), AG News (test) and BoolQ (validation), sampled with a fixed seed. Agreement and KL are against `Clef-Flash-Q8_0.gguf` from ggml-org, not against bf16. Livesport's per-tensor layout applied step by step to IQ2_M (all with the head at Q8_0), same 600 items, against the same Q8_0 baseline.