Search headlines, summaries and articles to connect the dots.
llama.cpp introduced a critical security fix in version b11871, imposing a hard limit of 128 nested JSON levels on requests to prevent HTTP thread stack overflows and service crashes caused by deep recursive parsing (triggering SIGBUS on macOS and SIGSEGV on Linux). This policy covers multiple input scenarios for the chat interface and uniformly returns an HTTP 400 error.
llama.cpp has added support for the DeepSeek-V4.1-Flash (deepseek41) model in version b11870, and implemented several low-level optimizations tailored to its Engram architecture, including simplification of KV cache computation, replacement of MXFP8 with BF16 precision, and in-graph row gather operations; it also provides multi-platform binary builds covering macOS, Linux, Windows, Android, iOS, and openEuler.
llama.cpp v2.45.0 (tag b11868) has been officially released, with the core update being the introduction of a KV-head splitting mechanism in the Hexagon backend to optimize multi-core HMX Flash Attention performance and unify the FA splitting control flag. Binary packages are simultaneously available for all major platforms, including macOS, Linux, Windows, Android, iOS, and openEuler, supporting multiple backends such as CUDA 12/13, Vulkan, ROCm, OpenVINO, SYCL, and Snapdragon (Adreno + Hexagon).
llama.cpp has officially released version b11867 on GitHub. Key changes include a refactored server entry point (PR #31113) and the addition of the server_role mechanism. Additionally, more than 40 precompiled binaries are now available, covering macOS, Linux, Windows, Android, iOS, and openEuler, with support for diverse hardware backends such as CPU, CUDA (12.4/12.8/13.4), Vulkan, ROCm 10.0, OpenVINO, SYCL (FP16/FP32), and Snapdragon (Adreno + Hexagon).
llama.cpp v.b11866 has removed the outdated src1 power-of-two AMAX scaling mechanism from the Metal backend, instead relying on a more granular per-expert-token amax scaling within the computation graph, ensuring that MoE projection activation values remain within the f16 representation range; concurrently, it also deleted the associated two-stage reduction kernels, F32-precision scheduling, and out-of-bounds test cases.
llama.cpp v.b11861 fixes the weight distortion issue in the minimax-m3 model that occurred under NVFP4/MXFP8 quantization due to the scale tensor not being injected into the computation graph, thereby preventing “token soup” and residual vanishing; it also provides multi-platform binary builds covering macOS, Linux, Windows, Android, iOS, and openEuler.
