Skip to content
AI NEWS.ccAI正在发生 未来正在更新
Bookmarks
THE JOURNAL
AI NEWS JOURNAL
AI, IN PERSPECTIVE

Search AI news

Search headlines, summaries and articles to connect the dots.

Newest first

llama.cpp releases

b12208

The ggml library has been updated to make tied selections in the radix Top-K algorithm deterministic on CUDA and Metal backends by replacing atomic compaction loops with a deterministic scheme using simdgroup scans and coalesced memory accesses. This change ensures byte-identical outputs across runs, improves performance by 20-45% on M5 Ultra hardware, and enables deterministic testing for Metal and ROCm. Redundant CUDA kernel resets were removed, and Vulkan/Metal changes were reduced or skipped.

Hacker News Show HN

Show HN: Digdeep.fyi – A DNS Debug Tool for DNSSEC, Mail, HTTP

A fully client side, fast DNS debug tool. Queries DNS via DoH resolvers and analyzes DNSSEC configs (inspired by DNSViz), mail records (MX, SRF, DKIM, DMARC, etc), SRC, HTTPS records and runs multiple compliance checks. Comments URL: https://news.ycombinator.com/item?id=50406439 Points: 1 # Comments: 0

Hacker News Show HN

Show HN: Throng, a project first, terminal 2nd IDE for command line people

I've been beavering away at this since July, and its finally getting to a point where its stabilising.It started Windows only, but I recently converted over to Linux, so I've been ironing out the kinks in the last week. You can install it via apt or rpm, or .exe or .msi on Windows.Many more features to come, including native agent support and more preview features (images, PDF, document formats). Claude works pretty well in it, but I've not tried many other agents yet.I rarely leave throng now - 99% of my work happens inside it. I stopped using Visual Studio around 10 months ago (in favour of VSCode), and now I don't even use VSCode. Comments URL: https://news.ycombinator.com/item?id=50412226 Points: 1 # Comments: 0

llama.cpp releases

b12175

A fix was implemented to override the hardware_concurrency value in CI tests, addressing an issue where test-llama-context and test-backend-ops hung due to incorrect thread count estimation on 8-CPU runners. The solution sets default values of 8 for TEST_ARG_HARDWARE_CONCURRENCY and 4 for TEST_ARG_PARALLEL_WORKERS specifically for the cpu-x64-high-perf configuration.

llama.cpp releases

b12176

The update qualifies calls to math functions like isnan and signbit with std:: to ensure compatibility with C++ standard library overloads, addressing issues on NetBSD 11.99.9/x86_64 with gcc 14.4.0. Additional C math function calls are standardized using std:: prefixes (e.g., std::fabs, std::copysign) instead of non-existent std::fabsf variants, improving accuracy by keeping computations in double precision. The change results in a minor behavioral difference with a relative error of at most 1.4e-7, well below test tolerances.

llama.cpp releases

b12177

A fix has been implemented to prevent crashes in the command-line interface when encountering invalid UTF-8 in prompts or files, with assistance from Claude. This update is part of the b12177 release of llama.cpp, which includes various binary distributions for macOS, Linux, Windows, Android, and other platforms.

llama.cpp releases

b12179

The update introduces support for 3D convolution (conv_3d) on Hexagon hardware by generalizing the existing conv_2d implementation. It leverages the HMX tiled path, folds kernel dimensions into a virtual row, and uses a shared solver with an is3d flag. The host computes unfold divisors to avoid device-side division, prevents DMA queue overflow, and improves tile size selection based on VTCM usage. Additional changes include handling arbitrary positive strides, preserving load/shuffle paths for small strides, and fixing compiler warnings.

llama.cpp releases

b12180

The release adds the Kimi-K3.1-Pro text model to llama.cpp, replacing full-attention MLA layers in K3 with DSA (Dynamic Sparse Attention) layers featuring a lightning indexer. The indexer uses an additive mask over the cache and reuses sparse flash attention paths, while preserving existing KDA layers and MoE components. The model's architecture includes four indexer tensors per DSA layer, hybrid memory for caching, and maintains quantization integrity by excluding indexer parameters from quant overrides. Verified against HF checkpoint with identical PPL beyond context length, and supports multiple platforms including macOS, Linux, Windows, Android, and iOS.

llama.cpp releases

b12182

The latest release of llama.cpp (v1.2182) includes a change to raise the compute view limit for buffers with few tensors in the meta backend, along with reverting the deepseek41 test model back to a 6-layer configuration. The release provides precompiled binaries for multiple platforms including macOS, Linux, Windows, Android, and iOS, supporting various backends such as CUDA, Vulkan, ROCm, OpenVINO, SYCL, and Snapdragon-specific hardware. Some openEuler builds remain disabled.

llama.cpp releases

b12183

The release includes the addition of arange functionality for OpenCL, enhancing support for array operations in the OpenCL backend. This update is part of a broader set of improvements and compatibility fixes across multiple platforms, including macOS, Linux, Windows, Android, and various GPU and NPU backends.

llama.cpp releases

b12184

The llama.cpp release b12184 includes a fix to add a missing link to pthread and privately link Threads::Threads, addressing potential runtime issues. The release provides precompiled binaries for multiple platforms including macOS, Linux, Windows, Android, and openEuler, supporting various backends such as CUDA, Vulkan, ROCm, OpenVINO, SYCL, and Snapdragon-specific hardware. Additional UI components are also available.

llama.cpp releases

b12185

A fix for shared memory bank conflicts in the lightning indexer has been implemented for CUDA support in llama.cpp version b12185, improving performance and stability on CUDA-enabled devices.

llama.cpp releases

b12186

A change has been made to add the 'readonly' attribute to decodeBuf declarations in the Vulkan backend, with potential performance improvements expected in future driver versions.

llama.cpp releases

b12187

The latest release of llama.cpp (b12187) includes the implementation of a WebGPU group norm kernel, with associated CI workflows, performance tests, and cleanup of related code. The update supports various platforms including macOS, Linux, Windows, Android, and specific hardware backends like Vulkan, CUDA, ROCm, OpenVINO, SYCL, and Snapdragon devices. Some builds remain disabled or experimental.