b12199
The release addresses the issue of invalid UTF-8 characters in arguments passed to PEG tool calls, improving input handling and robustness.
翻訳サービスが停止中のため原文を表示しています。
llama.cpp releases
FOXAI SEARCH
サイト内検索
ニュース記事 203
b12200
Enhancements to OpenCL support in llama.cpp include adding new kernel functions for quantized matrix operations, improving small-n MoE GEMV performance across multiple quantization types, optimizing Adreno GPU kernel floor settings, renaming functions for clarity, and disabling bin FA for small verification batches.
翻訳サービスが停止中のため原文を表示しています。
llama.cpp releases
b12201
The llama.cpp project has released version b12201, offering pre-compiled binaries for multiple platforms including macOS, Linux, Windows, Android, and iOS. The release includes support for various backends such as CUDA, Vulkan, ROCm, OpenVINO, SYCL, and Snapdragon hardware. Notably, the MoE cache feature is disabled for the draft model in this release. Additional resources include setup guides for Snapdragon devices and separate downloads for CUDA and OpenVINO libraries.
翻訳サービスが停止中のため原文を表示しています。
llama.cpp releases
b12202
The llama.cpp v1.220.2 release introduces enhanced BF16 precision support across multiple components, aligning with reference implementations by moving specific operations like GLM4 family projections, MiMoVL vision matmuls, and Qwen3-TTS speaker encoder conv1d to BF16 where appropriate. Backends such as CUDA, Hexagon, OpenCL, WebGPU, and Vulkan now uniformly handle GGML_PREC_BF16 similarly to F32, while CPU, SpaceMIT, and ET backends extend flash attention support to BF16 with F32 accumulation. Flash attention tests now include BF16 cases, and the KQ multiplication in Llama is updated to request BF16 precision. A TODO remains in clip.cpp for future work.
翻訳サービスが停止中のため原文を表示しています。
llama.cpp releases
b12207
A new fast path for d_state=64 has been added to the SSM_SCAN kernel in ggml-cuda, improving generation throughput for Zamba2-7B-Instruct from 11 to 15.1 tok/s—approximately a 35% increase—by eliminating CPU fallbacks for this state size. The change was verified with real-world Zamba2 hyperparameters and maintains correctness, though a separate 28% of scan calls still fall back to CPU due to an undiagnosed issue.
翻訳サービスが停止中のため原文を表示しています。
llama.cpp releases
b12208
The ggml library has been updated to make tied selections in the radix Top-K algorithm deterministic on CUDA and Metal backends by replacing atomic compaction loops with a deterministic scheme using simdgroup scans and coalesced memory accesses. This change ensures byte-identical outputs across runs, improves performance by 20-45% on M5 Ultra hardware, and enables deterministic testing for Metal and ROCm. Redundant CUDA kernel resets were removed, and Vulkan/Metal changes were reduced or skipped.
翻訳サービスが停止中のため原文を表示しています。
llama.cpp releases
Show HN: Agent Manager – keyboard-first workflow for running many coding agents
Article URL: https://github.com/wainmann/agent-manager Comments URL: https://news.ycombinator.com/item?id=50406983 Points: 3 # Comments: 0
翻訳サービスが停止中のため原文を表示しています。
Hacker News Show HN
Show HN: AIDA – agentic generated user guides
Article URL: https://github.com/tryaida/aida Comments URL: https://news.ycombinator.com/item?id=50412923 Points: 2 # Comments: 1
翻訳サービスが停止中のため原文を表示しています。
Hacker News Show HN
Show HN: Nino – Fastest C# serializer, safe on untrusted input, also TS/Go/Rust
Nino is a source-generated binary serializer for C#, and as far as we know the fastest one. In the same BenchmarkDotNet run on GitHub runners against MemoryPack 1.21.4, it serializes classes and polymorphic types 3.5–7.2x faster and deserializes them 1.7–2.1x faster (arrays of unmanaged structs are on par). Deserializing into existing objects allocates nothing. Reproduce: https://nino.xgamedev.net/en/docs/v4/benchmarksIt is built to read bytes you do not trust: lengths are checked before allocating, depth is bounded, hash flooding is limited, and the read paths are fuzzed in CI.The bytes are a spec, not a memory dump, so CoreCLR, Mono, IL2CPP and 32-bit hosts write the same bytes, and runtimes for TypeScript, Go and Rust pass the same conformance corpus.Trade-offs: positional by default (VersionTolerant or Keyed for stored data), a 4-byte type id on polymorphic values, no System.Type, needs C# 9 and Roslyn 4.3+.Docs: https://nino.xgamedev.net Comments URL: https://news.ycombinator.com/item?id=50413601 Points: 1 # Comments: 0
翻訳サービスが停止中のため原文を表示しています。
Hacker News Show HN
Show HN: Throng, a project first, terminal 2nd IDE for command line people
I've been beavering away at this since July, and its finally getting to a point where its stabilising.It started Windows only, but I recently converted over to Linux, so I've been ironing out the kinks in the last week. You can install it via apt or rpm, or .exe or .msi on Windows.Many more features to come, including native agent support and more preview features (images, PDF, document formats). Claude works pretty well in it, but I've not tried many other agents yet.I rarely leave throng now - 99% of my work happens inside it. I stopped using Visual Studio around 10 months ago (in favour of VSCode), and now I don't even use VSCode. Comments URL: https://news.ycombinator.com/item?id=50412226 Points: 1 # Comments: 0
翻訳サービスが停止中のため原文を表示しています。
Hacker News Show HN