b12186
A change has been made to add the 'readonly' attribute to decodeBuf declarations in the Vulkan backend, with potential performance improvements expected in future driver versions.
llama.cpp releases
FOXAI SEARCH
Search FoxAI
News stories 203
b12187
The latest release of llama.cpp (b12187) includes the implementation of a WebGPU group norm kernel, with associated CI workflows, performance tests, and cleanup of related code. The update supports various platforms including macOS, Linux, Windows, Android, and specific hardware backends like Vulkan, CUDA, ROCm, OpenVINO, SYCL, and Snapdragon devices. Some builds remain disabled or experimental.
llama.cpp releases
b12188
The server update addresses slot processing order by ensuring parent slots are visited before child slots, preventing delays caused by child tasks landing on lower slot IDs. This change ensures all child tasks join the same batch after being woken by their parent. Additionally, new test tags have been introduced for monitoring: __TEST_TAG_WAIT_PARENT_SLOT__ for child slot waits, __TEST_TAG_PROMPT_CACHE_RESTORE__ for prompt cache restores, and __TEST_TAG_PROMPT_CACHE_FULL_RESTORE__ when a cached prompt is fully contained in a new one based on token counts.
llama.cpp releases
b12189
The metal backend's kernel_group_norm_f32 was updated to correctly handle tensors with ne03 > 1 and non-contiguous inputs by dispatching one threadgroup per (group, i03) pair, computing per-batch statistics, clamping group element count for incomplete groups, and supporting strided access via separate strides for source and destination. The fix also restricts GROUP_NORM to f32 inputs and improves performance through specialized pipeline variants.
llama.cpp releases
Show HN: Combining Bursts of Images
An approach of taking many photos to enhance one final image is a technique called "stacking". Stacking alone doesn't account for everything so this is a take that helps get better alignment of images, allows comparisons, and drop bad images that dont match. Its not super resolution but it feels like when you look at it. it reduces the noise and makes it look more organic shot with less expensive hardware. enjoy! Comments URL: https://news.ycombinator.com/item?id=50401218 Points: 1 # Comments: 0
Hacker News Show HN
Show HN: Realtime sync engine without any new infra
Tandem is an open-source sync engine and client-side database that plugs into your existing infrastructure. Add the Tandem library to sync data in real time across your clients and server, without deploying any new services.I started work on Tandem 6 years ago as a side project. I was frustrated by the sync engine landscape at the time, thinking I could build a better DX and require less lock-in. Even now, sync engine companies and “full-stack databases” need you to migrate to their database or provision a separate service with auth, networking, etc. This makes them annoying to maintain and also harder to adopt incrementally.Tandem is designed to just be embedded into your existing frontend and backend code. You define a schema, set up a database adapter (any SQL-like database is supported), add the new sync endpoint to your existing API, and then you're good to go.Tandem uses DST (Deterministic Simulation Testing) on every PR and nightly to ensure correctness. Our DST system Gatekeeper lets us model not only storage and network failures, but also race conditions, by gating each call between client/server/other services independently.Tandem currently supports any React-based frontend, any serverful backend (like Cloudflare Durable Objects), and any SQL-like database. New adapters are easy to build, and PRs and issues are appreciated!Open-source and MIT licensed: https://github.com/tanishqkancharla/tandem Comments URL: https://news.ycombinator.com/item?id=50398763 Points: 1 # Comments: 0
Hacker News Show HN
Show HN: S3mail – Serverless personal email on AWS with JMAP
Article URL: https://github.com/zero11-0203/s3mail Comments URL: https://news.ycombinator.com/item?id=50401533 Points: 1 # Comments: 0
Hacker News Show HN
Show HN: Select – AI agents that earn autonomy through verified work
Article URL: https://github.com/Kirby54/Select Comments URL: https://news.ycombinator.com/item?id=50400882 Points: 1 # Comments: 0
Hacker News Show HN
What I learned from a month with WalShadow on ClickHouse Managed Postgres
Hidehiko ASAHI shares a month of WalShadow private-preview testing, comparing replication latency with ClickPipes and checking data correctness, schema changes, and recovery.
ClickHouse
b12131
The update removes the u8path() function and replaces it with generic_string() in the server component, as part of a broader effort to streamline and standardize string handling across platforms.
llama.cpp releases