Search headlines, summaries and articles to connect the dots.
The llama.cpp project has released build version b11869, which primarily fixes the parameter-parsing logic for the select and selectattr functions in Jinja templates and provides precompiled binaries that support dozens of hardware–backend combinations across macOS, Linux, Windows, Android, iOS, and openEuler.
llama.cpp v2.45.0 (tag b11868) has been officially released, with the core update being the introduction of a KV-head splitting mechanism in the Hexagon backend to optimize multi-core HMX Flash Attention performance and unify the FA splitting control flag. Binary packages are simultaneously available for all major platforms, including macOS, Linux, Windows, Android, iOS, and openEuler, supporting multiple backends such as CUDA 12/13, Vulkan, ROCm, OpenVINO, SYCL, and Snapdragon (Adreno + Hexagon).
The llama.cpp project has released build version b11865, with core changes including the addition of memory-boundary checks in the RDMA receive logic (PR #30399) and a significant expansion of hardware-acceleration support, covering CUDA 13.4, ROCm 10.0, Vulkan, OpenVINO, SYCL, and Qualcomm Snapdragon—providing full-stack heterogeneous computing backends for CPU, Adreno, and Hexagon. macOS KleidiAI support and openEuler builds have been explicitly marked as DISABLED.
Amazon SageMaker has released the Training Sessions API, enabling users to implement custom large-model training workflows—such as SFT, RLHF, GRPO, and KTO—using pure Python scripts. GPU resource scheduling, fault tolerance, distributed execution, and checkpoint management are all handled by the service.
Dharma-AI has introduced the VocabX method, which reconfigures the vocabulary of language models for specific tasks—such as automated scoring of Portuguese essays—by optimizing for cost rather than word frequency. Without modifying the model architecture, parameters, or training pipeline, empirical results show a 77% reduction in inference costs, while the evaluation score (bench score) improved from 0.703 to 0.810.
