Skip to content
AI NEWSSee every step of AI
Bookmarks
THE JOURNAL
AI NEWS JOURNAL
AI, IN PERSPECTIVE

Search AI news

Search headlines, summaries and articles to connect the dots.

Newest first

llama.cpp releases

llama.cpp releases version b11865: adds RDMA receive boundary checking and supports multiple platform backends, including CUDA 13.4, ROCm 10.0, and Snapdragon NPU.

The llama.cpp project has released build version b11865, with core changes including the addition of memory-boundary checks in the RDMA receive logic (PR #30399) and a significant expansion of hardware-acceleration support, covering CUDA 13.4, ROCm 10.0, Vulkan, OpenVINO, SYCL, and Qualcomm Snapdragon—providing full-stack heterogeneous computing backends for CPU, Adreno, and Hexagon. macOS KleidiAI support and openEuler builds have been explicitly marked as DISABLED.

Timeline and related coverage
llama.cpp releases

llama.cpp releases version b11861: fixes an inference exception caused by the minimax-m3 model’s quantized scaling tensor not being propagated.

llama.cpp v.b11861 fixes the weight distortion issue in the minimax-m3 model that occurred under NVFP4/MXFP8 quantization due to the scale tensor not being injected into the computation graph, thereby preventing “token soup” and residual vanishing; it also provides multi-platform binary builds covering macOS, Linux, Windows, Android, iOS, and openEuler.

Timeline and related coverage

Ars Technica · AI

Intel has received an exemption from the U.S. FCC’s ban on foreign-made robots, in order to ensure automated logistics at its chip fabs.

On October 22, 2026, the U.S. Federal Communications Commission (FCC) granted Intel a one-year exemption, allowing it to continue using certain foreign‑made automated guided vehicles (AGVs) at its U.S. semiconductor fabs, as the original ban’s vague wording could inadvertently affect critical semiconductor manufacturing equipment.

Media
Timeline and related coverage

NVIDIA Blog

Kazakhstan is accelerating the development of its AI computing infrastructure, and Firebird has obtained U.S. export approval to deploy 45,000 NVIDIA Grace Blackwell GPUs.

Kazakhstan’s AI ecosystem is transitioning from the planning phase to large-scale deployment. Firebird has obtained U.S. export licenses to build an AI factory in Kazakhstan, with the first phase deploying 45,000 NVIDIA Grace Blackwell GPUs. Kazakhtelecom has already brought online more than 1,000 H200/B300 GPUs and plans to add over 2,000 Vera Rubin and other GPUs by 2025. Multiple stakeholders are collaborating to advance computing power supply, developer access, and the local implementation of AI applications.

Official
Timeline and related coverage
AWS Machine Learning Blog

Amazon SageMaker AI has launched GPU-free managed model training sessions, now generally available.

AWS has announced that SageMaker AI’s serverless model customization feature now includes “Training Sessions,” which are fully available starting today. Users can independently define post-training logic—such as custom loss functions, reward signals, or multi‑round reinforcement learning—while the platform automatically handles GPU allocation, distributed execution, fault tolerance, and checkpoint storage.

OfficialTutorials
Timeline and related coverage
AWS Machine Learning Blog

Amazon SageMaker launches the Training Session API: users can write custom training loops for large models without managing GPUs.

Amazon SageMaker has released the Training Sessions API, enabling users to implement custom large-model training workflows—such as SFT, RLHF, GRPO, and KTO—using pure Python scripts. GPU resource scheduling, fault tolerance, distributed execution, and checkpoint management are all handled by the service.

OfficialTutorials
Timeline and related coverage

NVIDIA Blog

NVIDIA drives the transformation of Europe’s retail sector: Open models and physical intelligence are being implemented in e-commerce, warehousing, and virtual try-on.

European retailers are leveraging NVIDIA-accelerated open large models and physics‑AI technologies to achieve large‑scale deployment across scenarios such as digital product discovery, intelligent warehouse simulation, virtual try‑on, and accelerated R&D. Companies including Shopify, Zooplus, L’Oréal, and the Otto Group have used tools like the Nemotron series of models, Omniverse digital twins, and ALCHEMI molecular simulations to significantly reduce inference costs, improve search accuracy, shorten R&D cycles, and validate improvements in conversion rates and sales growth.

Official
Timeline and related coverage
TechCrunch · AI

Jas Kaira, Head of AI Business at Blackstone: Concerns about AI infrastructure debt are exaggerated.

Jas Kaira, head of Blackstone’s AI business, stated at the TechCrunch Disrupt conference that market panic over massive debt in the AI infrastructure sector has been overly amplified. His key argument is that this debt is largely backed by long-term contracts with high‑credit‑rating clients—such as Microsoft and Meta—and that the underlying assets (e.g., GPUs) possess strong collateral value, meaning the risk profile differs fundamentally from that of the 2008 banking system.

Media
Timeline and related coverage

Hugging Face 官方博客

VocabX: Reduces the inference cost of domain-specific small language models by 77% through cost-weighted vocabulary specialization.

Dharma-AI has introduced the VocabX method, which reconfigures the vocabulary of language models for specific tasks—such as automated scoring of Portuguese essays—by optimizing for cost rather than word frequency. Without modifying the model architecture, parameters, or training pipeline, empirical results show a 77% reduction in inference costs, while the evaluation score (bench score) improved from 0.703 to 0.810.

Timeline and related coverage
Hugging Face 官方博客

TorchNeuron System-Level Performance Analysis (Part 1): End-to-End Profiling Based on the AWS Trainium Chip

This article is the first in a series of technical blog posts jointly published by Hugging Face and Amazon, systematically introducing how to use TorchNeuron on AWS Trainium AI accelerator chips for PyTorch model inference performance analysis. It covers the principles of Neuron backend integration, methods for configuring torch.profiler, the use of NeuronConfig and NeuronProfiler tools, and visualized tracing with Neuron Explorer. Additionally, using RMSNorm as an example, it compares the device‑time differences among three implementations: plain PyTorch, the built-in torch.rms_norm fusion, and torch.compile’s automatic fusion.

Timeline and related coverage
AWS Machine Learning Blog

i14 releases the Laplace 3B linear attention model: inference with fixed-state memory, implemented on AWS Trainium2 and native PyTorch.

i14 has launched the Laplace 3B model with 3.028 billion parameters, which replaces Softmax attention with Gated Linear Attention (GLA). During inference, its per-sequence recursive state remains constant at 29.5 MB, independent of context length. The model was trained and validated on a single AWS trn2.48xlarge instance (equipped with 16 Trainium 2 chips), achieving a training throughput of 120,000 tokens per second and an inference throughput of 11,544 output tokens per second (with 1,280 concurrent sequences). All performance metrics are based on internal measurements conducted by i14 and the AWS GenAIIC team.

OfficialTutorials
Timeline and related coverage
Latent Space

SF Compute builds a programmable data center: leveraging physical delivery to drive the marketization of GPU computing power trading.

SF Compute was founded by Evan Conrad and focuses on enabling programmable, physically settled trading of GPU computing power. It does not operate its own data centers; instead, it leverages full-stack technology to collaborate with third-party facilities in co-building a “sovereign compute cloud,” emphasizing market neutrality and infrastructure controllability. The company has already facilitated hundreds of millions of dollars in transaction volume and implemented key capabilities such as dynamic InfiniBand partitioning.

Individual
Timeline and related coverage

MIT Technology Review · AI

Visiting Samsung’s Paju Ultra-Large-Scale Semiconductor New Facility: The AI-Driven Surge in Memory Chip Capacity Expansion

To meet the surging demand for high-bandwidth memory chips driven by the explosive growth of generative AI, Samsung is building a semiconductor manufacturing cluster in Pyeongtaek, South Korea, spanning an area equivalent to New York’s Central Park. To date, three fabs have been commissioned, with a fourth set to begin production soon, and construction on a fifth—halted in 2024 due to declining demand—has now resumed. The site showcases an intense construction pace and a workforce ecosystem adhering to stringent safety standards.

Media
Timeline and related coverage
Hugging Face 官方博客

AnyLanguageModel 1.0 released: a unified Swift interface supporting both local and hosted models, compatible with the entire Apple platform family of operating systems 27

Hugging Face has officially released AnyLanguageModel 1.0, an open-source Swift framework fully compatible with the Apple Foundation Models API. It supports seamless switching between local models (MLX, llama.cpp, Core ML) and hosted models (OpenAI, Anthropic, Gemini, Hugging Face Inference Providers, etc.), and introduces new features such as image input, tool invocation, guided generation, and automatic adaptation of inference chunks.

Timeline and related coverage

Hugging Face 官方博客

TorchNeuron launches public beta: Hugging Face models natively support AWS Trainium for training and inference.

Hugging Face, in collaboration with AWS, has launched TorchNeuron—a PyTorch-native Trainium backend—available for public beta starting October 20, 2026. This technology enables mainstream libraries such as Transformers and Diffusers to run directly on Trainium chips without any modifications, significantly enhancing the usability and compatibility of text-generation and image-generation models.

Timeline and related coverage