Skip to content
AI NEWS JOURNAL
AI, IN PERSPECTIVE

All AI updates

Explore the complete news stream by source, topic and date.

Newest first

i14 releases the Laplace 3B linear attention model: inference with fixed-state memory, implemented on AWS Trainium2 and native PyTorch.

i14 has launched the Laplace 3B model with 3.028 billion parameters, which replaces Softmax attention with Gated Linear Attention (GLA). During inference, its per-sequence recursive state remains constant at 29.5 MB, independent of context length. The model was trained and validated on a single AWS trn2.48xlarge instance (equipped with 16 Trainium 2 chips), achieving a training throughput of 120,000 tokens per second and an inference throughput of 11,544 output tokens per second (with 1,280 concurrent sequences). All performance metrics are based on internal measurements conducted by i14 and the AWS GenAIIC team.

Timeline and related coverage

SF Compute builds a programmable data center: leveraging physical delivery to power the GPU computing power trading market.

SF Compute was founded by Evan Conrad and is dedicated to building a neutral, programmable GPU computing‑power trading infrastructure that supports physical delivery. Its model rejects the abstraction of FLOPS as a commodity, emphasizing hardware heterogeneity, actual delivery, and real‑time constraints—such as interrupt tolerance, InfiniBand topology, and firmware versions. The platform has already facilitated tens of billions of dollars in transaction volume and introduced low‑level capabilities like dynamic InfiniBand subnet partitioning.

Timeline and related coverage

SF Compute builds a programmable data center: leveraging physical delivery to drive the marketization of GPU computing power trading.

SF Compute was founded by Evan Conrad and focuses on enabling programmable, physically settled trading of GPU computing power. It does not operate its own data centers; instead, it leverages full-stack technology to collaborate with third-party facilities in co-building a “sovereign compute cloud,” emphasizing market neutrality and infrastructure controllability. The company has already facilitated hundreds of millions of dollars in transaction volume and implemented key capabilities such as dynamic InfiniBand partitioning.

Timeline and related coverage

Visiting Samsung’s Paju Ultra-Large-Scale Semiconductor New Facility: The AI-Driven Surge in Memory Chip Capacity Expansion

To meet the surging demand for high-bandwidth memory chips driven by the explosive growth of generative AI, Samsung is building a semiconductor manufacturing cluster in Pyeongtaek, South Korea, spanning an area equivalent to New York’s Central Park. To date, three fabs have been commissioned, with a fourth set to begin production soon, and construction on a fifth—halted in 2024 due to declining demand—has now resumed. The site showcases an intense construction pace and a workforce ecosystem adhering to stringent safety standards.

Timeline and related coverage

AnyLanguageModel 1.0 released: a unified Swift interface supporting both local and hosted models, compatible with the entire Apple platform family of operating systems 27

Hugging Face has officially released AnyLanguageModel 1.0, an open-source Swift framework fully compatible with the Apple Foundation Models API. It supports seamless switching between local models (MLX, llama.cpp, Core ML) and hosted models (OpenAI, Anthropic, Gemini, Hugging Face Inference Providers, etc.), and introduces new features such as image input, tool invocation, guided generation, and automatic adaptation of inference chunks.

Timeline and related coverage

TorchNeuron launches public beta: Hugging Face models natively support AWS Trainium for training and inference.

Hugging Face, in collaboration with AWS, has launched TorchNeuron—a PyTorch-native Trainium backend—available for public beta starting October 20, 2026. This technology enables mainstream libraries such as Transformers and Diffusers to run directly on Trainium chips without any modifications, significantly enhancing the usability and compatibility of text-generation and image-generation models.

Timeline and related coverage

From CUDA to MLX: How K-Search Brings Decades of Kernel Expertise to Apple Silicon

Figure 1: CUDA-to-MLX optimization translation map. CUDA optimization knowledge can be translated into architecture-native MLX strategies rather than copied instruction-for-instruction. We face a new epoch in computing. Hardware is changing rapidly — not just faster GPUs, but a growing range of chips from different vendors, each with its own architecture and often tailored to specific AI workloads. Software is changing just as fast, and AI coding tools now generate in minutes what took months of effort a few years ago. With so much of computing now centered on AI, GPU kernels are a crucial component of its success. These are the low-level programs that run inside the GPU, and writing efficient ones is far from obvious — it takes years of expertise to get right. Transferring a kernel from o

Timeline and related coverage

Intelligence is Free, Now What? Data Systems for, of, and by Agents

... government of the people, by the people, for the people ... — Abraham Lincoln, Gettysburg Address (1863) The cost of AI is dropping rapidly. GPT-4-class capabilities cost roughly $30 per million tokens in early 2023; today the same runs under $1, and some providers are pushing costs below $0.10. Across benchmarks, inference prices have fallen between 9x and 900x per year, with a median decline near 50x. Even frontier models are getting dramatically cheaper each generation, with open-source models following closely behind. And crucially, even if “Nobel-Prize-winning genius-level” intelligence isn’t here yet, the intelligence that suffices for the vast majority of knowledge work is here today, and getting cheaper by the month. At this rate, we are soon entering the era of virtually free

Timeline and related coverage