All AI updates

Import AI 478: Math for alignment; ProgramBench; and Mirendil shows what RSI means

What is “night” to a machine?

Sebastian Raschka has released an eight-video course titled “Building a Reasoning Model from Scratch.”

On October 24, 2026, Sebastian Raschka published an eight-part, over-11-hour hands-on video course on Python and PyTorch in Ahead of AI magazine (magazine.sebastianraschka.com), systematically covering the evaluation of inference models, scaling during inference, reinforcement learning (RLVR), and knowledge distillation, with all methods implemented using the pre-trained Qwen3-0.6B model.

Why it matters：This course is the author’s advanced technical educational offering, following “Building Large Language Models from Scratch.” It focuses on the core evolutionary direction of today’s mainstream LLMs—enhancing inference capabilities—covering the entire technical pipeline from setting up the foundational environment to GRPO reinforcement learning and self‑distillation. The author explicitly states that all implementations are “hand‑crafted from scratch,” fully reproducible, and highly instructive with significant engineering reference value.

Amazon SageMaker AI has launched a Multi-Step Reinforcement Learning (MTRL) framework, supporting end-to-end training of agents to accomplish multi-step tasks.

AWS has launched the Multi-Turn Reinforcement Learning (MTRL) feature, enabling users to train large‑model agents on SageMaker AI using full task trajectories and final outcome feedback, without requiring step‑level annotations. A end-to-end demonstration is provided using Wordle as an example, covering AgentCore deployment, data preparation, GRPO training, reward design, and cost analysis.

IBM releases the Granite time-series integration forecasting model: a four-model, zero‑fine‑tuning ensemble that delivers a robust default forecasting solution.

IBM Research has released the open-source Granite Timeseries Ensemble (v1), which integrates four types of pre-trained architectures—PatchTST-FM-r1/r2, FlowState, and Tiny Time Mixers—and supports probabilistic ensemble forecasting with zero fine-tuning. By default, it employs equal-weight probabilistic pooling (Probabilistic Ensemble), while also offering an IQR-based adaptive weighting scheme (IQR Ensemble). On the GIFT-Eval benchmark (as of the October 20, 2026 snapshot), its point forecast error (MASE = 0.683) slightly outperforms that of the best single model, with significantly improved overall robustness.

AI-assisted “blind-scan” ultrasound technology supports maternal and child health care at the grassroots level: A multi-center, prospective study validates its cross-regional generalizability.

Google’s research team, in collaboration with clinical institutions, conducted a prospective multicenter study that demonstrated an AI‑driven “blind‑scan” ultrasound protocol—using low‑cost, portable probes operated by non‑ultrasound specialists—achieved gestational age assessment accuracy comparable to expert‑level ultrasonic biometry in both Chicago and Nairobi (mean absolute error of 4.18 days vs. 4.48 days), without requiring local data fine‑tuning. This offers a viable pathway to expand prenatal ultrasound coverage in resource‑limited settings.

Google Cloud and NVIDIA have announced the official commercial availability of the NVIDIA Vera Rubin infrastructure: A5X instances are now live, focusing on large-scale reinforcement learning and agent reasoning.

Google Cloud and NVIDIA have announced that the A5X instances, built on the Vera Rubin architecture, will officially go commercial starting next month, initially available in the United States and later expanding to Europe. The platform integrates NVL72 GPUs, ConnectX-9 SuperNICs, the Virgo network, and fourth-generation liquid cooling technology, and is specifically designed for high-density computing workloads such as large-scale reinforcement learning and generative agent inference.

NVIDIA releases Kumo Forecast: a multivariate forecasting model that integrates pre-trained time-series representations, historical pattern retrieval, and interpretability.

NVIDIA has launched the open-source time-series forecasting model Kumo Forecast (formerly NV-Tesseract Forecasting), which is built on the MOMENT-1-large Transformer architecture. It supports both direct prediction and dual-path inference via Domain-Aware Representation and Retrieval (DARR), and includes a built-in interpretability framework that requires no modifications to the model structure.

GPT-OSS-20B Multilingual Reasoning Fine-Tuning Experiment: SFT Enables Zero-Base Behavior Acquisition, while GRPO Only Effectively Improves Performance When a Probabilistic Headspace Exists

The AWS team conducted multilingual inference fine-tuning experiments on Amazon SageMaker HyperPod using GPT‑OSS‑20B, employing LoRA for parameter-efficient fine-tuning. SFT boosted the correctness rate of inference in five languages (English, French, German, Spanish, and Italian) from 22% to 100%, though the correctness rate for the answer language remained at only 62%. GRPO further improved the answer-language correctness rate to 70% without compromising inference-language performance; however, the gains varied across languages—for example, Spanish saw a +30 percentage-point increase, while Italian experienced a -20 percentage-point decline. The experiments clearly demonstrated that GRPO cannot bootstrap new capabilities from scratch and can only optimize behaviors that already occur sporadically.

“We’ve been looking at it all wrong”: A Goodfire researcher proposes a new perspective on neural network interpretability, sending shockwaves through the AI community.

Goodfire researcher Nick Cammarata published a 26,000-word paper arguing that the internal mechanisms of large language models (LLMs) may be far more structured and comprehensible than the academic community has previously assumed. His central thesis hinges on a reinterpretation of “polysemous neurons” in models such as Inception v1—suggesting that neurons associated with both cats and cars, for instance, actually respond to V-shaped visual patterns rather than exhibiting disordered overgeneralization. This view has yet to undergo systematic validation on modern LLMs and has been challenged by scholars including Chris Potts of Stanford University and Jacob Hilton of the Alignment Research Center, who question its universality and technical depth.

[AINews] Agents disprove Polysemanticity; greatly improve Interpretability & Alignment

Nick Cammarata out of nowhere with some major claims!

[AINews] Agents disprove Polysemanticity; greatly improve Interpretability & Alignment

Nick Cammarata out of nowhere with some major claims!

Scaling Indic Pretraining: 2.8 Trillion Tokens and an Open Data Generation Pipeline

Scaling Indic Pretraining: 2.8 Trillion Tokens and an Open Data Generation Pipeline

Agent Lightning v1.0: A 3,500-Line Lightweight Agentic RL Framework for Training Agents with Real Harnesses

Training AI agents with reinforcement learning can be challenging because their tools, context, and decision-making are managed by complex frameworks. Agent Lightning connects existing agents to RL training, making it easier to improve them without rebuilding them. The post Agent Lightning v1.0: A 3,500-Line Lightweight Agentic RL Framework for Training Agents with Real Harnesses appeared first on Microsoft Research.

One Model Family, Two Gold-Level Results: Fine-Tuning Nemotron for IOI and IMO

One Model Family, Two Gold-Level Results: Fine-Tuning Nemotron for IOI and IMO

How Fyxer built an AI executive assistant people trust

Fyxer uses OpenAI models, fine-tuning, memory, and real user feedback to organize inboxes and draft emails in each user’s voice.

Paul Christiano joins OpenAI Foundation Board

Paul Christiano joins the OpenAI Foundation Board and its Safety and Security Committee, bringing experience in AI alignment, safety, and standards.

Fine-tuning a 350M Model for Better Structured Outputs in 100 GRPO Steps

Fine-tuning a 350M Model for Better Structured Outputs in 100 GRPO Steps

Training and Finetuning Multi-Vector Embedding Models with Sentence Transformers

Training and Finetuning Multi-Vector Embedding Models with Sentence Transformers

Accelerating Transformers Fine-Tuning with NVIDIA NeMo AutoModel

Accelerating Transformers Fine-Tuning with NVIDIA NeMo AutoModel

Beyond LoRA: Can you beat the most popular fine-tuning technique?

Beyond LoRA: Can you beat the most popular fine-tuning technique?