Search AI news

Researchers from Stanford and UC Berkeley Introduce TokenGate: Token-Gated Attention Makes Long-Context Prefill Up to 11.3x Faster

Researchers from Stanford University and the University of California, Berkeley have introduced TokenGate—a plug-and-play, learnable token-pruning module designed for existing large language models (LLMs). This approach accelerates the first-token generation time (TTFT) for long-context prefill by 1.4 to 11.3 times without sacrificing accuracy, while reducing peak memory usage by 1.5 to 3.4 times. The associated code and checkpoints have been made open source.

Sebastian Raschka has released an eight-video course titled “Building a Reasoning Model from Scratch.”

On October 24, 2026, Sebastian Raschka published an eight-part, over-11-hour hands-on video course on Python and PyTorch in Ahead of AI magazine (magazine.sebastianraschka.com), systematically covering the evaluation of inference models, scaling during inference, reinforcement learning (RLVR), and knowledge distillation, with all methods implemented using the pre-trained Qwen3-0.6B model.

Why it matters：This course is the author’s advanced technical educational offering, following “Building Large Language Models from Scratch.” It focuses on the core evolutionary direction of today’s mainstream LLMs—enhancing inference capabilities—covering the entire technical pipeline from setting up the foundational environment to GRPO reinforcement learning and self‑distillation. The author explicitly states that all implementations are “hand‑crafted from scratch,” fully reproducible, and highly instructive with significant engineering reference value.

Amazon SageMaker AI has launched a Multi-Step Reinforcement Learning (MTRL) framework, supporting end-to-end training of agents to accomplish multi-step tasks.

AWS has launched the Multi-Turn Reinforcement Learning (MTRL) feature, enabling users to train large‑model agents on SageMaker AI using full task trajectories and final outcome feedback, without requiring step‑level annotations. A end-to-end demonstration is provided using Wordle as an example, covering AgentCore deployment, data preparation, GRPO training, reward design, and cost analysis.

谷歌推出零信任聚合私有分析技术，融合密码学与可信执行环境

谷歌研究团队发布新型私有分析方案，通过创新的单轮格密码聚合协议与可信执行环境（TEE）协同验证，实现无需信任单一实体的数据聚合，在保障用户数据始终驻留设备的前提下，获取群体级匿名洞察。

Why it matters：人工审核