Search AI news

OpenHome: From Perception to Insight in Smart-Home Camera Videos

arXiv:2610.31986v1 Announce Type: new Abstract: Vision language models (VLMs) have been increasingly adopted in consumer smart-home camera systems to interpret recorded videos and provide insights. However, video clips captured from smart-home cameras are different from curated web videos dominating existing VLM benchmarks. Smart-home video clips often do not contain subtitles or narration and are captured from different viewing angles, under various lighting conditions, and in diverse scenarios. However, the capabilities of the model in this domain, under sparse visual signals and limited context, are not fully assessed by existing VLM benchmarks. To close this gap, we introduce OpenHome, a visual-only, four-option multiple-choice benchmark for evaluating smart-home video understanding. I

Training an MoE LLM in MXFP4: How We Closed the Gap to BF16

arXiv:2610.32229v1 Announce Type: new Abstract: Training large language models (LLMs) in sub-8-bit arithmetic promises substantial gains in memory bandwidth and compute throughput, yet FP4 formats introduce quantization error severe enough to destabilize optimization if left unaddressed. We present ALTO, an open-source training recipe for GPT-OSS-20B, a 20-billion-parameter mixture-of-experts (MoE) model, on the MLPerf Small MoE Training benchmark under the MXFP4 microscaling format. The recipe combines established techniques from Abecassis, Felix et al. [arXiv:2509.25149] (hybrid 1D/2D block quantization, randomized Hadamard transforms, and stochastic rounding) with a simplified weight de-oscillation scheme adapted from TetraJet-v2 [arXiv:2510.27527]. On C4 validation at global batch size

EDWARD-NMT: Elastic Dimensions With Adaptive Routing and Dual-consistency for Neural Machine Translation

arXiv:2610.32115v1 Announce Type: new Abstract: Sparse Mixture-of-Experts (MoE) is a powerful paradigm for scaling Neural Machine Translation (NMT) and managing language heterogeneity. However, practical limitations hinder its deployment on resource-constrained devices: the entire expert pool must remain in memory, and the per-token compute budget is statically fixed during training by rigid top-k routing. We introduce EDWARD-NMT (Elastic Dimensions With Adaptive Routing and Dual-consistency for NMT), a novel MoE encoder-decoder architecture designed for a train once, deploy anywhere paradigm that exposes a family of deployable sub-networks at inference time. EDWARD-NMT integrates three key innovations: (i) Matryoshka-style elastic dimensions to flexibly reduce the memory footprint; (ii) a

Kolibri: A Sovereign European Model on the Pareto Frontier

arXiv:2610.31945v1 Announce Type: new Abstract: This report introduces Kolibri, an English-German mixture-of-experts transformer with 78.1B total parameters and 3.46B active parameters per token, released as open weights under the Apache 2.0 licence. We built Kolibri for sovereign and specialised deployment, with a particular focus on German and on regulated domains such as public administration, industry, and aerospace. To support these settings, we control the full model-development process, including data, architecture, training infrastructure, post-training, and evaluation. We train Kolibri on 24T tokens across pre-training, mid-training, and long-context extension, with German accounting for more than 20% of the data mix by bytes. To reach this share, we complement German datasets wit

CiteAnchor: Source-Aware Grounding for Hallucinated Citation Detection and Resolution

arXiv:2610.30355v1 Announce Type: new Abstract: Hallucinated citations make it harder to trace sources and verify the evidence behind scientific claims. Detecting them is difficult because bibliographic records can be incomplete or differ across source types and publication versions. A plausible match alone neither validates the citation nor establishes its underlying source. We introduce CiteResolve, a benchmark of 423 real-world hallucinated citations annotated for source recoverability. We further propose CiteAnchor, a source-aware grounding framework that adapts retrieval and field-level verification to each source type and separately determines citation validity and whether a unique source can be recovered. On an existing detection benchmark, CiteAnchor achieves 0.841 F1 with GPT-5.6

FusionEval Released: A New Benchmark for Large Language Model Fusion

On October 24, 2026, researchers published the paper arXiv:2610.30162v1 on arXiv, introducing FusionEval—the first unified benchmark specifically designed to evaluate fusion methods for large language models. It covers vulnerable aspects such as reasoning chain length and tool invocation, and supports comparisons between fine-tuning-based and zero-shot fusion approaches.

Why it matters：This benchmark fills the gap left by existing evaluations, which inadequately cover long-chain reasoning and tool usage; it clearly distinguishes between average performance and worst-case capability retention, provides a reproducible expert pool (based on Qwen3/Llama), multi-dimensional metrics (including GPU memory and runtime), and open-source code, offering strong practical guidance.

New arXiv paper compares the performance of joint scoring and item-by-item scoring for compact encoders.

On October 24, 2026, arXiv published the paper arXiv:2610.30970v1, which systematically evaluates design choices for compact encoders with model sizes ranging from 17 million to 1 billion parameters in closed-set decision-making tasks (such as tool selection): joint reading of all options versus independent scoring of each option. The study finds that, at a parameter scale of 32 million, option-by-option scoring significantly outperforms joint scoring on skill metrics; however, it incurs higher computational costs and exhibits more uneven latency. Multiple System1-Arena benchmarks show that joint encoders with 68 million and 150 million parameters surpass the 435-million-parameter DeBERTa-v3 zero-shot classifier.

Why it matters：This paper presents a key empirical comparison of lightweight design approaches for downstream decision-making modules in large models, covering engineering considerations such as architecture selection, initialization dependencies, the latency–accuracy trade-off, and input-order robustness. The data are based on experiments conducted with three random seeds and validated against both public and private benchmarks. The publication date (2026-10-24) matches the current UTC date (2026-10-25), making this the latest credible research advancement.

Recursive releases Flint: a lightweight, AI-driven programming model that can run locally.

AI startup Recursive has unveiled Flint, an open-source coding model that it claims was developed primarily using its in-house AI research system, Eureka Machine. With just 40 billion parameters and only 2.5 billion activations in practice, the model can run offline on a standard laptop—such as an M4 Pro MacBook—at an inference speed of 131 tokens per second, outperforming most models of comparable size on benchmarks like SWE-Bench.

NVIDIA releases Kumo Relational: the first foundation model for structured data that outperforms supervised learning without any training.

NVIDIA has launched Kumo Relational, a pre-trained relational foundation model that can perform predictive tasks—such as churn prediction, fraud detection, and demand forecasting—directly on enterprise‑grade relational databases, without the need for task fine-tuning, feature engineering, or table flattening. In 41 benchmark tests spanning 15 databases, it outperformed supervised models like XGBoost across the board, and on the SAP SALT enterprise benchmark, its MRR metric surpassed AutoGluon by 8%. The model supports databases with up to 500 billion rows and enables zero‑code predictive queries via Predictive Query Language (PQL).

ALTK-Evolve: Without model weight updates, relying solely on learning-based memory, it tops the τ²-bench customer service benchmark.

IBM Research has introduced the ALTK-Evolve method, which leverages GPT-4.1 to automatically extract structured behavioral guidelines—such as identity verification and refund confirmation—from its own task trajectories. These guidelines are then injected into the ReAct agent system via a purely prompt-engineering approach, significantly improving the accuracy and reliability of customer-service tasks without updating model weights or relying on human annotations. Its retail branch achieved a Pass⁴ score of 67.5%, ranking first on the τ²-bench leaderboard as of October 12, 2026, surpassing all state-of-the-art models and fine-tuned systems.

Advancing Coding in Low-Resource Programming Languages

Learn how OpenAI is improving ChatGPT across low-resource programming languages, with new evaluations for software engineering, SQLite, and COBOL migration.

ReviewBench: An open benchmark for AI code review

We’re launching ReviewBench, a benchmark for code review agents built on representative GitHub pull requests, multi-source ground truth, calibrated evaluation, and production-aligned metrics. The post ReviewBench: An open benchmark for AI code review appeared first on The GitHub Blog.

Introducing MentalHealthBench

MentalHealthBench is an expert-informed benchmark for evaluating helpful and safe AI responses across realistic mental health conversations.

How UK AISI and EvalEval Are Making Benchmark Results Reproducible

How UK AISI and EvalEval Are Making Benchmark Results Reproducible

Building standards for the next phase of AI

OpenAI outlines a path to shared global AI standards, calling for coordinated evaluation, reporting, and governance to improve safety.

Piloting the world's first double-blind AI evaluations

Piloting the world's first double-blind AI evaluations