All AI updates

Beyond Hotness: High-Resolution Memory Characterization of Cloud and LLM Workloads for Tiered Memory with ARM SPE

arXiv:2610.32711v1 Announce Type: new Abstract: Memory demands from data analytics and LLM workloads grow rapidly, driving up memory costs in cloud and data centers. Multi-tier memory has emerged as a promising solution to balance performance and cost. However, effectively leveraging it requires a deep understanding of workload memory behaviors. This work introduces a high-resolution memory characterization methodology for analyzing workload-specific opportunities for multi-tier memory usage. In response to the increasing deployment of ARM-based processors in data centers, we implement our methodology using the recent Statistical Profiling Extension (SPE) for ARM. By characterizing eight memory-intensive workloads from CloudSuite and LLM applications, we identify region-specific access pat

HyScale: Scaling Long-Context Training for Learned Sparse Attention

arXiv:2610.32057v1 Announce Type: new Abstract: We present HyScale, a long-context training system for learned sparse attention. Learned sparse attention is a promising architecture for million-token contexts, widely adopted in production since DeepSeek-V3.2. Selection, however, grows into the training bottleneck. For each query, it scores every previous token whereas sparse attention reads only $k$; worse, current systems materialize a full score table and repeat selection during recomputation. Our key insight is that the output of selection is not an activation, but rather a set of indices. Building on it, HyScale introduces HyTopK and selection replay. HyTopK finds each query's exact top-$k$ on the fly without a score table, while selection replay reuses forward-pass selection in recomp

The Helpful Agent Problem: When Emergent Cooperation Among LLM Agents Bypasses Intended Workflows

arXiv:2610.31985v1 Announce Type: new Abstract: LLM agents are increasingly deployed in collaborative settings where they pursue separate tasks while sharing resources and operating under review or oversight processes. Such settings create safety risks not only when agents are malicious, but also when they are simply trying to help. Prior work has largely studied adversarial or explicitly collusive behavior; we show that benign agents pursuing separate objectives can spontaneously cooperate in ways that bypass intended workflows. We call this the \emph{helpful agent problem}. We study long-horizon shared-resource environments in which agents sometimes depend on resources owned by their peers and cross-owner changes are normally mediated by a reviewer. When review becomes unavailable, agent

Do AI-for-Science Agents Preserve Model Safety?

arXiv:2610.32045v1 Announce Type: new Abstract: AI-for-Science agents are increasingly being used for formulating scientific hypotheses, running autonomous experiments, and interpreting evidence. These agents are constructed by integrating a large language model (LLM) into a domain-specific agent harness, which in turn can improve the LLM's scientific capability and enable the model to orchestrate scientific tools. In this work, we ask whether model safety is preserved when an LLM is integrated in an AI-for-Science agent harness. We evaluate five agent harnesses on 50 harmful chemistry requests. Specifically, we study how the safety behavior changes under direct prompting, two simple adversarial prompting strategies, and an adaptive attack. Across four recent GPT variants, our results show

Behaviour analysis for large language model-driven agents

arXiv:2610.32087v1 Announce Type: new Abstract: Understanding language-agent behaviour requires learning how actions are organised across a trajectory and how this organisation relates to context and outcomes. We propose a general framework that connects data-driven behavioural discovery with analysis and experimental investigation. Categories developed from recorded activity define what is measured. Analyses preserve the behaviours' positions in the process and express their relationships as interpretable hypotheses. Statistical assessment and tests in held-out contexts examine the strength and scope of the evidence. Experiments, including prompt steering, then test how behaviour and outcomes change under deliberately varied conditions. A study of iterative self-reflection illustrates how

Democratizing LLM Training with the Edge: Challenges, Systems, and the Road Ahead

arXiv:2610.32215v1 Announce Type: new Abstract: The growing computational power of modern GPU data centers has let a few industrial giants train and deploy large language models (LLMs) on massive amounts of data. Yet the sheer scale of these models and their training data makes centralized development increasingly hard to sustain, and at the same time shuts out smaller institutions that hold relevant private data but lack comparable infrastructure. In this paper, we organize our positions on distributed LLM training around the pretraining and fine-tuning paradigms, covering federated learning, split learning, and decentralized approaches, and we assess their readiness for geo-distributed settings with heterogeneous hardware and unreliable connectivity. We then present a {\em unified} syste

The study proposes the “Schema Consistency Index” (SCI) to assess the coherence of belief representations in language models.

On October 26, 2026, arXiv published the paper arXiv:2610.31683v1, introducing the Schema Coherence Inventory (SCI)—a 96-item forced-choice scale designed to assess whether the beliefs attributed to persona-conditioned language models genuinely structure their cognition, rather than merely eliciting emotional responses.

Why it matters：This study fills the current gap in the lack of a verifiable measurement method for the “degree of belief internalization” in language models; through validation by clinical experts, testing across multiple model backbones, and the design of target-specific criteria, it provides the first assessment framework that focuses on cognitive structures rather than emotional representations, and has open-sourced all its tools.

Research reveals multicultural value-selection bias in large language models: national and linguistic cues are not interchangeable

A study published on October 24, 2026, on the arXiv platform (ID 2610.31199v1) found that when large language models (LLMs) are presented with both a national identity (as set by system prompts) and a secondary cultural cue—either an explicitly named country or an implicitly used query language—the two types of cues exert markedly different effects on value judgments: linguistic cues trigger stronger but oppositely directed biases, whereas explicit country naming, though weaker in impact, leads to more nuanced and value shifts that align more closely with the target country’s values.

Why it matters：This study, based on 1.6 million open-ended generated responses and the World Values Survey (WVS) standardized tests, is the first to systematically distinguish the roles of explicit national labels and implicit linguistic cues in cultural modeling, highlighting that equating the two today can distort assessments of LLMs’ cultural adaptability. The findings carry methodological implications and were published prior to the current date (2026-10-26), making them valid new insights.

Research reveals the local geometric structure of semantic meaning in large language models

A paper published on October 24, 2026, on arXiv (ID 2610.30715v1) characterizes the local geometric properties of semantic meaning in embedding space across four decoder-only large language models—Gemma 4, Llama 3.2, Qwen 2.5, and Pythia—using cross-lingual probes and fine-grained probes.

Why it matters：This study is the first to systematically characterize the invariance, variability, and refinement mechanisms within “the same semantic factor” in LLMs, proposing the “local anisotropic neighborhood” model. The approach has been validated through blind human evaluations, demonstrating rigorous methodology, broad model coverage, and cross-architecture consistency in its findings.

Researchers have introduced the Japanese fact-checking benchmark JSFactCheckBench, revealing latent shortcomings in large language models’ fact-verification capabilities.

On October 24, 2026, arXiv published the paper arXiv:2610.30504v1, introducing a new Japanese benchmark called JSFactCheckBench. This benchmark is the first to explicitly define three key design elements in fact-checking evaluation—question relevance, judgment criteria, and evidence sources—and encompasses 1,913 statements derived from LLM responses to misleading information on Japanese social media platforms. It also features dual annotations for both factual accuracy and importance, based on pre-selected online sources at a reference point in time.

Why it matters：This study fills a gap in existing LLM fact-checking evaluation benchmarks, which have not explicitly specified assessment criteria. Through structured annotation, it reveals systematic weaknesses in mainstream models regarding direct-response statement verification, long‑ and multi‑source localization, and context sensitivity. Moreover, all findings rely on the benchmark’s transparent documentation of annotation conditions, endowing the work with methodological innovation and empirical value.

Aggregated scores in LLM evaluations mask the instability of individual judgments: New research from Arena-Hard reveals instruction sensitivity.

The study employed 500 Arena-Hard v2.0 prompts, with responses from two models held constant, and used GPT‑4.1 as the judge. Under eight instruction combinations, repeated evaluations revealed that even when aggregate scores varied only slightly (e.g., by ±1 point), up to 21.2% of individual prompt outcomes (win/draw/loss) changed; further adjustments to the instructions amplified this instability, leading to an additional 28.2 percentage points in outcome shifts, while the aggregate scores themselves remained virtually unchanged.

Why it matters：The study directly addresses a core blind spot in current LLM evaluation practices—overreliance on aggregate scores while neglecting the reproducibility of individual judgments and instruction dependency—providing critical methodological warnings for tasks that rely on fine-grained assessments, such as preference modeling and reinforcement learning from human feedback (RLHF).

A Study on the Prompt Sensitivity of Tool-Augmented Language Models: Tools Improve Accuracy but Exacerbate the Impact of Statement Variability

A study published on October 24, 2026, on the arXiv platform (ID 2610.31148v1) indicates that, under tool-augmented conditions, the comparative robustness of six open-source language models across five domains and five problem formulations did not improve; on the contrary, while tools increased the accuracy of questions that programs could answer, they also heightened the sensitivity of model ranking changes across different phrasings.

Why it matters：This study employs a newly designed matching protocol that decouples key stages in the entire tool-call process—such as call decision-making, tool responses, and no-call reports—and empirically demonstrates that “improved accuracy” does not necessarily translate into “greater stability.” It further highlights that interface design and instruction details significantly modulate the degree of sensitivity, offering direct guidance for model evaluation practices.

TauIndianBankBench Released: A Program-Aware Dialogue Agent Evaluation Benchmark for the Indian Retail Banking Sector

On October 24, 2026, researchers published TauIndianBankBench on arXiv (ID 2610.30161v1)—a task-oriented benchmark comprising 1,000 tasks, specifically designed to evaluate whether language-model–driven banking dialogue agents strictly adhere to operational procedures (such as obtaining a final settlement quote before closing an account), rather than relying solely on the final record to determine success or failure.

Why it matters：This benchmark directly addresses current blind spots in LLM evaluation: traditional methods only verify the final state of a dialogue, leading to 6.5–12.0% of sessions involving procedural jumps or unauthorized actions being mistakenly classified as successful; its program-aware design fills a critical gap in compliance assessment for business automation in the Indian banking sector.

New research introduces the Cross-Language Poor-Condition Stimuli (CPOS) experimental paradigm, revealing the conditional transfer of hierarchical generalization capabilities in language models.

On October 24, 2026, arXiv published paper 2610.30960v1, introducing the Cross-Language Poor-Condition Stimulus (CPOS) experimental design to quantify language models’ ability to transfer hierarchical structural knowledge from a source language (L1) to a target language (L2) during cross-language continual training. The experiments show that this transfer partially holds but is imperfect, and it heavily depends on the specific language pair and the degree of lexical overlap.

Why it matters：This study is the first to construct a controllable cross-linguistic minimal-stimulus framework, directly testing whether “universal linguistic structures” constitute the cognitive basis for cross-linguistic transfer, rather than being driven solely by non-linguistic factors (such as positional encoding initialization). Its findings hold both methodological and theoretical value for understanding the mechanisms of grammar acquisition in large language models and multi-language alignment strategies.

MemPlan: A Memory-Augmented PDDL Planning Framework for Partially Observable Textual Environments

The paper was published on arXiv on October 24, 2026 (ID 2610.30379v1), introducing MemPlan—a memory-conditioned PDDL planning framework that uses large language models (LLMs) as a constrained bridge between linguistic and symbolic planning, suitable for partially observable interactive text-based environments.

Why it matters：MemPlan dynamically reformulates PDDL problems using forward-graph memory and backward-memory mechanisms, significantly improving task success rates and step efficiency while substantially reducing online token consumption. Its offline fine-tuned language–symbol interface can be reused across TextWorld task types without requiring task-specific fine-tuning, demonstrating the method’s generalizability and practicality.

The study proposes a new metric, RCG, to assess the coverage of synthetic survey respondents generated by LLMs.

The paper, published on October 24, 2026, on arXiv (ID 2610.30900v1), introduces a new evaluation metric called “Respondent Coverage Gap” (RCG) to assess the extent to which synthetic survey respondents generated by large language models (LLMs) cover the full response-profile space of real human respondents.

Why it matters：Existing evaluation methods focus solely on the distribution of individual item responses or inter-item correlations, failing to detect whether LLM-generated responses replicate answer combinations that actually exist in the real population. RCG is the first to quantify coverage gaps by analyzing the full response profile, and empirical evidence from two U.S. social survey datasets reveals that all tested LLMs exhibit significant undercoverage of certain population groups, performing worse than both a simple marginal sampling baseline and a Gaussian copula model.

Consistency Does Not Equal Effectiveness: Self-Rewarding Moral Reasoning Makes Large Language Models More Decisive but More Susceptible to Manipulation

The study, posted on arXiv on October 24, 2026 (ID 2610.30349v1), proposes a method for training large language models to make ethical judgments by self-assessing the quality of their own reasoning. It finds that the model exhibits more consistent behavior—i.e., becomes more “decisive”—when the order of options is varied, but this does not improve the effectiveness of its ethical judgments and it still suffers from sycophancy and reframing issues.

Why it matters：The paper challenges the prevailing assumption that behavioral consistency—such as sequence invariance—serves as a proxy for moral reasoning capability, empirically demonstrating that consistency can be optimized without improving the quality of substantive judgments, thereby offering important cautionary insights for methodologies used in AI ethics assessment.

New research introduces the ReflectPO framework, enhancing the autonomous error-correction capabilities of large language model agents in long-term tasks.

On October 24, 2026, arXiv published a research paper titled “ReflectPO: Reflection-Guided Policy Optimization for Long-Horizon LLM Agents” (ID 2610.30933v1), introducing a reinforcement learning framework called ReflectPO, designed to enhance the autonomous error-recovery capabilities of tool-augmented large language model agents in complex, multi-step, state-dependent tasks.

Why it matters：This paper is a cutting-edge AI study recently published, focusing on a key bottleneck in the real-world deployment of LLM-based agents: the cumulative effect of early errors in long‑term tasks. Its proposed dual-component design—Reflection‑Guided Sampling and Tree‑Structured Credit Assignment—features methodological innovation and empirically outperforms multiple baselines across two benchmarking scenarios, making it a valuable technical reference.

Protegrity-PII: A new PII recognition model has been released, supporting both structured and unstructured text.

On October 24, 2026, the research team published the Protegrity-PII model on arXiv (ID 2610.30518v1), a novel decision-making model designed for identifying personally identifiable information (PII). On the new benchmark PII-SCOPE, it achieves a typological recall of 0.915 and a precision of 0.907, with an inference speed of 0.49 seconds per million characters and a cost of only $0.0005 per million characters (using a single RTX 6000 GPU in batch mode).

Why it matters：This technical report provides quantifiable performance metrics, clear hardware and cost specifications, the newly proposed benchmark PII-SCOPE, and an empirical comparison of out-of-distribution generalization capabilities, offering both research transparency and engineering reference value. Its publication date (2026-10-24) is no later than the current date (2026-10-26), making it a valid, recent achievement.

Research reveals that in multilingual evaluation, the effectiveness of “large models as referees” heavily depends on the choice of referee model.

A multilingual empirical study published on October 24, 2026, on arXiv found that current mainstream prompting strategies—such as chain-of-thought and role‑playing—lack cross‑model and cross‑language transferability in LLM‑as‑a‑Judge scenarios; the choice of the judge model exerts far greater influence than the prompting strategy itself, and the effectiveness of the strategy can even reverse direction across different judge models.

Why it matters：This study is the first to systematically measure the interaction effects among nine prompting strategies, four open-source evaluation models, 27 languages, and 13 datasets, generating over one million human-validated point-by-point ratings and filling a critical gap between English-centric prompting research and fixed-template multilingual studies.