Search AI news

Examining form-based linguistic productivity in people and large language models

arXiv:2610.33433v1 Announce Type: new Abstract: Linguistic productivity, as evidenced by the use of words in novel contexts, is one of the most striking facts about human language. However, how abstract the knowledge that enables such productivity is remains unclear. We compare people's and computational language models' linguistic productivity in contexts where successful generalization depends on form-based information. We focus on extending the use of a novel verb learned in the active voice to passive contexts. We find people extend active to passive uses in a way consistent with abstract generalizations concerning linguistic form, even when no plausible meaning can be assigned to the novel verb. In contrast, large language models succeeded only when a meaning like an existing verb's c

Can we trust LLMs to judge whether a research idea is novel?

Can we trust LLMs to judge whether a research idea is novel?

The RealReal won’t let AI agents hog designer clothing

The RealReal, a secondhand luxury fashion consignment retailer, said it's updating its bot defense system, effectively making it harder for AI agents to shop on its site. The change comes days after The Verge reported that an AI agent could be used to take advantage of The RealReal's item reserve system. On the retailer's website, […]

What a swarm of rogue AI agents can teach us about having better ideas

Benn Stancil uses the Hugging Face hack to explain why the most useful ideas come from the weirdest connections.

POS-Signature Demonstration Retrieval for In-Context Dependency Parsing

arXiv:2610.31966v1 Announce Type: new Abstract: Demonstrations for in-context learning are often retrieved by semantic similarity, which may be a poor proxy for relevance in structured prediction. We study demonstration selection for Universal Dependencies parsing with a POS-signature policy that represents sentences with weighted part-of-speech statistics and retrieves three length-compatible, gold-parsed examples from the labeled training split. We evaluate two open-weight language models without fine-tuning on all 2,077 sentences of the UD English Web Treebank test set, comparing the policy with shot- and format-matched fixed and semantic three-shot baselines, as well as zero-shot, chain-of-thought, and critique-refinement systems. POS-signature retrieval yields the highest labeled atta

Semantically Rich, Metrically Affect-Blind: A Geometric Blind Spot in Modern Text Embedders

arXiv:2610.32122v1 Announce Type: new Abstract: We report a systematic dissociation in modern text embedders: sentiment is almost perfectly decodable from their embeddings, yet almost entirely absent from their metric. Across eleven frozen encoders spanning 2021 to 2026, including 2026-generation models and the 4B-parameter LLM embedder Qwen3-Embedding-4B, a linear probe recovers sentence polarity at up to 91.3% accuracy while cosine similarity separates polarity by a margin of only 0.003-0.064. Qwen3-Embedding-4B, the strongest probe in the panel, reaches 91.3% probe accuracy but only 64.3 retrieval MAP. Because retrieval, clustering, deduplication, and retrieval-augmented generation operate on the metric rather than on a trained probe, these systems are effectively blind to information t

Context or Knowledge: How LLMs Attribute Their Own Answers

arXiv:2610.32109v1 Announce Type: new Abstract: Language models can answer a question from a supplied document or from their parametric knowledge. When later asked where the answer came from, what determines their source report? We study this by intervening on the model's key-value (KV) cache after the answer is generated and before the source question is asked. On a controlled factual task with four models (7B-32B), changing or removing the document's cache never changes the report. In contrast, transplanting the question-and-answer (Q+A) cache between runs with identical question and answer tokens transfers it: every eligible report follows the donor, while the recipient's document is unchanged. On the two smaller models, steering Q+A values along directions fitted before any source ques

ULME Framework Achieves True Unification of Text Embedding and Language Modeling: A New Paper on arXiv Proposes a Predictive Coupling Mechanism

On October 24, 2026, arXiv published the paper arXiv:2610.30705v1, introducing ULME—a post-training framework for causal-decoder–based large language models that, through a predictive coupling mechanism, achieves, for the first time, a mutually reinforcing unification of text embedding and language-generation capabilities. This approach was validated on the Qwen2.5/Qwen3 series (with 0.5B–8B parameters), yielding MTEB improvements of 3.3–4.1 points while maintaining performance on generation tasks such as MMLU.

Why it matters：This paper directly addresses the core issue of fragmented multimodal LLM capabilities: embeddings and generation have long been handled either by separate models or by “pseudo-unified” models that rely solely on parameter sharing. ULME achieves a substantial architectural breakthrough by employing learnable slots and joint training with three objectives—including a stop-gradient prediction loss—enabling the generation process to actively shape the embedding representations. The study features broad experimental coverage, strong baselines, comprehensive metrics, and was published on a reputable preprint platform, balancing timeliness with technical rigor.

Memory safety for Postgres extensions in C/C++

How ClickHouse’s Postgres extensions handle the memory safety challenges of combining C and C++, from clean language boundaries to isolated helper processes.

Generate incredible images with Google's Imagen 4

Google's flagship image generation model, Imagen 4, is now available for you to try on Replicate. Create images with fine detail, versatile styles, and improved typography.

Qwen2.5-Math: The world's leading open-sourced mathematical LLMs

GITHUB HUGGING FACE MODELSCOPE DISCORD 🚨 Qwen2.5-Math mainly supports solving English and Chinese math problems through CoT and TIR. We do not recommend using this series of models for other tasks. Introduction A month ago, we released the first series of mathematical LLMs - Qwen2-Math - of our Qwen family. Today, we have upgraded it and open-sourced Qwen2.5-Math series, including base models Qwen2.5-Math-1.5B/7B/72B, instruction-tuned models Qwen2.5-Math-1.5B/7B/72B-Instruct, and mathematical reward model Qwen2.