跳到正文
AI NEWS JOURNAL
ONE EVENT. MANY PERSPECTIVES.

前沿大模型零样本概率判断首现系统性检验:GPT-6.1 Sol与Claude Opus 5.5在全概率定律一致性上表现最优

一项2026年10月26日发布于arXiv的预印本研究(编号2610.31833v1)首次系统评估了当前前沿语言模型在零样本下对全概率定律(P(X) = ∑_z P(z)P(X|z))的遵守程度,聚焦需从上下文推断隐变量z的情形。GPT-6.1 Sol和Claude Opus 5.5表现最一致,平均绝对残差分别为0.08和0.12 log-odds(约2个百分点);Claude Haiku 5.5、Gemini 3.8 Flash与DeepSeek V4-Pro则呈现显著且以题目为特异性的不一致。

1 个独立来源 · 1 篇报道切换最早在前 ↕
按发布时间排序

Latent Coherence: Do Frontier Language Models' Probability Judgments Obey the Law of Total Probability?

arXiv:2610.31833v1 Announce Type: new Abstract: LawZero's Scientist AI trains a Predictor toward the Bayesian posterior, with an objective that penalizes inconsistent probabilities among latent explanations. We ask whether current frontier language models, with no such training, are already consistent in this sense zero-shot: do their probability judgments satisfy the law of total probability, $P(X)=\sum_z P(z)P(X|z)$, when the latent $z$ must be inferred from records in the context? In separate single-turn calls, models are asked for $P(X)$, for $P(z)$ over the latent's states, and for $P(X|z)$; a causal family applies the same test to $P(y|do(x))$ and the back-door adjustment. Every query has an exact ground-truth probability, and a subset of items is asked in three wordings to separate

译文排队中,当前为原文 · en
事件进展与其他报道