Our first phase of embedded assessments
OpenAI begins embedded assessments with Apollo Research, METR, and Transluce, and Goodfire to independently evaluate model alignment, safeguards, and monitoring systems.
Search headlines, summaries and articles to connect the dots.
OpenAI begins embedded assessments with Apollo Research, METR, and Transluce, and Goodfire to independently evaluate model alignment, safeguards, and monitoring systems.
Health & Bioscience
arXiv:2611.09993v1 Announce Type: new Abstract: Chest radiograph report generation is hampered by retrieved reports that resemble the current image but are clinically inconsistent with it, and by diagnostic-label imbalance. We present RG-MVR, a retrieval-grounded framework comprising Retrieval-Augmented Evidence Grounding, which combines dense memory summaries with visually gated sparse retrieved evidence; Adaptive Multi-view Evidential Reasoning, which weights image, memory, and retrieved evidence per case; and a Clinical Prompt Learner, which models finding mention separately from positive, negative, or uncertain status. On MIMIC-CXR, RG-MVR achieved a clinical-label F1 of 0.483 and a BLEU-4 of 0.118 (IU X-ray: 0.202 and 0.110). In an exploratory external cohort of 22 examinations, clinical-label agreement declined markedly (F1, 0.071) and unsupported statements remained common, although physicians found fewer unsupported temporal comparisons (9 vs. 20 cases) and device-related statements (7 vs. 15) than with the baseline. Evidence-aware retrieval and structured diagnostic prompting may reduce specific reporting errors, but broader external validation is required.
arXiv:2610.31810v1 Announce Type: new Abstract: Even a carefully proofread paper can leave small gaps in its proofs or its stated assumptions. We introduce PaperFormalizer, a Lean-based agentic pipeline that helps authors find and close such gaps in their own papers and turn each paper into a Lean-verified version. Starting from the LaTeX source, PaperFormalizer transcribes the paper into a dependency graph of statements, audits each statement in natural language for faithfulness, ambiguity and correctness, and then formalizes and proves the statements in Lean against Mathlib, optional domain libraries and the author's personal toolkit. Only the author knows what a statement is meant to say and how a formalization gap in a result is best fixed. The pipeline therefore stops and asks the aut
In 2024, Google launched AI Overviews, and in May 2025 it rolled out AI Mode, causing a significant drop in search traffic from Google across several major media outlets—The New York Times saw its share of search traffic fall from 44% to 35.5% over three years. Among DCN members, 19 experienced traffic losses ranging from 1% to 25% in May–June 2025, with DMG Media reporting a peak decline of 89% in click-through rates. Publishers filed multiple lawsuits, but all were dismissed by U.S. judges; Google subsequently introduced an opt-out option, enhanced source attribution, and launched a news AI pilot involving 400 media organizations, along with a content‑paying test program.
Why it matters:The report systematically examines the structural impact of Google’s AI-powered search feature on the publishing ecosystem, covering a timeline (2024–2025), empirical data (from third-party institutions), responses from multiple stakeholders (publishers, regulators, courts, and nonprofit organizations), and recent countermeasures (opt-out mechanisms, source optimization, and licensing and paid-access pilots). The content is information-dense, timely, and policy-relevant.