How UK AISI and EvalEval Are Making Benchmark Results Reproducible
How UK AISI and EvalEval Are Making Benchmark Results Reproducible
AI NEWS JOURNAL
All AI updates
Explore the complete news stream by source, topic and date.
Building standards for the next phase of AI
OpenAI outlines a path to shared global AI standards, calling for coordinated evaluation, reporting, and governance to improve safety.
The Open ASR Leaderboard Adds Its First Global South Language
The Open ASR Leaderboard Adds Its First Global South Language
Piloting the world's first double-blind AI evaluations
Piloting the world's first double-blind AI evaluations
Measuring benchmark optimization in speech recognition
Measuring benchmark optimization in speech recognition
Introducing the FFASR Leaderboard: Benchmarking ASR in the Real World
Introducing the FFASR Leaderboard: Benchmarking ASR in the Real World
Measuring progress toward AGI: A cognitive framework
We’re introducing a framework to measure progress toward AGI, and launching a Kaggle hackathon to build the relevant evaluations.
FACTS Benchmark Suite: Systematically evaluating the factuality of large language models
Systematically evaluating the factuality of large language models with the FACTS Benchmark Suite.