Skip to content
AI NEWS JOURNAL
AI, IN PERSPECTIVE

Search AI news

Search headlines, summaries and articles to connect the dots.

Newest first

IFC-MCQ: A Method for Automatically Generating Multiple-Choice Question Benchmarks for LLM Agents in Building Information Modeling

On October 24, 2026, researchers published the IFC-MCQ method on arXiv, aiming to automatically generate a multi-choice question benchmark with precise scoring for Industry Foundation Classes (IFC) data retrieval systems based on large language models (LLMs) in the architecture, engineering, and construction (AEC) sector.

IFC-MCQ: Automatically Generating Multiple-Choice Benchmarks for Evaluating LLM Agents on IFC Data Retrieval

Why it matters:This work directly addresses the pain points of LLMs—namely, the difficulty and high cost of evaluating them on specialized structured data such as IFC—by proposing the first automated multiple-choice question-generation framework for IFC files. It covers 15 categories and 36 subcategories, supporting reproducible and scalable evaluations of agent capabilities.

Timeline and related coverage

Rescale leverages the AWS AI-DLC framework and Strands Agents to rapidly build an AI test traffic-splitting proxy.

Rescale, in collaboration with AWS engineers and leveraging the AI-Driven Development Lifecycle (AI-DLC) methodology, the Strands Agents framework, and Amazon Bedrock (Claude Opus 4.8), completed within five days a production-ready AI test-routing agent designed to automatically classify and route nighttime end-to-end test failures, and rolled out this human-AI collaborative development paradigm across the organization.

Timeline and related coverage

Several leading financial institutions in Europe have adopted open-source large models to build proprietary intelligent systems.

At the GTC Berlin conference, European financial institutions including Revolut, Starling Bank, Lloyds, and Santander announced that they are building production‑grade AI capabilities based on NVIDIA’s accelerated computing platform and open‑source weight models—such as PRAGMA, the Nemotron series, and the Kumo family—covering core use cases like trading analytics, speech recognition, fraud detection, and data pipeline acceleration, while emphasizing data sovereignty, cost control, and compliant deployment.

Timeline and related coverage

OpenAI's latest GPT-6 series models will be available on Google Cloud and the Antigravity platform.

OpenAI’s cutting-edge GPT-6 and 6.1 series models (Astra, Sol, Luna) will be launched on Google Cloud Model Garden in the coming weeks and integrated into Google’s agent-driven programming tool, Antigravity; this move makes Google the first mainstream cloud provider to offer all three major closed-source large models—Gemini, Claude, and GPT.

Timeline and related coverage

Mistral partners with NVIDIA to advance AI-native engineering workflows, releases Mistral Large 4, and jointly develops physical and agent-based AI evaluation benchmarks.

Mistral and NVIDIA announced a deepened collaboration, integrating Mistral’s Large 4 model, physics-based modeling pipelines, and NVIDIA’s accelerated computing stack (CUDA-X, Warp, Omniverse) to co-develop AI-native engineering workflows for industries such as aerospace, automotive, and semiconductors. The two parties will jointly release open-source datasets and public evaluation benchmarks, covering the assessment of agent capabilities in physics-informed AI and CAE/EDA use cases.

Timeline and related coverage