Search AI news

IFC-MCQ: A Method for Automatically Generating Multiple-Choice Question Benchmarks for LLM Agents in Building Information Modeling

On October 24, 2026, researchers published the IFC-MCQ method on arXiv, aiming to automatically generate a multi-choice question benchmark with precise scoring for Industry Foundation Classes (IFC) data retrieval systems based on large language models (LLMs) in the architecture, engineering, and construction (AEC) sector.

Why it matters：This work directly addresses the pain points of LLMs—namely, the difficulty and high cost of evaluating them on specialized structured data such as IFC—by proposing the first automated multiple-choice question-generation framework for IFC files. It covers 15 categories and 36 subcategories, supporting reproducible and scalable evaluations of agent capabilities.

Rescale leverages the AWS AI-DLC framework and Strands Agents to rapidly build an AI test traffic-splitting proxy.

Rescale, in collaboration with AWS engineers and leveraging the AI-Driven Development Lifecycle (AI-DLC) methodology, the Strands Agents framework, and Amazon Bedrock (Claude Opus 4.8), completed within five days a production-ready AI test-routing agent designed to automatically classify and route nighttime end-to-end test failures, and rolled out this human-AI collaborative development paradigm across the organization.

OpenAI's latest GPT-6 series models will be available on Google Cloud and the Antigravity platform.

OpenAI’s cutting-edge GPT-6 and 6.1 series models (Astra, Sol, Luna) will be launched on Google Cloud Model Garden in the coming weeks and integrated into Google’s agent-driven programming tool, Antigravity; this move makes Google the first mainstream cloud provider to offer all three major closed-source large models—Gemini, Claude, and GPT.

Mistral partners with NVIDIA to advance AI-native engineering workflows, releases Mistral Large 4, and jointly develops physical and agent-based AI evaluation benchmarks.

Mistral and NVIDIA announced a deepened collaboration, integrating Mistral’s Large 4 model, physics-based modeling pipelines, and NVIDIA’s accelerated computing stack (CUDA-X, Warp, Omniverse) to co-develop AI-native engineering workflows for industries such as aerospace, automotive, and semiconductors. The two parties will jointly release open-source datasets and public evaluation benchmarks, covering the assessment of agent capabilities in physics-informed AI and CAE/EDA use cases.