foxAIAI正在发生 未来正在更新
中文
中文English日本語한국어

DA3-BASE

We present Depth Anything 3 (DA3), a model that predicts spatially consistent geometry from an arbitrary number of visual inputs, with or without known camera poses. In pursuit of minimal modeling, DA3 yields two key insights: a single plain transformer (e.g., vanilla DINO encoder) is sufficient as a backbone without architectural specialization, and a singular depth-ray prediction target obviates the need for complex multi-task learning. Through our teacher-student training paradigm, the model achieves a level of detail and generalization on par with Depth Anything 2 (DA2). We establish a new visual geometry benchmark covering camera pose estimation, any-view geometry and visual rendering. On this benchmark, DA3 sets a new state-of-the-art across all tasks, surpassing prior SOTA VGGT by an average of 44.3% in camera pose accuracy and 25.1% in geometric accuracy. Moreover, it outperforms DA2 in monocular depth estimation. All models are trained exclusively on public academic datasets. DA3 Base model for multi-view depth estimation and camera pose estimation. Compact foundation model with unified depth-ray representation. - **Developed by:** ByteDance Seed Team - **Model Type:** Vision Transformer for Visual Geometry - **Architecture:** Plain transformer with unified depth-ray representation - **Training Data:** Public academic datasets only

译文尚未就绪,显示来源原文

We present Depth Anything 3 (DA3), a model that predicts spatially consistent geometry from an arbitrary number of visual inputs, with or without known camera poses. In pursuit of minimal modeling, DA3 yields two key insights: a single plain transformer (e.g., vanilla DINO encoder) is sufficient as a backbone without architectural specialization, and a singular depth-ray prediction target obviates the need for complex multi-task learning. Through our teacher-student training paradigm, the model achieves a level of detail and generalization on par with Depth Anything 2 (DA2). We establish a new visual geometry benchmark covering camera pose estimation, any-view geometry and visual rendering. On this benchmark, DA3 sets a new state-of-the-art across all tasks, surpassing prior SOTA VGGT by an average of 44.3% in camera pose accuracy and 25.1% in geometric accuracy. Moreover, it outperforms DA2 in monocular depth estimation. All models are trained exclusively on public academic datasets. DA3 Base model for multi-view depth estimation and camera pose estimation. Compact foundation model with unified depth-ray representation. - **Developed by:** ByteDance Seed Team - **Model Type:** Vision Transformer for Visual Geometry - **Architecture:** Plain transformer with unified depth-ray representation - **Training Data:** Public academic datasets only

资料来源

huggingface.co ↗