Idefics3-8B-Llama3

Idefics3 is an open multimodal model that accepts arbitrary sequences of image and text inputs and produces text outputs. The model can answer questions about images, describe visual content, create stories grounded on multiple images, or simply behave as a pure language model without visual inputs. It improves upon Idefics1 and Idefics2, significantly enhancing capabilities around OCR, document understanding and visual reasoning. - **Developed by:** Hugging Face - **Model type:** Multi-modal model (image+text) - **Language(s) (NLP):** en - **License:** Apache 2.0 - **Parent Models:** google/siglip-so400m-patch14-384 and meta-llama/Meta-Llama-3.1-8B-Instruct - **Resources for more information:** - Idefics1 paper: OBELICS: An Open Web-Scale Filtered Dataset of Interleaved Image-Text Documents - Idefics2 paper: What matters when building vision-language models? - Idefics3 paper: Building and better understanding vision-language models: insights and future directions `Idefics3-8B` can be used to perform inference on multimodal (image + text) tasks in which the input is composed of a text query along with one (or multiple) image(s). Text and images can be arbitrarily interleaved. That includes image captioning, visual question answering, etc. These model does not support image generation.

译文尚未就绪，显示来源原文