AI is happening. The future is updating.Phi-3.5-MoE-instruct
Phi-3.5-MoE is a lightweight, state-of-the-art open model built upon datasets used for Phi-3 - synthetic data and filtered publicly available documents - with a focus on very high-quality, reasoning dense data. The model supports multilingual and comes with 128K context length (in tokens). The model underwent a rigorous enhancement process, incorporating supervised fine-tuning, proximal policy optimization, and direct preference optimization to ensure precise instruction adherence and robust safety measures. π‘ Phi-3 Portal π° Phi-3 Microsoft Blog π Phi-3 Technical Report π©βπ³ Phi-3 Cookbook π₯οΈ Try It MoE references: πPhi-3.5-MoE Blog | πGRIN MoE
Phi-3.5-MoE is a lightweight, state-of-the-art open model built upon datasets used for Phi-3 - synthetic data and filtered publicly available documents - with a focus on very high-quality, reasoning dense data. The model supports multilingual and comes with 128K context length (in tokens). The model underwent a rigorous enhancement process, incorporating supervised fine-tuning, proximal policy optimization, and direct preference optimization to ensure precise instruction adherence and robust safety measures. π‘ Phi-3 Portal π° Phi-3 Microsoft Blog π Phi-3 Technical Report π©βπ³ Phi-3 Cookbook π₯οΈ Try It MoE references: πPhi-3.5-MoE Blog | πGRIN MoE