Infinity-Instruct-3M-0625-Llama3-8B

Infinity-Instruct-3M-0625-Llama3-8B is an opensource supervised instruction tuning model without reinforcement learning from human feedback (RLHF). This model is just finetuned on Infinity-Instruct-3M and Infinity-Instruct-0625 and showing favorable results on AlpacaEval 2.0 and MT-Bench. Infinity-Instruct-3M-0625-Llama3-8B is tuned on Million-level instruction dataset Infinity-Instruct. First, we apply the foundational dataset Infinity-Instruct-3M to improve the foundational ability (math & code) of Llama3-8B, and get the foundational instruct model Infinity-Instruct-3M-Llama3-8B. Then we finetune the Infinity-Instruct-3M-Llama3-8B to get the stronger chat model Infinity-Instruct-3M-0625-Llama3-8B. Here is the training hyperparamers. Thanks to FlagScale, we could concatenate multiple training samples to remove padding token and apply diverse acceleration techniques to the traning procudure. It effectively reduces our training costs. We will release our code in the near future!

翻訳準備中のため原文を表示しています