AI is happening. The future is updating.internlm2-chat-7b-ExPO
The extrapolated (ExPO) model based on `internlm2-chat-7b` and `internlm/internlm2-chat-7b-sft`, as in the "Weak-to-Strong Extrapolation Expedites Alignment" paper. Specifically, we obtain this model by extrapolating **(alpha = 0.5)** from the weights of the SFT and DPO/RLHF checkpoints, achieving superior alignment with human preference. Evaluation results on the **AlpacaEval 2.0** benchmark (you can find the evaluation outputs on the official GitHub repo):
The extrapolated (ExPO) model based on `internlm2-chat-7b` and `internlm/internlm2-chat-7b-sft`, as in the "Weak-to-Strong Extrapolation Expedites Alignment" paper. Specifically, we obtain this model by extrapolating **(alpha = 0.5)** from the weights of the SFT and DPO/RLHF checkpoints, achieving superior alignment with human preference. Evaluation results on the **AlpacaEval 2.0** benchmark (you can find the evaluation outputs on the official GitHub repo):