internlm2-chat-7b-ExPO

The extrapolated (ExPO) model based on `internlm2-chat-7b` and `internlm/internlm2-chat-7b-sft`, as in the "Weak-to-Strong Extrapolation Expedites Alignment" paper. Specifically, we obtain this model by extrapolating **(alpha = 0.5)** from the weights of the SFT and DPO/RLHF checkpoints, achieving superior alignment with human preference. Evaluation results on the **AlpacaEval 2.0** benchmark (you can find the evaluation outputs on the official GitHub repo):

번역 준비 중입니다. 원문을 표시합니다.