AI가 움직이고 미래가 업데이트됩니다.LLaMA3-iterative-DPO-final-ExPO
The extrapolated (ExPO) model based on `RLHFlow/LLaMA3-iterative-DPO-final` and `RLHFlow/LLaMA3-SFT`, as in the "Weak-to-Strong Extrapolation Expedites Alignment" paper. Specifically, we obtain this model by extrapolating **(alpha = 0.3)** from the weights of the SFT and DPO/RLHF checkpoints, achieving superior alignment with human preference. Evaluation results on the **AlpacaEval 2.0** benchmark (you can find the evaluation outputs on the official GitHub repo):
번역 준비 중입니다. 원문을 표시합니다.
The extrapolated (ExPO) model based on `RLHFlow/LLaMA3-iterative-DPO-final` and `RLHFlow/LLaMA3-SFT`, as in the "Weak-to-Strong Extrapolation Expedites Alignment" paper. Specifically, we obtain this model by extrapolating **(alpha = 0.3)** from the weights of the SFT and DPO/RLHF checkpoints, achieving superior alignment with human preference. Evaluation results on the **AlpacaEval 2.0** benchmark (you can find the evaluation outputs on the official GitHub repo):