AI가 움직이고 미래가 업데이트됩니다.Llama3-8B-Chinese-Chat-ExPO
The extrapolated (ExPO) model based on `shenzhi-wang/Llama3-8B-Chinese-Chat` and `meta-llama/Meta-Llama-3-8B-Instruct`, as in the "Weak-to-Strong Extrapolation Expedites Alignment" paper. Specifically, we obtain this model by extrapolating **(alpha = 0.3)** from the weights of the SFT and DPO/RLHF checkpoints, achieving superior alignment with human preference. **Note:** This is an experimental model, as I have not comprehensively evaluated its Chinese ability. **Unexpected issues may occur when we apply extrapolation to the DPO/RLHF alignment training for new languages (e.g., Chinese).**
번역 준비 중입니다. 원문을 표시합니다.
The extrapolated (ExPO) model based on `shenzhi-wang/Llama3-8B-Chinese-Chat` and `meta-llama/Meta-Llama-3-8B-Instruct`, as in the "Weak-to-Strong Extrapolation Expedites Alignment" paper. Specifically, we obtain this model by extrapolating **(alpha = 0.3)** from the weights of the SFT and DPO/RLHF checkpoints, achieving superior alignment with human preference. **Note:** This is an experimental model, as I have not comprehensively evaluated its Chinese ability. **Unexpected issues may occur when we apply extrapolation to the DPO/RLHF alignment training for new languages (e.g., Chinese).**