AI is happening. The future is updating.LLaDA-1.5
We introduce LLaDA 1.5, a competitive large diffusion language model, trained by variance-reduced preference optimization (VRPO), as presented in the paper LLaDA 1.5: Variance-Reduced Preference Optimization for Large Language Diffusion Models. Compared with LLaDA-8B-Instruct, LLaDA 1.5 achieves better performance on a wide range of tasks, including Math, Code, and Alignment tasks.
We introduce LLaDA 1.5, a competitive large diffusion language model, trained by variance-reduced preference optimization (VRPO), as presented in the paper LLaDA 1.5: Variance-Reduced Preference Optimization for Large Language Diffusion Models. Compared with LLaDA-8B-Instruct, LLaDA 1.5 achieves better performance on a wide range of tasks, including Math, Code, and Alignment tasks.