llm-jp-4-8b-base
LLM-jp-4 is a series of large language models developed by the Research and Development Center for Large Language Models at the National Institute of Informatics. This repository provides the **llm-jp-4-8b-base** model. For an overview of the LLM-jp-4 models across different parameter sizes, please refer to: - LLM-jp-4 Models Base models are trained with pre-training and mid-training only. Post-trained models are aligned using supervised fine-tuning (SFT) and direct preference optimization (DPO), without reinforcement learning.
LLM-jp-4 is a series of large language models developed by the Research and Development Center for Large Language Models at the National Institute of Informatics. This repository provides the **llm-jp-4-8b-base** model. For an overview of the LLM-jp-4 models across different parameter sizes, please refer to: - LLM-jp-4 Models Base models are trained with pre-training and mid-training only. Post-trained models are aligned using supervised fine-tuning (SFT) and direct preference optimization (DPO), without reinforcement learning.
AI is happening. The future is updating.