Llama-3.1-Swallow-8B-Instruct-v0.5

모델 소개

Llama 3.1 Swallow is a series of large language models (8B, 70B) that were built by continual pre-training on the Meta Llama 3.1 models. Llama 3.1 Swallow enhanced the Japanese language capabilities of the original Llama 3.1 while retaining the English language capabilities. We use approximately 200 billion tokens that were sampled from a large Japanese web corpus (Swallow Corpus Version 2), Japanese and English Wikipedia articles, and mathematical and coding contents, etc (see the Training Datasets section of the base model) for continual pre-training. The instruction-tuned models (Instruct) were built by supervised fine-tuning (SFT) on the synthetic data specially built for Japanese. See the Swallow Model Index section to find other model variants. **Note**: Llama-3.1-Swallow-8B-Instruct-v0.5 model was continually pre-trained from the meta-llama/Llama-3.1-8B-Instruct and then instruction-tuned with our instruction datasets. This release enhances the conversation capability of Llama 3.1 Swallow. The model is trained to imitate the behavior of gemma-3-27b-it. Among all open-source LLMs with <= 8 billion parameters, Llama-3.1-Swallow-8B-Instruct-v0.5 exhibits **state-of-the-art performance on Japanese MT-Bench**, outperforming its predecessor, Llama-3.1-Swallow-8B-Instruct-v0.3, by 1.5 points.

주요 특징

特点摘要待依据来源补齐，不凭模型名称推断能力。

한계 및 유의 사항

구체적 한계를 판단할 출처가 부족합니다. 실제 성능, 지연, 데이터 정책, 라이선스와 버전 수명을 확인하세요.

출처별 요금 및 비용 분석

요금은 채널, 지역, 설정에 따라 다릅니다. 각 채널 요금은 개별 표시되며 제공사의 통일 공식 요금이 아닙니다.

공개 평가 및 실행 설정

暂无已采集的可核验公开评分。模型未上榜不代表能力较低。

자주 묻는 질문

출처 및 추적 기록

许可证：llama3.3。模型介绍与第三方评测均以原来源的具体版本和方法为准。