Qwen3-Swallow-8B-SFT-v0.2
**Qwen3-Swallow v0.2** is a family of large language models available in **8B**, **30B-A3B**, and **32B** parameter sizes. Built as bilingual Japanese-English models, they were developed through Continual Pre-Training (CPT), Supervised Fine-Tuning (SFT), and Reinforcement Learning with Verifiable Rewards (RLVR) based on the Qwen3 [Yang, 2025]. In addition to enhancing Japanese language proficiency and Japanese-English translation capabilities, we significantly improved or maintained performance on math and coding tasks during CPT by using high-quality math and code datasets with reasoning traces, along with custom-built datasets during SFT. Subsequently, we further improved the models' math and coding performance by enhancing reasoning capabilities through RLVR. We are releasing nine Qwen3-Swallow models: three each for CPT, SFT, and RL models. Quantized versions of RL models are also available. The complete list is as follows:
**Qwen3-Swallow v0.2** is a family of large language models available in **8B**, **30B-A3B**, and **32B** parameter sizes. Built as bilingual Japanese-English models, they were developed through Continual Pre-Training (CPT), Supervised Fine-Tuning (SFT), and Reinforcement Learning with Verifiable Rewards (RLVR) based on the Qwen3 [Yang, 2025]. In addition to enhancing Japanese language proficiency and Japanese-English translation capabilities, we significantly improved or maintained performance on math and coding tasks during CPT by using high-quality math and code datasets with reasoning traces, along with custom-built datasets during SFT. Subsequently, we further improved the models' math and coding performance by enhancing reasoning capabilities through RLVR. We are releasing nine Qwen3-Swallow models: three each for CPT, SFT, and RL models. Quantized versions of RL models are also available. The complete list is as follows:
AI is happening. The future is updating.