Laguna-XS.2

Laguna XS.2 is a 33B total parameter Mixture-of-Experts model with 3B activated parameters per token designed for agentic coding and long-horizon work on a local machine. It uses Sliding Window Attention with per-head gating in 30 out of 40 layers for fast inference and low KV cache requirements. > [!NOTE] > For more details on how we trained this model, including on data automixing and async off-policy agent RL, check out our release blog post and technical report. - **Mixed SWA and global attention layout**: Laguna XS.2 uses sigmoid gating with per-layer rotary scales, enabling mixed SWA (Sliding Window Attention) and global attention layers in a 3:1 ratio (across 40 total layers) - **KV cache in FP8**: KV cache quantized to FP8, reducing memory per token - **Native reasoning support**: Interleaved thinking between tool calls with support for enabling and disabling thinking per-request - **Local-ready**: At 33B total parameters and 3B activated, Laguna XS.2 is compact enough to run on a Mac with 36 GB of RAM. Available on Ollama - **Apache 2.0 license**: Use and modify freely for commercial and non-commercial purposes

번역 준비 중입니다. 원문을 표시합니다.