Laguna-S-2.1-Uncensored-APEX-GGUF

Laguna-S-2.1-Uncensored-APEX-GGUF English | 📖 中文文档 Uncensored 118B-A8B MoE · abliterix Trial 16 · APEX I-tier GGUFs + imatrix Laguna S 2.1 is a poolside ~118B total / ~8B active per token Mixture-of-Experts model for agentic coding and long-horizon work. Architecture highlights: token-choice routing with softplus gates, 256 routed experts + 1 shared expert (top-10) , GQA, 1:3 global/sliding-window attention (48 layers: 12 global + 36 local, window 512), and up to about 1M context , with optional native thinking interleaved with tool use. This release builds on the official weights in two steps: Uncensored behavior edit via abliterix (ROCm + bitsandbytes 4-bit search path), selecting Trial 16 LoRA, stream-merged back to BF16, plus MoE safety-expert router bake-in. APEX mixed-precision GGUF quantized from the BF16 GGUF of our Laguna-S-2.1-Uncensored (converted with poolside llama.cpp (laguna) ), using APEX -style tensor-type configs + imatrix (token embedding / output kept at BF16 ).

翻訳準備中のため原文を表示しています