foxAIAI가 움직이고 미래가 업데이트됩니다.
한국어
中文English日本語한국어

Swift-1.5-Qwen3.8-27B-NInfer

A single-file NInfer **v3 artifact** of ukisai/Swift-1.5-Qwen3.8-27b-NVFP4, UkisAI's second reasoning-efficient fine-tune of Qwen3.8-27B, with more post-training aimed at agentic and coding work, in NVIDIA ModelOpt's NVFP4/FP8 quantization. Converted with upstream's own converter and the recipe included here; weight bytes are imported, not requantized. The successor to CaptainArni/Swift-Qwen3.8-27B-NInfer (Swift 1.0). The two files are structural twins — same size to the byte, same layout, same VRAM — so one replaces the other with no other change. **What is inside:** all 64 MLP layers and nothing else at NVFP4 (block size 16); the 144 GDN and 64 full-attention projections at FP8 E4M3 with one BF16 scale per row; an FP8 output head and FP8 embeddings; Q4/Q5/Q6 Vision; Q8 MTP; z-lab's DFlash2 draft at W8G32. Norms, convolutions, the small GDN projections and the draft codebooks stay BF16.

번역 준비 중입니다. 원문을 표시합니다.

A single-file NInfer **v3 artifact** of ukisai/Swift-1.5-Qwen3.8-27b-NVFP4, UkisAI's second reasoning-efficient fine-tune of Qwen3.8-27B, with more post-training aimed at agentic and coding work, in NVIDIA ModelOpt's NVFP4/FP8 quantization. Converted with upstream's own converter and the recipe included here; weight bytes are imported, not requantized. The successor to CaptainArni/Swift-Qwen3.8-27B-NInfer (Swift 1.0). The two files are structural twins — same size to the byte, same layout, same VRAM — so one replaces the other with no other change. **What is inside:** all 64 MLP layers and nothing else at NVFP4 (block size 16); the 144 GDN and 64 full-attention projections at FP8 E4M3 with one BF16 scale per row; an FP8 output head and FP8 embeddings; Q4/Q5/Q6 Vision; Q8 MTP; z-lab's DFlash2 draft at W8G32. Norms, convolutions, the small GDN projections and the draft codebooks stay BF16.

출처

huggingface.co ↗