AIが動く。未来が更新される。Qwen3.8-27B-NVFP4-RTX5090
Runs on **SparkInfer, SGLang and vLLM** unmodified — configs for all three are below. Serving many users at once? See concurrency. **SparkInfer × this NVFP4 build × the DSpark v2 drafter** — an engine, a checkpoint, and a speculative drafter optimized against each other, compounding to **4.3×**. The drafter never changes what the model says: the target verifies every drafted token. **GeForce RTX 5090–specific** NVFP4 checkpoint of `Qwen/Qwen3.8-27B`, quantized with NVIDIA Model Optimizer. Serves the **full native 262,144-token context** on 32 GB.
翻訳準備中のため原文を表示しています
Runs on **SparkInfer, SGLang and vLLM** unmodified — configs for all three are below. Serving many users at once? See concurrency. **SparkInfer × this NVFP4 build × the DSpark v2 drafter** — an engine, a checkpoint, and a speculative drafter optimized against each other, compounding to **4.3×**. The drafter never changes what the model says: the target verifies every drafted token. **GeForce RTX 5090–specific** NVFP4 checkpoint of `Qwen/Qwen3.8-27B`, quantized with NVIDIA Model Optimizer. Serves the **full native 262,144-token context** on 32 GB.