Naive-N0.5-Flash-EXL3-3.5bpw

> **Original model:** NaiveAI/Naive-N0.5-Flash by the > NaiveAI Team, MIT License. > This artifact is quantized from the public FP8 release > NaiveAI/Naive-N0.5-Flash-FP8. > It contains **modified weights** (EXL3 trellis quantization); the original model is © its authors. > Tokenizer and chat template are unchanged from the original. > Served by the veloGB10 engine it is listed by `/v1/models` as **`doth4580/Naive-N0.5-Flash-EXL3-3.5bpw`** (the `model_name:` line of > this card); `base_model:` is the original model it was quantized from, not this pack. An **EXL3 (ExLlamaV3 trellis) 3.5 bpw** quantization of **Naive-N0.5-Flash** — 309B parameters, 15.5B active, native 1M-token context. The pack is **~137 GB (~128 GiB) against ~315 GB for the FP8 original**, which is what lets it fit across **two NVIDIA DGX Spark (GB10)** machines. Quantized with the exllamav3 tooling, adapted for this architecture, run on **8×H100** for speed. It is served on two Sparks with the recipe in **sf-stav/Naive-N0.5-Flash-EXL3-2x-DGX-Spark** — see Serving below.

번역 준비 중입니다. 원문을 표시합니다.