GEV-26B-Decide-NVFP4

> [!IMPORTANT] > **Try AutoTrust/GuruSearch live (new, 11 October 2026).** A recommendation and search demo in which every ranking is a > calibrated System 1 decision, made in about half a second: > * **Recommendation:** the latest headlines from 6 news feeds, ranked by importance. > * **Search:** results from Google News, Bing News and Yahoo News re-ranked by relevance, side by side with the > search engines' own order, plus a short answer with citations. This repository is **autotrust/GEV-26B-Decide with its 3,840 routed expert MLPs (30 layers × 128 experts) quantized to NVFP4**. Everything else is the bf16 model unchanged: attention, the dense MLP of every layer, the routers, the vision tower, the lm_head, the System 1 adapter, the decision head and the temperatures. The rest of this card is the card of GEV-26B-Decide; its benchmark tables are the bf16 results, and the NVFP4 comparison is below. GPQA Diamond and HLE are the Decision Index items; the bf16 row is the model's `transformers` engine, the NVFP4 row is vLLM with this checkpoint. The differences are within run-to-run noise (198 questions: about ±7 points).

번역 준비 중입니다. 원문을 표시합니다.