AI가 움직이고 미래가 업데이트됩니다.rune-26b-a4b-v3-GGUF
llama.cpp builds of **Rune 26B-A4B v3**, the decision model by Invergent. Each file is measured against the original bf16 weights. Livesport serves **IQ3_S-dyn** in production on **2× Quadro RTX 4000 8 GB** behind a Jev/SystemOne-compatible `/v1/systemone` API. Rune does not generate text. Given a *state* and a question with a set of options, it returns a probability for every option, read from the logits of the option letters at the first generated position. The upstream card describes the model, its training protocol and its Decision Index results. This card covers only what is specific to these quantizations. **Text only:** the files contain the language model, without Gemma 4's vision tower, so image states are not supported. The first version of this repository (one IQ3_M in three shards, KL 0.0450) is at revision `4990396`. IQ3_S-dyn replaces it: 1.2 GB larger, with half the KL against bf16.
번역 준비 중입니다. 원문을 표시합니다.
llama.cpp builds of **Rune 26B-A4B v3**, the decision model by Invergent. Each file is measured against the original bf16 weights. Livesport serves **IQ3_S-dyn** in production on **2× Quadro RTX 4000 8 GB** behind a Jev/SystemOne-compatible `/v1/systemone` API. Rune does not generate text. Given a *state* and a question with a set of options, it returns a probability for every option, read from the logits of the option letters at the first generated position. The upstream card describes the model, its training protocol and its Decision Index results. This card covers only what is specific to these quantizations. **Text only:** the files contain the language model, without Gemma 4's vision tower, so image states are not supported. The first version of this repository (one IQ3_M in three shards, KL 0.0450) is at revision `4990396`. IQ3_S-dyn replaces it: 1.2 GB larger, with half the KL against bf16.