サイト内検索

AI モデル 84759

• bge-reranker-v2-m3-en-ru↗

  qilowoq

• llm-compiler-7b-GGUF↗

  QuantFactory

• SmolLM2-135M-Instruct-GGUF↗

  QuantFactory

• TableLLM-13b-GGUF↗

  QuantFactory

• gemma-4-26B-A4B-it-qat-assistant-q4_0-gguf↗

  RachidAR

  `Q4_0-q4emb` is an experimental quantization where `token_embd.weight` is kept in `Q4_0` instead of `Q6_K` precision quantization typically used by llama.cpp. This follows a similar approach to recent QAT experiments for Gemma models, where preserving the original Q4-trained embedding format may better match the intended QAT behavior. Initial testing showed similar draft acceptance rates to the default Q4_0 quant, with a small speed advantage, though more benchmarking is needed.

• Rain-100M↗

  raincandy-u

• Laya-Multilingual-MXFP8↗

  sahilchachra

• LFM3-1.7B-Paretrix↗

  Soulfate24

• MedVAE↗

  stanfordmimi

• Step-Audio-EditX↗

  阶跃星辰