サイト内検索
AI モデル 85012
- Ornith-1.5-9B-GSQ-RCO-GGUF↗
abenzerps
Mixed-precision **GSQ-RCO** GGUF quantizations of ornith-ai/Ornith-1.5-9B, optimized for efficient, high-fidelity local inference in `llama.cpp`. The model supports a context length of up to 262,144 tokens (262K). Standard quantization severely degrades hybrid SSM-Transformer models (e.g. stock IQ3_M perplexity drops to ~75.2). **GSQ-RCO** solves this through two targeted techniques: - **RCO:** Keeps all 48 critical SSM parameters in unquantized **BF16**. - **GSQ:** Optimizes per-layer precision guided by Hessian sensitivity calibration.
- Spark-X2.5-4B-MLX-4bit↗
abenzerps
- TSHIRTDESIGN-REDMOND-QWENIMAGE↗
artificialguybr
- ChatHercules-2.5-Mistral-7B-GGUF↗
bartowski
- MiniCPM-V-2_6-GGUF↗
bartowski
- Qwen_Qwen3-235B-A22B-Thinking-2507-GGUF↗
bartowski
- Gemma-4-14B-A4B-Heretic-v2-GGUF↗
blascotobasco
- flint-mlx-mxfp4↗
bouroo
- grok-oss-Revenant-8B↗
c4tdr0ut
- MixedQuantFlux↗
ChrisGoringe
*Note that all these models are derivatives of black-forest-labs/FLUX.1-dev and therefore covered by the [FLUX.1 [dev] Non-Commercial License](https://huggingface.co/black-forest-labs/FLUX.1-dev/blob/main/LICENSE.md) license.* A collection of GGUF models using mixed quantization (different layers quantized to different precision to optimise fidelity v. memory), created using mixed gguf converter. They can be loaded in ComfyUI using the ComfyUI GGUF Nodes. Just put the gguf files in your models/unet directory.
