Search FoxAI

AI Models 84759

• granite-4.2-8b-GGUF↗

  ibm-granite

  > [!NOTE] > This repository contains models that have been converted to the GGUF format with various quantizations from an IBM Granite base model. > > Please reference the base model's full model card here: > https://huggingface.co/ibm-granite/granite-4.2-8b

• gliner-biomed-base-v1.0↗

  Ihor

• CoRM-182M-top2↗

  ilsp

• ThinkingCap-Qwen3.8-27B-abliterated-GGUF↗

  IstroSec

  GGUF quantizations of ThinkingCap-Qwen3.8-27B-abliterated, the uncensored variant of bottlecapai/ThinkingCap-Qwen3.8-27B, for llama.cpp and apps built on it. Nine files from 13.0 GB (IQ3_M) to 29.0 GB (Q8_0): six with llama.cpp's standard mix for their type and three (`UD-*`) with Unsloth's per-tensor layouts. Every file is quantized directly from the BF16 GGUF, never from another quant, and every file below Q8_0 uses an importance matrix computed on this model. In every file the MTP head is pinned to Q8_0 (see Tensor pins). **Which build?** Q5_K_M (19.7 GB) is the recommended file. Below it, by memory: UD-Q4_K_XL (17.7 GB), IQ4_XS (15.5 GB), UD-IQ4_XS (14.4 GB), UD-Q3_K_XL (13.2 GB); Q6_K (22.5 GB) or Q8_0 (29.0 GB) when the memory is there. UD-Q4_K_XL and UD-Q3_K_XL have lower divergence than Q4_K_M and IQ3_M at a slightly larger size.

• gemma-4-31B-it-attn48-removed-Q4_0-GGUF↗

  Joakimpalm-Zen

• Kail_F2↗

  Kaniskten

• llm-course-hw1↗

  ketimiroshnik

• Kiel-2-Image-HD↗

  kiel2

• minor13↗

  kinggeezero

• gpt-oss-120b-heretic↗

  kldzj