전체 검색
AI 모델 84762
- gemma-4-12B-AWQ↗
mattbucci
In-house **AWQ-Marlin (4-bit)** quantization of `google/gemma-4-12B-it` — the encoder-free omni Gemma 4 (`Gemma4UnifiedForConditionalGeneration`): text + reasoning + tool-use + vision + audio, global-MQA attention, 5:1 sliding:full, ~262K native context. Packed **data-free** from the QAT base `google/gemma-4-12B-it-qat-q4_0-unquantized` (Gemma's quantization-aware-trained release). Because QAT already conditions the weights onto a 4-bit grid, a plain RTN re-quantization to AWQ group-128 is **near-lossless** — no calibration corpus needed: Weights are **5.4 GB/rank** at int4. Identical text quality to the BF16 base at matched context length.
- maya2-native↗
maya-research
- build-unosquare-summarizer↗
mbrown-uno
- figpanel-yolov12↗
mermermer
- qwen3-tiny-4kv-heads-8layers-random↗
michaelbenayoun
- descript-audio-codec-44khz↗
mlx-community
- Aronnax-N9Bv2-1.0-i1-GGUF↗
mradermacher
- Blossom-V6.3-36B-tainted-heresy-i1-GGUF↗
mradermacher
- danskgpt-v4-12b-i1-GGUF↗
mradermacher
- DeepSeek-R1-Distill-Qwen-14B-Uncensored-GGUF↗
mradermacher
weighted/imatrix quants are available at https://huggingface.co/mradermacher/DeepSeek-R1-Distill-Qwen-14B-Uncensored-i1-GGUF If you are unsure how to use GGUF files, refer to one of TheBloke's READMEs for more details, including on how to concatenate multi-part files. (sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
