전체 검색
AI 모델 84762
- Qwen3-Omni-30B-A3B-GGUF↗
TrevorJS
- bge-reranker-v2-m3-onnx-int8↗
tss-deposium
- Qwen3.8-27B-Uncensored-HauhauCS-NInfer↗
ttindall
The HauhauCS Aggressive uncensored tune of Qwen3.8-27B, converted to the native NInfer `.ninfer` artifact format for the RTX 4090 (sm_89) line. The HauhauCS release ships GGUF only; this repository carries the artifact built from its `Q8_K_P` quant, in both container generations, plus the conversion report, the provenance sidecar and a manifest for each file. `.ninfer` is NInfer's own container. This is not a Transformers checkpoint, not safetensors and not a GGUF file, and it does not load in `transformers`, vLLM, llama.cpp or LM Studio. It is read by the NInfer engine only. > [!WARNING] > This model is uncensored by design: HauhauCS reports 0/465 refusals on its probe set, and the > Aggressive profile answers hard prompts directly with minimal preamble. It will produce content that > other models refuse to. You are responsible for what you generate with it and for complying with > the source licenses and applicable law.
- NVIDIA-Nemotron-3.5-Bolt-74B-A9B-24GB-LiLiCorr-MLX↗
txgsync
- typhoon2.1-gemma3-12b↗
typhoon-ai
- gemma-3-12b-it-bnb-4bit↗
unsloth
Gemma is a family of lightweight, state-of-the-art open models from Google, built from the same research and technology used to create the Gemini models. Gemma 3 models are multimodal, handling text and image input and generating text output, with open weights for both pre-trained variants and instruction-tuned variants. Gemma 3 has a large, 128K context window, multilingual support in over 140 languages, and is available in more sizes than previous versions. Gemma 3 models are well-suited for a variety of text generation and image understanding tasks, including question answering, summarization, and reasoning. Their relatively small size makes it possible to deploy them in environments with limited resources such as laptops, desktops or your own cloud infrastructure, democratizing access to state of the art AI models and helping foster innovation for everyone. These models were trained on a dataset of text data that includes a wide variety of sources. The 27B model was trained with 14 trillion tokens, the 12B model was trained with 12 trillion tokens, 4B model was trained with 4 trillion tokens and 1B with 2 trillion tokens. Here are the key components: The combination of these diverse data sources is crucial for training a powerful multimodal model that can handle a wide variety of different tasks and data formats.
- Llama-3.2-1B-bnb-4bit↗
unsloth
- Qwen3-Reranker-4B-GGUF-llama_cpp↗
Voodisss
Working GGUF of Qwen/Qwen3-Reranker-4B for llama.cpp. Converted 2025-03-09 with the official `convert_hf_to_gguf.py`. Benchmarked on MTEB AskUbuntuDupQuestions (361 queries) via llama-server `/v1/rerank` on RTX 3090. All quants produced from the same F16 source using `llama-quantize`. **Takeaway:** All quants from Q8_0 down to Q3_K_M are within ±1% of F16 — pick based on your VRAM budget. Q4_K_M (2.33 GB) is the sweet spot: 3.2x smaller than F16 with no measurable quality loss. **Avoid Q2_K** — it's the only quant with real degradation.
- LTX-Ripple↗
WepeNerd
- Gemma-4-26B-A4B-TAIDE-zhTW-GGUF↗
xCloudinfo
