全站搜索
AI 模型 84760
- 1dvit_base_patch50_5000.ptbxl-form↗
4dm-labs
- Spark-X2.5-4B-GGUF↗
abenzerps
> [!IMPORTANT] > **Compatibility:** These GGUF files require `llama.cpp` **b10828** or later, which includes official support for the Spark-X2.5 (`spark2_5`) architecture. Applications with a bundled runtime must use an equivalent or newer build. llama.cpp support GGUF quantizations of XHToken/Spark-X2.5-4B, a 4B general-purpose language model for reasoning, coding, tool use, and agentic workflows. Native context: **1,048,576 tokens (1M)**. Includes the upstream chat_template.jinja. Checksums: SHA256SUMS.txt.
- GigaChat3.1-10B-A1.8B-GGUF↗
ai-sage
`GigaChat 3.1 Lightning` is the compact instruct model of the GigaChat 3.1 family. It is a Mixture-of-Experts (MoE) model with 10B total parameters and 1.8B active parameters, designed for fast multilingual assistant workloads, reasoning, code, function calling, and product-style deployment. For high-performance inference, an fp8 version of the model is available - GigaChat3.1-10B-A1.8B. bf16 version is also avaliable - GigaChat3.1-10B-A1.8B-bf16.
- Wan2.2-Fun-A14B-Control-Camera↗
alibaba-pai
Windows 的详细信息: - 操作系统 Windows 10 - python: python3.10 & python3.11 - pytorch: torch2.2.0 - CUDA: 11.8 & 12.1 - CUDNN: 8+ - GPU: Nvidia-3060 12G & Nvidia-3090 24G Linux 的详细信息: - 操作系统 Ubuntu 20.04, CentOS - python: python3.10 & python3.11 - pytorch: torch2.2.0 - CUDA: 11.8 & 12.1 - CUDNN: 8+ - GPU:Nvidia-V100 16G & Nvidia-A10 24G & Nvidia-A100 40G & Nvidia-A100 80G 由于Wan2.2的参数非常大,我们需要考虑显存节省方案,以节省显存适应消费级显卡。我们给每个预测文件都提供了GPU_memory_mode,可以在model_cpu_offload,model_cpu_offload_and_qfloat8,sequential_cpu_offload中进行选择。该方案同样适用于CogVideoX-Fun的生成。
- Qwen3.8-27B-abliterated-ROCmFPX↗
ArtomYuan
**ROCmFPX quantized GGUF (7 tiers + vision mmproj)** of huihui-ai/Huihui-Qwen3.8-27B-abliterated — abliterated BF16 weights, locally requantized. This repository uses strix.cpp, a llama.cpp fork **specifically tuned for the AMD Strix Halo `gfx1151` (Ryzen AI MAX+ 395) UMA architecture and ROCm/HIP backend**, with native support for the ROCmFPX quantization format. Requires strix.cpp (this fork supports ROCmFPX; **upstream llama.cpp cannot load these files** — format note at the end).
- smolm2-1.7b-uncensored↗
arzaan789
- aragpt2-medium↗
aubmindlab
- Aquila-135M-Intermediate↗
BAAI
- allura-org_remnant-mn-12b-GGUF↗
bartowski
- deepseek-ai_DeepSeek-V3.1-GGUF↗
bartowski
All quants made using imatrix option with dataset from here combined with a subset of combined_all_small.parquet from Ed Addario here Some of these quants (Q3_K_XL, Q4_K_L etc) are the standard quantization method with the embeddings and output weights quantized to Q8_0 instead of what they would normally default to. If the model is bigger than 50GB, it will have been split into multiple files. In order to download them all to a local folder, run:
