전체 검색

AI 모델 84759

• qwen-metaphor-unke-camada-5↗

  luisastellet

• dolphin-2.6-mistral-7b-dpo-laser-GGUF↗

  MaziyarPanahi

• Inex12Multiverseex26-7B-GGUF↗

  MaziyarPanahi

• Llama-3-8B-Instruct-DPO-v0.2-GGUF↗

  MaziyarPanahi

• Qwen2.5-1.5B-Instruct-GGUF↗

  MaziyarPanahi

  - Model creator: Qwen - Original model: Qwen/Qwen2.5-1.5B-Instruct GGUF is a new format introduced by the llama.cpp team on August 21st 2023. It is a replacement for GGML, which is no longer supported by llama.cpp. Here is an incomplete list of clients and libraries that are known to support GGUF:

• EZO-Humanities-9B-gemma-2-it-GGUF↗

  MCZK

• stable-diffusion-v1.5-webnn↗

  Microsoft

• Qwen3.6-35B-A3B-APEX-MTP-Strata-Q5EXPS-GGUF↗

  misthemAI

  This Q5'd model is now redundant - a fix was committed to the PR and it loads the Q6 models unconverted. A conversion of **mudler's Qwen3.6-35B-A3B-APEX-MTP** ("I-Quality", 23.5 GB) that runs on the **Strata** inference engine with PR #1402 (`qwen35moe` support). The model, its weights lineage and its in-file MTP draft layer are mudler's and Qwen's — this repo only changes the quantization of 27 tensors so the routed experts fit Strata's GPU kernels. **It is also a perfectly standard GGUF: llama.cpp and friends run it unchanged.** The APEX "I-Quality" ladder mixes routed-expert quantization per layer: 21 layers IQ4_XS, 10 layers Q5_K, **9 layers Q6_K**. Strata's engine (PR #1402) has GPU expert kernels for Q4_K / Q5_K / Q5_1 / Q8_0 / IQ2-4 families — but **not Q6_K experts** — so the original file is refused at load ("layer N's experts are Q6_K/Q6_K ... no GPU kernels for").

• gemma-1.1-2b-it-4bit↗

  mlx-community

• gemma-3-4b-it-8bit↗

  mlx-community

  This model was converted to MLX format from `google/gemma-3-4b-it` using mlx-vlm version **0.1.18**. Refer to the original model card for more details on the model.