AI is happening. The future is updating.ComfyUI-Qwen3-VL-GGUF
This repository provides **two distinct formats** depending on your runtime: 1. **π₯ NEW: Unified Single-File Hybrid GGUFs (`*_vision_q8_0.gguf`)** β Combines the K-quantized LLM backbone (`Q4_K_M` / `Q5_K_M`) and the `Q8_0` Vision Tower + DeepStack Mergers + 5D `Conv3d` shape metadata (`comfy.gguf.orig_shape`) inside a **single file**. 2. **Split LLM + Standalone `mmproj` GGUFs** β Standard two-file format for **llama.cpp**, **llama-server**, **Ollama**, and split VLM loaders. *Contains both the Language Backbone (`blk.*`) and Vision Tower (`model.visual.*`) in a single GGUF file.* 1. Download either `qwen3vl_8b_q4_k_m_vision_q8_0.gguf` or `qwen3vl_8b_q5_k_m_vision_q8_0.gguf` and place it into:
This repository provides **two distinct formats** depending on your runtime: 1. **π₯ NEW: Unified Single-File Hybrid GGUFs (`*_vision_q8_0.gguf`)** β Combines the K-quantized LLM backbone (`Q4_K_M` / `Q5_K_M`) and the `Q8_0` Vision Tower + DeepStack Mergers + 5D `Conv3d` shape metadata (`comfy.gguf.orig_shape`) inside a **single file**. 2. **Split LLM + Standalone `mmproj` GGUFs** β Standard two-file format for **llama.cpp**, **llama-server**, **Ollama**, and split VLM loaders. *Contains both the Language Backbone (`blk.*`) and Vision Tower (`model.visual.*`) in a single GGUF file.* 1. Download either `qwen3vl_8b_q4_k_m_vision_q8_0.gguf` or `qwen3vl_8b_q5_k_m_vision_q8_0.gguf` and place it into: