サイト内検索
AI モデル 84760
- sd15↗
ckpt
- Qwen3-Coder-30B-A3B-Instruct-AWQ↗
dark-side-of-the-code
AWQ **W4A16** (4-bit weights, group size 128) quantization of `Qwen/Qwen3-Coder-30B-A3B-Instruct`, produced with llm-compressor for serving on a single 24 GB GPU with vLLM. Qwen3-Coder-30B-A3B is a Mixture-of-Experts model (128 experts, 8 active per token) using standard **GQA** attention — so it serves on consumer Ada GPUs with the stock attention backends, no special kernels required. Notes: - At `--max-model-len 65536` on a 24 GB card the KV pool holds ~118K tokens (~1.8x concurrency). The base model's native context is 262K; 64K is the practical cap at 24 GB. - Tool calling works via vLLM's first-class `qwen3_coder` parser. - Non-thinking model — no reasoning parser needed. - Pass `--override-generation-config` if your client doesn't send sampling params, or vLLM will default to `temperature=1.0`, which is far too hot for coding.
- Qwen_image↗
DeepBeepMeep
You will find here all the Qwen image models used with WanGP (https://github.com/deepbeepmeep/Wan2GP) : WanGP by DeepBeepMeep : The best Open Source Video Generative Models Accessible to the GPU Poor WanGP supports the Wan (and derived models), Hunyuan Video, Flux 1 & 2, Qwen, Z-Image and LTV Video models with:
- bald_konverter↗
deepmancer
- Z-Image-Turbo-6B-MLX-Q8↗
deepsweet
- Qwen3.6-27B-GGUF↗
eaddario
- distilbert-base-uncased-finetuned-conll03-english↗
elastic
- ELYZA-japanese-Llama-2-13b-fast↗
elyza
- fasttext-mk-vectors↗
facebook
- fasttext-mwl-vectors↗
facebook
