サイト内検索
AI モデル 84761
- Qwen-Image-Edit-2511-Midnight-Noir-Eyes-Spotlight↗
prithivMLmods
- bge-base-en-v1.5-onnx-Q↗
Qdrant
Quantized ONNX port of BAAI/bge-base-en-v1.5 for text classification and similarity searches. Here's an example of performing inference using the model with FastEmbed.
- mpt-7b-storywriter-GGUF↗
QuantFactory
- Qwen3-30B-A3B-AWQ↗
QuixiAI
tokenizer = AutoTokenizer.from_pretrained(model_name) model = AutoModelForCausalLM.from_pretrained( model_name, torch_dtype=torch.float16, device_map="auto" ) prompt = "Give me a short introduction to large language model." messages = [ {"role": "user", "content": prompt} ] text = tokenizer.apply_chat_template( messages, tokenize=False, add_generation_prompt=True, enable_thinking=True # Switches between thinking and non-thinking modes. Default is True. ) model_inputs = tokenizer([text], return_tensors="pt").to(model.device) generated_ids = model.generate( **model_inputs, max_new_tokens=32768 ) output_ids = generated_ids[0][len(model_inputs.input_ids[0]):].tolist()
- Qwen2.5-Coder-14B-Instruct-GPTQ-Int8↗
阿里巴巴 · Qwen
- Qwen3-VL-32B-Thinking-FP8↗
阿里巴巴 · Qwen
> This repository contains an FP8 quantized version of the Qwen3-VL-32B-Thinking model. The quantization method is fine-grained fp8 quantization with block size of 128, and its performance metrics are nearly identical to those of the original BF16 model. Enjoy! This generation delivers comprehensive upgrades across the board: superior text understanding & generation, deeper visual perception & reasoning, extended context length, enhanced spatial and video dynamics comprehension, and stronger agent interaction capabilities. Available in Dense and MoE architectures that scale from edge to cloud, with Instruct and reasoning‑enhanced Thinking editions for flexible, on‑demand deployment.
- protolabsAI-ThinkingCap-Qwen3.6-27B-MTP-ROCMFPX↗
rcmorano
- Qwen3.6-35B-A3B-PrismaQuant-4.75bit-vllm↗
rdtand
Mixed-precision quantization of `Qwen/Qwen3.6-35B-A3B` produced by **PrismaQuant** — a per-Linear sensitivity-driven allocator that chooses each Linear module's format individually under a total-bit budget. **Why "every layer refracts into a different format":** a naive uniform NVFP4 either leaves disk on the table (keeping everything BF16 "to be safe") or loses quality (quantizing sensitive layers to 4-bit). PrismaQuant measures the actual Fisher-weighted MSE for every (Linear, format) pair and runs a multi-choice knapsack under a total-bit budget, so every bit lives where it buys the most likelihood. This checkpoint uses **three precisions**, selected per-Linear by the allocator from measured sensitivity — not chosen uniformly:
- abdulmannan-01_-_qwen-2.5-0.5b-finetuned-for-sql-generation-combined-dataset-gguf↗
RichardErkhov
- Changgil_-_K2S3-Mistral-7b-v1.43-gguf↗
RichardErkhov
