サイト内検索
AI モデル 85012
- Qwen-Image-Edit-Rapid-AIO-GGUF↗
chfm
- canvers-ko2en-v1↗
circulus
- gpt2-base-chinese↗
ckiplab
- Claude Fable 5.1 (Max, Default Fallback)↗
Anthropic
Claude Fable 5.1 在 Claude Fable 5 的基础上进行了扩展,输入和输出价格保持不变,缓存读取成本降至四分之一,并带来了更强的长时间运行的智能体编码、多步骤研究,以及文档、电子表格和幻灯片处理能力。对于大多数工作负载
- claude-opus-4-7-thinking↗
Anthropic
- JiRackUltra_7b↗
CMSManhattan
A fast and efficient 7B model optimized for CPU inference. The model was refactored with BitNet features and an updated tokenizer that includes new **Routing**, **Media**, **Vision** , **Sound** ,**Tool call**, and **Robotics** tags. Built on a DeepSeek R1 -7B architecture with native ternary (BitNet-style) support and ready-to-run GGUF quantizations. - JiRack is a cloud-ready model that helps save money on cloud infrastructure. It can be used as an expert model in RAG deployments, with the ONNX JiRack Java server as an alternative. The listening port can be easily modified directly from the **Settings** panel within the JiRack UI. For commercial licensing, cluster deployment, or enterprise use of JiRack models, please contact us.
- test-bf-moe↗
crumbs-playground
- cld3-GGUF↗
cstr
- fireredpunc-GGUF↗
cstr
**Recommendation**: Use Q8_0. Token classification is more sensitive to quantization than language modeling — Q4_K occasionally drops commas that Q8_0 and F16 correctly predict.
- GLM-5.3-Flash-UNCENSORED-NVFP4↗
dealignai
> [!IMPORTANT] > **Serving note — read before your first request (vLLM / SGLang with a reasoning parser).** > > - **`reasoning_effort` only accepts `"low"` and `"high"`.** Anything else — `medium`, `xhigh`, > `off`, or omitting it — silently resolves to **`max`**, the deepest mode. Template line: > `reasoning_effort ... in ['low','high'] else 'max'`. > - **At `max`, a small `max_tokens` returns an EMPTY reply.** The model spends the whole budget > inside ` ` and you get `finish_reason="length"` with `content=""`. In multi-turn the empty > turn poisons the history and the conversation does not recover. Measured: `max` + `max_tokens > 2000` dies from turn ~4; `max` + `6000` is clean; `low` and `high` are clean at 2000. > **It is budget exhaustion, not a loop** — sampling changes do not rescue it. > - **Do NOT pass `enable_thinking`.** This template has no such variable (only `clear_thinking` and > `reasoning_effort`). Passing it — or a top-level `reasoning_effort: "none"` — turns the parser off > while the model still thinks, dumping raw reasoning into `content`. > - **Reasoning is returned in `message.reasoning`**, not `message.reasoning_content` > (vLLM renamed the output field; the input side still accepts both). > - `clear_thinking` must be nested inside `chat_template_kwargs` — a top-level key is ignored. > > > Use `"high"` for hard tasks; if you want `max`, give it `max_tokens >= 6000`. > > > **Video and image parameters — measured, because several are accepted then silently ignored.** > > - 🔴 **`media_io_kwargs.video.fps` must stay BELOW the clip's own frame rate.** Requesting a value > at or above it makes the placeholder builder count 3x the real tokens and **kills the engine**: > `ValueError: Attempted to assign N = N multimodal tokens to 3N placeholders` -> `EngineDeadError`, > server down until restarted. Upstream: vLLM #55644 / #55647. `fps: 2` is the safe, accurate choice. > - **`max_frames` and `num_frames` are not interchangeable across builds.** On vLLM nightly > `max_frames` is honoured and `num_frames` ignored; on the older `0.1.dev*` line it is the exact > reverse. A client that sets only one silently gets full-rate sampling on the other build
