全站搜索
AI 模型 84762
- Phi-4-mini-instruct-int4-ov↗
OpenVINO
- ka_PP-OCRv3_mobile_rec↗
PaddlePaddle
- Clef-Flash-GGUF↗
Pitaya1219
Low-bit quantizations (Q4_K_M, IQ3_XXS, IQ2_M, IQ2_XS) of Cloudflare/clef-flash in the native `clef` GGUF architecture. Serve with `llama-server` b11415 or later (`/v1/systemone`, llama.cpp#29831). Run through `llama-server` b11415 (`/v1/systemone`, Vulkan, AMD Radeon 8060S), one request at a time, with the same 600 items for every model: 200 each from SST-2 (validation), AG News (test) and BoolQ (validation), sampled with a fixed seed. Agreement and KL are against `Clef-Flash-Q8_0.gguf` from ggml-org, not against bf16. Livesport's per-tensor layout applied step by step to IQ2_M (all with the head at Q8_0), same 600 items, against the same Q8_0 baseline.
- zerank-1-GGUF↗
prithivMLmods
- lakshyakh93-deberta_finetuned_pii-onnx↗
protectai
- codegemma-2b-GGUF-smashed↗
PrunaAI
- GLM-4.7-Flash-AWQ↗
QuantTrio
Base model: zai-org/GLM-4.7-Flash GLM-4.7-Flash is a 30B-A3B MoE model. As the strongest model in the 30B class, GLM-4.7-Flash offers a new option for lightweight deployment that balances performance and efficiency. For local deployment, GLM-4.7-Flash supports inference frameworks including vLLM and SGLang. Comprehensive deployment instructions are available in the official Github repository.
- Qwen3-4B-AWQ↗
阿里巴巴 · Qwen
Qwen3 is the latest generation of large language models in Qwen series, offering a comprehensive suite of dense and mixture-of-experts (MoE) models. Built upon extensive training, Qwen3 delivers groundbreaking advancements in reasoning, instruction-following, agent capabilities, and multilingual support, with the following key features: - **Uniquely support of seamless switching between thinking mode** (for complex logical reasoning, math, and coding) and **non-thinking mode** (for efficient, general-purpose dialogue) **within single model**, ensuring optimal performance across various scenarios. - **Significantly enhancement in its reasoning capabilities**, surpassing previous QwQ (in thinking mode) and Qwen2.5 instruct models (in non-thinking mode) on mathematics, code generation, and commonsense logical reasoning. - **Superior human preference alignment**, excelling in creative writing, role-playing, multi-turn dialogues, and instruction following, to deliver a more natural, engaging, and immersive conversational experience. - **Expertise in agent capabilities**, enabling precise integration with external tools in both thinking and unthinking modes and achieving leading performance among open-source models in complex agent-based tasks. - **Support of 100+ languages and dialects** with strong capabilities for **multilingual instruction following** and **translation**. **Qwen3-4B** has the following features: - Type: Causal Language Models - Training Stage: Pretraining & Post-training - Number of Parameters: 4.0B - Number of Paramaters (Non-Embedding): 3.6B - Number of Layers: 36 - Number of Attention Heads (GQA): 32 for Q and 8 for KV - Context Length: 32,768 natively and 131,072 tokens with YaRN.
- whisper-large-v3-turbo-FP8-dynamic↗
RedHatAI
- Nitral-AI_-_Nyan-Stunna-7B-gguf↗
RichardErkhov
