サイト内検索
AI モデル 84761
- diffusiongemma-26B-A4B-it-FP8-dynamic↗
RedHatAI
This model is an FP8 quantized version of google/diffusiongemma-26B-A4B-it. The model has both weights and activations quantized to FP8 using vllm/llm-compressor and in the compressed-tensors format. It was evaluated on several tasks to assess its quality in comparison to the unquantized model using vLLM. The following metrics were generated when serving the quantized model with vLLM on a single B200 GPU.
- TheBlueObserver_-_Qwen2.5-1.5B-Instruct-MLX-gguf↗
RichardErkhov
- grunge-acestep1.5-v1↗
ryanontheinside
- clip-ViT-L-14↗
sentence-transformers
- Supra2-Medium-Instruct↗
SupraLabs
- Mach-1-Additive-35B-Multimodal-GGUF↗
SyzygyResearch
- ModernBERT-base-nli↗
tasksource
ModernBERT multi-task fine-tuned on tasksource NLI tasks, including MNLI, ANLI, SICK, WANLI, doc-nli, LingNLI, FOLIO, FOL-NLI, LogicNLI, Label-NLI and all datasets in the below table). This is the equivalent of an "instruct" version. The model was trained for 200k steps on an Nvidia A30 GPU. It is very good at reasoning tasks (better than llama 3.1 8B Instruct on ANLI and FOLIO), long context reasoning, sentiment analysis and zero-shot classification with new labels. The following table shows model test accuracy. These are the scores for the same single transformer with different classification heads on top. Further gains can be obtained by fine-tuning on a single-task, e.g. SST, but it this checkpoint is great for zero-shot classification and natural language inference (contradiction/entailment/neutral classification).
- NVIDIA-Nemotron-3.5-Lightning-30B-A3B-oQ4↗
TensorFold
- Seraph-openchat-3.5-1210-Slerp-GGUF↗
TheBloke
- YuLan-Chat-2-13B-GGUF↗
TheBloke
