サイト内検索
AI モデル 84761
- gemma-3-27b-it-quantized-W4A16↗
abhishekchohan
This repository contains W4A16 quantized versions of Google's Gemma 3 instruction-tuned models, making them more accessible for deployment on consumer hardware while maintaining good performance. These models use W4A16 quantization via LLM Compressor: - Weights quantized to 4-bit precision - Activations use 16-bit precision - Significantly reduced memory requirements
- Fara1.5-27B-GGUF↗
Abiray
- gena-lm-bert-large-t2t↗
AIRI-Institute
- longformer-base-4096↗
allenai
`longformer-base-4096` is a BERT-like model started from the RoBERTa checkpoint and pretrained for MLM on long documents. It supports sequences of length up to 4,096. Longformer uses a combination of a sliding window (local) attention and global attention. Global attention is user-configured based on the task to allow the model to learn task-specific representations. Please refer to the examples in `modeling_longformer.py` and the paper for more details on how to set global attention. If you use `Longformer` in your research, please cite Longformer: The Long-Document Transformer.
- OLMo-7B-0424-Instruct-hf↗
allenai
- translategemma-gguf↗
anilb
- Marco-DeepResearch-8B↗
ATH-MaaS
- Solar-Open2-250B-Mixed-Quant-GGUF↗
Baekpica
- Mistral-7B-v0.2-OpenHermes-GGUF↗
bartowski
- Qwen2.5-1.5B-Instruct-GGUF↗
bartowski
All quants made using imatrix option with dataset from here Some of these quants (Q3_K_XL, Q4_K_L etc) are the standard quantization method with the embeddings and output weights quantized to Q8_0 instead of what they would normally default to. Some say that this improves the quality, others don't notice any difference. If you use these models PLEASE COMMENT with your findings. I would like feedback that these are actually used and useful so I don't keep uploading quants no one is using.
