Search FoxAI
AI Models 84761
- Meta-Llama-3.1-70B-Instruct-quantized.w4a16↗
RedHatAI
This model is a quantized version of Meta-Llama-3.1-70B-Instruct. It was evaluated on a several tasks to assess the its quality in comparison to the unquatized model, including multiple-choice, math reasoning, and open-ended text generation. Meta-Llama-3.1-70B-Instruct-quantized.w4a16 achieves 100.0% recovery for the Arena-Hard evaluation, 99.4% for OpenLLM v1 (using Meta's prompting when available), 97.4% for OpenLLM v2, 101.0% for HumanEval pass@1, and 99.2% for HumanEval+ pass@1. This model was obtained by quantizing the weights of Meta-Llama-3.1-70B-Instruct to INT4 data type. This optimization reduces the number of bits per parameter from 16 to 4, reducing the disk size and GPU memory requirements by approximately 75%. Only the weights of the linear operators within transformers blocks are quantized. Symmetric per-group quantization is applied, in which a linear scaling per group of 128 parameters maps the INT4 and floating point representations of the quantized weights. The GPTQ algorithm is applied for quantization, as implemented in the AutoGPTQ library. GPTQ used a 1% damping factor and 512 sequences of 8,192 random tokens.
- BAAI_-_Infinity-Instruct-3M-0625-Mistral-7B-gguf↗
RichardErkhov
- Huihui-Qwen3.8-Flash-Next-abliterated-GGUF↗
robertbschuette
- dubstep-acestep1.5-xl-v1↗
ryanontheinside
- Huihui-GLM-5.1-abliterated-MLX-3.9bit↗
spicyneuron
- indonesian-roberta-base-emotion-classifier↗
StevenLimcorn
- clip-vit-large-patch14_dtd↗
tanganke
Adam Optimizer with a constant learning rate 1e-5 for 4000 steps training (batch_size=32). Only the vision encoder is fine-tuned.
- gr11↗
tao1000
- embeddinggemma-pt-br↗
tardellirs
- Jeffan-31b-1710↗
tattrongvu
