Search FoxAI
AI Models 84768
- Meta-Llama-3.1-70B-Instruct-FP8↗
RedHatAI
- **Model Architecture:** Meta-Llama-3.1 - **Input:** Text - **Output:** Text - **Model Optimizations:** - **Weight quantization:** FP8 - **Activation quantization:** FP8 - **Intended Use Cases:** Intended for commercial and research use in multiple languages. Similarly to Meta-Llama-3.1-8B-Instruct, this models is intended for assistant-like chat. - **Out-of-scope:** Use in any manner that violates applicable laws or regulations (including trade compliance laws). Use in languages other than English. - **Release Date:** 7/23/2024 - **Version:** 1.0 - **License(s):** llama3.1 - **Model Developers:** Neural Magic Quantized version of Meta-Llama-3.1-70B-Instruct. It achieves an average score of 84.29 on the OpenLLM benchmark (version 1), whereas the unquantized model achieves 84.40. This model was obtained by quantizing the weights and activations of Meta-Llama-3.1-70B-Instruct to FP8 data type. This optimization reduces the number of bits per parameter from 16 to 8, reducing the disk size and GPU memory requirements by approximately 50%.
- lucyknada_-_microsoft_WizardLM-2-7B-gguf↗
RichardErkhov
- MaLA-LM_-_lucky52-bloom-7b1-no-16-gguf↗
RichardErkhov
- tokyotech-llm_-_Llama-3-Swallow-8B-v0.1-gguf↗
RichardErkhov
- wang7776_-_Llama-2-7b-chat-hf-30-sparsity-gguf↗
RichardErkhov
- lingbot-vla-4b↗
robbyant
- tiny-lm-chat↗
sbintuitions
This repository provides a tiny 16M parameters language model for debugging and testing purposes. This is created by tuning sbintuitions/tiny-lm with oasset1 datasets in Japanese and English. The model was first pre-trained on English Wikipedia and Japanese Wikipedia to optimize a traditional language modelling objective for 25B tokens. And then it was fine-tuned on oasst1 datasets in Japanese and English for 15 epochs.
- Nanbeige4.1-3B-GGUF↗
seanbailey518
- Gemma-2b-it-GGUF↗
second-state
- SILMA-9B-Instruct-v1.0↗
silma-ai
