foxAIAI正在发生 未来正在更新
中文
中文English日本語한국어

Meta-Llama-3.1-8B-Instruct-int8

This repo contains the Llama 3 8B Instruct model quantized to INT8 by FriendliAI, significantly enhancing its inference efficiency while maintaining high accuracy. Check out FriendliAI documentation for more details. 1. Sign in Friendli Suite. 2. Go to **User Settings > Tokens** and click **'Create new token'**. 3. Save your created token value. Container secret is a credential to launch our Friendli Container images. You should pass the container secret as an environment variable to run the container image.

译文尚未就绪,显示来源原文

This repo contains the Llama 3 8B Instruct model quantized to INT8 by FriendliAI, significantly enhancing its inference efficiency while maintaining high accuracy. Check out FriendliAI documentation for more details. 1. Sign in Friendli Suite. 2. Go to **User Settings > Tokens** and click **'Create new token'**. 3. Save your created token value. Container secret is a credential to launch our Friendli Container images. You should pass the container secret as an environment variable to run the container image.

资料来源

huggingface.co ↗