Qwen3-30B-A3B-FP8-block

This model was obtained by quantizing the weights and activations of Qwen/Qwen3-30B-A3B to FP8 data type. This optimization reduces the number of bits per parameter from 16 to 8, reducing the disk size and GPU memory requirements by approximately 50%. Only the weights and activations of the linear operators within transformers blocks of the language model are quantized. The model was evaluated on the OpenLLM leaderboard task, using lm-evaluation-harness. vLLM was used for all evaluations.

译文尚未就绪，显示来源原文