AI is happening. The future is updating.Qwen3.8-27B-INT4
- **Model Architecture:** Qwen3_5ForConditionalGeneration - **Input:** Text / Image - **Output:** Text - **Model Optimizations:** - **Weight quantization:** INT4 - **Activation quantization:** None - **Release Date:** 2026-08-17 - **Version:** 1.0 - **Model Developers:** RedHatAI This model is a quantized version of Qwen/Qwen3.8-27B. It was evaluated on several tasks to assess its quality in comparison to the unquantized model. This model was obtained by quantizing the weights of Qwen/Qwen3.8-27B to INT4 data type while keeping activations in original precision, with FP8 KV cache, ready for inference with vLLM.
- **Model Architecture:** Qwen3_5ForConditionalGeneration - **Input:** Text / Image - **Output:** Text - **Model Optimizations:** - **Weight quantization:** INT4 - **Activation quantization:** None - **Release Date:** 2026-08-17 - **Version:** 1.0 - **Model Developers:** RedHatAI This model is a quantized version of Qwen/Qwen3.8-27B. It was evaluated on several tasks to assess its quality in comparison to the unquantized model. This model was obtained by quantizing the weights of Qwen/Qwen3.8-27B to INT4 data type while keeping activations in original precision, with FP8 KV cache, ready for inference with vLLM.