AI가 움직이고 미래가 업데이트됩니다.gemma-3-12b-it-quantized-W4A16
This repository contains W4A16 quantized versions of Google's Gemma 3 instruction-tuned models, making them more accessible for deployment on consumer hardware while maintaining good performance. - **abhishekchohan/gemma-3-27b-it-quantized-W4A16** - **abhishekchohan/gemma-3-12b-it-quantized-W4A16** - **abhishekchohan/gemma-3-4b-it-quantized-W4A16** These models use W4A16 quantization via LLM Compressor: - Weights quantized to 4-bit precision - Activations use 16-bit precision - Significantly reduced memory requirements
번역 준비 중입니다. 원문을 표시합니다.
This repository contains W4A16 quantized versions of Google's Gemma 3 instruction-tuned models, making them more accessible for deployment on consumer hardware while maintaining good performance. - **abhishekchohan/gemma-3-27b-it-quantized-W4A16** - **abhishekchohan/gemma-3-12b-it-quantized-W4A16** - **abhishekchohan/gemma-3-4b-it-quantized-W4A16** These models use W4A16 quantization via LLM Compressor: - Weights quantized to 4-bit precision - Activations use 16-bit precision - Significantly reduced memory requirements