AI가 움직이고 미래가 업데이트됩니다.gemma-2-27b-it-IMat-GGUF
Original Model: google/gemma-2-27b-it Original dtype: `BF16` (`bfloat16`) Quantized by: llama.cpp b3790 IMatrix dataset: here If the model file is big, it has been split into multiple files. In order to download them all to a local folder, run: According to this investigation, it appears that lower quantizations are the only ones that benefit from the imatrix input (as per hellaswag results).
번역 준비 중입니다. 원문을 표시합니다.
Original Model: google/gemma-2-27b-it Original dtype: `BF16` (`bfloat16`) Quantized by: llama.cpp b3790 IMatrix dataset: here If the model file is big, it has been split into multiple files. In order to download them all to a local folder, run: According to this investigation, it appears that lower quantizations are the only ones that benefit from the imatrix input (as per hellaswag results).