AI가 움직이고 미래가 업데이트됩니다.DeepSeek-V2-Lite-Chat-IMat-GGUF
Original Model: deepseek-ai/DeepSeek-V2-Lite-Chat Original dtype: `BF16` (`bfloat16`) Quantized by: llama.cpp fork PR 7519 IMatrix dataset: here If the model is bigger than 50GB, it will have been split into multiple files. In order to download them all to a local folder, run: According to this investigation, it appears that lower quantizations are the only ones that benefit from the imatrix input (as per hellaswag results).
번역 준비 중입니다. 원문을 표시합니다.
Original Model: deepseek-ai/DeepSeek-V2-Lite-Chat Original dtype: `BF16` (`bfloat16`) Quantized by: llama.cpp fork PR 7519 IMatrix dataset: here If the model is bigger than 50GB, it will have been split into multiple files. In order to download them all to a local folder, run: According to this investigation, it appears that lower quantizations are the only ones that benefit from the imatrix input (as per hellaswag results).