AI正在发生 未来正在更新DeepSeek-V2.5-IMat-GGUF
Original Model: deepseek-ai/DeepSeek-V2.5 Original dtype: `BF16` (`bfloat16`) Quantized by: llama.cpp b3675 IMatrix dataset: here If the model file is big, it has been split into multiple files. In order to download them all to a local folder, run: According to this investigation, it appears that lower quantizations are the only ones that benefit from the imatrix input (as per hellaswag results).
译文尚未就绪，显示来源原文
Original Model: deepseek-ai/DeepSeek-V2.5 Original dtype: `BF16` (`bfloat16`) Quantized by: llama.cpp b3675 IMatrix dataset: here If the model file is big, it has been split into multiple files. In order to download them all to a local folder, run: According to this investigation, it appears that lower quantizations are the only ones that benefit from the imatrix input (as per hellaswag results).