AIが動く。未来が更新される。DeepSeek-R1-Distill-Qwen-32B-abliterated-GGUF
Original model: https://huggingface.co/huihui-ai/DeepSeek-R1-Distill-Qwen-32B-abliterated All quants made using imatrix option with dataset from here Some of these quants (Q3_K_XL, Q4_K_L etc) are the standard quantization method with the embeddings and output weights quantized to Q8_0 instead of what they would normally default to.
翻訳準備中のため原文を表示しています
Original model: https://huggingface.co/huihui-ai/DeepSeek-R1-Distill-Qwen-32B-abliterated All quants made using imatrix option with dataset from here Some of these quants (Q3_K_XL, Q4_K_L etc) are the standard quantization method with the embeddings and output weights quantized to Q8_0 instead of what they would normally default to.