AI가 움직이고 미래가 업데이트됩니다.DeepSeek-R1-BF16
You can view more detailed instructions in our blog: unsloth.ai/blog/deepseek-r1 1. Do not forget about ` ` and ` ` tokens! - Or use a chat template formatter 2. Obtain the latest `llama.cpp` at https://github.com/ggerganov/llama.cpp 3. Example with Q8_0 K quantized cache **Notice -no-cnv disables auto conversation mode** 4. If you have a GPU (RTX 4090 for example) with 24GB, you can offload multiple layers to the GPU for faster processing. If you have multiple GPUs, you can probably offload more layers. We have a free Google Colab Tesla T4 notebook for Llama 3.1 (8B) here: https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Llama3.1_(8B)-Alpaca.ipynb
번역 준비 중입니다. 원문을 표시합니다.
You can view more detailed instructions in our blog: unsloth.ai/blog/deepseek-r1 1. Do not forget about ` ` and ` ` tokens! - Or use a chat template formatter 2. Obtain the latest `llama.cpp` at https://github.com/ggerganov/llama.cpp 3. Example with Q8_0 K quantized cache **Notice -no-cnv disables auto conversation mode** 4. If you have a GPU (RTX 4090 for example) with 24GB, you can offload multiple layers to the GPU for faster processing. If you have multiple GPUs, you can probably offload more layers. We have a free Google Colab Tesla T4 notebook for Llama 3.1 (8B) here: https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Llama3.1_(8B)-Alpaca.ipynb