AI正在发生 未来正在更新Tiger-Gemma-9B-v1-GGUF
If the model is bigger than 50GB, it will have been split into multiple files. In order to download them all to a local folder, run: The first thing to figure out is how big a model you can run. To do this, you'll need to figure out how much RAM and/or VRAM you have. If you want your model running as FAST as possible, you'll want to fit the whole thing on your GPU's VRAM. Aim for a quant with a file size 1-2GB smaller than your GPU's total VRAM.
译文尚未就绪，显示来源原文
If the model is bigger than 50GB, it will have been split into multiple files. In order to download them all to a local folder, run: The first thing to figure out is how big a model you can run. To do this, you'll need to figure out how much RAM and/or VRAM you have. If you want your model running as FAST as possible, you'll want to fit the whole thing on your GPU's VRAM. Aim for a quant with a file size 1-2GB smaller than your GPU's total VRAM.