Grok-1-GGUF
This repository contains unofficial GGUF Quantizations of Grok-1, compatible with `llama.cpp` as of PR- Add grok-1 support #6204. - The splits have been updated to utilize the improvements from PR: llama_model_loader: support multiple split/shard GGUFs. As a result, manual merging with `gguf-split` is no longer required. With this, there is no need to merge the split files before use. Just download all splits and run llama.cpp with the first split like you would previously. It'll detect the other splits and load them as well.
翻訳準備中のため原文を表示しています
This repository contains unofficial GGUF Quantizations of Grok-1, compatible with `llama.cpp` as of PR- Add grok-1 support #6204. - The splits have been updated to utilize the improvements from PR: llama_model_loader: support multiple split/shard GGUFs. As a result, manual merging with `gguf-split` is no longer required. With this, there is no need to merge the split files before use. Just download all splits and run llama.cpp with the first split like you would previously. It'll detect the other splits and load them as well.
AIが動く。未来が更新される。