AIが動く。未来が更新される。Ternary-Bonsai-2-9B-mlx-2bit
> **PrismML-Eng/Bonsai-demo is the source of truth for running these models.** Where anything here disagrees with it, it is right. For an OpenAI-compatible server, run `python -m mlx_vlm.server --model bonsai2-9b-mlx` and send the sampling settings in each request. For CUDA, CPU, and llama.cpp on Metal, use the GGUF packs of the same weights: **Ternary-Bonsai-2-9B-gguf**.
翻訳準備中のため原文を表示しています
> **PrismML-Eng/Bonsai-demo is the source of truth for running these models.** Where anything here disagrees with it, it is right. For an OpenAI-compatible server, run `python -m mlx_vlm.server --model bonsai2-9b-mlx` and send the sampling settings in each request. For CUDA, CPU, and llama.cpp on Metal, use the GGUF packs of the same weights: **Ternary-Bonsai-2-9B-gguf**.