Bonsai-1.7B-gguf

Prism ML Website  |  Whitepaper  |  Demo & Examples  |  Colab Notebook  |  Discord - Deployed footprint — runs on virtually any device - **End-to-end 1-bit weights** across embeddings, attention projections, MLP projections, and LM head - **GGUF Q1_0 (g128)** format for 1-bit packing of weights with shared scales for each group (group size 128). - **Cross-platform**: CUDA (RTX/datacenter), Metal (Mac), Swift (iPhone/iPad), Android - **MLX companion**: also available as MLX 1-bit g128 for native Apple Silicon inference - **Google Colab** — try Bonsai in your browser, no setup required - **Whitepaper** — for more details on Bonsai, check out our whitepaper - **Demo repo** — comprehensive examples for serving, benchmarking, and integrating Bonsai - **Discord** — join the community for support, discussion, and updates - **1-bit kernels**: llama.cpp fork (CUDA + Metal) · MLX fork (Apple Silicon) · mlx-swift fork (iOS/macOS) - **Locally AI** — we have partnered with Locally AI for iPhone support

译文尚未就绪，显示来源原文