foxAIAI is happening. The future is updating.
English
中文English日本語한국어

Bonsai-27B-mlx-1bit

Prism ML Website  |  Whitepaper  |  Demo & Examples  |  Discord Full 27B-class reasoning in binary transformer weights — the first 27B-class model to run on a phone > **~14.2x** smaller than FP16 | **~90%** of FP16 intelligence retained | **~11 tok/s** on iPhone 17 Pro Max

Prism ML Website  |  Whitepaper  |  Demo & Examples  |  Discord Full 27B-class reasoning in binary transformer weights — the first 27B-class model to run on a phone > **~14.2x** smaller than FP16 | **~90%** of FP16 intelligence retained | **~11 tok/s** on iPhone 17 Pro Max

Sources

huggingface.co ↗