foxAIAI is happening. The future is updating.
English
中文English日本語한국어

Ternary-Bonsai-2-27B-gguf

Prism ML Website  |  Whitepaper  |  Demo & Examples  |  Discord Full 27B-class reasoning in ternary transformer weights, for llama.cpp (CUDA, Metal, CPU) > **\~9.3x** smaller than FP16 (ideal) | **98.2%** of FP16 intelligence retained | **\~47 tok/s** on an Apple M5 Max laptop

Prism ML Website  |  Whitepaper  |  Demo & Examples  |  Discord Full 27B-class reasoning in ternary transformer weights, for llama.cpp (CUDA, Metal, CPU) > **\~9.3x** smaller than FP16 (ideal) | **98.2%** of FP16 intelligence retained | **\~47 tok/s** on an Apple M5 Max laptop

Sources

huggingface.co ↗