Ternary-Bonsai-2-27B-gguf
Prism ML Website | Whitepaper | Demo & Examples | Discord Full 27B-class reasoning in ternary transformer weights, for llama.cpp (CUDA, Metal, CPU) > **\~9.3x** smaller than FP16 (ideal) | **98.2%** of FP16 intelligence retained | **\~47 tok/s** on an Apple M5 Max laptop
Prism ML Website | Whitepaper | Demo & Examples | Discord Full 27B-class reasoning in ternary transformer weights, for llama.cpp (CUDA, Metal, CPU) > **\~9.3x** smaller than FP16 (ideal) | **98.2%** of FP16 intelligence retained | **\~47 tok/s** on an Apple M5 Max laptop
AI is happening. The future is updating.