JiRackUltra_32b
A fast and efficient 32B model optimized for CPU inference. The model was refactored with BitNet features and an updated tokenizer that includes new **Routing**, **Media**, **Vision**, **Sound**, **Tool call**, and **Robotics** tags. Built on a DeepSeek R1-32B architecture with native ternary (BitNet-style) support and ready-to-run GGUF quantizations. - JiRack is a cloud-ready model that helps save money on cloud infrastructure. It can be used as an expert model in RAG deployments, with the ONNX JiRack Java server as an alternative. Once the container is running, open your browser and navigate to: `http://localhost:7869` This opens the JiRack UI — a clean web interface. The listening port can be easily modified directly from the **Settings** panel within the JiRack UI. - Model weights are released under the MIT License — free to use, modify, and distribute for any purpose, including commercial. No royalties, no per-user fees, no subscription. - The Docker image with UI and the pre-built Ollama quantizations are separate paid products. If you prefer to build your own secure deployment — take the weights, assemble your own stack, and you're done. - The JiRack Ultra 32B model for Docker and Ollama is provided under a commercial license ($12 per user per year). - All JiRack UI clients are provided under a commercial license. - However, the UI clients can be used for free when running together with the official JiRack Docker containers, as long as they are not redistributed separately. For commercial licensing, cluster deployment, or enterprise use of JiRack models, please contact us. - **JiRack MS Windows 11 Desktop Client (with Ollama API):** https://huggingface.co/kgrabko/JiRackTernary_1b/resolve/main/jirack-chat.zip - **Live email chat with the model:** support@cmsmanhattan.com | Use Case | CPU | RAM | Recommended Quant | Expected Speed | Recommendation | |-------------------|----------------------------|-----------|-------------------|---------------------|----------------| | Recommended | Ryzen 9 / Intel i9 / Xeon | 32–48 GB | Q4_K_M | Good interactive | Best choice | | High Performance | High-core server CPU | 64 GB+ | Full / Q4 | Excellent | Excellent | | Low
译文尚未就绪,显示来源原文
A fast and efficient 32B model optimized for CPU inference. The model was refactored with BitNet features and an updated tokenizer that includes new **Routing**, **Media**, **Vision**, **Sound**, **Tool call**, and **Robotics** tags. Built on a DeepSeek R1-32B architecture with native ternary (BitNet-style) support and ready-to-run GGUF quantizations. - JiRack is a cloud-ready model that helps save money on cloud infrastructure. It can be used as an expert model in RAG deployments, with the ONNX JiRack Java server as an alternative. Once the container is running, open your browser and navigate to: `http://localhost:7869` This opens the JiRack UI — a clean web interface. The listening port can be easily modified directly from the **Settings** panel within the JiRack UI. - Model weights are released under the MIT License — free to use, modify, and distribute for any purpose, including commercial. No royalties, no per-user fees, no subscription. - The Docker image with UI and the pre-built Ollama quantizations are separate paid products. If you prefer to build your own secure deployment — take the weights, assemble your own stack, and you're done. - The JiRack Ultra 32B model for Docker and Ollama is provided under a commercial license ($12 per user per year). - All JiRack UI clients are provided under a commercial license. - However, the UI clients can be used for free when running together with the official JiRack Docker containers, as long as they are not redistributed separately. For commercial licensing, cluster deployment, or enterprise use of JiRack models, please contact us. - **JiRack MS Windows 11 Desktop Client (with Ollama API):** https://huggingface.co/kgrabko/JiRackTernary_1b/resolve/main/jirack-chat.zip - **Live email chat with the model:** support@cmsmanhattan.com | Use Case | CPU | RAM | Recommended Quant | Expected Speed | Recommendation | |-------------------|----------------------------|-----------|-------------------|---------------------|----------------| | Recommended | Ryzen 9 / Intel i9 / Xeon | 32–48 GB | Q4_K_M | Good interactive | Best choice | | High Performance | High-core server CPU | 64 GB+ | Full / Q4 | Excellent | Excellent | | Low
AI正在发生 未来正在更新