AIが動く。未来が更新される。occamy-1.0-APEX-GGUF
Occamy-1.0 · APEX GGUF Three plain profiles · four calibrated profiles, including Mini Collection · Checkpoint explorer · Project · Paper Occamy-1.0 quantized with the LocalAI team's APEX profiles. APEX allocates GGUF precision by tensor role and layer position: routed experts, shared experts and attention receive different allocations. The three plain profiles and four calibrated `I-` profiles use the pinned upstream 40-layer configurations. Every file is generated directly from the same BF16 source. The calibrated group adds I-Compact, I-Quality, I-Balanced and I-Mini. Profile names describe allocation strategies; file size does not follow the name order. These are weight-file sizes, not peak memory requirements. Allow additional memory for the runtime, context and image input.
翻訳準備中のため原文を表示しています
Occamy-1.0 · APEX GGUF Three plain profiles · four calibrated profiles, including Mini Collection · Checkpoint explorer · Project · Paper Occamy-1.0 quantized with the LocalAI team's APEX profiles. APEX allocates GGUF precision by tensor role and layer position: routed experts, shared experts and attention receive different allocations. The three plain profiles and four calibrated `I-` profiles use the pinned upstream 40-layer configurations. Every file is generated directly from the same BF16 source. The calibrated group adds I-Compact, I-Quality, I-Balanced and I-Mini. Profile names describe allocation strategies; file size does not follow the name order. These are weight-file sizes, not peak memory requirements. Allow additional memory for the runtime, context and image input.