foxAIAIが動く。未来が更新される。
日本語
中文English日本語한국어

multilingual-e5-small-GGUF

Sizes are MiB (what the file browser above reports). Auxiliary files: `multilingual-e5-small.imatrix` (131 KiB, the importance matrix used for the imatrix/IQ quants) and `multilingual-e5-small-imatrix-ab.txt` (the A/B notes from producing it). **Recommended: Q8_0.** It is within 0.0001 cosine of the F32 reference while being 3.6× smaller, so F32 buys nothing you can measure. Drop to a 4-bit quant only when you are memory-bound: they save a further 11 MiB — about 9% — and Q4_K gives up an order of magnitude more accuracy (0.990) to do it. At this model size the 4-bit tier is rarely the right trade; it matters much more on the larger models in this registry. CrispEmbed server supports four API dialects: - `POST /embed` — native - `POST /v1/embeddings` — OpenAI-compatible - `POST /api/embed` — Ollama-compatible - `POST /api/embeddings` — Ollama legacy

翻訳準備中のため原文を表示しています

Sizes are MiB (what the file browser above reports). Auxiliary files: `multilingual-e5-small.imatrix` (131 KiB, the importance matrix used for the imatrix/IQ quants) and `multilingual-e5-small-imatrix-ab.txt` (the A/B notes from producing it). **Recommended: Q8_0.** It is within 0.0001 cosine of the F32 reference while being 3.6× smaller, so F32 buys nothing you can measure. Drop to a 4-bit quant only when you are memory-bound: they save a further 11 MiB — about 9% — and Q4_K gives up an order of magnitude more accuracy (0.990) to do it. At this model size the 4-bit tier is rarely the right trade; it matters much more on the larger models in this registry. CrispEmbed server supports four API dialects: - `POST /embed` — native - `POST /v1/embeddings` — OpenAI-compatible - `POST /api/embed` — Ollama-compatible - `POST /api/embeddings` — Ollama legacy

情報源

huggingface.co ↗