multilingual-e5-small-GGUF
Sizes are MiB (what the file browser above reports). Auxiliary files: `multilingual-e5-small.imatrix` (131 KiB, the importance matrix used for the imatrix/IQ quants) and `multilingual-e5-small-imatrix-ab.txt` (the A/B notes from producing it). **Recommended: Q8_0.** It is within 0.0001 cosine of the F32 reference while being 3.6× smaller, so F32 buys nothing you can measure. Drop to a 4-bit quant only when you are memory-bound: they save a further 11 MiB — about 9% — and Q4_K gives up an order of magnitude more accuracy (0.990) to do it. At this model size the 4-bit tier is rarely the right trade; it matters much more on the larger models in this registry. CrispEmbed server supports four API dialects: - `POST /embed` — native - `POST /v1/embeddings` — OpenAI-compatible - `POST /api/embed` — Ollama-compatible - `POST /api/embeddings` — Ollama legacy
번역 준비 중입니다. 원문을 표시합니다.
Sizes are MiB (what the file browser above reports). Auxiliary files: `multilingual-e5-small.imatrix` (131 KiB, the importance matrix used for the imatrix/IQ quants) and `multilingual-e5-small-imatrix-ab.txt` (the A/B notes from producing it). **Recommended: Q8_0.** It is within 0.0001 cosine of the F32 reference while being 3.6× smaller, so F32 buys nothing you can measure. Drop to a 4-bit quant only when you are memory-bound: they save a further 11 MiB — about 9% — and Q4_K gives up an order of magnitude more accuracy (0.990) to do it. At this model size the 4-bit tier is rarely the right trade; it matters much more on the larger models in this registry. CrispEmbed server supports four API dialects: - `POST /embed` — native - `POST /v1/embeddings` — OpenAI-compatible - `POST /api/embed` — Ollama-compatible - `POST /api/embeddings` — Ollama legacy
AI가 움직이고 미래가 업데이트됩니다.