AIが動く。未来が更新される。LFM2.5-24B-A2B-FP8
FP8 version of LFM2.5-24B-A2B for GPU inference. Linear weights are quantized to FP8 with 128×128 blocks and dynamic activation quantization. The embedding, MoE routing gates and convolution weights are kept in their original precision. Find more details in the original model card: https://huggingface.co/LiquidAI/LFM2.5-24B-A2B
翻訳準備中のため原文を表示しています
FP8 version of LFM2.5-24B-A2B for GPU inference. Linear weights are quantized to FP8 with 128×128 blocks and dynamic activation quantization. The embedding, MoE routing gates and convolution weights are kept in their original precision. Find more details in the original model card: https://huggingface.co/LiquidAI/LFM2.5-24B-A2B