MiniMaxAI_MiniMax-M2.7-GGUF

If running with CUDA on a model that has `Q4_K` or `Q5_K` for `61.blk.ffn_down_exps` you should compile with the following flag: to avoid `NaN` activations. This is most likely an issue in `llama.cpp` itself and will hopefully be resolved, but in the meantime this fixes the issue. You can check in the info on huggingface which models are affected, but it seems to be `Q5_K_S`, `Q4_K_S`, `Q3_K_XL`, `Q3_K_L`, `Q3_K_M`, `IQ3_M`, `IQ3_XS`, and `IQ3_XXS`

번역 준비 중입니다. 원문을 표시합니다.