Search FoxAI

AI Models 84759

• RoboInter-VLM_qwenvl25_3b-i1-GGUF↗

  mradermacher

• sakthai-plus-1.5b-GGUF↗

  mradermacher

• Sally-QwQ-GGUF↗

  mradermacher

• Saul-7B-Instruct-v1-i1-GGUF↗

  mradermacher

• SEV-UI-4B-GGUF↗

  mradermacher

• sofia-qwen2.5-7b-i1-GGUF↗

  mradermacher

• OpenCodeReasoning-Nemotron-32B-IOI-GGUF↗

  Mungert

• MIstral-QUantized-70b_Miqu-1-70b-iMat.GGUF↗

  NexesQuants

  Miqu is probably the best 70b model I could ever play with, especially as a French speaker. Smart like a good Llama 2 70b finetune, no overfitting, little censorship, reasonable alignement, and even a sufficient mastery of French language to have a proper chat in French without feeling like spreaking to a broken bot. Requantizations with iMatrix (better quality than without) of a Q5_K_M quant of a trending 70b model without better quant/fp16 available, this through a Q8_0 intermediary step. Full offload possible on 48GB VRAM with a huge context size : - Q4_K_S. Note : A Q5_K_S requant compared to the original Q4_K_M quant of Miqudev wouldn't bring much benefit if any, and take much more VRAM, so I didn't do it. - Lower quality : Q3_K_L

• NextStep-1.1-Pretrain-256px↗

  阶跃星辰

• LAMAR-600m↗

  nlpai-lab