Search FoxAI
AI Models 84761
- SmolLM-135M-Instruct↗
abcsnoobai
- AlbanyBulb_AutonomousZone_ZiT_LoRA↗
AlekseyCalvin
- StdMoE_1b14b_1T_Preanneal↗
allenai
- IconsMI-AppIconsModelforSD↗
artificialguybr
- nbeerbower_Gemma4-Gutenberg-31B-Heretic-GGUF↗
bartowski
- phi3.5-gutenberg-4B-GGUF↗
bartowski
Some of these quants (Q3_K_XL, Q4_K_L etc) are the standard quantization method with the embeddings and output weights quantized to Q8_0 instead of what they would normally default to. Some say that this improves the quality, others don't notice any difference. If you use these models PLEASE COMMENT with your findings. I would like feedback that these are actually used and useful so I don't keep uploading quants no one is using. If the model is bigger than 50GB, it will have been split into multiple files. In order to download them all to a local folder, run:
- zerofata_MS3.2-PaintedFantasy-v2-24B-GGUF↗
bartowski
- g2p-multilingual-byT5-tiny-mlx↗
beshkenadze
- Llama-3-8b-Indo-Dicoding-Eksperimen-1↗
BlackJagger
- Muse-Glimmer-30B-pruned-V2.5-en-pl-GGUF↗
bluevoid-pl
Vision requires downloading `mmproj-*` file. Quantization of vision models usually compound error, so it's recommended to use Q8_0 qwant regardless of your text-text quantization level. Correct file is: `mmproj-Muse-Glimmer-30B_pruned-pl-V2.5-Q8_0.gguf`. Note: This model is using English thinking, because of that using Polish language in your prompt is not ideal. > [!WARNING] > Make sure to use llama.cpp version greater than `b10430`, model will fail to load on older version.
