AI is happening. The future is updating.NousResearch_Hermes-4-14B-GGUF
All quants made using imatrix option with dataset from here combined with a subset of combined_all_small.parquet from Ed Addario here Run them directly with llama.cpp, or any other llama.cpp based project Some of these quants (Q3_K_XL, Q4_K_L etc) are the standard quantization method with the embeddings and output weights quantized to Q8_0 instead of what they would normally default to.
All quants made using imatrix option with dataset from here combined with a subset of combined_all_small.parquet from Ed Addario here Run them directly with llama.cpp, or any other llama.cpp based project Some of these quants (Q3_K_XL, Q4_K_L etc) are the standard quantization method with the embeddings and output weights quantized to Q8_0 instead of what they would normally default to.