AI is happening. The future is updating.AMALIA-9B-0626-DPO-GGUF
GGUF quantizations of amalia-llm/AMALIA-9B-0626-DPO for use with llama.cpp and compatible runtimes (LM Studio, Ollama, Jan, etc.). AMALIA is an open-source language model targeting European Portuguese, developed by a consortium of Portuguese universities and research centres and funded by the Government of Portugal. This is the DPO (preference-tuned) variant. See the original model card and the technical report for full details. Converted with `convert_hf_to_gguf.py` (llama.cpp b8470) from the original bf16 weights. BF16 and Q4_K_S come directly from the original weights; Q8_0 was converted directly from bf16 and Q4_K_M was requantized from that Q8_0 (Q8_0 is near-lossless relative to bf16). The chat template (ChatML with the AMALIA Portuguese system prompt) is embedded in the GGUF metadata.
GGUF quantizations of amalia-llm/AMALIA-9B-0626-DPO for use with llama.cpp and compatible runtimes (LM Studio, Ollama, Jan, etc.). AMALIA is an open-source language model targeting European Portuguese, developed by a consortium of Portuguese universities and research centres and funded by the Government of Portugal. This is the DPO (preference-tuned) variant. See the original model card and the technical report for full details. Converted with `convert_hf_to_gguf.py` (llama.cpp b8470) from the original bf16 weights. BF16 and Q4_K_S come directly from the original weights; Q8_0 was converted directly from bf16 and Q4_K_M was requantized from that Q8_0 (Q8_0 is near-lossless relative to bf16). The chat template (ChatML with the AMALIA Portuguese system prompt) is embedded in the GGUF metadata.