AI is happening. The future is updating.Qwen2-Audio-7B-Instruct-GGUF
weighted/imatrix quants are available at https://huggingface.co/mradermacher/Qwen2-Audio-7B-Instruct-i1-GGUF If you are unsure how to use GGUF files, refer to one of TheBloke's READMEs for more details, including on how to concatenate multi-part files. (sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
weighted/imatrix quants are available at https://huggingface.co/mradermacher/Qwen2-Audio-7B-Instruct-i1-GGUF If you are unsure how to use GGUF files, refer to one of TheBloke's READMEs for more details, including on how to concatenate multi-part files. (sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)