AI가 움직이고 미래가 업데이트됩니다.Llama-3.2-1B-Instruct-NEO-SI-FI-GGUF
It is the new "Llama-3.2-1B-Instruct", max context of 131,000 (128k) with the NEO IMATRIX Science Fiction and Story dataset. The power in this 1B (for its size) is frankly jaw dropping... and at 190 tokens per second + on a GPU. This is a LLAMA 3.2 model, and requires Llama3 template, but may work with other template(s) and has maximum context of 128k.
번역 준비 중입니다. 원문을 표시합니다.
It is the new "Llama-3.2-1B-Instruct", max context of 131,000 (128k) with the NEO IMATRIX Science Fiction and Story dataset. The power in this 1B (for its size) is frankly jaw dropping... and at 190 tokens per second + on a GPU. This is a LLAMA 3.2 model, and requires Llama3 template, but may work with other template(s) and has maximum context of 128k.