Zamba2-7B-Instruct

Zamba2-7B-Instruct is obtained from Zamba2-7B by fine-tuning on instruction-following and chat datasets. Zamba2-7B-Instruct long-context has been extended from 4k to 16k context by adjusting the rope frequency in the attention blocks. To install dependencies necessary to run Mamba2 kernels, install `mamba-ssm` from source (due to compatibility issues with PyTorch) as well as `causal-conv1d`:

번역 준비 중입니다. 원문을 표시합니다.