AI is happening. The future is updating.Qwen3.5-9B-NVFP4
This model has been quantized using llm-compressor v0.10.1.dev31+geb49917e (just after Qwen3.5 support was merged) and transformers v5.3.0. It is based on the official example with a few modifications (see next section). The sequence length has been increased from 4096 to 8192 and the number of samples from 256 to 1024. The 1024 samples come from 4 differents datasets: * 256 general conversation samples (UltraChat) * 256 math reasoning samples (GSM8K) * 256 code samples (CodeAlpaca) * 256 multilingual samples (Aya)
This model has been quantized using llm-compressor v0.10.1.dev31+geb49917e (just after Qwen3.5 support was merged) and transformers v5.3.0. It is based on the official example with a few modifications (see next section). The sequence length has been increased from 4096 to 8192 and the number of samples from 256 to 1024. The 1024 samples come from 4 differents datasets: * 256 general conversation samples (UltraChat) * 256 math reasoning samples (GSM8K) * 256 code samples (CodeAlpaca) * 256 multilingual samples (Aya)