AI is happening. The future is updating.gpt-oss-20b-unsloth-bnb-4bit
See our collection for all versions of gpt-oss including GGUF, 4-bit & 16-bit formats. - Read our Blog about gpt-oss support: unsloth.ai/blog/gpt-oss - View the rest of our notebooks in our docs here. - Thank you to the llama.cpp team for their work on supporting this model. We wouldn't be able to release quants without them! The F32 quant is MXFP4 upcasted to BF16 for every single layer and is unquantized.
See our collection for all versions of gpt-oss including GGUF, 4-bit & 16-bit formats. - Read our Blog about gpt-oss support: unsloth.ai/blog/gpt-oss - View the rest of our notebooks in our docs here. - Thank you to the llama.cpp team for their work on supporting this model. We wouldn't be able to release quants without them! The F32 quant is MXFP4 upcasted to BF16 for every single layer and is unquantized.