AI is happening. The future is updating.gemma-2-9b-it-GGUF
All quants made using imatrix option with dataset from here Thank you kalomaze and Dampf for assistance in creating the imatrix calibration dataset If the model is bigger than 50GB, it will have been split into multiple files. In order to download them all to a local folder, run:
All quants made using imatrix option with dataset from here Thank you kalomaze and Dampf for assistance in creating the imatrix calibration dataset If the model is bigger than 50GB, it will have been split into multiple files. In order to download them all to a local folder, run: