전체 검색
AI 모델 84759
- kana-whisper↗
0x3
- WizardLM-13B-Uncensored-4bit-128g↗
4bit
- GPT-NeoX-1.3B-viet-final-GGUF↗
afrideva
- qwen2-57b-a14b-instruct↗
阿里巴巴 · Qwen
Qwen2 is the new series of Qwen large language models. For Qwen2, we release a number of base language models and instruction-tuned language models ranging from 0.5 to 72 billion parameters, including a Mixture-of-Experts model. This repo contains the instruction-tuned 57B-A14B Mixture-of-Experts Qwen2 model. Compared with the state-of-the-art opensource language models, including the previous released Qwen1.5, Qwen2 has generally surpassed most opensource models and demonstrated competitiveness against proprietary models across a series of benchmarks targeting for language understanding, language generation, multilingual capability, coding, mathematics, reasoning, etc. Qwen2-57B-A14B-Instruct supports a context length of up to 65,536 tokens, enabling the processing of extensive inputs. Please refer to this section for detailed instructions on how to deploy Qwen2 for handling long texts.
- Hemmingway-1-Unlocked-GGUF↗
amylynn
- LFM2.5-2.6B-GGUF-shards↗
Arki05
- `source/`: LiquidAI's BF16 GGUF (LiquidAI/LFM2.5-2.6B-GGUF), unchanged. - `types/ -hq.gguf`, `types/ -hq1.gguf`: the tensors at llama.cpp type `T`, rebuilt from the BF16 weights in two Hessian-quantized (GPTQ-family) builds: `-hq`, the higher-quality one, the block tensors; `-hq1`, the first build, every quantized tensor. Same type, format and size as llama.cpp's: plain GGUF types, for stock llama.cpp (a GGUF assembled from them holds the plain type `T`); modified versions of the original weights. - `data/`: the calibration data the types were made from (token ids and their manifest). - `manifest.json` (`qcore-store/1`), `skeleton.gguf`, `store.json`, `records/`: what qalloc reads, with every tensor's offset and sha256. The first version of this store (bartowski's BF16 GGUF and imatrix, types by llama.cpp's `llama-quantize`) is at revision `fe50613`.
- Art-v0-3B-GGUF↗
bartowski
- Qwen2.5-Coder-1.5B-Instruct-abliterated-GGUF↗
bartowski
Some of these quants (Q3_K_XL, Q4_K_L etc) are the standard quantization method with the embeddings and output weights quantized to Q8_0 instead of what they would normally default to. Some say that this improves the quality, others don't notice any difference. If you use these models PLEASE COMMENT with your findings. I would like feedback that these are actually used and useful so I don't keep uploading quants no one is using. If the model is bigger than 50GB, it will have been split into multiple files. In order to download them all to a local folder, run:
- starcoder2-7b↗
bigcode
1. Model Summary 2. Use 3. Limitations 4. Training 5. License 6. Citation StarCoder2-7B model is a 7B parameter model trained on 17 programming languages from The Stack v2, with opt-out requests excluded. The model uses Grouped Query Attention, a context window of 16,384 tokens with a sliding window attention of 4,096 tokens, and was trained using the Fill-in-the-Middle objective on 3.5+ trillion tokens. - **Project Website:** bigcode-project.org - **Paper:** Link - **Point of Contact:** contact@bigcode-project.org - **Languages:** 17 Programming languages
- Drjajsufhfh↗
Bill435
