全站搜索
AI 模型 84759
- Alphacode-AI_-_AlphaMist7B-slr-v3-gguf↗
RichardErkhov
- Hachipo_-_qwen2.5-0.5B_educational_instruct_top3000_en_ja-gguf↗
RichardErkhov
- LLaMA3-iterative-DPO-final↗
RLHFlow
- sink_logit_llama3.2_1b↗
robinzixuan
- Qwen3.8-27B-Uncensored-HauhauCS-Aggressive-MTP-GGUF↗
Saviitt
- DR34ML4Y_I2V_14B_LOW_V2↗
SlartyG
- squeezebert-uncased↗
squeezebert
This model, `squeezebert-uncased`, is a pretrained model for the English language using a masked language modeling (MLM) and Sentence Order Prediction (SOP) objective. SqueezeBERT was introduced in this paper. This model is case-insensitive. The model architecture is similar to BERT-base, but with the pointwise fully-connected layers replaced with grouped convolutions. The authors found that SqueezeBERT is 4.3x faster than `bert-base-uncased` on a Google Pixel 3 smartphone. The model is pretrained using the Masked Language Model (MLM) and Sentence Order Prediction (SOP) tasks. (Author's note: If you decide to pretrain your own model, and you prefer to train with MLM only, that should work too.) From the SqueezeBERT paper: > We pretrain SqueezeBERT from scratch (without distillation) using the LAMB optimizer, and we employ the hyperparameters recommended by the LAMB authors: a global batch size of 8192, a learning rate of 2.5e-3, and a warmup proportion of 0.28. Following the LAMB paper's recommendations, we pretrain for 56k steps with a maximum sequence length of 128 and then for 6k steps with a maximum sequence length of 512.
- Llama-3.3-70B-Instruct-lecore-GGUF↗
staccs
- Upstage-Llama1-65B-Instruct-GGUF↗
TheBloke
- granite-4.0-h-micro↗
unsloth
