Search FoxAI

AI Models 84759

• CherryPit-1.1-2B-GGUF↗

  DRUPEs

• LongWriter-glm4-9b-imatrix-GGUF↗

  duyntnet

• pythia-12b-deduped↗

  EleutherAI

  The *Pythia Scaling Suite* is a collection of models developed to facilitate interpretability research (see paper). It contains two sets of eight models of sizes 70M, 160M, 410M, 1B, 1.4B, 2.8B, 6.9B, and 12B. For each size, there are two models: one trained on the Pile, and one trained on the Pile after the dataset has been globally deduplicated. All 8 model sizes are trained on the exact same data, in the exact same order. We also provide 154 intermediate checkpoints per model, hosted on Hugging Face as branches. The Pythia model suite was designed to promote scientific research on large language models, especially interpretability research. Despite not centering downstream performance as a design goal, we find the models match or exceed the performance of similar and same-sized models, such as those in the OPT and GPT-Neo suites. Previously, we released an early version of the Pythia suite to the public. However, we decided to retrain the model suite to address a few hyperparameter discrepancies. This model card lists the changes ; see appendix B in the Pythia paper for further discussion. We found no difference in benchmark performance between the two Pythia versions. The old models are still available, but we suggest the retrained suite if you are just starting to use Pythia. **This is the current release.**

• hiera-tiny-224-in1k-hf↗

  facebook

• mbart-large-cc25↗

  facebook

  Original Code: https://github.com/pytorch/fairseq/tree/master/examples/mbart Docs: https://huggingface.co/transformers/master/model_doc/mbart.html Finetuning Code: examples/seq2seq/finetune.py (as of Aug 20, 2020)

• mms-tts-gwi↗

  facebook

• mms-tts-yka↗

  facebook

• webssl-dino7b-full8b-224↗

  facebook

• wav2vec2-large-uralic-voxpopuli-v2-finnish↗

  Finnish-NLP

• ultravox-v0_3↗

  fixie-ai

  Ultravox is a multimodal Speech LLM built around a pretrained Llama3.1-8B-Instruct and Whisper-small backbone.\ See https://ultravox.ai for the GitHub repo and more information. Ultravox is a multimodal model that can consume both speech and text as input (e.g., a text system prompt and voice user message). The input to the model is given as a text prompt with a special ` ` pseudo-token, and the model processor will replace this magic token with embeddings derived from the input audio. Using the merged embeddings as input, the model will then generate output text as usual. In a future revision of Ultravox, we plan to expand the token vocabulary to support generation of semantic and acoustic audio tokens, which can then be fed to a vocoder to produce voice output. No preference tuning has been applied to this revision of the model.