Search FoxAI
AI Models 535
- whisper-large-v3-mlx↗
mlx-community
- kotoba-whisper-v2.0↗
kotoba-tech
_Kotoba-Whisper_ is a collection of distilled Whisper models for Japanese ASR, developed through the collaboration bewteen Asahi Ushio and Kotoba Technologies. Following the original work of distil-whisper (Robust Knowledge Distillation via Large-Scale Pseudo Labelling), we employ OpenAI's Whisper large-v3 as the teacher model, and the student model consists the full encoder of the teacher large-v3 model and the decoder with two layers initialized from the first and last layer of the large-v3 model. Kotoba-Whisper is **6.3x faster than large-v3**, while retaining as low error rate as the large-v3. As successor of our first model, kotoba-whisper-v1.0, we release ***kotoba-whisper-v2.0*** trained on the `all` subset of ReazonSpeech (the largest speech-transcription paired dataset in Japanese extracted from Japanese TV audio recordings), which amounts 7,203,957 audio clips (5 sec audio with 18 text tokens in average) after those transcriptions more than 10 WER are removed (see WER Filter for detail). The model was trained for 8 epochs with batch size 256 with sampling rate of 16kHz, and the training and evaluation code to reproduce kotoba-whisper is available at https://github.com/kotoba-tech/kotoba-whisper. Kotoba-whisper-v2.0 achieves better CER and WER than the openai/whisper-large-v3 in the in-domain held-out test set from ReazonSpeech, and achieves competitive CER and WER on the out-of-domain test sets including JSUT basic 5000 and the Japanese subset from CommonVoice 8.0 (see Evaluation for detail).
- nb-whisper-small↗
NbAiLab
Introducing the **_Norwegian NB-Whisper Small model_**, proudly developed by the National Library of Norway. NB-Whisper is a cutting-edge series of models designed for automatic speech recognition (ASR) and speech translation. These models are based on the work of OpenAI's Whisper. Each model in the series has been trained for 250,000 steps, utilizing a diverse dataset of 8 million samples. These samples consist of aligned audio clips, each 30 seconds long, culminating in a staggering 66,000 hours of speech. For an in-depth understanding of our training methodology and dataset composition, keep an eye out for our upcoming article. While the main models are suitable for most transcription task, we demonstrate how easy it is to change the output of the main model. The following models are trained 250 additional steps from the main models above, and might be suitable for more targetted use cases: - **Verbatim version**: This lower-cased variant is more literal and suitable for tasks requiring detailed transcription, such as linguistic analysis. You can try the models directly through the HuggingFace Inference API, accessible on the right side of this page. Be aware that initially, the model needs to load and will run on limited CPU capacity, which might be slow. To enhance your experience, we are temporarily hosting some models on TPUs for a few days, significantly boosting their performance. Explore these under the **Spaces** section on the Main Page.
- faster-whisper-medium.en↗
Systran
This repository contains the conversion of openai/whisper-medium.en to the CTranslate2 model format. This model can be used in CTranslate2 or projects based on CTranslate2 such as faster-whisper. Note that the model weights are saved in FP16. This type can be changed when the model is loaded using the `compute_type` option in CTranslate2.
- whisper-small-cuzco-quechua↗
pollitoconpapass
- whisper-tiny-mic↗
huggingface-mic
- react-native-executorch-whisper-tiny↗
software-mansion
This repository hosts the **whisper-tiny** models exported for the React Native ExecuTorch library as ExecuTorch `.pte` programs, ready to run on device. `xnnpack/whisper_tiny_xnnpack_int8.pte` is 8da8w (int8 dynamic activations, int8 per-channel weights). Greedy WER (CER for zh) against the fp32 file, LibriSpeech test-clean (150 clips) and FLEURS (80 per language): These files are published for the **ExecuTorch v1.4.1** runtime. ExecuTorch gives no forward compatibility guarantee, so an older runtime may fail to load them.
- distil-large-v2↗
distil-whisper
- whisper-tiny.en↗
onnx-community
https://huggingface.co/openai/whisper-tiny.en with ONNX weights to be compatible with Transformers.js. Note: Having a separate repo for ONNX weights is intended to be a temporary solution until WebML gains more traction. If you would like to make your models web-ready, we recommend converting to ONNX using 🤗 Optimum and structuring your repo like this one (with ONNX weights located in a subfolder named `onnx`).
- whisper-hindi-large-v2↗
vasista22