granite-speech-4.1-2b-plus-gguf

Ported from upstream commit edd3bf5, pinned 2026-05-17. Validated against the Transformers reference at transcribe.cpp commit 275332d on 2026-05-17. Offline multilingual speech-to-text with word-level timestamps. IBM Granite Speech 4.1-2b-plus is the timestamp-and-diarization variant of the Granite-Speech family. Same architecture as the base 4.1-2b (Conformer encoder, BLIP-2 Q-Former projector, Granite-4.0-1b autoregressive LLM decoder) with two changes: the encoder concatenates mid-layer (idx 3) and final-layer hidden states (`cat_hidden_layers=[3]`, doubling the projector K/V input from 1024 to 2048), and the LM token embeddings are tied with the lm_head. Takes a 16 kHz mono WAV and produces a transcript, with `--timestamps word` returning structured per-word timestamps (parsed from the model's `[T:N]` centisecond markers), or `--diarize` returning structured speaker-attributed turns from its separate SAA prompt. Those two prompt tasks cannot be combined. Transcribes English, French, German, Spanish, and Portuguese (no Japanese on this variant). This variant is transcription-only: unlike the base granite-speech-4.1-2b, it does not perform speech translation. WER on the full LibriSpeech test-clean split (2,620 utterances), batch size 1, timestamps none. Figures without a commit were published before provenance was recorded.

번역 준비 중입니다. 원문을 표시합니다.