nemotron-3.5-asr-streaming-0.6b-gguf
GGUF conversions of nvidia/nemotron-3.5-asr-streaming-0.6b for use with transcribe.cpp. Ported from upstream commit 24b151a, pinned 2026-06-08. Validated against the NeMo reference at transcribe.cpp commit 909e94e on 2026-06-08. Multilingual speech-to-text across 32 supported language-locales (the model's tokenizer recognizes 40, but 8 are adaptation-ready and need fine-tuning) with punctuation and capitalization. A cache-aware streaming FastConformer encoder with a prompt-conditioned RNN-T transducer decoder; the target language is selected per call (--language en-US, fr-FR, de-DE, ...) and an auto mode emits a tag. Ships both the offline path (att_context_size=[56, 13], 1.12s, headline accuracy) and runtime-selectable chunked streaming (--stream-chunk-ms 1120 --stream-att-right {0,3,6,13}).
GGUF conversions of nvidia/nemotron-3.5-asr-streaming-0.6b for use with transcribe.cpp. Ported from upstream commit 24b151a, pinned 2026-06-08. Validated against the NeMo reference at transcribe.cpp commit 909e94e on 2026-06-08. Multilingual speech-to-text across 32 supported language-locales (the model's tokenizer recognizes 40, but 8 are adaptation-ready and need fine-tuning) with punctuation and capitalization. A cache-aware streaming FastConformer encoder with a prompt-conditioned RNN-T transducer decoder; the target language is selected per call (--language en-US, fr-FR, de-DE, ...) and an auto mode emits a tag. Ships both the offline path (att_context_size=[56, 13], 1.12s, headline accuracy) and runtime-selectable chunked streaming (--stream-chunk-ms 1120 --stream-att-right {0,3,6,13}).
AI is happening. The future is updating.