DiarizationLM-Gemma-4-E4B-v1

DiarizationLM is a Large Language Model framework designed to post-process, correct, and optimize automatic speech recognition (ASR) and speaker diarization outputs. `diarizers-community/DiarizationLM-Gemma-4-E4B-v1` is built on Google's **Gemma 4 E4B** (4B dense parameters) foundation model and fine-tuned with **Locality-Preserving Oracle Supervision** across **all 4 canonical speaker diarization benchmark corpora**: 1. **Fisher English** (2-speaker conversational telephone speech) 2. **Callhome American English** (2–5 speaker informal telephone conversations) 3. **ICSI Meeting Corpus** (3–9 speaker academic research meetings) 4. **AMI Meeting Corpus** (4-speaker tabletop meetings) Unlike earlier models trained exclusively on 2-speaker telephone data (such as google/DiarizationLM-8b-Fisher-v2) or naive multi-domain SFT (which suffers from long-monologue speaker identity drift in 4+ speaker meetings), `diarizers-community/DiarizationLM-Gemma-4-E4B-v1` is trained on locality-preserving oracle targets that teach the model to correct lexical turn boundaries and backchannels (1 ≤ L ≤ 5 words) while preserving acoustic speaker anchors across long monologues (L ≥ 6 words). As a result, it achieves **statistically significant (p --> [eod]`) * **Training Data**: 51,063 Fisher + 20,762 Multi-Corpus (Callhome, ICSI, AMI) locality-preserving prompt-completion pairs * **Optimization**: 10,000 steps, global batch size 8, AdamW (beta1 = 0.9, beta2 = 0.99), peak learning rate 1.5e-4 with 500-step linear warmup and cosine decay on 8 Google Cloud TPU v5p chips * **Prompt Segmentation Length**: 4,000 characters (maximal sequence length 2,560 tokens)

번역 준비 중입니다. 원문을 표시합니다.