跳到正文
AI NEWS JOURNAL
arXiv cs.CLAI NEWS / JOURNAL

Lipi-Ghor:一个大规模、已标注的多领域孟加拉语语音语料库及其可扩展构建流水线

arXiv:2610.36184v1 发布类型:新 摘要:孟加拉语由超过2.3亿人使用,但在口语研究领域仍严重缺乏资源。现有的公开孟加拉语语音识别语料库多局限于短时、朗读或众包语音,且缺乏说话人分割与长篇音频。我们提出了Lipi-Ghor,一个大规模弱监督的孟加拉语语音语料库,包含来自596个独立频道的998个YouTube视频中的885小时音频,覆盖17个多样化的领域,包括有声书、戏剧、宗教布道、新闻以及地方方言等。每段录音均以SSTT格式(说话人、语音、转录、时间戳)进行标注,该格式将自动说话人分割与孟加拉语YouTube字幕轨道相结合。据我们所知,Lipi-Ghor是首个将大规模…

翻译服务暂未运行,当前显示原文。

arXiv:2610.36184v1 Announce Type: new

Abstract: Bengali, spoken by over 230 million people, remains severely under-resourced in spoken language research. Existing open Bengali ASR corpora are confined to short, read or crowd-sourced speech and lack speaker diarization and long-form audio.

We present Lipi-Ghor, a large-scale weakly-supervised Bengali speech corpus comprising 885 hours of audio sourced from 998 YouTube videos across 596 unique channels, spanning 17 diverse domains including audiobooks, drama, religious sermons, news, and regional dialects. Each recording is annotated in SSTT format (Speaker, Speech, Transcription, Timestamp), which combines automated diarization with Bengali YouTube caption tracks.

To our knowledge, Lipi-Ghor is the first Bengali speech corpus to pair large-scale coverage with speaker-diarized, long-form audio annotations, both of which are absent from existing open Bengali resources. We also present the construction methodology as a replicable pipeline for any language with a sufficient captioned YouTube presence. Targeted channel curation across a handful of rich domains yields corpus scales that were previously out of reach for low-resource languages.

We benchmark four widely-used ASR models under zero-shot and fine-tuned conditions. All four degrade consistently on emotive, dialectal, and long-form content. Because caption targets are noisy, we also release a human-annotated gold evaluation split, verified by 17 volunteer annotators over 30 hours of human-in-the-loop correction and stratified across all 17 domains.

We release our original contributions (video-ID lists, diarization output, pipeline code, and the gold annotations) under CC-BY-4.0, and distribute caption-derived transcripts for research use only; no raw audio is redistributed.

资料来源

阅读原文 ↗

相关主题

← 继续阅读全部动态