Scholarlink

<p>Text-to-speech (TTS) synthesis is a critical area in speech and language processing, with extensive applications in assistive technologies, virtual assistants, and automated content generation. Despite Bangla being the seventh most spoken language globally, high-quality TTS datasets remain scarce, limiting advancements in Bangla speech synthesis. To bridge this gap, we introduce a meticulously curated single-speaker Bangla audio dataset comprising over 20 hours of clean speech. Our dataset ensures diverse linguistic coverage, incorporating compound letters, long vowels, Sanskrit words, and varied sentence structures while maintaining phonetic balance. In addition to the dataset, we propose <i>STFT-GradTTS</i>, a novel diffusion-based TTS model featuring a Multi-Stream iSTFT decoder and a Stochastic Duration Predictor (SDP). The iSTFT-based decoder synthesizes high-fidelity waveforms by decomposing signals into sub-bands using learnable synthesis filters, enhancing spectral clarity. The SDP models phoneme duration distributions, capturing the natural variability in speech pacing. Together, these innovations address key limitations of GradTTS, particularly in duration accuracy and audio naturalness. We validate our approach through blind subjective &amp; objective evaluations and demostrate that <i>STFT-GradTTS</i> significantly outperforms the baseline models in speech quality, naturalness, and duration modeling. Our work not only establishes a new benchmark for Bangla Text-to-Speech (TTS) systems but also provides a solid foundation for future research in low-resource language speech synthesis.</p>

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

STFT-GradTTS: a robust, diffusion-based speech synthesis system with iSTFT decoder for Bangla

  • 期刊论文

  • 发表日期：

    2026年1月9日

查看全文
  • Mushahid Intesum,
  • Abdullah Ibne Masud,
  • Md. Rezaul Karim,
  • Md. Ashraful Islam

摘要

Text-to-speech (TTS) synthesis is a critical area in speech and language processing, with extensive applications in assistive technologies, virtual assistants, and automated content generation. Despite Bangla being the seventh most spoken language globally, high-quality TTS datasets remain scarce, limiting advancements in Bangla speech synthesis. To bridge this gap, we introduce a meticulously curated single-speaker Bangla audio dataset comprising over 20 hours of clean speech. Our dataset ensures diverse linguistic coverage, incorporating compound letters, long vowels, Sanskrit words, and varied sentence structures while maintaining phonetic balance. In addition to the dataset, we propose STFT-GradTTS, a novel diffusion-based TTS model featuring a Multi-Stream iSTFT decoder and a Stochastic Duration Predictor (SDP). The iSTFT-based decoder synthesizes high-fidelity waveforms by decomposing signals into sub-bands using learnable synthesis filters, enhancing spectral clarity. The SDP models phoneme duration distributions, capturing the natural variability in speech pacing. Together, these innovations address key limitations of GradTTS, particularly in duration accuracy and audio naturalness. We validate our approach through blind subjective & objective evaluations and demostrate that STFT-GradTTS significantly outperforms the baseline models in speech quality, naturalness, and duration modeling. Our work not only establishes a new benchmark for Bangla Text-to-Speech (TTS) systems but also provides a solid foundation for future research in low-resource language speech synthesis.