Scholarlink

<p>Recent speech technologies have led to the production of high quality synthesised speech due to recent advances in neural text-to-speech (TTS). However, such TTS models depend on extensive amounts of data that can be costly to produce and are hardly scalable to all existing languages, especially since little attention is given to low-resource languages. With techniques such as knowledge transfer, the burden of creating datasets can be alleviated. In this paper, we therefore investigate two aspects; firstly, whether data from social media can be used for a small TTS dataset construction, and secondly whether cross-lingual transfer learning (TL) for a low-resource language can work with this type of data. In this aspect, we specifically assess to what extent multilingual modeling can be leveraged as an alternative to training on monolingual corpora. To do so, we explore how data from foreign languages may be selected and pooled to train a TTS model for a target low-resource language. Our findings show that multilingual pre-training with informed source language selection outperforms monolingual pre-training in enhancing both the intelligibility and naturalness of the generated speech.</p>

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

A Multilingual Training Strategy for Low-Resource Text-to-Speech

  • 期刊论文

  • 出版模式：

    开放获取

  • 发表日期：

    2026年5月19日

查看全文
  • Asma Amalas,
  • Mounir Ghogho,
  • Mohamed Chetouani,
  • Rachid Oulad Haj Thami

摘要

Recent speech technologies have led to the production of high quality synthesised speech due to recent advances in neural text-to-speech (TTS). However, such TTS models depend on extensive amounts of data that can be costly to produce and are hardly scalable to all existing languages, especially since little attention is given to low-resource languages. With techniques such as knowledge transfer, the burden of creating datasets can be alleviated. In this paper, we therefore investigate two aspects; firstly, whether data from social media can be used for a small TTS dataset construction, and secondly whether cross-lingual transfer learning (TL) for a low-resource language can work with this type of data. In this aspect, we specifically assess to what extent multilingual modeling can be leveraged as an alternative to training on monolingual corpora. To do so, we explore how data from foreign languages may be selected and pooled to train a TTS model for a target low-resource language. Our findings show that multilingual pre-training with informed source language selection outperforms monolingual pre-training in enhancing both the intelligibility and naturalness of the generated speech.