The primary aim of emotional speech synthesis is to generate high-quality speech that conveys a range of emotional effects. This paper focuses on controlling the emotional expression in speech and enhancing the quality of the synthesized speech. To quantify the relative differences between speech samples with different emotions, we employ a formula that measures these differences, thus facilitating the exploration of the hierarchical structure of emotions. We integrate a random duration predictor to forecast speech timing, aligning the text with the speech, which allows the input text to generate speech with varying rhythms. The generative model’s expressive capacity is improved through enhanced variational inference and adversarial training processes utilizing normalized flow techniques. During runtime, the model can be directed to produce the desired level of emotional intensity by manually defining emotion attribute vectors. The model’s effectiveness is validated through both objective and subjective evaluation methods.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Controllable Emotional Speech Synthesis Based on the Ranking of Relative Emotional Attributes

  • Yolwas Nurmemet,
  • Qichao Liu

摘要

The primary aim of emotional speech synthesis is to generate high-quality speech that conveys a range of emotional effects. This paper focuses on controlling the emotional expression in speech and enhancing the quality of the synthesized speech. To quantify the relative differences between speech samples with different emotions, we employ a formula that measures these differences, thus facilitating the exploration of the hierarchical structure of emotions. We integrate a random duration predictor to forecast speech timing, aligning the text with the speech, which allows the input text to generate speech with varying rhythms. The generative model’s expressive capacity is improved through enhanced variational inference and adversarial training processes utilizing normalized flow techniques. During runtime, the model can be directed to produce the desired level of emotional intensity by manually defining emotion attribute vectors. The model’s effectiveness is validated through both objective and subjective evaluation methods.