Automatic Speech Recognition (ASR) systems have significantly advanced with the integration of deep learning techniques, particularly neural networks and attention mechanisms; however, challenges remain in accurately modeling variable-length sequences and capturing complex temporal dependencies inherent in speech data. In this paper, we propose an enhanced end-to-end ASR model that incorporates a novel iterative attention mechanism, which loops through the attention layer multiple times with independent Dense and Dropout layers in each iteration. This design enables the model to focus on different aspects of the input sequence, effectively enhancing its ability to capture nuanced temporal patterns. Evaluated on the TIMIT dataset—a benchmark known for its comprehensive phonetic coverage—our model achieves a Phoneme Error Rate (PER) of 15.9%, outperforming existing neural network-based models. The results demonstrate that our iterative attention mechanism offers a more flexible and accurate solution for speech recognition tasks, addressing challenges associated with variable-length sequences and noisy environments, and contributing to the development of more robust ASR systems.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

End-to-End ASR Model with Iterative Attention Mechanism Enhanced RNN Model for Phoneme Recognition

  • Ke Fang,
  • Yancong Deng

摘要

Automatic Speech Recognition (ASR) systems have significantly advanced with the integration of deep learning techniques, particularly neural networks and attention mechanisms; however, challenges remain in accurately modeling variable-length sequences and capturing complex temporal dependencies inherent in speech data. In this paper, we propose an enhanced end-to-end ASR model that incorporates a novel iterative attention mechanism, which loops through the attention layer multiple times with independent Dense and Dropout layers in each iteration. This design enables the model to focus on different aspects of the input sequence, effectively enhancing its ability to capture nuanced temporal patterns. Evaluated on the TIMIT dataset—a benchmark known for its comprehensive phonetic coverage—our model achieves a Phoneme Error Rate (PER) of 15.9%, outperforming existing neural network-based models. The results demonstrate that our iterative attention mechanism offers a more flexible and accurate solution for speech recognition tasks, addressing challenges associated with variable-length sequences and noisy environments, and contributing to the development of more robust ASR systems.