Multilingual ASR Using LLAMA 2 Post-processing and Machine Translation
摘要
An innovative framework for Automatic Speech Recognition (ASR) and language translation that combines the Wave2Vec transformer model with a post-processing stage utilizing the LLAMA 2 language model (LLM). The ASR component efficiently converts spoken audio into text, while LLAMA 2 is fine-tuned to improve grammatical accuracy, punctuation, and overall transcript clarity. By comparing the word error rates (WER) of the initial ASR output to the refined transcripts, the results demonstrate a significant reduction in errors, showcasing the effectiveness of this integrated approach.