This experiment has a focus on the enhancement capability of large language models (LLMs) for translation in low-resource languages, specifically Thai. Moreover, the experiment of translation by selected different LLMs, such as GPT-3.5 Turbo, Claude 3.5 Sonnet, SeaLLMs, and Typhoon, translating from English to Thai in general text, found that translation by specific languages pre-trained LLMs such as Typhoon has more accuracy than multilingual pre-trained LLMs such as GPT-3.5 Turbo. Furthermore, attempt to implement Agentic Machine Translate to enhance translation, which is a process that uses 2 LLMs; first assign as translator and second assign as reflector. This experiment has 2 methods, first using the same LLMs as translation and reflection, and second methods using different LLMs. Additionally, the results before and after translation by reflection were assessed by BERTScore, COMET, METEOR, and BLEU. By using different LLMs, the quality of translation increases with Typhoon as translator and Claude as reflector. As a result, the efficiency of translation by agentic flow depends on the generated reflection prompt and pre-trained language. Although this experiment was not to confirm that agentic machine translation can enhance LLMs-based translation accuracy, it showed there is a challenge in leveraging LLMs-based translation instead of machine translation to improve translation in low-resource languages.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Enhancement of LLMs-Based Translation by Agentic Machine Translation in Thai Language

  • Artid Boonrerng,
  • Nouh Elmitwally,
  • Edlira Vakaj,
  • Shadi Basurra

摘要

This experiment has a focus on the enhancement capability of large language models (LLMs) for translation in low-resource languages, specifically Thai. Moreover, the experiment of translation by selected different LLMs, such as GPT-3.5 Turbo, Claude 3.5 Sonnet, SeaLLMs, and Typhoon, translating from English to Thai in general text, found that translation by specific languages pre-trained LLMs such as Typhoon has more accuracy than multilingual pre-trained LLMs such as GPT-3.5 Turbo. Furthermore, attempt to implement Agentic Machine Translate to enhance translation, which is a process that uses 2 LLMs; first assign as translator and second assign as reflector. This experiment has 2 methods, first using the same LLMs as translation and reflection, and second methods using different LLMs. Additionally, the results before and after translation by reflection were assessed by BERTScore, COMET, METEOR, and BLEU. By using different LLMs, the quality of translation increases with Typhoon as translator and Claude as reflector. As a result, the efficiency of translation by agentic flow depends on the generated reflection prompt and pre-trained language. Although this experiment was not to confirm that agentic machine translation can enhance LLMs-based translation accuracy, it showed there is a challenge in leveraging LLMs-based translation instead of machine translation to improve translation in low-resource languages.