Significant advancements have been made in Natural Language Processing (NLP) in recent years, particularly in Question-Answering (QA). The availability of pre-trained Large Language Models (LLMs) and annotated datasets has driven these improvements. However, most resources are designed for high-resource languages like English, while low-resource languages face challenges due to data limitations. Sinhala, the most widely spoken language in Sri Lanka, with over 20 million speakers, still lacks sufficient annotated datasets and monolingual models for downstream tasks like QA. To address this gap, this study presents a Sinhala QA dataset, SiQuAD, translated from SQuAD v1.1, containing 16,000 unique question-answer pairs. Experiments covering monolingual, cross-lingual, and multilingual approaches are conducted, with the best-performing model achieving an F1 score of 73%, indicating promising capabilities while highlighting room for improvement and future research. The dataset will be made publicly available.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Question Answering in a Low-Resource Language: Dataset and Deep Learning Adaptations for Sinhala

  • Janani Ranasinghe,
  • Ruvan Weerasinghe

摘要

Significant advancements have been made in Natural Language Processing (NLP) in recent years, particularly in Question-Answering (QA). The availability of pre-trained Large Language Models (LLMs) and annotated datasets has driven these improvements. However, most resources are designed for high-resource languages like English, while low-resource languages face challenges due to data limitations. Sinhala, the most widely spoken language in Sri Lanka, with over 20 million speakers, still lacks sufficient annotated datasets and monolingual models for downstream tasks like QA. To address this gap, this study presents a Sinhala QA dataset, SiQuAD, translated from SQuAD v1.1, containing 16,000 unique question-answer pairs. Experiments covering monolingual, cross-lingual, and multilingual approaches are conducted, with the best-performing model achieving an F1 score of 73%, indicating promising capabilities while highlighting room for improvement and future research. The dataset will be made publicly available.