Scholarlink

<p>This paper introduces <b>TigCLaF</b>, a novel cross-lingual large language model framework for sentiment-aware text classification in low-resource Tigrigna. The framework integrates tokenizer extension with adaptation, continual pretraining on unlabeled Tigrigna data, and LoRA-based parameter-efficient fine-tuning to enable effective cross-lingual adaptation from high-resource languages. Leveraging recent advances in multilingual pre-trained language models and large language models, we investigate zero-shot, few-shot, and full fine-tuning strategies for sentiment detection, incorporating transformer models XLM-RoBERTa and AfriBERTa, as well as instruction-tuned LLaMA models. Our approach integrates a Tigrigna sentiment lexicon into transformer-based embeddings via feature fusion, thereby enhancing preservation of the sentiment signal during cross-lingual transfer. The proposed framework is evaluated on a newly curated dataset of 30,000 Tigrigna instances, supported by auxiliary English and Amharic sentiment corpora for transfer learning. Experimental results show that sentiment-aware feature integration improves classification accuracy and Macro-F1 up to 7% over baseline multilingual models without sentiment augmentation. Furthermore, parameter-efficient fine-tuning LoRA achieved competitive accuracy while reducing model size and inference latency, making it suitable for computationally constrained settings. The systematic error analysis highlights the roles of script-specific preprocessing, idiomatic expressions, and nuances of cultural sentiment in classification performance. The proposed framework demonstrates the viability of combining LLM-based cross-lingual transfer with masked sentiment-aware enhancements for practical, resource-efficient NLP applications in low-resource language contexts.</p>

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

TigCLaF: a cross-lingual large language model framework for sentiment-aware text classification in low-resource tigrigna

  • 期刊论文

  • 出版模式：

    开放获取

  • 发表日期：

    2026年3月10日

查看全文
  • Hagos Gebremedhin Gebremeskel,
  • Chong Feng,
  • Asefa Mebrahtu Abera,
  • Geleta Negasa Binegde

摘要

This paper introduces TigCLaF, a novel cross-lingual large language model framework for sentiment-aware text classification in low-resource Tigrigna. The framework integrates tokenizer extension with adaptation, continual pretraining on unlabeled Tigrigna data, and LoRA-based parameter-efficient fine-tuning to enable effective cross-lingual adaptation from high-resource languages. Leveraging recent advances in multilingual pre-trained language models and large language models, we investigate zero-shot, few-shot, and full fine-tuning strategies for sentiment detection, incorporating transformer models XLM-RoBERTa and AfriBERTa, as well as instruction-tuned LLaMA models. Our approach integrates a Tigrigna sentiment lexicon into transformer-based embeddings via feature fusion, thereby enhancing preservation of the sentiment signal during cross-lingual transfer. The proposed framework is evaluated on a newly curated dataset of 30,000 Tigrigna instances, supported by auxiliary English and Amharic sentiment corpora for transfer learning. Experimental results show that sentiment-aware feature integration improves classification accuracy and Macro-F1 up to 7% over baseline multilingual models without sentiment augmentation. Furthermore, parameter-efficient fine-tuning LoRA achieved competitive accuracy while reducing model size and inference latency, making it suitable for computationally constrained settings. The systematic error analysis highlights the roles of script-specific preprocessing, idiomatic expressions, and nuances of cultural sentiment in classification performance. The proposed framework demonstrates the viability of combining LLM-based cross-lingual transfer with masked sentiment-aware enhancements for practical, resource-efficient NLP applications in low-resource language contexts.